Waypoint Planning for Autonomous Aerial Inspection of Large-Scale Solar Farms

Solar energy is seen as a sustainable and nondepletable source of energy supply. Worldwide, large-scale solar power infrastructure is being installed every day. Such structures can suffer from many faults and defects that degrade their energy output during their operational life. Detecting such faults and defects requires regular inspection over physically large and distributed solar infrastructure. On-site manual human inspection tends to be impractical, risky and costly. As such, replacing humans with autonomous robotic aerial inspection systems has great potential. In this work, we propose an unmanned aerial vehicle (UAV) waypoint generation system that is specifically designed for aerial inspection of solar infrastructure. Our system takes into consideration the physical structure and the dynamic nature of sun-tracking solar modules and generates waypoints with the right camera viewing pose and drone orientation. Statistical methods are used to generate a randomly selected set of modules as a representation of the entire solar farm. The set is guaranteed to satisfy a user-defined confidence level and margin of error requirements. A path is generated to visit selected modules in an optimal way by deploying the traveling-salesman shortest path algorithm, allowing the vehicle to maximize battery use. Illustrative flights and preliminary inspection results are presented and discussed.This research was supported by the Australian Renewable Energy Agency (ARENA), through Grant G00853 “A robotic vision system for rapid inspection and evaluation of solar plant infrastructure”

Monitoring and Mapping Solutions Using Sensor Nodes and Drones

Researchers are always looking for innovative ways to collect the environmental data and ease the process of data collection on the field. Advancement in sensor technologies and drones has led to easy technological access to design custom solutions even with basic electronics and technical knowledge. This paper documents, construction and working of “ITT Smart Sense”, which is a low power, easy to use and cost effective environment monitoring system using wireless sensor network that runs autonomously on battery power for an extended period of time. Along with that, a UAV based platform, titled “ITT Smart Sense Fly”, focused on environmental monitoring and scientific research and is tailored to the needs of researchers has been proposed in this paper. This platform is comprised of an autonomous unmanned aerial vehicle (UAV)/Drone with a camera sensor, an autopilot mobile app for mission planning and other required Photogrammetry tools. The drone navigates over the area of interest based on a pre-programmed flight plan and captures a series of photographs using the on-board camera. The collected image data set is processed to create orthomosaics, high resolution maps and 3D point cloud. The proposed solutions were demonstrated with three distinct case studies

Standardization Roadmap for Unmanned Aircraft Systems, Version 1.0

This Standardization Roadmap for Unmanned Aircraft Systems, Version 1.0 (“roadmap”) represents the culmination of the UASSC’s work to identify existing standards and standards in development, assess gaps, and make recommendations for priority areas where there is a perceived need for additional standardization and/or pre-standardization R&D. The roadmap has examined 64 issue areas, identified a total of 60 gaps and corresponding recommendations across the topical areas of airworthiness; flight operations (both general concerns and application-specific ones including critical infrastructure inspections, commercial services, and public safety operations); and personnel training, qualifications, and certification. Of that total, 40 gaps/recommendations have been identified as high priority, 17 as medium priority, and 3 as low priority. A “gap” means no published standard or specification exists that covers the particular issue in question. In 36 cases, additional R&D is needed. The hope is that the roadmap will be broadly adopted by the standards community and that it will facilitate a more coherent and coordinated approach to the future development of standards for UAS. To that end, it is envisioned that the roadmap will be widely promoted and discussed over the course of the coming year, to assess progress on its implementation and to identify emerging issues that require further elaboration

Small UAS Detect and Avoid Requirements Necessary for Limited Beyond Visual Line of Sight (BVLOS) Operations

Potential small Unmanned Aircraft Systems (sUAS) beyond visual line of sight (BVLOS) operational scenarios/use cases and Detect And Avoid (DAA) approaches were collected through a number of industry wide data calls. Every 333 Exemption holder was solicited for this same information. Summary information from more than 5,000 exemption holders is documented, and the information received had varied level of detail but has given relevant experiential information to generalize use cases. A plan was developed and testing completed to assess Radio Line Of Sight (RLOS), a potential key limiting factors for safe BVLOS ops. Details of the equipment used, flight test area, test payload, and fixtures for testing at different altitudes is presented and the resulting comparison of a simplified mathematical model, an online modeling tool, and flight data are provided. An Operational Framework that defines the environment, conditions, constraints, and limitations under which the recommended requirements will enable sUAS operations BVLOS is presented. The framework includes strategies that can build upon Federal Aviation Administration (FAA) and industry actions that should result in an increase in BVLOS flights in the near term. Evaluating approaches to sUAS DAA was accomplished through five subtasks: literature review of pilot and ground observer see and avoid performance, survey of DAA criteria and recommended baseline performance, survey of existing/developing DAA technologies and performance, assessment of risks of selected DAA approaches, and flight testing. Pilot and ground observer see and avoid performance were evaluated through a literature review. Development of DAA criteria—the emphasis here being well clear— was accomplished through working with the Science And Research Panel (SARP) and through simulations of manned and unmanned aircraft interactions. Information regarding sUAS DAA approaches was collected through a literature review, requests for information, and direct interactions. These were analyzed through delineation of system type and definition of metrics and metric values. Risks associated with sUAS DAA systems were assessed by focusing on the Safety Risk Management (SRM) pillar of the SMS (Safety Management System) process. This effort (1) identified hazards related to the operation of sUAS in BVLOS, (2) offered a preliminary risk assessment considering existing controls, and (3) recommended additional controls and mitigations to further reduce risk to the lowest practical level. Finally, flight tests were conducted to collect preliminary data regarding well clear and DAA system hazards

A Biomimetic, Energy-Harvesting, Obstacle-Avoiding, Path-Planning Algorithm for UAVs

This dissertation presents two new approaches to energy harvesting for Unmanned Aerial Vehicles (UAV). One method is based on the Potential Flow Method (PFM); the other method seeds a wind-field map based on updraft peak analysis and then applies a variant of the Bellman-Ford algorithm to find the minimum-cost path. Both methods are enhanced by taking into account the performance characteristics of the aircraft using advanced performance theory. The combined approach yields five possible trajectories from which the one with the minimum energy cost is selected. The dissertation concludes by using the developed theory and modeling tools to simulate the flight paths of two small Unmanned Aerial Vehicles (sUAV) in the 500 kg and 250 kg class. The results show that, in mountainous regions, substantial energy can be recovered, depending on topography and wind characteristics. For the examples presented, as much as 50% of the energy was recovered for a complex, multi-heading, multi-altitude, 170 km mission in an average wind speed of 9 m/s. The algorithms constitute a Generic Intelligent Control Algorithm (GICA) for autonomous unmanned aerial vehicles that enables an extraction of atmospheric energy while completing a mission trajectory. At the same time, the algorithm automatically adjusts the flight path in order to avoid obstacles, in a fashion not unlike what one would expect from living organisms, such as birds and insects. This multi-disciplinary approach renders the approach biomimetic, i.e. it constitutes a synthetic system that “mimics the formation and function of biological mechanisms and processes.

Collaborative Unmanned Vehicles for Inspection, Maintenance, and Repairs of Offshore Wind Turbines

Operations and maintenance of Offshore Wind Turbines (OWTs) are challenging, with manual operators constantly exposed to hazardous environments. Due to the high task complexity associated with the OWT, the transition to unmanned solutions remains stagnant. Efforts toward unmanned operations have been observed using Unmanned Aerial Vehicles (UAVs) and Unmanned Underwater Vehicles (UUVs) but are limited mostly to visual inspections only. Collaboration strategies between unmanned vehicles have introduced several opportunities that would enable unmanned operations for the OWT maintenance and repair activities. There have been many papers and reviews on collaborative UVs. However, most of the past papers reviewed collaborative UVs for surveillance purposes, search and rescue missions, and agricultural activities. This review aims to present the current capabilities of Unmanned Vehicles (UVs) used in OWT for Inspection, Maintenance, and Repair (IMR) operations. Strategies to implement collaborative UVs for complex tasks and their associated challenges are discussed together with the strategies to solve localization and navigation issues, prolong operation time, and establish effective communication within the OWT IMR operations. This paper also briefly discusses the potential failure modes for collaborative approaches and possible redundancy strategies to manage them. The collaborative strategies discussed herein will be of use to researchers and technology providers in identifying significant gaps that have hindered the implementation of full unmanned systems which have significant impacts towards the net zero strategy.</jats:p

Innovative Solutions for Navigation and Mission Management of Unmanned Aircraft Systems

The last decades have witnessed a significant increase in Unmanned Aircraft Systems (UAS) of all shapes and sizes. UAS are finding many new applications in supporting several human activities, offering solutions to many dirty, dull, and dangerous missions, carried out by military and civilian users. However, limited access to the airspace is the principal barrier to the realization of the full potential that can be derived from UAS capabilities. The aim of this thesis is to support the safe integration of UAS operations, taking into account both the user's requirements and flight regulations. The main technical and operational issues, considered among the principal inhibitors to the integration and wide-spread acceptance of UAS, are identified and two solutions for safe UAS operations are proposed: A. Improving navigation performance of UAS by exploiting low-cost sensors. To enhance the performance of the low-cost and light-weight integrated navigation system based on Global Navigation Satellite System (GNSS) and Micro Electro-Mechanical Systems (MEMS) inertial sensors, an efficient calibration method for MEMS inertial sensors is required. Two solutions are proposed: 1) The innovative Thermal Compensated Zero Velocity Update (TCZUPT) filter, which embeds the compensation of thermal effect on bias in the filter itself and uses Back-Propagation Neural Networks to build the calibration function. Experimental results show that the TCZUPT filter is faster than the traditional ZUPT filter in mapping significant bias variations and presents better performance in the overall testing period. Moreover, no calibration pre-processing stage is required to keep measurement drift under control, improving the accuracy, reliability, and maintainability of the processing software; 2) A redundant configuration of consumer grade inertial sensors to obtain a self-calibration of typical inertial sensors biases. The result is a significant reduction of uncertainty in attitude determination. In conclusion, both methods improve dead-reckoning performance for handling intermittent GNSS coverage. B. Proposing novel solutions for mission management to support the Unmanned Traffic Management (UTM) system in monitoring and coordinating the operations of a large number of UAS. Two solutions are proposed: 1) A trajectory prediction tool for small UAS, based on Learning Vector Quantization (LVQ) Neural Networks. By exploiting flight data collected when the UAS executes a pre-assigned flight path, the tool is able to predict the time taken to fly generic trajectory elements. Moreover, being self-adaptive in constructing a mathematical model, LVQ Neural Networks allow creating different models for the different UAS types in several environmental conditions; 2) A software tool aimed at supporting standardized procedures for decision-making process to identify UAS/payload configurations suitable for any type of mission that can be authorized standing flight regulations. The proposed methods improve the management and safe operation of large-scale UAS missions, speeding up the flight authorization process by the UTM system and supporting the increasing level of autonomy in UAS operations

Path planning, modelling and simulation for energy optimised mobile robotics

This thesis is concerned with an investigation of a solution for mobile robotic platforms to minimize the usage of scarce energy that is available and is not wasted following traditionally planned paths for complex terrain environments. This therefore addresses the need to reduce the total energy cost during a field task or mission. A path planning algorithm is designed by creating a new approach of artificial potential field method that generates a planned path, utilising terrain map. The new approach has the capability of avoiding the local minimum problems which is one of the major problems of traditional potential field method. By solving such problems gives a reliable solution to establish a required path. Therefore the approach results in an energy efficient path of the terrain identified, instead obvious straight line of the terrain. A literature review is conducted which reviews the mainstream path planning algorithms with the applications in mobile robotic platforms was analysed. These path planning algorithms are compared for the purpose of energy optimized planning, which concludes the method of artificial potential field as the path planning algorithm which has the most potential and will be further investigated and improved in this research. The methodology of designing, modelling and simulating a mobile robotic platform is defined and presented for the purpose of energy optimized path planning requirement. The research is to clarify the needs, requirements, and specifications of the design. A complete set of models which include mechanical and electrical modelling, functional concept modelling, modelling of the system are established. Based on these models, an energy optimized path planning algorithm is designed. The modelling of force and the kinematics is established to validate and evaluate the result of the algorithm through simulations. Moreover a simulation environment is established which is constructed for multi perspective simulation. This also enables collaborative simulation using Simulink and ADAMS to for simulating a path generated by the path planning algorithm and assess the energy consumption of the driven and steering mechanism of an exemplar system called AgriRover. This simulation environment allows the capture of simulated result of the total energy consumption, therefore outlines the energy cost behaviour of the AgriRover. A total of two sets of paths was tested in the fields for validation, one being generated by the energy optimized path planning algorithm and the other following a straight path. During the field tests the total cost of energy was captured . Two sets of results are compared with each other and compared with the simulation. The comparison shows a 21.34% of the energy saving by deploying the path generated with the energy optimized path planning algorithm in the field test. This research made the following contribution to knowledge. A comparison and grading of mainstream path planning algorithms from energy optimisation perspective is undertaken using detailed evaluation criteria, including computational power required, extendibility, flexibility and more criteria that is relevant for the energy optimized planning purpose. These algorithms have not been compared from energy optimisation angle before, and the research for energy optimised planning under complex terrain environments have not been investigated. Addressing these knowledge gaps, a methodology of designing, modelling and simulating a mobile platform system is proposed to facilitate an energy optimized path planning. This , leads to a new approach of path planning algorithm that reduces unnecessary energy spend for climbing of the terrain, using the terrain data available. Such a methodology derives several novel methods: Namely, a method for avoiding local minimum problem for artificial potential field path planning using the approach of approximation; A method of achieving high expendability of the path planning algorithm, where this method is capable of generate a path through a large map in a short time; A novel method of multi perspective dynamic simulation, which is capable of simulating the behaviour of internal mechanism and the overall robotic mobile platform with the fully integrated control, The dynamic simulation enables prediction of energy consumption; Finally, a novel method of mathematically modelling and simplifying a steering mechanism for the wheel based mobile vehicle was further investigated.This thesis is concerned with an investigation of a solution for mobile robotic platforms to minimize the usage of scarce energy that is available and is not wasted following traditionally planned paths for complex terrain environments. This therefore addresses the need to reduce the total energy cost during a field task or mission. A path planning algorithm is designed by creating a new approach of artificial potential field method that generates a planned path, utilising terrain map. The new approach has the capability of avoiding the local minimum problems which is one of the major problems of traditional potential field method. By solving such problems gives a reliable solution to establish a required path. Therefore the approach results in an energy efficient path of the terrain identified, instead obvious straight line of the terrain. A literature review is conducted which reviews the mainstream path planning algorithms with the applications in mobile robotic platforms was analysed. These path planning algorithms are compared for the purpose of energy optimized planning, which concludes the method of artificial potential field as the path planning algorithm which has the most potential and will be further investigated and improved in this research. The methodology of designing, modelling and simulating a mobile robotic platform is defined and presented for the purpose of energy optimized path planning requirement. The research is to clarify the needs, requirements, and specifications of the design. A complete set of models which include mechanical and electrical modelling, functional concept modelling, modelling of the system are established. Based on these models, an energy optimized path planning algorithm is designed. The modelling of force and the kinematics is established to validate and evaluate the result of the algorithm through simulations. Moreover a simulation environment is established which is constructed for multi perspective simulation. This also enables collaborative simulation using Simulink and ADAMS to for simulating a path generated by the path planning algorithm and assess the energy consumption of the driven and steering mechanism of an exemplar system called AgriRover. This simulation environment allows the capture of simulated result of the total energy consumption, therefore outlines the energy cost behaviour of the AgriRover. A total of two sets of paths was tested in the fields for validation, one being generated by the energy optimized path planning algorithm and the other following a straight path. During the field tests the total cost of energy was captured . Two sets of results are compared with each other and compared with the simulation. The comparison shows a 21.34% of the energy saving by deploying the path generated with the energy optimized path planning algorithm in the field test. This research made the following contribution to knowledge. A comparison and grading of mainstream path planning algorithms from energy optimisation perspective is undertaken using detailed evaluation criteria, including computational power required, extendibility, flexibility and more criteria that is relevant for the energy optimized planning purpose. These algorithms have not been compared from energy optimisation angle before, and the research for energy optimised planning under complex terrain environments have not been investigated. Addressing these knowledge gaps, a methodology of designing, modelling and simulating a mobile platform system is proposed to facilitate an energy optimized path planning. This , leads to a new approach of path planning algorithm that reduces unnecessary energy spend for climbing of the terrain, using the terrain data available. Such a methodology derives several novel methods: Namely, a method for avoiding local minimum problem for artificial potential field path planning using the approach of approximation; A method of achieving high expendability of the path planning algorithm, where this method is capable of generate a path through a large map in a short time; A novel method of multi perspective dynamic simulation, which is capable of simulating the behaviour of internal mechanism and the overall robotic mobile platform with the fully integrated control, The dynamic simulation enables prediction of energy consumption; Finally, a novel method of mathematically modelling and simplifying a steering mechanism for the wheel based mobile vehicle was further investigated