Vision-model-based Real-time Localization of Unmanned Aerial Vehicle for Autonomous Structure Inspection under GPS-denied Environment

UAVs have been widely used in visual inspections of buildings, bridges and other structures. In either outdoor autonomous or semi-autonomous flights missions strong GPS signal is vital for UAV to locate its own positions. However, strong GPS signal is not always available, and it can degrade or fully loss underneath large structures or close to power lines, which can cause serious control issues or even UAV crashes. Such limitations highly restricted the applications of UAV as a routine inspection tool in various domains. In this paper a vision-model-based real-time self-positioning method is proposed to support autonomous aerial inspection without the need of GPS support. Compared to other localization methods that requires additional onboard sensors, the proposed method uses a single camera to continuously estimate the inflight poses of UAV. Each step of the proposed method is discussed in detail, and its performance is tested through an indoor test case.Comment: 8 pages, 5 figures, submitted to i3ce 201

Remote inspection of wind turbine blades using UAV with photogrammetry payload

Visual Inspection is regularly used as a method of non-destructive testing (NDT) to find defects in large component structures. Wind turbine blades, regularly located in isolated environments, are typically difficult to access. In order to reduce operational and maintenance costs and extend asset lifetime, a project for the remote inspection of blades to accurately assess surface integrity is being undertaken. The remote inspection solution combines an unmanned aerial vehicle (UAV) with a photogrammetry payload to provide visual reconstruction of a blade for a holistic condition overview. Photogrammetric software is used to process the captured images to generate a 3D blade profile. A waypoint guidance algorithm controls the UAV to complete a full blade surface capture at constant distance, minimising motion blur. The results provide an accurate 3D reconstruction of the used blade complete with defects, discontinuities and markings and hence visual inspection using UAV combined with photogrammetry has been successfully implemented

Collaborative Unmanned Vehicles for Inspection, Maintenance, and Repairs of Offshore Wind Turbines

Operations and maintenance of Offshore Wind Turbines (OWTs) are challenging, with manual operators constantly exposed to hazardous environments. Due to the high task complexity associated with the OWT, the transition to unmanned solutions remains stagnant. Efforts toward unmanned operations have been observed using Unmanned Aerial Vehicles (UAVs) and Unmanned Underwater Vehicles (UUVs) but are limited mostly to visual inspections only. Collaboration strategies between unmanned vehicles have introduced several opportunities that would enable unmanned operations for the OWT maintenance and repair activities. There have been many papers and reviews on collaborative UVs. However, most of the past papers reviewed collaborative UVs for surveillance purposes, search and rescue missions, and agricultural activities. This review aims to present the current capabilities of Unmanned Vehicles (UVs) used in OWT for Inspection, Maintenance, and Repair (IMR) operations. Strategies to implement collaborative UVs for complex tasks and their associated challenges are discussed together with the strategies to solve localization and navigation issues, prolong operation time, and establish effective communication within the OWT IMR operations. This paper also briefly discusses the potential failure modes for collaborative approaches and possible redundancy strategies to manage them. The collaborative strategies discussed herein will be of use to researchers and technology providers in identifying significant gaps that have hindered the implementation of full unmanned systems which have significant impacts towards the net zero strategy.</jats:p

Autonomous wind turbine inspection using a quadrotor

There has been explosive growth of wind farm installations in recent years due to the fact that wind energy is gaining worldwide popularity. However, the maintenance of these offshore or onshore wind turbines, especially in remote areas, remains a challenging task. In this work, vision-based autonomous wind turbine inspection using a quadrotor is designed based on realistic assumptions. Both simulation and Hardware-In-the-Loop (HIL) testing results have shown the effectiveness of the proposed approach

Aerostack2: A Software Framework for Developing Multi-robot Aerial Systems

In recent years, the robotics community has witnessed the development of several software stacks for ground and articulated robots, such as Navigation2 and MoveIt. However, the same level of collaboration and standardization is yet to be achieved in the field of aerial robotics, where each research group has developed their own frameworks. This work presents Aerostack2, a framework for the development of autonomous aerial robotics systems that aims to address the lack of standardization and fragmentation of efforts in the field. Built on ROS 2 middleware and featuring an efficient modular software architecture and multi-robot orientation, Aerostack2 is a versatile and platform-independent environment that covers a wide range of robot capabilities for autonomous operation. Its major contributions include providing a logical level for specifying missions, reusing components and sub-systems for aerial robotics, and enabling the development of complete control architectures. All major contributions have been tested in simulation and real flights with multiple heterogeneous swarms. Aerostack2 is open source and community oriented, democratizing the access to its technology by autonomous drone systems developers

Survey of computer vision algorithms and applications for unmanned aerial vehicles

This paper presents a complete review of computer vision algorithms and vision-based intelligent applications, that are developed in the field of the Unmanned Aerial Vehicles (UAVs) in the latest decade. During this time, the evolution of relevant technologies for UAVs; such as component miniaturization, the increase of computational capabilities, and the evolution of computer vision techniques have allowed an important advance in the development of UAVs technologies and applications. Particularly, computer vision technologies integrated in UAVs allow to develop cutting-edge technologies to cope with aerial perception difficulties; such as visual navigation algorithms, obstacle detection and avoidance and aerial decision-making. All these expert technologies have developed a wide spectrum of application for UAVs, beyond the classic military and defense purposes. Unmanned Aerial Vehicles and Computer Vision are common topics in expert systems, so thanks to the recent advances in perception technologies, modern intelligent applications are developed to enhance autonomous UAV positioning, or automatic algorithms to avoid aerial collisions, among others. Then, the presented survey is based on artificial perception applications that represent important advances in the latest years in the expert system field related to the Unmanned Aerial Vehicles. In this paper, the most significant advances in this field are presented, able to solve fundamental technical limitations; such as visual odometry, obstacle detection, mapping and localization, et cetera. Besides, they have been analyzed based on their capabilities and potential utility. Moreover, the applications and UAVs are divided and categorized according to different criteria.This research is supported by the Spanish Government through the CICYT projects (TRA2015-63708-R and TRA2013-48314-C3-1-R)

A multi-robot platform for the autonomous operation and maintenance of offshore wind farms

With the increasing scale of offshore wind farm development, maintaining farms efficiently and safely becomes a necessity. The length of turbine downtime and the logistics for human technician transfer make up a significant proportion of the operation and maintenance (O&M) costs. To reduce such costs, future O&M infrastructures will increasingly rely on offshore autonomous robotic solutions that are capable of co-managing wind farms with human operators located onshore. In particular, unmanned aerial vehicles, autonomous surface vessels and crawling robots are expected to play important roles not only to bring down costs but also to significantly reduce the health and safety risks by assisting (or replacing) human operators in performing the most hazardous tasks. This paper portrays a visionary view in which heterogeneous robotic assets, underpinned by AI agent technology, coordinate their behavior to autonomously inspect, maintain and repair offshore wind farms over long periods of time and unstable weather conditions. They cooperate with onshore human operators, who supervise the mission at a distance, via the use of shared deliberation techniques. We highlight several challenging research directions in this context and offer ambitious ideas to tackle them as well as initial solutions