A Review on IoT Deep Learning UAV Systems for Autonomous Obstacle Detection and Collision Avoidance

[Abstract] Advances in Unmanned Aerial Vehicles (UAVs), also known as drones, offer unprecedented opportunities to boost a wide array of large-scale Internet of Things (IoT) applications. Nevertheless, UAV platforms still face important limitations mainly related to autonomy and weight that impact their remote sensing capabilities when capturing and processing the data required for developing autonomous and robust real-time obstacle detection and avoidance systems. In this regard, Deep Learning (DL) techniques have arisen as a promising alternative for improving real-time obstacle detection and collision avoidance for highly autonomous UAVs. This article reviews the most recent developments on DL Unmanned Aerial Systems (UASs) and provides a detailed explanation on the main DL techniques. Moreover, the latest DL-UAV communication architectures are studied and their most common hardware is analyzed. Furthermore, this article enumerates the most relevant open challenges for current DL-UAV solutions, thus allowing future researchers to define a roadmap for devising the new generation affordable autonomous DL-UAV IoT solutions.Xunta de Galicia; ED431C 2016-045Xunta de Galicia; ED431C 2016-047Xunta de Galicia; , ED431G/01Centro Singular de Investigación de Galicia; PC18/01Agencia Estatal de Investigación de España; TEC2016-75067-C4-1-

Introducing autonomous aerial robots in industrial manufacturing

Although ground robots have been successfully used for many years in manufacturing, the capability of aerial robots to agilely navigate in the often sparse and static upper part of factories makes them suitable for performing tasks of interest in many industrial sectors. This paper presents the design, development, and validation of a fully autonomous aerial robotic system for manufacturing industries. It includes modules for accurate pose estimation without using a Global Navigation Satellite System (GNSS), autonomous navigation, radio-based localization, and obstacle avoidance, among others, providing a fully onboard solution capable of autonomously performing complex tasks in dynamic indoor environments in which all necessary sensors, electronics, and processing are on the robot. It was developed to fulfill two use cases relevant in many industries: light object logistics and missing tool search. The presented robotic system, functionalities, and use cases have been extensively validated with Technology Readiness Level 7 (TRL-7) in the Centro Bahía de C´ adiz (CBC) Airbus D&S factory in fully working conditions.Comisión Europea 60884Horizonte 2020 (Unión Europea) 871479Plan Nacional de I+D+I DPI2017-8979-

Perception-aware Tag Placement Planning for Robust Localization of UAVs in Indoor Construction Environments

Tag-based visual-inertial localization is a lightweight method for enabling autonomous data collection missions of low-cost unmanned aerial vehicles (UAVs) in indoor construction environments. However, finding the optimal tag configuration (i.e., number, size, and location) on dynamic construction sites remains challenging. This paper proposes a perception-aware genetic algorithm-based tag placement planner (PGA-TaPP) to determine the optimal tag configuration using 4D-BIM, considering the project progress, safety requirements, and UAV's localizability. The proposed method provides a 4D plan for tag placement by maximizing the localizability in user-specified regions of interest (ROIs) while limiting the installation costs. Localizability is quantified using the Fisher information matrix (FIM) and encapsulated in navigable grids. The experimental results show the effectiveness of our method in finding an optimal 4D tag placement plan for the robust localization of UAVs on under-construction indoor sites.Comment: [Final draft] This material may be downloaded for personal use only. Any other use requires prior permission of the American Society of Civil Engineers and the Journal of Computing in Civil Engineerin

Autonomous Vehicles

This edited volume, Autonomous Vehicles, is a collection of reviewed and relevant research chapters, offering a comprehensive overview of recent developments in the field of vehicle autonomy. The book comprises nine chapters authored by various researchers and edited by an expert active in the field of study. All chapters are complete in itself but united under a common research study topic. This publication aims to provide a thorough overview of the latest research efforts by international authors, open new possible research paths for further novel developments, and to inspire the younger generations into pursuing relevant academic studies and professional careers within the autonomous vehicle field

Development of an Emergency Radio Beacon for Small Unmanned Aerial Vehicles

Emergency locator transmitters (ELTs) used to locate manned aircrafts are not well suited to find and recover small crashed unmanned aerial vehicles (UAVs). ELTs utilize an international satellite system for search and rescue (Cospas-Sarsat System), which should leverage its expensive resources to save lives as a priority. Besides, ELTs are too big and heavy to be used within small UAVs. Some of the existing solutions for this problem are based on receivers that detect signal strength, which may be a long and tedious process not suitable for user needs. Others do not have enough range or require radio license and expensive amateur radio receivers. This paper presents an emergency radio beacon specifically designed to locate small UAVs. It is triggered automatically in the event of a crash and allows finding and recovering a crashed UAV in a fast and simple way. It meets not only the required specifications of user-friendliness, size and weight of this kind of application, but also it is a high precision and low cost device. Besides, it has enough range and endurance. The experiments carried out show the operation of the proposed system

Localization and detection of wireless embeddable structural sensors using an unmanned aerial vehicle in the absence of visual markers

The objective of this thesis is to develop a fully integrated UAV based platform for autonomous collection of data from embedded sensors. Passive (battery-less) embedded sensors provide means for periodic long-term monitoring of civil structures like bridges. However, collection of data from these sensors requires extensive manual effort of locating them. UAVs can automate this process, although localization of these embedded tags in absence of visual markers pose a challenge. A RF (13.56MHz) reader is used to capture data from RF tags wirelessly. Different tag coil sizes are tested to observe effects on read range as well as to characterize the interaction volume between reader and tag. The UAV platform is integrated with the RF reader to autonomously capture data from tags using GPS based localization. Different sensor configurations are tested and characterized to meet the requirements of X,Y,Z localization set by the reader and tag interaction volume. Flight characteristics are also observed for various UAV navigation parameters. Results suggest that by using low-cost RTK GPS unit, the UAV is capable of detecting and localizing RF tags without any visual markers or aides.Electrical and Computer Engineerin

Sensors Utilisation and Data Collection of Underground Mining

This study reviews IMU significance and performance for underground mine drone localisation. This research has designed a Kalman filter which extracts reliable information from raw data. Kalman filter for INS combines different measurements considering estimated errors to produce a trajectory including time, position and attitude. To evaluate the feasibility of the proposed method, a prototype has been designed and evaluated. Experimental results indicate that the designed Kalman filter estimates the internal states of a system

Autonomous Systems, Robotics, and Computing Systems Capability Roadmap: NRC Dialogue

Contents include the following: Introduction. Process, Mission Drivers, Deliverables, and Interfaces. Autonomy. Crew-Centered and Remote Operations. Integrated Systems Health Management. Autonomous Vehicle Control. Autonomous Process Control. Robotics. Robotics for Solar System Exploration. Robotics for Lunar and Planetary Habitation. Robotics for In-Space Operations. Computing Systems. Conclusion

Vision-based SLAM system for MAVs in GPS-denied environments

Using a camera, a micro aerial vehicle (MAV) can perform visual-based navigation in periods or circumstances when GPS is not available, or when it is partially available. In this context, the monocular simultaneous localization and mapping (SLAM) methods represent an excellent alternative, due to several limitations regarding to the design of the platform, mobility and payload capacity that impose considerable restrictions on the available computational and sensing resources of the MAV. However, the use of monocular vision introduces some technical difficulties as the impossibility of directly recovering the metric scale of the world. In this work, a novel monocular SLAM system with application to MAVs is proposed. The sensory input is taken from a monocular downward facing camera, an ultrasonic range finder and a barometer. The proposed method is based on the theoretical findings obtained from an observability analysis. Experimental results with real data confirm those theoretical findings and show that the proposed method is capable of providing good results with low-cost hardware.Peer ReviewedPostprint (published version

Development of Non Expensive Technologies for Precise Maneuvering of Completely Autonomous Unmanned Aerial Vehicles

In this paper, solutions for precise maneuvering of an autonomous small (e.g., 350-class) Unmanned Aerial Vehicles (UAVs) are designed and implemented from smart modifications of non expensive mass market technologies. The considered class of vehicles suffers from light load, and, therefore, only a limited amount of sensors and computing devices can be installed on-board. Then, to make the prototype capable of moving autonomously along a fixed trajectory, a “cyber-pilot”, able on demand to replace the human operator, has been implemented on an embedded control board. This cyber-pilot overrides the commands thanks to a custom hardware signal mixer. The drone is able to localize itself in the environment without ground assistance by using a camera possibly mounted on a 3 Degrees Of Freedom (DOF) gimbal suspension. A computer vision system elaborates the video stream pointing out land markers with known absolute position and orientation. This information is fused with accelerations from a 6-DOF Inertial Measurement Unit (IMU) to generate a “virtual sensor” which provides refined estimates of the pose, the absolute position, the speed and the angular velocities of the drone. Due to the importance of this sensor, several fusion strategies have been investigated. The resulting data are, finally, fed to a control algorithm featuring a number of uncoupled digital PID controllers which work to bring to zero the displacement from the desired trajectory