Transfer Learning-Based Crack Detection by Autonomous UAVs

Unmanned Aerial Vehicles (UAVs) have recently shown great performance collecting visual data through autonomous exploration and mapping in building inspection. Yet, the number of studies is limited considering the post processing of the data and its integration with autonomous UAVs. These will enable huge steps onward into full automation of building inspection. In this regard, this work presents a decision making tool for revisiting tasks in visual building inspection by autonomous UAVs. The tool is an implementation of fine-tuning a pretrained Convolutional Neural Network (CNN) for surface crack detection. It offers an optional mechanism for task planning of revisiting pinpoint locations during inspection. It is integrated to a quadrotor UAV system that can autonomously navigate in GPS-denied environments. The UAV is equipped with onboard sensors and computers for autonomous localization, mapping and motion planning. The integrated system is tested through simulations and real-world experiments. The results show that the system achieves crack detection and autonomous navigation in GPS-denied environments for building inspection

Vision-Aided Navigation for GPS-Denied Environments Using Landmark Feature Identification

In recent years, unmanned autonomous vehicles have been used in diverse applications because of their multifaceted capabilities. In most cases, the navigation systems for these vehicles are dependent on Global Positioning System (GPS) technology. Many applications of interest, however, entail operations in environments in which GPS is intermittent or completely denied. These applications include operations in complex urban or indoor environments as well as missions in adversarial environments where GPS might be denied using jamming technology. This thesis investigate the development of vision-aided navigation algorithms that utilize processed images from a monocular camera as an alternative to GPS. The vision-aided navigation approach explored in this thesis entails defining a set of inertial landmarks, the locations of which are known within the environment, and employing image processing algorithms to detect these landmarks in image frames collected from an onboard monocular camera. These vision-based landmark measurements effectively serve as surrogate GPS measurements that can be incorporated into a navigation filter. Several image processing algorithms were considered for landmark detection and this thesis focuses in particular on two approaches: the continuous adaptive mean shift (CAMSHIFT) algorithm and the adaptable compressive (ADCOM) tracking algorithm. These algorithms are discussed in detail and applied for the detection and tracking of landmarks in monocular camera images. Navigation filters are then designed that employ sensor fusion of accelerometer and rate gyro data from an inertial measurement unit (IMU) with vision-based measurements of the centroids of one or more landmarks in the scene. These filters are tested in simulated navigation scenarios subject to varying levels of sensor and measurement noise and varying number of landmarks. Finally, conclusions and recommendations are provided regarding the implementation of this vision-aided navigation approach for autonomous vehicle navigation systems

A low-cost vision-based unmanned aerial system for extremely low-light GPS-denied navigation and thermal imaging

A Low-Cost Vision-Based Unmanned Aerial System for Extremely Low-Light GPS-Denied Navigation and Thermal Imaging}, abstract = {This paper presents the design and implementation details of a complete unmanned aerial system (UAS) based on commercial-off-the-shelf (COTS) components, focusing on safety, security, search and rescue scenarios in GPS-denied environments. In particular, the aerial platform is capable of semi-autonomously navigating through extremely low-light, GPS-denied indoor environments based on onboard sensors only, including a downward-facing optical flow camera. Besides, an additional low-cost payload camera system is developed to stream both infrared video and visible light video to a ground station in real-time, for the purpose of detecting sign of life and hidden humans. The total cost of the complete system is estimated to be $1150, and the effectiveness of the system has been tested and validated in practical scenarios

Implementation of an Extended Kalman Filter Using Inertial Sensor Data for UAVs During GPS Denied Applications

Unmanned Aerial Vehicles (UAVs) are widely used across the industry and have a strong military application for defense. As UAVs become more accessible so does the increase of their applications, now being more limited by one’s imagination as opposed to the past where micro electric components were the limiting factor. Almost all of the applications require GPS or radio guidance. For more covert and longer range missions relying solely on GPS and radio is insufficient as the Unmanned Aerial System is vulnerable to malicious encounters like GPS Jamming and GPS Spoofing. For long range mission GPS denied environments are common where loss of signal is experienced. For autonomous flight GPS is a fundamental requirement. In this work an advanced inertial navigation system is proposed along with a programmable Pixhawk flight controller and Cube Black autopilot. A Raspberry Pi serves as a companion computer running autonomous flight missions and providing data acquisition. The advancement in inertial navigation comes from the implementation of a high end Analog Devices’ IMU providing input to an Extended Kalman Filter (EKF) to reduce error associated with measurement noise. The EKF is a efficient recursive computation applying the least-squares method. UAS flight controller simulations and calibrations were conducted to ensure the expected flight capabilities were achieved. The developed software and hardware was implemented in a Quadcopter build to perform flight test. Flight test data were used to analyze the performance post flight. Later, simulated feedback of the inertial navigation based state estimates (from flight test data) is performed to ensure reliable position data during GPS denied flight. The EKF applied to perform strapdown navigation was a limited success at estimating the vehicles’ inertial states but only when tuned for the specific flight trajectory. The predicted position was successfully converted to GPS data and passed to the autopilot in a LINUX based simulations ensuring autonomous mission capability is maintainable in GPS denied environments. The results from this research can be applied with ease to any vehicle operating with a Pixhawk controller and a companion computer of the appropriate processing capability

Adaptations and Analysis of the AFIT Noise Radar Network for Indoor Navigation

After several years of development, the AFIT Noise Radar Network (NoNET) has proven to be an extremely versatile system for many standard radar functions. This pallet of capabilities includes through the wall target tracking capabilities due to its wide bandwidth and UHF operations. Utilizing White Gaussian Noise as its waveform, the NoNET can operate at much lower power levels than other comparable systems while remaining extremely covert. In an effort to explore new applications, the question arose could the NoNET provide a viable option for navigation capability in GPS denied and indoor environments? This research aims to provide proof of concept and demonstration of the navigation function execution with the NoNET in indoor, multipath-ridden environments. Results demonstrate that the NoNET is currently capable of locating a receiver to accuracies of approximately 1 foot. Multipath, background RF interference, and network timing were investigated and solutions to mitigate the limitations imposed by each were developed with the potential to significantly improve accuracy. Future upgrades to the current NoNET hardware package were also investigated in order to provide a near real-time, portable solution to navigation in GPS denied environments

Virtual Testbed for Monocular Visual Navigation of Small Unmanned Aircraft Systems

Monocular visual navigation methods have seen significant advances in the last decade, recently producing several real-time solutions for autonomously navigating small unmanned aircraft systems without relying on GPS. This is critical for military operations which may involve environments where GPS signals are degraded or denied. However, testing and comparing visual navigation algorithms remains a challenge since visual data is expensive to gather. Conducting flight tests in a virtual environment is an attractive solution prior to committing to outdoor testing. This work presents a virtual testbed for conducting simulated flight tests over real-world terrain and analyzing the real-time performance of visual navigation algorithms at 31 Hz. This tool was created to ultimately find a visual odometry algorithm appropriate for further GPS-denied navigation research on fixed-wing aircraft, even though all of the algorithms were designed for other modalities. This testbed was used to evaluate three current state-of-the-art, open-source monocular visual odometry algorithms on a fixed-wing platform: Direct Sparse Odometry, Semi-Direct Visual Odometry, and ORB-SLAM2 (with loop closures disabled)

Nonlinear Deterministic Observer for Inertial Navigation using Ultra-wideband and IMU Sensor Fusion

Navigation in Global Positioning Systems (GPS)-denied environments requires robust estimators reliant on fusion of inertial sensors able to estimate rigid-body's orientation, position, and linear velocity. Ultra-wideband (UWB) and Inertial Measurement Unit (IMU) represent low-cost measurement technology that can be utilized for successful Inertial Navigation. This paper presents a nonlinear deterministic navigation observer in a continuous form that directly employs UWB and IMU measurements. The estimator is developed on the extended Special Euclidean Group $\mathbb{SE}_{2}\left(3\right)$ and ensures exponential convergence of the closed loop error signals starting from almost any initial condition. The discrete version of the proposed observer is tested using a publicly available real-world dataset of a drone flight. Keywords: Ultra-wideband, Inertial measurement unit, Sensor Fusion, Positioning system, GPS-denied navigation.Comment: 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS