Visual 3-D SLAM from UAVs

The aim of the paper is to present, test and discuss the implementation of Visual SLAM techniques to images taken from Unmanned Aerial Vehicles (UAVs) outdoors, in partially structured environments. Every issue of the whole process is discussed in order to obtain more accurate localization and mapping from UAVs flights. Firstly, the issues related to the visual features of objects in the scene, their distance to the UAV, and the related image acquisition system and their calibration are evaluated for improving the whole process. Other important, considered issues are related to the image processing techniques, such as interest point detection, the matching procedure and the scaling factor. The whole system has been tested using the COLIBRI mini UAV in partially structured environments. The results that have been obtained for localization, tested against the GPS information of the flights, show that Visual SLAM delivers reliable localization and mapping that makes it suitable for some outdoors applications when flying UAVs

A Systematic Literature Survey of Unmanned Aerial Vehicle Based Structural Health Monitoring

Unmanned Aerial Vehicles (UAVs) are being employed in a multitude of civil applications owing to their ease of use, low maintenance, affordability, high-mobility, and ability to hover. UAVs are being utilized for real-time monitoring of road traffic, providing wireless coverage, remote sensing, search and rescue operations, delivery of goods, security and surveillance, precision agriculture, and civil infrastructure inspection. They are the next big revolution in technology and civil infrastructure, and it is expected to dominate more than $45 billion market value. The thesis surveys the UAV assisted Structural Health Monitoring or SHM literature over the last decade and categorize UAVs based on their aerodynamics, payload, design of build, and its applications. Further, the thesis presents the payload product line to facilitate the SHM tasks, details the different applications of UAVs exploited in the last decade to support civil structures, and discusses the critical challenges faced in UASHM applications across various domains. Finally, the thesis presents two artificial neural network-based structural damage detection models and conducts a detailed performance evaluation on multiple platforms like edge computing and cloud computing

A Survey on UAV-Aided Maritime Communications: Deployment Considerations, Applications, and Future Challenges

Maritime activities represent a major domain of economic growth with several emerging maritime Internet of Things use cases, such as smart ports, autonomous navigation, and ocean monitoring systems. The major enabler for this exciting ecosystem is the provision of broadband, low-delay, and reliable wireless coverage to the ever-increasing number of vessels, buoys, platforms, sensors, and actuators. Towards this end, the integration of unmanned aerial vehicles (UAVs) in maritime communications introduces an aerial dimension to wireless connectivity going above and beyond current deployments, which are mainly relying on shore-based base stations with limited coverage and satellite links with high latency. Considering the potential of UAV-aided wireless communications, this survey presents the state-of-the-art in UAV-aided maritime communications, which, in general, are based on both conventional optimization and machine-learning-aided approaches. More specifically, relevant UAV-based network architectures are discussed together with the role of their building blocks. Then, physical-layer, resource management, and cloud/edge computing and caching UAV-aided solutions in maritime environments are discussed and grouped based on their performance targets. Moreover, as UAVs are characterized by flexible deployment with high re-positioning capabilities, studies on UAV trajectory optimization for maritime applications are thoroughly discussed. In addition, aiming at shedding light on the current status of real-world deployments, experimental studies on UAV-aided maritime communications are presented and implementation details are given. Finally, several important open issues in the area of UAV-aided maritime communications are given, related to the integration of sixth generation (6G) advancements

Unmanned Aircraft System Assessments of Landslide Safety for Transportation Corridors

An assessment of unmanned aircraft systems (UAS) concluded that current, off-the-shelf UAS aircraft and cameras can be effective for creating the digital surface models used to evaluate rock-slope stability and landslide risk along transportation corridors. The imagery collected with UAS can be processed using a photogrammetry technique called Structure-from-Motion (SfM) which generates a point cloud and surface model, similar to terrestrial laser scanning (TLS). We treated the TLS data as our control, or “truth,” because it is a mature and well-proven technology. The comparisons of the TLS surfaces and the SFM surfaces were impressive – if not comparable is many cases. Thus, the SfM surface models would be suitable for deriving slope morphology to generate rockfall activity indices (RAI) for landslide assessment provided the slopes. This research also revealed that UAS are a safer alternative to the deployment and operation of TLS operating on a road shoulder because UAS can be launched and recovered from a remote location and capable of imaging without flying directly over the road. However both the UAS and TLS approaches still require traditional survey control and photo targets to accurately geo-reference their respective DSM.List of Figures ...................................................................................................... vi List of Abbreviations ......................................................................................... vii Acknowledgments ................................................................................................ x Executive Summary ............................................................................................. xi CHAPTER 1 INTRODUCTION .......................................................................... 1 CHAPTER 2 LITERATURE REVIEW ................................................................ 4 2.1 Landslide Hazards .................................................................................... 4 2.2 Unmanned Aircraft Systems Remote Sensing.......................................... 6 2.3 Structure From Motion (SfM) .................................................................. 7 2.4 Lidar terrain mapping ............................................................................... 8 CHAPTER 3 STUDY SITE/DATA .................................................................. 11 CHAPTER 4 METHODS ................................................................................ 13 4.1 Data Collection ............................................................................................. 13 4.1.1 Survey Control ..................................................................................... 14 4.1.2 TLS Surveys ........................................................................................ 16 4.1.3 UAS Imagery ....................................................................................... 17 4.1.4 Terrestrial Imagery Acquisition ........................................................... 19 4.2 Data Processing ............................................................................................ 20 4.2.1 Survey Control ..................................................................................... 20 4.2.2 TLS Processing .................................................................................... 20 4.2.3 SfM Processing .................................................................................... 21 4.2.4 Surface Generation .............................................................................. 22 4.3 Quality Evaluation ........................................................................................ 23 4.3.1 Completeness ....................................................................................... 23 4.3.2 Data Density/Resolution ...................................................................... 23 4.3.3 Accuracy Assessment .......................................................................... 23 4.3.2 Surface Morphology Analysis ............................................................. 24 4.2.6 Data Visualization ............................................................................... 25 CHAPTER 5 RESULTS ................................................................................. 27 v 5.1 UTIC DSM evaluation.................................................................................. 27 5.1.1 Completeness evaluation ..................................................................... 28 5.1.2 Data Density Evaluation ...................................................................... 29 5.1.3 Accuracy Evaluation............................................................................ 30 5.2 Geomorphological Evaluation ...................................................................... 32 CHAPTER 6 DISCUSSION ............................................................................ 35 6.1 Evaluation of UAS efficiencies .................................................................... 35 6.2 DSM quality and completeness .................................................................... 37 6.3 Safety and operational considerations .......................................................... 37 CHAPTER 7 CONCLUSIONS AND RECOMMENDATIONS ................................ 40 7.1 Technology Transfer..................................................................................... 41 7.1.1 Publications ......................................................................................... 41 7.1.2 Presentations ........................................................................................ 42 7.1.3 Multi-media outreach .......................................................................... 43 6.4 Integration of UAS and TLS data ................................................................. 44 REFERENCES .............................................................................................. 4

Point clouds by SLAM-based mobile mapping systems: accuracy and geometric content validation in multisensor survey and stand-alone acquisition

The paper provides some operative replies to evaluate the effectiveness and the critical issues of the simultaneous localisation and mapping (SLAM)-based mobile mapping system (MMS) called ZEB by GeoSLAM™ https://geoslam.com/technology/. In these last years, this type of handheld 3D mapping technology has increasingly developed the framework of portable solutions for close-range mapping systems that have mainly been devoted to mapping the indoor building spaces of enclosed or underground environments, such as forestry applications and tunnels or mines. The research introduces a set of test datasets related to the documentation of landscape contexts or the 3D modelling of architectural complexes. These datasets are used to validate the accuracy and informative content richness about ZEB point clouds in stand-alone solutions and in cases of combined applications of this technology with multisensor survey approaches. In detail, the proposed validation method follows the fulfilment of the endorsed approach by use of root mean square error (RMSE) evaluation and deviation analysis assessment of point clouds between SLAM-based data and 3D point cloud surfaces computed by more precise measurement methods to evaluate the accuracy of the proposed approach. Furthermore, this study specifies the suitable scale for possible handlings about these peculiar point clouds and uses the profile extraction method in addition to feature analyses such as corner and plane deviation analysis of architectural elements. Finally, because of the experiences reported in the literature and performed in this work, a possible reversal is suggested. If in the 2000s, most studies focused on intelligently reducing the light detection and ranging (LiDAR) point clouds where they presented redundant and not useful information, contrariwise, in this sense, the use of MMS methods is proposed to be firstly considered and then to increase the information only wherever needed with more accurate high-scale methods

The future of Earth observation in hydrology

In just the past 5 years, the field of Earth observation has progressed beyond the offerings of conventional space-agency-based platforms to include a plethora of sensing opportunities afforded by CubeSats, unmanned aerial vehicles (UAVs), and smartphone technologies that are being embraced by both for-profit companies and individual researchers. Over the previous decades, space agency efforts have brought forth well-known and immensely useful satellites such as the Landsat series and the Gravity Research and Climate Experiment (GRACE) system, with costs typically of the order of 1 billion dollars per satellite and with concept-to-launch timelines of the order of 2 decades (for new missions). More recently, the proliferation of smart-phones has helped to miniaturize sensors and energy requirements, facilitating advances in the use of CubeSats that can be launched by the dozens, while providing ultra-high (3-5 m) resolution sensing of the Earth on a daily basis. Start-up companies that did not exist a decade ago now operate more satellites in orbit than any space agency, and at costs that are a mere fraction of traditional satellite missions. With these advances come new space-borne measurements, such as real-time high-definition video for tracking air pollution, storm-cell development, flood propagation, precipitation monitoring, or even for constructing digital surfaces using structure-from-motion techniques. Closer to the surface, measurements from small unmanned drones and tethered balloons have mapped snow depths, floods, and estimated evaporation at sub-metre resolutions, pushing back on spatio-temporal constraints and delivering new process insights. At ground level, precipitation has been measured using signal attenuation between antennae mounted on cell phone towers, while the proliferation of mobile devices has enabled citizen scientists to catalogue photos of environmental conditions, estimate daily average temperatures from battery state, and sense other hydrologically important variables such as channel depths using commercially available wireless devices. Global internet access is being pursued via high-altitude balloons, solar planes, and hundreds of planned satellite launches, providing a means to exploit the "internet of things" as an entirely new measurement domain. Such global access will enable real-time collection of data from billions of smartphones or from remote research platforms. This future will produce petabytes of data that can only be accessed via cloud storage and will require new analytical approaches to interpret. The extent to which today's hydrologic models can usefully ingest such massive data volumes is unclear. Nor is it clear whether this deluge of data will be usefully exploited, either because the measurements are superfluous, inconsistent, not accurate enough, or simply because we lack the capacity to process and analyse them. What is apparent is that the tools and techniques afforded by this array of novel and game-changing sensing platforms present our community with a unique opportunity to develop new insights that advance fundamental aspects of the hydrological sciences. To accomplish this will require more than just an application of the technology: in some cases, it will demand a radical rethink on how we utilize and exploit these new observing systems

New Perspectives for UAV-Based Modelling the Roman Gold Mining Infrastructure in NW Spain

This contribution discusses the potential of UAV-assisted (unmanned aerial vehicles) photogrammetry for the study and preservation of mining heritage sites using the example of Roman gold mining infrastructure in northwestern Spain. The study area represents the largest gold area in Roman times and comprises 7 mining elements of interest that characterize the most representative examples of such ancient works. UAV technology provides a non-invasive procedure valuable for the acquisition of digital information in remote, difficult to access areas or under the risk of destruction. The proposed approach is a cost-effective, robust and rapid method for image processing in remote areas were no traditional surveying technologies are available. It is based on a combination of data provided by aerial orthoimage and LiDAR (Light Detection and Ranging) to improve the accuracy of UAV derived data. The results provide high-resolution orthomosaic, DEMs and 3D textured models that aim for the documentation of ancient mining scenarios, providing high-resolution digital information that improves the identification, description and interpretation of mining elements such as the hydraulic infrastructure, the presence of open-cast mines which exemplifies the different exploitation methods, and settlements. However, beyond the scientific and technical information provided by the data, the 3D documentation of ancient mining scenarios is a powerful tool for an effective and wider public diffusion ensuring the visualization, preservation and awareness over the importance and conservation of world mining heritage sites

Small unmanned airborne systems to support oil and gas pipeline monitoring and mapping

Acknowledgments We thank Johan Havelaar, Aeryon Labs Inc., AeronVironment Inc. and Aeronautics Inc. for kindly permitting the use of materials in Fig. 1.Peer reviewedPublisher PD

Vegetation Dynamics in Ecuador

Global forest cover has suffered a dramatic reduction during recent decades, especially in tropical regions, which is mainly due to human activities caused by enhanced population pressures. Nevertheless, forest ecosystems, especially tropical forests, play an important role in the carbon cycle functioning as carbon stocks and sinks, which is why conservation strategies are of utmost importance respective to ongoing global warming. In South America the highest deforestation rates are observed in Ecuador, but an operational surveillance system for continuous forest monitoring, along with the determination of deforestation rates and the estimation of actual carbon socks is still missing. Therefore, the present investigation provides a functional tool based on remote sensing data to monitor forest stands at local, regional and national scales. To evaluate forest cover and deforestation rates at country level satellite data was used, whereas LiDAR data was utilized to accurately estimate the Above Ground Biomass (AGB; carbon stocks) at catchment level. Furthermore, to provide a cost-effective tool for continuous forest monitoring of the most vulnerable parts, an Unmanned Aerial Vehicle (UAV) was deployed and equipped with various sensors (RBG and multispectral camera). The results showed that in Ecuador total forest cover was reduced by about 24% during the last three decades. Moreover, deforestation rates have increased with the beginning of the new century, especially in the Andean Highland and the Amazon Basin, due to enhanced population pressures and the government supported oil and mining industries, besides illegal timber extractions. The AGB stock estimations at catchment level indicated that most of the carbon is stored in natural ecosystems (forest and páramo; AGB ~98%), whereas areas affected by anthropogenic land use changes (mostly pastureland) lost nearly all their storage capacities (AGB ~2%). Furthermore, the LiDAR data permitted the detection of the forest structure, and therefore the identification of the most vulnerable parts. To monitor these areas, it could be shown that UAVs are useful, particularly when equipped with an RGB camera (AGB correlation: R² > 0.9), because multispectral images suffer saturation of the spectral bands over dense natural forest stands, which results in high overestimations. In summary, the developed operational surveillance systems respective to forest cover at different spatial scales can be implemented in Ecuador to promote conservation/ restoration strategies and to reduce the high deforestation rates. This may also mitigate future greenhouse gas emissions and guarantee functional ecosystem services for local and regional populations