Building an Aerial-Ground Robotics System for Precision Farming: An Adaptable Solution

[No abstract available

Building an Aerial-Ground Robotics System for Precision Farming: An Adaptable Solution

The application of autonomous robots in agriculture is gaining increasing popularity thanks to the high impact it may have on food security, sustainability, resource use efficiency, reduction of chemical treatments, and the optimization of human effort and yield. With this vision, the Flourish research project aimed to develop an adaptable robotic solution for precision farming that combines the aerial survey capabilities of small autonomous unmanned aerial vehicles (UAVs) with targeted intervention performed by multi-purpose unmanned ground vehicles (UGVs). This paper presents an overview of the scientific and technological advances and outcomes obtained in the project. We introduce multi-spectral perception algorithms and aerial and ground-based systems developed for monitoring crop density, weed pressure, crop nitrogen nutrition status, and to accurately classify and locate weeds. We then introduce the navigation and mapping systems tailored to our robots in the agricultural environment, as well as the modules for collaborative mapping. We finally present the ground intervention hardware, software solutions, and interfaces we implemented and tested in different field conditions and with different crops. We describe a real use case in which a UAV collaborates with a UGV to monitor the field and to perform selective spraying without human intervention.Comment: Published in IEEE Robotics & Automation Magazine, vol. 28, no. 3, pp. 29-49, Sept. 202

Autonomous 3D Exploration of Large Structures Using an UAV Equipped with a 2D LIDAR

This paper addressed the challenge of exploring large, unknown, and unstructured industrial environments with an unmanned aerial vehicle (UAV). The resulting system combined well-known components and techniques with a new manoeuvre to use a low-cost 2D laser to measure a 3D structure. Our approach combined frontier-based exploration, the Lazy Theta* path planner, and a flyby sampling manoeuvre to create a 3D map of large scenarios. One of the novelties of our system is that all the algorithms relied on the multi-resolution of the octomap for the world representation. We used a Hardware-in-the-Loop (HitL) simulation environment to collect accurate measurements of the capability of the open-source system to run online and on-board the UAV in real-time. Our approach is compared to different reference heuristics under this simulation environment showing better performance in regards to the amount of explored space. With the proposed approach, the UAV is able to explore 93% of the search space under 30 min, generating a path without repetition that adjusts to the occupied space covering indoor locations, irregular structures, and suspended obstaclesUnión Europea Marie Sklodowska-Curie 64215Unión Europea MULTIDRONE (H2020-ICT-731667)Uniión Europea HYFLIERS (H2020-ICT-779411

An informative path planning framework for UAV-based terrain monitoring

© 2020, The Author(s). Unmanned aerial vehicles represent a new frontier in a wide range of monitoring and research applications. To fully leverage their potential, a key challenge is planning missions for efficient data acquisition in complex environments. To address this issue, this article introduces a general informative path planning framework for monitoring scenarios using an aerial robot, focusing on problems in which the value of sensor information is unevenly distributed in a target area and unknown a priori. The approach is capable of learning and focusing on regions of interest via adaptation to map either discrete or continuous variables on the terrain using variable-resolution data received from probabilistic sensors. During a mission, the terrain maps built online are used to plan information-rich trajectories in continuous 3-D space by optimizing initial solutions obtained by a coarse grid search. Extensive simulations show that our approach is more efficient than existing methods. We also demonstrate its real-time application on a photorealistic mapping scenario using a publicly available dataset and a proof of concept for an agricultural monitoring task

Multi-UAV trajectory planning for 3D visual inspection of complex structures

This paper presents a new trajectory planning algorithm for 3D autonomous UAV volume coverage and visual inspection. The algorithm is an extension of a state-of-the-art Heat Equation Driven Area Coverage (HEDAC) multi-agent area coverage algorithm for 3D domains. With a given target exploration density field, the algorithm designs a potential field and directs UAVs to the regions of higher potential, i.e., higher values of remaining density. Collisions between the agents and agents with domain boundaries are prevented by implementing the distance field and correcting the agent's directional vector when the distance threshold is reached. A unit cube test case is considered to evaluate this trajectory planning strategy for volume coverage. For visual inspection applications, the algorithm is supplemented with camera direction control. A field containing the nearest distance from any point in the domain to the structure surface is designed. The gradient of this field is calculated to obtain the camera orientation throughout the trajectory. Three different test cases of varying complexities are considered to validate the proposed method for visual inspection. The simplest scenario is a synthetic portal-like structure inspected using three UAVs. The other two inspection scenarios are based on realistic structures where UAVs are commonly utilized: a wind turbine and a bridge. When deployed to a wind turbine inspection, two simulated UAVs traversing smooth spiral trajectories have successfully explored the entire turbine structure while cameras are directed to the curved surfaces of the turbine's blades. In the bridge test case an efficacious visual inspection of a complex structure is demonstrated by employing a single UAV and five UAVs. The proposed methodology is successful, flexible and applicable in real-world UAV inspection tasks.Comment: 14 page

Collision-Free Navigation of Small UAVs in Complex Urban Environment

Small unmanned aerial vehicles (UAVs) are expected to become highly innovative solutions for all kind of tasks such as transport, surveillance, inspection or guidance, and many commercial ideas already exist. Herein, small multi rotor UAVs are preferred since they are easy to construct and to fly, at least in wide open spaces. However, many UAV business cases are foreseen in complex urban environments which are very challenging from the perspective of UAV flight. Our work focuses on the autonomous flight and collision-free navigation in an urban environment, where GPS is still considered for localization but where variations in the accuracy or temporary unavailability of GPS position data is explicitly considered. Herein, urban environments are challenging because they require flight nearby large structures and also nearby moving obstacles such as humans and other moving objects, at low altitudes or in very narrow spaces and thus also in areas where GPS (global positioning system) position data might temporarily be very inaccurate or even not available. Therefore we designed a custom stereo camera with adjustable base length for the perception of the possible potential obstacles in the unknown outdoor environment. In this context the optimal design and sensitivity parameters are investigated in outdoor experiments. Using the stereo images, graph based SLAM approach is used for online three dimensional mapping of the static and dynamic environment. For the memory efficiency incremental online loop closure detection using bag of words method is implemented here. By having the three dimensional map, the cost of the cell and its transition calculated in real time by the modified D* lite which will search and generate three dimensional collision free path planning. Experiments of the 3D mapping and collision free path planning are conducted using small UAV in outdoor scenario. The combined experimental results of real time mapping and path planning demonstrated that the three dimensional collision free path planning is able to handle the real time computational constraints while maintaining safety distance

Earth Observations and the Role of UAVs: A Capabilities Assessment

This three-volume document, based on the draft document located on the website given on page 6, presents the findings of a NASA-led capabilities assessment of Uninhabited Aerial Vehicles (UAVs) for civil (defined as non-DoD) use in Earth observations. Volume 1 is the report that presents the overall assessment and summarizes the data. The second volume contains the appendices and references to address the technologies and capabilities required for viable UAV missions. The third volume is the living portion of this effort and contains the outputs from each of the Technology Working Groups (TWGs) along with the reviews conducted by the Universities Space Research Association (USRA). The focus of this report, intended to complement the Office of the Secretary of Defense UAV Roadmap, is four-fold: 1) To determine and document desired future Earth observation missions for all UAVs based on user-defined needs; 2) To determine and document the technologies necessary to support those missions; 3) To discuss the present state of the art platform capabilities and required technologies, including identifying those in progress, those planned, and those for which no current plans exist; 4) Provide the foundations for development of a comprehensive civil UAV roadmap. It is expected that the content of this report will be updated periodically and used to assess the feasibility of future missions. In addition, this report will provide the foundation to help influence funding decisions to develop those technologies that are considered enabling or necessary but are not contained within approved funding plans. This document is written such that each section will be supported by an Appendix that will give the reader a more detailed discussion of that section's topical materials

Earth Observations and the Role of UAVs: A Capabilities Assessment

This document provides an assessment of the civil UAV missions and technologies and is intended to parallel the Office of the Secretary of Defense UAV Roadmap. The intent of this document is four-fold: 1. Determine and document desired future missions of Earth observation UAVs based on user-defined needs 2. Determine and document the technologies necessary to support those missions 3. Discuss the present state of the platform capabilities and required technologies, identifying those in progress, those planned, and those for which no current plans exist 4. Provide the foundations for development of a comprehensive civil UAV roadmap to complement the Department of Defense (DoD) effort (http://www.acq.osd.mil/uas/). Two aspects of the President's Management Agenda (refer to the document located at: www.whitehouse.gov/omb/budget/fy2002/mgmt.pdf ) are supported by this undertaking. First, it is one that will engage multiple Agencies in the effort as stakeholders and benefactors of the systems. In that sense, the market will be driven by the user requirements and applications. The second aspect is one of supporting economic development in the commercial sector. Market forecasts for the civil use of UAVs have indicated an infant market stage at present with a sustained forecasted growth. There is some difficulty in quantifying the value of the market since the typical estimate excludes system components other than the aerial platforms. Section 2.4 addresses the civil UAV market forecast and lists several independent forecasts. One conclusion that can be drawn from these forecasts is that all show a sustained growth for the duration of each long-term forecast

Satellite and UAV Platforms, Remote Sensing for Geographic Information Systems

The present book contains ten articles illustrating the different possible uses of UAVs and satellite remotely sensed data integration in Geographical Information Systems to model and predict changes in both the natural and the human environment. It illustrates the powerful instruments given by modern geo-statistical methods, modeling, and visualization techniques. These methods are applied to Arctic, tropical and mid-latitude environments, agriculture, forest, wetlands, and aquatic environments, as well as further engineering-related problems. The present Special Issue gives a balanced view of the present state of the field of geoinformatics