Aspects of automation of selective cleaning

Cleaning (pre-commercial thinning) is a silvicultural operation, primarily used to improve growing conditions of remaining trees in young stands (ca. 3 - 5 m of height). Cleaning costs are considered high in Sweden and the work is laborious. Selective cleaning with autonomous artificial agents (robots) may rationalise the work, but requires new knowledge. This thesis aims to analyse key issues regarding automation of cleaning; suggesting general solutions and focusing on automatic selection of main-stems. The essential requests put on cleaning robots are to render acceptable results and to be cost competitive. They must be safe and be able to operate independently and unattended for several hours in a dynamic and non-deterministic environment. Machine vision, radar, and laser scanners are promising techniques for obstacle avoidance, tree identification, and tool control. Horizontal laser scannings were made, demonstrating the possibility to find stems and make estimations regarding their height and diameter. Knowledge regarding stem selections was retrieved through qualitative interviews with persons performing cleaning. They consider similar attributes of trees, and these findings and current cleaning manuals were used in combination with a field inventory in the development of a decision support system (DSS). The DSS selects stems by the attributes species, position, diameter, and damage. It was used to run computer-based simulations in a variety of young forests. A general follow-up showed that the DSS produced acceptable results. The DSS was further evaluated by comparing its selections with those made by experienced cleaners, and by a test in which laymen performed cleanings following the system. The DSS seems to be useful and flexible, since it can be adjusted in accordance with the cleaners’ results. The laymen’s results implied that the DSS is robust and that it could be used as a training tool. Using the DSS in automatic, or semi-automatic, cleaning operations should be possible if and when selected attributes can be automatically perceived. A suitable base-machine and thorough research, regarding e.g. safety, obstacle avoidance, and target identification, is needed to develop competitive robots. However, using the DSS as a training-tool for inexperienced cleaners could be an interesting option as of today

Virtual-to-Real-World Transfer Learning for Robots on Wilderness Trails

Robots hold promise in many scenarios involving outdoor use, such as search-and-rescue, wildlife management, and collecting data to improve environment, climate, and weather forecasting. However, autonomous navigation of outdoor trails remains a challenging problem. Recent work has sought to address this issue using deep learning. Although this approach has achieved state-of-the-art results, the deep learning paradigm may be limited due to a reliance on large amounts of annotated training data. Collecting and curating training datasets may not be feasible or practical in many situations, especially as trail conditions may change due to seasonal weather variations, storms, and natural erosion. In this paper, we explore an approach to address this issue through virtual-to-real-world transfer learning using a variety of deep learning models trained to classify the direction of a trail in an image. Our approach utilizes synthetic data gathered from virtual environments for model training, bypassing the need to collect a large amount of real images of the outdoors. We validate our approach in three main ways. First, we demonstrate that our models achieve classification accuracies upwards of 95% on our synthetic data set. Next, we utilize our classification models in the control system of a simulated robot to demonstrate feasibility. Finally, we evaluate our models on real-world trail data and demonstrate the potential of virtual-to-real-world transfer learning.Comment: iROS 201

Local Motion Planner for Autonomous Navigation in Vineyards with a RGB-D Camera-Based Algorithm and Deep Learning Synergy

With the advent of agriculture 3.0 and 4.0, researchers are increasingly focusing on the development of innovative smart farming and precision agriculture technologies by introducing automation and robotics into the agricultural processes. Autonomous agricultural field machines have been gaining significant attention from farmers and industries to reduce costs, human workload, and required resources. Nevertheless, achieving sufficient autonomous navigation capabilities requires the simultaneous cooperation of different processes; localization, mapping, and path planning are just some of the steps that aim at providing to the machine the right set of skills to operate in semi-structured and unstructured environments. In this context, this study presents a low-cost local motion planner for autonomous navigation in vineyards based only on an RGB-D camera, low range hardware, and a dual layer control algorithm. The first algorithm exploits the disparity map and its depth representation to generate a proportional control for the robotic platform. Concurrently, a second back-up algorithm, based on representations learning and resilient to illumination variations, can take control of the machine in case of a momentaneous failure of the first block. Moreover, due to the double nature of the system, after initial training of the deep learning model with an initial dataset, the strict synergy between the two algorithms opens the possibility of exploiting new automatically labeled data, coming from the field, to extend the existing model knowledge. The machine learning algorithm has been trained and tested, using transfer learning, with acquired images during different field surveys in the North region of Italy and then optimized for on-device inference with model pruning and quantization. Finally, the overall system has been validated with a customized robot platform in the relevant environment

Unmanned Aerial Systems for Wildland and Forest Fires

Wildfires represent an important natural risk causing economic losses, human death and important environmental damage. In recent years, we witness an increase in fire intensity and frequency. Research has been conducted towards the development of dedicated solutions for wildland and forest fire assistance and fighting. Systems were proposed for the remote detection and tracking of fires. These systems have shown improvements in the area of efficient data collection and fire characterization within small scale environments. However, wildfires cover large areas making some of the proposed ground-based systems unsuitable for optimal coverage. To tackle this limitation, Unmanned Aerial Systems (UAS) were proposed. UAS have proven to be useful due to their maneuverability, allowing for the implementation of remote sensing, allocation strategies and task planning. They can provide a low-cost alternative for the prevention, detection and real-time support of firefighting. In this paper we review previous work related to the use of UAS in wildfires. Onboard sensor instruments, fire perception algorithms and coordination strategies are considered. In addition, we present some of the recent frameworks proposing the use of both aerial vehicles and Unmanned Ground Vehicles (UV) for a more efficient wildland firefighting strategy at a larger scale.Comment: A recent published version of this paper is available at: https://doi.org/10.3390/drones501001