Reinforcement and Curriculum Learning for Off-Road Navigation of an UGV with a 3D LiDAR

This paper presents the use of deep Reinforcement Learning (RL) for autonomous navigation of an Unmanned Ground Vehicle (UGV) with an onboard three-dimensional (3D) Light Detection and Ranging (LiDAR) sensor in off-road environments. For training, both the robotic simulator Gazebo and the Curriculum Learning paradigm are applied. Furthermore, an Actor–Critic Neural Network (NN) scheme is chosen with a suitable state and a custom reward function. To employ the 3D LiDAR data as part of the input state of the NNs, a virtual two-dimensional (2D) traversability scanner is developed. The resulting Actor NN has been successfully tested in both real and simulated experiments and favorably compared with a previous reactive navigation approach on the same UGV.Partial funding for open access charge: Universidad de Málag

Autonomous navigation of a wheeled mobile robot in farm settings

This research is mainly about autonomously navigation of an agricultural wheeled mobile robot in an unstructured outdoor setting. This project has four distinct phases defined as: (i) Navigation and control of a wheeled mobile robot for a point-to-point motion. (ii) Navigation and control of a wheeled mobile robot in following a given path (path following problem). (iii) Navigation and control of a mobile robot, keeping a constant proximity distance with the given paths or plant rows (proximity-following). (iv) Navigation of the mobile robot in rut following in farm fields. A rut is a long deep track formed by the repeated passage of wheeled vehicles in soft terrains such as mud, sand, and snow. To develop reliable navigation approaches to fulfill each part of this project, three main steps are accomplished: literature review, modeling and computer simulation of wheeled mobile robots, and actual experimental tests in outdoor settings. First, point-to-point motion planning of a mobile robot is studied; a fuzzy-logic based (FLB) approach is proposed for real-time autonomous path planning of the robot in unstructured environment. Simulation and experimental evaluations shows that FLB approach is able to cope with different dynamic and unforeseen situations by tuning a safety margin. Comparison of FLB results with vector field histogram (VFH) and preference-based fuzzy (PBF) approaches, reveals that FLB approach produces shorter and smoother paths toward the goal in almost all of the test cases examined. Then, a novel human-inspired method (HIM) is introduced. HIM is inspired by human behavior in navigation from one point to a specified goal point. A human-like reasoning ability about the situations to reach a predefined goal point while avoiding any static, moving and unforeseen obstacles are given to the robot by HIM. Comparison of HIM results with FLB suggests that HIM is more efficient and effective than FLB. Afterward, navigation strategies are built up for path following, rut following, and proximity-following control of a wheeled mobile robot in outdoor (farm) settings and off-road terrains. The proposed system is composed of different modules which are: sensor data analysis, obstacle detection, obstacle avoidance, goal seeking, and path tracking. The capabilities of the proposed navigation strategies are evaluated in variety of field experiments; the results show that the proposed approach is able to detect and follow rows of bushes robustly. This action is used for spraying plant rows in farm field. Finally, obstacle detection and obstacle avoidance modules are developed in navigation system. These modules enables the robot to detect holes or ground depressions (negative obstacles), that are inherent parts of farm settings, and also over ground level obstacles (positive obstacles) in real-time at a safe distance from the robot. Experimental tests are carried out on two mobile robots (PowerBot and Grizzly) in outdoor and real farm fields. Grizzly utilizes a 3D-laser range-finder to detect objects and perceive the environment, and a RTK-DGPS unit for localization. PowerBot uses sonar sensors and a laser range-finder for obstacle detection. The experiments demonstrate the capability of the proposed technique in successfully detecting and avoiding different types of obstacles both positive and negative in variety of scenarios

Learning Terrain-Aware Kinodynamic Model for Autonomous Off-Road Rally Driving With Model Predictive Path Integral Control

High-speed autonomous driving in off-road environments has immense potential for various applications, but it also presents challenges due to the complexity of vehicle-terrain interactions. In such environments, it is crucial for the vehicle to predict its motion and adjust its controls proactively in response to environmental changes, such as variations in terrain elevation. To this end, we propose a method for learning terrain-aware kinodynamic model which is conditioned on both proprioceptive and exteroceptive information. The proposed model generates reliable predictions of 6-degree-of-freedom motion and can even estimate contact interactions without requiring ground truth force data during training. This enables the design of a safe and robust model predictive controller through appropriate cost function design which penalizes sampled trajectories with unstable motion, unsafe interactions, and high levels of uncertainty derived from the model. We demonstrate the effectiveness of our approach through experiments on a simulated off-road track, showing that our proposed model-controller pair outperforms the baseline and ensures robust high-speed driving performance without control failure.Comment: Accepted to IEEE Robotics and Automation Letters (and ICRA 2024). Our video can be found at https://youtu.be/VXf_prNQnJo Project page : https://sites.google.com/view/terrainawarekinody

A Systematic Survey of Control Techniques and Applications: From Autonomous Vehicles to Connected and Automated Vehicles

Vehicle control is one of the most critical challenges in autonomous vehicles (AVs) and connected and automated vehicles (CAVs), and it is paramount in vehicle safety, passenger comfort, transportation efficiency, and energy saving. This survey attempts to provide a comprehensive and thorough overview of the current state of vehicle control technology, focusing on the evolution from vehicle state estimation and trajectory tracking control in AVs at the microscopic level to collaborative control in CAVs at the macroscopic level. First, this review starts with vehicle key state estimation, specifically vehicle sideslip angle, which is the most pivotal state for vehicle trajectory control, to discuss representative approaches. Then, we present symbolic vehicle trajectory tracking control approaches for AVs. On top of that, we further review the collaborative control frameworks for CAVs and corresponding applications. Finally, this survey concludes with a discussion of future research directions and the challenges. This survey aims to provide a contextualized and in-depth look at state of the art in vehicle control for AVs and CAVs, identifying critical areas of focus and pointing out the potential areas for further exploration

The Effects of Flood Warning Information on Driver Decisions in a Driving Simulator Scenario

Flood warnings are a type of risk communication that alerts the public of potential floods. Flood warnings can be communicated through mobile devices and should convey enough information to keep the user safe during a flood situation. However, the amount of detail included in the warning, such as the depth of the flood, may vary. The purpose of this study was to: (a) extend our prior research on flood warnings by recreating the written driving scenarios into the driving simulator; (b) deepen the understanding of human decision-making in risky situations; and (c) investigate how to best inform drivers of floods by design to keep them protected. We examined the effects of flood warning information on the actions taken by drivers in various driving scenarios in a driving simulator. Participants were tasked to drive to a restaurant after receiving instructions and a type of flood information warning during each scenario (flood, no flood, flood of 6 inches, flood of 6 inches maximum). Their actions taken, trust in the navigation system, understanding of the situation and scenario, and perceived risk were measured for each type of flood information warning. We found that participants accepted the alternate route more when in a scenario with a flood present compared to the no-flood scenario. The level of detail of the warning did not influence the actions taken. These results deepened the understanding of human decision-making and can guide future flood warning designs to keep drivers protected from flooded roadways

Development of track-driven agriculture robot with terrain classification functionality / Khairul Azmi Mahadhir

Over the past years, many robots have been devised to facilitate agricultural activities (that are labor-intensive in nature) so that they can carry out tasks such as crop care or selective harvesting with minimum human supervision. It is commonly observed that rapid change in terrain conditions can jeopardize the performance and efficiency of a robot when performing agricultural activity. For instance, a terrain covered with gravel produces high vibration to robot when traversing on the surface. In this work, an agricultural robot is embedded with machine learning algorithm based on Support Vector Machine (SVM). The aim is to evaluate the effectiveness of the Support Vector Machine in recognizing different terrain conditions in an agriculture field. A test bed equipped with a tracked-driven robot and three types o f terrain i.e. sand, gravel and vegetation has been developed. A small and low power MEMS accelerometer is integrated into the robot for measuring the vertical acceleration. In this experiment, the vibration signals resulted from the interaction between the robot and the different type of terrain were collected. An extensive experimental study was conducted to evaluate the effectiveness of SVM. The results in terms of accuracy of two machine learning techniques based on terrain classification are analyzed and compared. The results show that the robot that is equipped with an SVM can recognize different terrain conditions effectively. Such capability enables the robot to traverse across changing terrain conditions without being trapped in the field. Hence, this research work contributes to develop a self-adaptive agricultural robot in coping with different terrain conditions with minimum human supervision