Autonomous vehicle guidance in unknown environments

Gaining from significant advances in their performance granted by technological evolution, Autonomous Vehicles are rapidly increasing the number of fields of possible and effective applications. From operations in hostile, dangerous environments (military use in removing unexploded projectiles, survey of nuclear power and chemical industrial plants following accidents) to repetitive 24h tasks (border surveillance), from power-multipliers helping in production to less exotic commercial application in household activities (cleaning robots as consumer electronics products), the combination of autonomy and motion offers nowadays impressive options. In fact, an autonomous vehicle can be completed by a number of sensors, actuators, devices making it able to exploit a quite large number of tasks. However, in order to successfully attain these results, the vehicle should be capable to navigate its path in different, sometimes unknown environments. This is the goal of this dissertation: to analyze and - mainly - to propose a suitable solution for the guidance of autonomous vehicles. The frame in which this research takes its steps is the activity carried on at the Guidance and Navigation Lab of Sapienza – Università di Roma, hosted at the School of Aerospace Engineering. Indeed, the solution proposed has an intrinsic, while not limiting, bias towards possible space applications, that will become obvious in some of the following content. A second bias dictated by the Guidance and Navigation Lab activities is represented by the choice of a sample platform. In fact, it would be difficult to perform a meaningful study keeping it a very general level, independent on the characteristics of the targeted kind of vehicle: it is easy to see from the rough list of applications cited above that these characteristics are extremely varied. The Lab hosted – even before the beginning of this thesis activity – a simple, home-designed and manufactured model of a small, yet performing enough autonomous vehicle, called RAGNO (standing for Rover for Autonomous Guidance Navigation and Observation): it was an obvious choice to select that rover as the reference platform to identify solutions for guidance, and to use it, cooperating to its improvement, for the test activities which should be considered as mandatory in this kind of thesis work to validate the suggested approaches. The draft of the thesis includes four main chapters, plus introduction, final remarks and future perspectives, and the list of references. The first chapter (“Autonomous Guidance Exploiting Stereoscopic Vision”) investigates in detail the technique which has been deemed as the most interesting for small vehicles. The current availability of low cost, high performance cameras suggests the adoption of the stereoscopic vision as a quite effective technique, also capable to making available to remote crew a view of the scenario quite similar to the one humans would have. Several advanced image analysis techniques have been investigated for the extraction of the features from left- and right-eye images, with SURF and BRISK algorithm being selected as the most promising one. In short, SURF is a blob detector with an associated descriptor of 64 elements, where the generic feature is extracted by applying sequential box filters to the surrounding area. The features are then localized in the point of the image where the determinant of the Hessian matrix H(x,y) is maximum. The descriptor vector is than determined by calculating the Haar wavelet response in a sampling pattern centered in the feature. BRISK is instead a corner detector with an associated binary descriptor of 512 bit. The generic feature is identified as the brightest point in a sampling circular area of N pixels while the descriptor vector is calculated by computing the brightness gradient of each of the N(N-1)/2 pairs of sampling points. Once left and right features have been extracted, their descriptors are compared in order to determine the corresponding pairs. The matching criterion consists in seeking for the two descriptors for which their relative distance (Euclidean norm for SURF, Hamming distance for BRISK) is minimum. The matching process is computationally expensive: to reduce the required time the thesis successfully explored the theory of the epipolar geometry, based on the geometric constraint existing between the left and right projection of the scene point P, and indeed limiting the space to be searched. Overall, the selected techniques require between 200 and 300 ms on a 2.4GHz clock CPU for the feature extraction and matching in a single (left+right) capture, making it a feasible solution for slow motion vehicles. Once matching phase has been finalized, a disparity map can be prepared highlighting the position of the identified objects, and by means of a triangulation (the baseline between the two cameras is known, the size of the targeted object is measured in pixels in both images) the position and distance of the obstacles can be obtained. The second chapter (“A Vehicle Prototype and its Guidance System”) is devoted to the implementation of the stereoscopic vision onboard a small test vehicle, which is the previously cited RAGNO rover. Indeed, a description of the vehicle – the chassis, the propulsion system with four electric motors empowering the wheels, the good roadside performance attainable, the commanding options – either fully autonomous, partly autonomous with remote monitoring, or fully remotely controlled via TCP/IP on mobile networks - is included first, with a focus on different sensors that, depending on the scenario, can integrate the stereoscopic vision system. The intelligence-side of guidance subsystem, exploiting the navigation information provided by the camera, is then detailed. Two guidance techniques have been studied and implemented to identify the optimal trajectory in a field with scattered obstacles: the artificial potential guidance, based on the Lyapunov approach, and the A-star algorithm, looking for the minimum of a cost function built on graphs joining the cells of a mesh over-imposed to the scenario. Performance of the two techniques are assessed for two specific test-cases, and the possibility of unstable behavior of the artificial potential guidance, bouncing among local minima, has been highlighted. Overall, A-star guidance is the suggested solution in terms of time, cost and reliability. Notice that, withstanding the noise affecting information from sensors, an estimation process based on Kalman filtering has been also included in the process to improve the smoothness of the targeted trajectory. The third chapter (“Examples of Possible Missions and Applications”) reports two experimental campaigns adopting RAGNO for the detection of dangerous gases. In the first one, the rover accommodates a specific sensor, and autonomously moves in open fields, avoiding possible obstacles, to exploit measurements at given time intervals. The same configuration for RAGNO is also used in the second campaign: this time, however, the path of the rover is autonomously computed on the basis of the way points communicated by a drone which is flying above the area of measurements and identifies possible targets of interest. The fourth chapter (“Guidance of Fleet of Autonomous Vehicles ”) stresses this successful idea of fleet of vehicles, and numerically investigates by algorithms purposely written in Matlab the performance of a simple swarm of two rovers exploring an unknown scenario, pretending – as an example - to represent a case of planetary surface exploration. The awareness of the surrounding environment is dictated by the characteristics of the sensors accommodated onboard, which have been assumed on the basis of the experience gained with the material of previous chapter. Moreover, the communication issues that would likely affect real world cases are included in the scheme by the possibility to model the comm link, and by running the simulation in a multi-task configuration where the two rovers are assigned to two different computer processes, each of them having a different TCP/IP address with a behavior actually depending on the flow of information received form the other explorer. Even if at a simulation-level only, it is deemed that such a final step collects different aspects investigated during the PhD period, with feasible sensors’ characteristics (obviously focusing on stereoscopic vision), guidance technique, coordination among autonomous agents and possible interesting application cases

Mapped Landmark Algorithm for Precision Landing

A report discusses a computer vision algorithm for position estimation to enable precision landing during planetary descent. The Descent Image Motion Estimation System for the Mars Exploration Rovers has been used as a starting point for creating code for precision, terrain-relative navigation during planetary landing. The algorithm is designed to be general because it handles images taken at different scales and resolutions relative to the map, and can produce mapped landmark matches for any planetary terrain of sufficient texture. These matches provide a measurement of horizontal position relative to a known landing site specified on the surface map. Multiple mapped landmarks generated per image allow for automatic detection and elimination of bad matches. Attitude and position can be generated from each image; this image-based attitude measurement can be used by the onboard navigation filter to improve the attitude estimate, which will improve the position estimates. The algorithm uses normalized correlation of grayscale images, producing precise, sub-pixel images. The algorithm has been broken into two sub-algorithms: (1) FFT Map Matching (see figure), which matches a single large template by correlation in the frequency domain, and (2) Mapped Landmark Refinement, which matches many small templates by correlation in the spatial domain. Each relies on feature selection, the homography transform, and 3D image correlation. The algorithm is implemented in C++ and is rated at Technology Readiness Level (TRL) 4

Efficient Autonomous Navigation for Planetary Rovers with Limited Resources

Rovers operating on Mars are in need of more and more autonomous features to ful ll their challenging mission requirements. However, the inherent constraints of space systems make the implementation of complex algorithms an expensive and difficult task. In this paper we propose a control architecture for autonomous navigation. Efficient implementations of autonomous features are built on top of the current ExoMars navigation method, enhancing the safety and traversing capabilities of the rover. These features allow the rover to detect and avoid hazards and perform long traverses by following a roughly safe path planned by operators on ground. The control architecture implementing the proposed navigation mode has been tested during a field test campaign on a planetary analogue terrain. The experiments evaluated the proposed approach, autonomously completing two long traverses while avoiding hazards. The approach only relies on the optical Localization Cameras stereobench, a sensor that is found in all rovers launched so far, and potentially allows for computationally inexpensive long-range autonomous navigation in terrains of medium difficulty

Autonomous Surface Site Establishment to Ensure Safe Crew Arrival and Operations

Traditional human Mars missions have relied on crew to support the surface systems. However, for safety, the surface systems will likely need to be setup and capable of operating prior to the arrival of crew. To mitigate risks to the crew, a novel surface architecture has been developed that addresses risks associated with other Mars missions. This architecture relies on a reusable descent and ascent vehicle, extensive in-situ resource utilization, redundant habitation systems, and emerging autonomous capabilities. The resulting surface architecture increases safety for the crew while also providing potential to expand to support longer missions with larger populations in the future

A comparison of multiple techniques for the reconstruction of entry, descent, and landing trajectories and atmospheres

The primary importance of trajectory reconstruction is to assess the accuracy of pre-flight predictions of the entry trajectory. While numerous entry systems have flown, often these systems are not adequately instrumented or the flight team not adequately funded to perform the statistical engineering reconstruction required to quantify performance and feed-forward lessons learned into future missions. As such, entry system performance and reliability levels remain unsubstantiated and improvement in aerothermodynamic and flight dynamics modeling remains data poor. The comparison is done in an effort to quantitatively and qualitatively compare Kalman filtering methods of reconstructing trajectories and atmospheric conditions from entry systems flight data. The first Kalman filter used is the extended Kalman filter. Extended Kalman filtering has been used extensively in trajectory reconstruction both for orbiting spacecraft and for planetary probes. The second Kalman filter is the unscented Kalman filter. Additionally, a technique for using collocation to reconstruct trajectories is formulated, and collocation's usefulness for trajectory simulation is demonstrated for entry, descent, and landing trajectories using a method developed here to deterministically find the state variables of the trajectory without nonlinear programming. Such an approach could allow one to utilize the same collocation trajectory design tools for the subsequent reconstruction.Ph.D.Committee Chair: Braun, Robert; Committee Member: Lisano, Michael; Committee Member: Russell, Ryan; Committee Member: Striepe, Scott; Committee Member: Volovoi, Vital

Autonomous Systems, Robotics, and Computing Systems Capability Roadmap: NRC Dialogue

Contents include the following: Introduction. Process, Mission Drivers, Deliverables, and Interfaces. Autonomy. Crew-Centered and Remote Operations. Integrated Systems Health Management. Autonomous Vehicle Control. Autonomous Process Control. Robotics. Robotics for Solar System Exploration. Robotics for Lunar and Planetary Habitation. Robotics for In-Space Operations. Computing Systems. Conclusion

Opportunity rover localization and topographic mapping at the landing site of Meridiani Planum, Mars

This paper presents the results of Mars topographic mapping and lander and rover localization for the Opportunity rover at Meridiani Planum during the Mars Exploration Rover (MER) 2003 mission. By Sol 458, the Opportunity rover traversed a distance of 5.20 km. We localized the lander using two-way Doppler radio positioning and cartographic triangulation of craters visible in both orbital and ground images. Additional high-resolution orbital images were taken to verify the determined lander position. Visual odometry and bundle adjustment techniques were applied to overcome wheel slippages, azimuthal angle drift, and other navigation errors (as large as 21% within Eagle crater). In addition, orbit-to-ground image-based adjustment was applied to correct rover location errors where bundle adjustment was not applicable. We generated timely topographic products, including orthoimages, digital terrain models (DTMs), three-dimensional (3-D) crater models, and rover traverse maps. In particular, detailed 3-D terrain models of major features, such as Endurance crater, have been generated using multisite panoramic stereo images based on bundle adjustment and wide baseline stereo technique

System of Terrain Analysis, Energy Estimation and Path Planning for Planetary Exploration by Robot Teams

NASA’s long term plans involve a return to manned moon missions, and eventually sending humans to mars. The focus of this project is the use of autonomous mobile robotics to enhance these endeavors. This research details the creation of a system of terrain classification, energy of traversal estimation and low cost path planning for teams of inexpensive and potentially expendable robots. The first stage of this project was the creation of a model which estimates the energy requirements of the traversal of varying terrain types for a six wheel rocker-bogie rover. The wheel/soil interaction model uses Shibly’s modified Bekker equations and incorporates a new simplified rocker-bogie model for estimating wheel loads. In all but a single trial the relative energy requirements for each soil type were correctly predicted by the model. A path planner for complete coverage intended to minimize energy consumption was designed and tested. It accepts as input terrain maps detailing the energy consumption required to move to each adjacent location. Exploration is performed via a cost function which determines the robot’s next move. This system was successfully tested for multiple robots by means of a shared exploration map. At peak efficiency, the energy consumed by our path planner was only 56% that used by the best case back and forth coverage pattern. After performing a sensitivity analysis of Shibly’s equations to determine which soil parameters most affected energy consumption, a neural network terrain classifier was designed and tested. The terrain classifier defines all traversable terrain as one of three soil types and then assigns an assumed set of soil parameters. The classifier performed well over all, but had some difficulty distinguishing large rocks from sand. This work presents a system which successfully classifies terrain imagery into one of three soil types, assesses the energy requirements of terrain traversal for these soil types and plans efficient paths of complete coverage for the imaged area. While there are further efforts that can be made in all areas, the work achieves its stated goals

NASA Innovative Advanced Concepts (NIAC) Phase 1 Final Report: Venus Landsailer Zephyr

Imagine sailing across the hot plains of Venus! A design for a craft to do just this was completed by the COncurrent Multidisciplinary Preliminary Assessment of Space Systems (COMPASS) Team for the NASA Innovative Advanced Concepts (NIAC) project. The robotic craft could explore over 30 km of surface of Venus, driven by the power of the wind