Improving the mobility performance of autonomous unmanned ground vehicles by adding the ability to 'Sense/Feel' their local environment.

This paper follows on from earlier work detailed in output one and critically reviews the sensor technologies used in autonomous vehicles, including robots, to ascertain the physical properties of the environment including terrain sensing. The paper reports on a comprehensive study done in terrain types and how these could be determined and the appropriate sensor technologies that can be used. It also reports on work currently in progress in applying these sensor technologies and gives details of a prototype system built at Middlesex University on a reconfigurable mobility system, demonstrating the success of the proposed strategies. This full paper was subject to a blind refereed review process and presented at the 12th HCI International 2007, Beijing, China, incorporating 8 other international thematic conferences. The conference involved over 250 parallel sessions and was attended by 2000 delegates. The conference proceedings are published by Springer in a 17 volume paperback book edition in the Lecture Notes in Computer Science series (LNCS). These are available on-line through the LNCS Digital Library, readily accessible by all subscribing libraries around the world, published in the proceedings of the Second International Conference on Virtual Reality, ICVR 2007, held as Part of HCI International 2007, Beijing, China, July 22-27, 2007. It is also published as a collection of 81 papers in Lecture Notes in Computer Science Series by Springer

Unevenness Point Descriptor for Terrain Analysis in Mobile Robot Applications

In recent years, the use of imaging sensors that produce a three-dimensional representation of the environment has become an efficient solution to increase the degree of perception of autonomous mobile robots. Accurate and dense 3D point clouds can be generated from traditional stereo systems and laser scanners or from the new generation of RGB-D cameras, representing a versatile, reliable and cost-effective solution that is rapidly gaining interest within the robotics community. For autonomous mobile robots, it is critical to assess the traversability of the surrounding environment, especially when driving across natural terrain. In this paper, a novel approach to detect traversable and non-traversable regions of the environment from a depth image is presented that could enhance mobility and safety through integration with localization, control and planning methods. The proposed algorithm is based on the analysis of the normal vector of a surface obtained through Principal Component Analysis and it leads to the definition of a novel, so defined, Unevenness Point Descriptor. Experimental results, obtained with vehicles operating in indoor and outdoor environments, are presented to validate this approach

Adaptive Technique for Contrast Enhancement of Leading Vehicle Tracks

During movement in various unpaved terrain conditions, the track impressions left over by the leading vehicles provide guiding and safe routes in the area. The delineation of these tracks captured by the images can extend immense support for guidance in real time. These tracks that look like edges in coarse-resolution images take the shape of elongated areas in fine-resolution images. In such a scenario, the high pass and edge detection filters give limited information to delineate these tracks passing through different surroundings. However, the distinct texture of these tracks assists in the delineation of these tracks from their surroundings. Gray level co-occurrence matrix (GLCM) representing the spatial relation of pixels is employed here to define the texture. The authors investigated the influence of different resolutions on the distinguishability of these tracks. The study revealed that texture plays an increasing role in distinguishing objects as the image resolution improves. The texture analysis extended to investigate the track impressions left over by the leading vehicle brings out an ample scope in delineating these tracks. The measures could improve the track contrast even better than conventional techniques. To select the most optimal contrast enhancement measure in a given scenario, authors proposed a quantified measure of track index. An investigation is made on the difference-based track index (TI) representing the mean contrast value of the track vis-à-vis off-track areas. The results show an increase in the quantified contrast from 7.83 per cent to 29.06 per cent. The proposed technique highlights the image with the highest track contrast in a given scenario. The study can lead to onboard decision-making for the rut following vehicles moving in low-contrast terrain

Track-index-guided sustainable off-road operations using visual analytics, image intelligence and optimal delineation of track features

Visual-analytics-guided systems are replacing human efforts today. In many applications, movement in off-road terrain is required. Considering the need to negotiate various soft ground and desertic conditions, the beaten tracks of leading vehicles considered to be safe and suitable for guiding are used in such operations. During night, often, these tracks pass through low-contrast conditions posing difficulty in their identification. The maximization of track contrast is therefore desired. Many contrast enhancement techniques exist but their effectiveness varies as per the surrounding. Other than conventional techniques, the role of texture too becomes important for enhancing the differentiable track contrast. Gray-level co-occurrence matrix (GLCM)-based statistic measures are used here to evaluate the track texture. These measures are seen to improve the contrast of vehicle tracks significantly. A track-index-based technique is proposed to sort various images as per their effectiveness in increasing the track contrast. Different forms of track indices are proposed and compared. The proposed track index is seen as effective in sorting 88.8% of contrast images correctly. The proposed technique of creating and sorting images based on the contrast level is seen as a useful tool for improved fidelity in many difficult situations for making the off-road operations sustainable

Calibration and Validation of Earth-Observing Sensors Using Deployable Surface-Based Sensor Networks

©2010 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other worksDOI: 10.1109/JSTARS.2010.2053021Satellite-based instruments are now routinely used to map the surface of the globe or monitor weather conditions. However, these orbital measurements of ground-based quantities are heavily influenced by external factors, such as air moisture content or surface emissivity. Detailed atmospheric models are created to compensate for these factors, but the satellite system must still be tested over a wide variety of surface conditions to validate the instrumentation and correction model. Validation and correction are particularly important for arctic environments, as the unique surface properties of packed snow and ice are poorly modeled by any other terrain type. Currently, this process is human intensive, requiring the coordinated collection of surface measurements over a number of years. A decentralized, autonomous sensor network is proposed which allows the collection of ground-based environmental measurements at a location and resolution that is optimal for the specific on-orbit sensor under investigation. A prototype sensor network has been constructed and fielded on a glacier in Alaska, illustrating the ability of such systems to properly collect and log sensor measurements, even in harsh arctic environments

A Systematic Approach to Predict Performance of Human-Automation Systems

©2007 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works.DOI: 10.1109/TSMCC.2007.897505This paper discusses an approach for predicting system performance resulting from humans and robots performing repetitive tasks in a collaborative manner. The methodology uses a systematic approach that incorporates the various effects of workload on human performance, and estimates resulting performance attributes derived between teleoperated and autonomous control of robotic systems. Performance is determined by incorporating capabilities of the human and robotic agent based on accomplishment of functional operations and effect of cognitive stress due to continuous operation by the human agent. This paper provides an overview of the prediction system and discusses its implementation on a simulated rendezvous/docking task

An intelligent terrain-based navigation system for planetary rovers

©2001 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works.DOI: 10.1109/100.973242A fuzzy logic framework for onboard terrain analysis and guidance towards traversable regions. An onboard terrain-based navigation system for mobile robots operating on natural terrain is presented. This system utilizes a fuzzy-logic framework for onboard analysis of the terrain and develops a set of fuzzy navigation rules that guide the rover toward the safest and the most traversable regions. The overall navigation strategy deals with uncertain knowledge about the environment and uses the onboard terrain analysis to enable the rover to select easy-to-traverse paths to the goal autonomously. The navigation system is tested and validated with a set of physical rover experiments and demonstrates the autonomous capability of the system

Behavior-Based Robot Navigation on Challenging Terrain: A Fuzzy Logic Approach

©2002 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works.DOI: 10.1109/TRA.2002.1019461This paper presents a new strategy for behavior-based navigation of field mobile robots on challenging terrain, using a fuzzy logic approach and a novel measure of terrain traversability. A key feature of the proposed approach is real-time assessment of terrain characteristics and incorporation of this information in the robot navigation strategy. Three terrain characteristics that strongly affect its traversability, namely, roughness, slope, and discontinuity, are extracted from video images obtained by on-board cameras. This traversability data is used to infer, in real time, the terrain Fuzzy Rule-Based Traversability Index, which succinctly quantifies the ease of traversal of the regional terrain by the mobile robot. A new traverse-terrain behavior is introduced that uses the regional traversability index to guide the robot to the safest and the most traversable terrain region. The regional traverse-terrain behavior is complemented by two other behaviors, local avoid-obstacle and global seek-goal. The recommendations of these three behaviors are integrated through adjustable weighting factors to generate the final motion command for the robot. The weighting factors are adjusted automatically, based on the situational context of the robot. The terrain assessment and robot navigation algorithms Are implemented on a Pioneer commercial robot and field-test studies are conducted. These studies demonstrate that the robot possesses intelligent decision-making capabilities that are brought to bear in negotiating hazardous terrain conditions during the robot motion

System of Terrain Analysis, Energy Estimation and Path Planning for Planetary Exploration by Robot Teams

NASA’s long term plans involve a return to manned moon missions, and eventually sending humans to mars. The focus of this project is the use of autonomous mobile robotics to enhance these endeavors. This research details the creation of a system of terrain classification, energy of traversal estimation and low cost path planning for teams of inexpensive and potentially expendable robots. The first stage of this project was the creation of a model which estimates the energy requirements of the traversal of varying terrain types for a six wheel rocker-bogie rover. The wheel/soil interaction model uses Shibly’s modified Bekker equations and incorporates a new simplified rocker-bogie model for estimating wheel loads. In all but a single trial the relative energy requirements for each soil type were correctly predicted by the model. A path planner for complete coverage intended to minimize energy consumption was designed and tested. It accepts as input terrain maps detailing the energy consumption required to move to each adjacent location. Exploration is performed via a cost function which determines the robot’s next move. This system was successfully tested for multiple robots by means of a shared exploration map. At peak efficiency, the energy consumed by our path planner was only 56% that used by the best case back and forth coverage pattern. After performing a sensitivity analysis of Shibly’s equations to determine which soil parameters most affected energy consumption, a neural network terrain classifier was designed and tested. The terrain classifier defines all traversable terrain as one of three soil types and then assigns an assumed set of soil parameters. The classifier performed well over all, but had some difficulty distinguishing large rocks from sand. This work presents a system which successfully classifies terrain imagery into one of three soil types, assesses the energy requirements of terrain traversal for these soil types and plans efficient paths of complete coverage for the imaged area. While there are further efforts that can be made in all areas, the work achieves its stated goals

Optimum Pipeline for Visual Terrain Classification Using Improved Bag of Visual Words and Fusion Methods

We propose an optimum pipeline and develop the hybrid representation to produce an effective and efficient visual terrain classification system. The bag of visual words (BOVW) framework has emerged as a promising approach and effective paradigm for visual terrain classification. The method includes four main steps: (1) feature extraction, (2) codebook generation, (3) feature coding, and (4) pooling and normalization. Recent researches have primarily focused on feature extraction in the development of new handcrafted descriptors that are specific to the visual terrain. However, the effects of other steps on visual terrain classification are still unknown. At the same time, fusion methods are often used to boost classification performance by exploring the complementarity of diverse features. We provide a comprehensive study of all steps in the BOVW framework and different fusion methods for visual terrain classification. Then, multiple approaches in each step and their effects are explored on the visual terrain dataset. Finally, the feature preprocessing technique, improved BOVW framework, and fusion method are used to construct an optimum pipeline for visual terrain classification. The hybrid representation developed by the optimum pipeline performs effectively and rapidly for visual terrain classification in the terrain dataset, outperforming those current methods. Furthermore, it is robust to diverse noises and illumination alterations