Terrain-Dependent Slip Risk Prediction for Planetary Exploration Rovers

Wheel slip prediction on rough terrain is crucial for secure, long-term operations of planetary exploration rovers. Although rough, unstructured terrain hampers mobility, prediction by modeling wheel–terrain interactions remains difficult owing to unclear terrain conditions and complexities of terramechanics models. This study proposes a vision-based approach with machine learning for predicting wheel slip risk by estimating the slope from 3D information and classifying terrain types from image information. It considers the slope estimation accuracy for risk prediction under sharp increases in wheel slip due to inclined ground. Experimental results obtained with a rover testbed on several terrain types validate this method

The Cyborg Astrobiologist: Testing a Novelty-Detection Algorithm on Two Mobile Exploration Systems at Rivas Vaciamadrid in Spain and at the Mars Desert Research Station in Utah

(ABRIDGED) In previous work, two platforms have been developed for testing computer-vision algorithms for robotic planetary exploration (McGuire et al. 2004b,2005; Bartolo et al. 2007). The wearable-computer platform has been tested at geological and astrobiological field sites in Spain (Rivas Vaciamadrid and Riba de Santiuste), and the phone-camera has been tested at a geological field site in Malta. In this work, we (i) apply a Hopfield neural-network algorithm for novelty detection based upon color, (ii) integrate a field-capable digital microscope on the wearable computer platform, (iii) test this novelty detection with the digital microscope at Rivas Vaciamadrid, (iv) develop a Bluetooth communication mode for the phone-camera platform, in order to allow access to a mobile processing computer at the field sites, and (v) test the novelty detection on the Bluetooth-enabled phone-camera connected to a netbook computer at the Mars Desert Research Station in Utah. This systems engineering and field testing have together allowed us to develop a real-time computer-vision system that is capable, for example, of identifying lichens as novel within a series of images acquired in semi-arid desert environments. We acquired sequences of images of geologic outcrops in Utah and Spain consisting of various rock types and colors to test this algorithm. The algorithm robustly recognized previously-observed units by their color, while requiring only a single image or a few images to learn colors as familiar, demonstrating its fast learning capability.Comment: 28 pages, 12 figures, accepted for publication in the International Journal of Astrobiolog

Vision-based terrain classification and classifier fusion for planetary exploration rovers

Thesis (S.M.)--Massachusetts Institute of Technology, Dept. of Mechanical Engineering, 2006.Includes bibliographical references (leaves 63-66).Autonomous rover operation plays a key role in planetary exploration missions. Rover systems require more and more autonomous capabilities to improve efficiency and robustness. Rover mobility is one of the critical components that can directly affect mission success. Knowledge of the physical properties of the terrain surrounding a planetary exploration rover can be used to allow a rover system to fully exploit its mobility capabilities. Here a study of multi-sensor terrain classification for planetary rovers in Mars and Mars-like environments is presented. Supervised classification algorithms for color, texture, and range features are presented based on mixture of Gaussians modeling. Two techniques for merging the results of these "low level" classifiers are presented that rely on Bayesian fusion and meta-classifier fusion. The performances of these algorithms are studied using images from NASA's Mars Exploration Rover mission and through experiments on a four-wheeled test-bed rover operating in Mars-analog terrain. It is shown that accurate terrain classification can be achieved via classifier fusion from visual features.by Ibrahim Halatci.S.M

A New Terrain Classification Framework Using Proprioceptive Sensors for Mobile Robots

Mobile robots that operate in real-world environments interact with the surroundings to generate complex acoustics and vibration signals, which carry rich information about the terrain. This paper presents a new terrain classification framework that utilizes both acoustics and vibration signals resulting from the robot-terrain interaction. As an alternative to handcrafted domain-specific feature extraction, a two-stage feature selection method combining ReliefF and mRMR algorithms was developed to select optimal feature subsets that carry more discriminative information. As different data sources can provide complementary information, a multiclassifier combination method was proposed by considering a priori knowledge and fusing predictions from five data sources: one acoustic data source and four vibration data sources. In this study, four conceptually different classifiers were employed to perform the classification, each with a different number of optimal features. Signals were collected using a tracked robot moving at three different speeds on six different terrains. The new framework successfully improved classification performance of different classifiers using the newly developed optimal feature subsets. The greater improvement was observed for robot traversing at lower speeds

Tapered whisker reservoir computing for real-time terrain identification-based navigation

This paper proposes a new method for real-time terrain recognition-based navigation for mobile robots. Mobile robots performing tasks in unstructured environments need to adapt their trajectories in real-time to achieve safe and efficient navigation in complex terrains. However, current methods largely depend on visual and IMU (inertial measurement units) that demand high computational resources for real-time applications. In this paper, a real-time terrain identification-based navigation method is proposed using an on-board tapered whisker-based reservoir computing system. The nonlinear dynamic response of the tapered whisker was investigated in various analytical and Finite Element Analysis frameworks to demonstrate its reservoir computing capabilities. Numerical simulations and experiments were cross-checked with each other to verify that whisker sensors can separate different frequency signals directly in the time domain and demonstrate the computational superiority of the proposed system, and that different whisker axis locations and motion velocities provide variable dynamical response information. Terrain surface-following experiments demonstrated that our system could accurately identify changes in the terrain in real-time and adjust its trajectory to stay on specific terrain

Integrating Reconfigurable Foot Design, Multi-modal Contact Sensing, and Terrain Classification for Bipedal Locomotion

The ability of bipedal robots to adapt to diverse and unstructured terrain conditions is crucial for their deployment in real-world environments. To this end, we present a novel, bio-inspired robot foot design with stabilizing tarsal segments and a multifarious sensor suite involving acoustic, capacitive, tactile, temperature, and acceleration sensors. A real-time signal processing and terrain classification system is developed and evaluated. The sensed terrain information is used to control actuated segments of the foot, leading to improved ground contact and stability. The proposed framework highlights the potential of the sensor-integrated adaptive foot for intelligent and adaptive locomotion.Comment: 7 pages, 6 figure

Learning to visually predict terrain properties for planetary rovers

Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Mechanical Engineering, 2009.This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections.Includes bibliographical references (p. 174-180).For future planetary exploration missions, improvements in autonomous rover mobility have the potential to increase scientific data return by providing safe access to geologically interesting sites that lie in rugged terrain, far from landing areas. This thesis presents an algorithmic framework designed to improve rover-based terrain sensing, a critical component of any autonomous mobility system operating in rough terrain. Specifically, this thesis addresses the problem of predicting the mechanical properties of distant terrain. A self-supervised learning framework is proposed that enables a robotic system to learn predictions of mechanical properties of distant terrain, based on measurements of mechanical properties of similar terrain that has been previously traversed. The proposed framework relies on three distinct algorithms. A mechanical terrain characterization algorithm is proposed that computes upper and lower bounds on the net traction force available at a patch of terrain, via a constrained optimization framework. Both model-based and sensor-based constraints are employed. A terrain classification method is proposed that exploits features from proprioceptive sensor data, and employs either a supervised support vector machine (SVM) or unsupervised k-means classifier to assign class labels to terrain patches that the rover has traversed. A second terrain classification method is proposed that exploits features from exteroceptive sensor data (e.g. color and texture), and is automatically trained in a self-supervised manner, based on the outputs of the proprioceptive terrain classifier.(cont.) The algorithm includes a method for distinguishing novel terrain from previously observed terrain. The outputs of these three algorithms are merged to yield a map of the surrounding terrain that is annotated with the expected achievable net traction force. Such a map would be useful for path planning purposes. The algorithms proposed in this thesis have been experimentally validated in an outdoor, Mars-analog environment. The proprioceptive terrain classifier demonstrated 92% accuracy in labeling three distinct terrain classes. The exteroceptive terrain classifier that relies on self-supervised training was shown to be approximately as accurate as a similar, human-supervised classifier, with both achieving 94% correct classification rates on identical data sets. The algorithm for detection of novel terrain demonstrated 89% accuracy in detecting novel terrain in this same environment. In laboratory tests, the mechanical terrain characterization algorithm predicted the lower bound of the net available traction force with an average margin of 21% of the wheel load.by Christopher A. Brooks.Ph.D

Terrain sensing and estimation for dynamic outdoor mobile robots

Thesis (S.M.)--Massachusetts Institute of Technology, Dept. of Mechanical Engineering, 2007.Includes bibliographical references (p. 120-125).In many applications, mobile robots are required to travel on outdoor terrain at high speed. Compared to traditional low-speed, laboratory-based robots, outdoor scenarios pose increased perception and mobility challenges which must be considered to achieve high performance. Additionally, high-speed driving produces dynamic robot-terrain interactions which are normally negligible in low speed driving. This thesis presents algorithms for estimating wheel slip and detecting robot immobilization on outdoor terrain, and for estimating traversed terrain profile and classifying terrain type. Both sets of algorithms utilize common onboard sensors. Two methods are presented for robot immobilization detection. The first method utilizes a dynamic vehicle model to estimate robot velocity and explicitly estimate longitudinal wheel slip. The vehicle model utilizes a novel simplified tire traction/braking force model in addition to estimating external resistive disturbance forces acting on the robot. The dynamic model is combined with sensor measurements in an extended Kalman filter framework. A preliminary algorithm for adapting the tire model parameters is presented. The second, model-free method takes a signal recognition-based approach to analyze inertial measurements to detect robot immobilization. Both approaches are experimentally validated on a robotic platform traveling on a variety of outdoor terrains. Two detector fusion techniques are proposed and experimentally validated which combine multiple detectors to increase detection speed and accuracy. An algorithm is presented to classify outdoor terrain for high-speed mobile robots using a suspension mounted accelerometer. The algorithm utilizes a dynamic vehicle model to estimate the terrain profile and classifies the terrain based on spatial frequency components of the estimated profile. The classification algorithm is validated using experimental results collected with a commercial automobile driving in real-world conditions.by Christopher Charles Ward.S.M