1,924 research outputs found
Reset-free Trial-and-Error Learning for Robot Damage Recovery
The high probability of hardware failures prevents many advanced robots
(e.g., legged robots) from being confidently deployed in real-world situations
(e.g., post-disaster rescue). Instead of attempting to diagnose the failures,
robots could adapt by trial-and-error in order to be able to complete their
tasks. In this situation, damage recovery can be seen as a Reinforcement
Learning (RL) problem. However, the best RL algorithms for robotics require the
robot and the environment to be reset to an initial state after each episode,
that is, the robot is not learning autonomously. In addition, most of the RL
methods for robotics do not scale well with complex robots (e.g., walking
robots) and either cannot be used at all or take too long to converge to a
solution (e.g., hours of learning). In this paper, we introduce a novel
learning algorithm called "Reset-free Trial-and-Error" (RTE) that (1) breaks
the complexity by pre-generating hundreds of possible behaviors with a dynamics
simulator of the intact robot, and (2) allows complex robots to quickly recover
from damage while completing their tasks and taking the environment into
account. We evaluate our algorithm on a simulated wheeled robot, a simulated
six-legged robot, and a real six-legged walking robot that are damaged in
several ways (e.g., a missing leg, a shortened leg, faulty motor, etc.) and
whose objective is to reach a sequence of targets in an arena. Our experiments
show that the robots can recover most of their locomotion abilities in an
environment with obstacles, and without any human intervention.Comment: 18 pages, 16 figures, 3 tables, 6 pseudocodes/algorithms, video at
https://youtu.be/IqtyHFrb3BU, code at
https://github.com/resibots/chatzilygeroudis_2018_rt
Learning Image-Conditioned Dynamics Models for Control of Under-actuated Legged Millirobots
Millirobots are a promising robotic platform for many applications due to
their small size and low manufacturing costs. Legged millirobots, in
particular, can provide increased mobility in complex environments and improved
scaling of obstacles. However, controlling these small, highly dynamic, and
underactuated legged systems is difficult. Hand-engineered controllers can
sometimes control these legged millirobots, but they have difficulties with
dynamic maneuvers and complex terrains. We present an approach for controlling
a real-world legged millirobot that is based on learned neural network models.
Using less than 17 minutes of data, our method can learn a predictive model of
the robot's dynamics that can enable effective gaits to be synthesized on the
fly for following user-specified waypoints on a given terrain. Furthermore, by
leveraging expressive, high-capacity neural network models, our approach allows
for these predictions to be directly conditioned on camera images, endowing the
robot with the ability to predict how different terrains might affect its
dynamics. This enables sample-efficient and effective learning for locomotion
of a dynamic legged millirobot on various terrains, including gravel, turf,
carpet, and styrofoam. Experiment videos can be found at
https://sites.google.com/view/imageconddy
Development of track-driven agriculture robot with terrain classification functionality / Khairul Azmi Mahadhir
Over the past years, many robots have been devised to facilitate agricultural activities (that are labor-intensive in nature) so that they can carry out tasks such as crop care or selective harvesting with minimum human supervision. It is commonly observed that rapid change in terrain conditions can jeopardize the performance and efficiency of a robot when performing agricultural activity. For instance, a terrain covered with gravel produces high vibration to robot when traversing on the surface. In this work, an agricultural robot is embedded with machine learning algorithm based on Support Vector Machine (SVM). The aim is to evaluate the effectiveness of the Support Vector Machine in recognizing different terrain conditions in an agriculture field. A test bed equipped with a tracked-driven robot and three types o f terrain i.e. sand, gravel and vegetation has been developed. A small and low power MEMS accelerometer is integrated into the robot for measuring the vertical acceleration. In this experiment, the vibration signals resulted from the interaction between the robot and the different type of terrain were collected. An extensive experimental study was conducted to evaluate the effectiveness of SVM. The results in terms of accuracy of two machine learning techniques based on terrain classification are analyzed and compared. The results show that the robot that is equipped with an SVM can recognize different terrain conditions effectively. Such capability enables the robot to traverse across changing terrain conditions without being trapped in the field. Hence, this research work contributes to develop a self-adaptive agricultural robot in coping with different terrain conditions with minimum human supervision
Virtual Structure Based Formation Tracking of Multiple Wheeled Mobile Robots: An Optimization Perspective
Today, with the increasing development of science and technology, many systems need to be optimized to find the optimal solution of the system. this kind of problem is also called optimization problem. Especially in the formation problem of multi-wheeled mobile robots, the optimization algorithm can help us to find the optimal solution of the formation problem. In this paper, the formation problem of multi-wheeled mobile robots is studied from the point of view of optimization. In order to reduce the complexity of the formation problem, we first put the robots with the same requirements into a group. Then, by using the virtual structure method, the formation problem is reduced to a virtual WMR trajectory tracking problem with placeholders, which describes the expected position of each WMR formation. By using placeholders, you can get the desired track for each WMR. In addition, in order to avoid the collision between multiple WMR in the group, we add an attraction to the trajectory tracking method. Because MWMR in the same team have different attractions, collisions can be easily avoided. Through simulation analysis, it is proved that the optimization model is reasonable and correct. In the last part, the limitations of this model and corresponding suggestions are given
High Speed Lunar Navigation for Crewed and Remotely Piloted Vehicles
Increased navigation speed is desirable for lunar rovers, whether autonomous, crewed or remotely operated, but is hampered by the low gravity, high contrast lighting and rough terrain. We describe lidar based navigation system deployed on NASA's K10 autonomous rover and to increase the terrain hazard situational awareness of the Lunar Electric Rover crew
System of Terrain Analysis, Energy Estimation and Path Planning for Planetary Exploration by Robot Teams
NASA’s long term plans involve a return to manned moon missions, and eventually sending humans to mars. The focus of this project is the use of autonomous mobile robotics to enhance these endeavors. This research details the creation of a system of terrain classification, energy of traversal estimation and low cost path planning for teams of inexpensive and potentially expendable robots.
The first stage of this project was the creation of a model which estimates the energy requirements of the traversal of varying terrain types for a six wheel rocker-bogie rover. The wheel/soil interaction model uses Shibly’s modified Bekker equations and incorporates a new simplified rocker-bogie model for estimating wheel loads. In all but a single trial the relative energy requirements for each soil type were correctly predicted by the model.
A path planner for complete coverage intended to minimize energy consumption was designed and tested. It accepts as input terrain maps detailing the energy consumption required to move to each adjacent location. Exploration is performed via a cost function which determines the robot’s next move. This system was successfully tested for multiple robots by means of a shared exploration map. At peak efficiency, the energy consumed by our path planner was only 56% that used by the best case back and forth coverage pattern.
After performing a sensitivity analysis of Shibly’s equations to determine which soil parameters most affected energy consumption, a neural network terrain classifier was designed and tested. The terrain classifier defines all traversable terrain as one of three soil types and then assigns an assumed set of soil parameters. The classifier performed well over all, but had some difficulty distinguishing large rocks from sand.
This work presents a system which successfully classifies terrain imagery into one of three soil types, assesses the energy requirements of terrain traversal for these soil types and plans efficient paths of complete coverage for the imaged area. While there are further efforts that can be made in all areas, the work achieves its stated goals
Fast Approximate Clearance Evaluation for Rovers with Articulated Suspension Systems
We present a light-weight body-terrain clearance evaluation algorithm for the
automated path planning of NASA's Mars 2020 rover. Extraterrestrial path
planning is challenging due to the combination of terrain roughness and severe
limitation in computational resources. Path planning on cluttered and/or uneven
terrains requires repeated safety checks on all the candidate paths at a small
interval. Predicting the future rover state requires simulating the vehicle
settling on the terrain, which involves an inverse-kinematics problem with
iterative nonlinear optimization under geometric constraints. However, such
expensive computation is intractable for slow spacecraft computers, such as
RAD750, which is used by the Curiosity Mars rover and upcoming Mars 2020 rover.
We propose the Approximate Clearance Evaluation (ACE) algorithm, which obtains
conservative bounds on vehicle clearance, attitude, and suspension angles
without iterative computation. It obtains those bounds by estimating the lowest
and highest heights that each wheel may reach given the underlying terrain, and
calculating the worst-case vehicle configuration associated with those extreme
wheel heights. The bounds are guaranteed to be conservative, hence ensuring
vehicle safety during autonomous navigation. ACE is planned to be used as part
of the new onboard path planner of the Mars 2020 rover. This paper describes
the algorithm in detail and validates our claim of conservatism and fast
computation through experiments
- …