Pushing with Soft Robotic Arms via Deep Reinforcement Learning

Soft robots can adaptively interact with unstructured environments. However, nonlinear soft material properties challenge modeling and control. Learningbased controllers that leverage efficient mechanical models are promising for solving complex interaction tasks. This article develops a closed-loop pose/force controller for a dexterous soft manipulator enabling dynamic pushing tasks using deep reinforcement learning. Force tests investigate the mechanical properties of a soft robot module, resulting in orthogonal forces of 9  13 N. Then, the policy is trained in simulation leveraging a dynamic Cosserat rod model of the soft robot. Domain randomization mitigate the sim-to-real gap while careful reward engineering induced pose and force control even without explicit force inputs. Despite the approximate simulation, the sim-to-real transfer achieved an average reaching distance of 34  14mm (8.1%L  3.4%L), an average orientation error of 0.40  0.29 rad (23°  17°) and applied pushing forces up to 3 N. Such performance is reasonable for the intended assistive tasks of the manipulator. The experiments uncovered that the soft robot interacting with the environment exhibited torsional and counter-balancing movements. Although not explicitly enforced, they emerged from the mechanical intelligence of the manipulator. The results demonstrate the potential of soft robotic manipulation via reinforcement learning

3D printed pneumatic soft actuators and sensors: their modeling, performance quantification, control and applications in soft robotic systems

Continued technological progress in robotic systems has led to more applications where robots and humans operate in close proximity and even physical contact in some cases. Soft robots, which are primarily made of highly compliant and deformable materials, provide inherently safe features, unlike conventional robots that are made of stiff and rigid components. These robots are ideal for interacting safely with humans and operating in highly dynamic environments. Soft robotics is a rapidly developing field exploiting biomimetic design principles, novel sensor and actuation concepts, and advanced manufacturing techniques. This work presents novel soft pneumatic actuators and sensors that are directly 3D printed in one manufacturing step without requiring postprocessing and support materials using low-cost and open-source fused deposition modeling (FDM) 3D printers that employ an off-the-shelf commercially available soft thermoplastic poly(urethane) (TPU). The performance of the soft actuators and sensors developed is optimized and predicted using finite element modeling (FEM) analytical models in some cases. A hyperelastic material model is developed for the TPU based on its experimental stress-strain data for use in FEM analysis. The novel soft vacuum bending (SOVA) and linear (LSOVA) actuators reported can be used in diverse robotic applications including locomotion robots, adaptive grippers, parallel manipulators, artificial muscles, modular robots, prosthetic hands, and prosthetic fingers. Also, the novel soft pneumatic sensing chambers (SPSC) developed can be used in diverse interactive human-machine interfaces including wearable gloves for virtual reality applications and controllers for soft adaptive grippers, soft push buttons for science, technology, engineering, and mathematics (STEM) education platforms, haptic feedback devices for rehabilitation, game controllers and throttle controllers for gaming and bending sensors for soft prosthetic hands. These SPSCs are directly 3D printed and embedded in a monolithic soft robotic finger as position and touch sensors for real-time position and force control. One of the aims of soft robotics is to design and fabricate robotic systems with a monolithic topology embedded with its actuators and sensors such that they can safely interact with their immediate physical environment. The results and conclusions of this thesis have significantly contributed to the realization of this aim

On Advanced Mobility Concepts for Intelligent Planetary Surface Exploration

Surface exploration by wheeled rovers on Earth's Moon (the two Lunokhods) and Mars (Nasa's Sojourner and the two MERs) have been followed since many years already very suc-cessfully, specifically concerning operations over long time. However, despite of this success, the explored surface area was very small, having in mind a total driving distance of about 8 km (Spirit) and 21 km (Opportunity) over 6 years of operation. Moreover, ESA will send its ExoMars rover in 2018 to Mars, and NASA its MSL rover probably this year. However, all these rovers are lacking sufficient on-board intelligence in order to overcome longer dis-tances, driving much faster and deciding autonomously on path planning for the best trajec-tory to follow. In order to increase the scientific output of a rover mission it seems very nec-essary to explore much larger surface areas reliably in much less time. This is the main driver for a robotics institute to combine mechatronics functionalities to develop an intelligent mo-bile wheeled rover with four or six wheels, and having specific kinematics and locomotion suspension depending on the operational terrain of the rover to operate. DLR's Robotics and Mechatronics Center has a long tradition in developing advanced components in the field of light-weight motion actuation, intelligent and soft manipulation and skilled hands and tools, perception and cognition, and in increasing the autonomy of any kind of mechatronic systems. The whole design is supported and is based upon detailed modeling, optimization, and simula-tion tasks. We have developed efficient software tools to simulate the rover driveability per-formance on various terrain characteristics such as soft sandy and hard rocky terrains as well as on inclined planes, where wheel and grouser geometry plays a dominant role. Moreover, rover optimization is performed to support the best engineering intuitions, that will optimize structural and geometric parameters, compare various kinematics suspension concepts, and make use of realistic cost functions like mass and consumed energy minimization, static sta-bility, and more. For self-localization and safe navigation through unknown terrain we make use of fast 3D stereo algorithms that were successfully used e.g. in unmanned air vehicle ap-plications and on terrestrial mobile systems. The advanced rover design approach is applica-ble for lunar as well as Martian surface exploration purposes. A first mobility concept ap-proach for a lunar vehicle will be presented

Social Attention: Modeling Attention in Human Crowds

Robots that navigate through human crowds need to be able to plan safe, efficient, and human predictable trajectories. This is a particularly challenging problem as it requires the robot to predict future human trajectories within a crowd where everyone implicitly cooperates with each other to avoid collisions. Previous approaches to human trajectory prediction have modeled the interactions between humans as a function of proximity. However, that is not necessarily true as some people in our immediate vicinity moving in the same direction might not be as important as other people that are further away, but that might collide with us in the future. In this work, we propose Social Attention, a novel trajectory prediction model that captures the relative importance of each person when navigating in the crowd, irrespective of their proximity. We demonstrate the performance of our method against a state-of-the-art approach on two publicly available crowd datasets and analyze the trained attention model to gain a better understanding of which surrounding agents humans attend to, when navigating in a crowd