Multiagent learning for locomotion and coordination in tensegrity robotics

Tensegrity structures are composed of pure compressional elements that are connected via a network of pure tensional elements. The concept of tensegrity promises numerous advantages to the field of robotics. Tensegrity robots are, however, notoriously difficult to control due to their oscillatory nature and nonlinear interaction between the components. Multiagent learning, a subtopic of artificial intelligence, provides the tools to address challenges of tensegrity robots. In multiagent learning, multiple entities simultaneously learn a task together while interacting with each other through the environment. This approach can be applied at two different levels: both to coordinate teams of multiple robots, and to control a single robot where different agents control different parts of the robot. In this work, we consider both cases, and apply two multiagent learning approaches (Reinforcement Learning and Evolutionary Algorithms) to tensegrity robotics problems at different levels. First, we take the model of an icosahedron robot, and use multiagent learning to control different parts. We use coevolutionary algorithms and fitness shaping to develop learning based robust rolling locomotion algorithm. After the locomotion aspect, we study multi-robot coordination using multiagent reinforcement learning and reward shaping methods. At this phase, we study reward shaping and develop methods to use reward shaping to improve the cooperation between multiple tensegrity robots. We explain how these results are simulated and validated by using physical tensegrity robots. Last, we explain how these results helped design and development of a tensegrity robot with rolling capability: SUPERBall

Controlling Tensegrity Robots Through Evolution

Tensegrity structures (built from interconnected rods and cables) have the potential to offer a revolutionary new robotic design that is light-weight, energy-efficient, robust to failures, capable of unique modes of locomotion, impact tolerant, and compliant (reducing damage between the robot and its environment). Unfortunately robots built from tensegrity structures are difficult to control with traditional methods due to their oscillatory nature, nonlinear coupling between components and overall complexity. Fortunately this formidable control challenge can be overcome through the use of evolutionary algorithms. In this paper we show that evolutionary algorithms can be used to efficiently control a ball-shaped tensegrity robot. Experimental results performed with a variety of evolutionary algorithms in a detailed soft-body physics simulator show that a centralized evolutionary algorithm performs 400 percent better than a hand-coded solution, while the multi-agent evolution performs 800 percent better. In addition, evolution is able to discover diverse control solutions (both crawling and rolling) that are robust against structural failures and can be adapted to a wide range of energy and actuation constraints. These successful controls will form the basis for building high-performance tensegrity robots in the near future

Design and Evolution of a Modular Tensegrity Robot Platform

NASA Ames Research Center is developing a compliant modular tensegrity robotic platform for planetary exploration. In this paper we present the design and evolution of the platform's main hardware component, an untethered, robust tensegrity strut, with rich sensor feedback and cable actuation. Each strut is a complete robot, and multiple struts can be combined together to form a wide range of complex tensegrity robots. Our current goal for the tensegrity robotic platform is the development of SUPERball, a 6-strut icosahedron underactuated tensegrity robot aimed at dynamic locomotion for planetary exploration rovers and landers, but the aim is for the modular strut to enable a wide range of tensegrity morphologies. SUPERball is a second generation prototype, evolving from the tensegrity robot ReCTeR, which is also a modular, lightweight, highly compliant 6-strut tensegrity robot that was used to validate our physics based NASA Tensegrity Robot Toolkit (NTRT) simulator. Many hardware design parameters of the SUPERball were driven by locomotion results obtained in our validated simulator. These evolutionary explorations helped constrain motor torque and speed parameters, along with strut and string stress. As construction of the hardware has finalized, we have also used the same evolutionary framework to evolve controllers that respect the built hardware parameters