Evolutionary Modular Robotics: Survey and Analysis

This paper surveys various applications of artificial evolution in the field of modular robots. Evolutionary robotics aims to design autonomous adaptive robots automatically that can evolve to accomplish a specific task while adapting to environmental changes. A number of studies have demonstrated the feasibility of evolutionary algorithms for generating robotic control and morphology. However, a huge challenge faced was how to manufacture these robots. Therefore, modular robots were employed to simplify robotic evolution and their implementation in real hardware. Consequently, more research work has emerged on using evolutionary computation to design modular robots rather than using traditional hand design approaches in order to avoid cognition bias. These techniques have the potential of developing adaptive robots that can achieve tasks not fully understood by human designers. Furthermore, evolutionary algorithms were studied to generate global modular robotic behaviors including; self-assembly, self-reconfiguration, self-repair, and self-reproduction. These characteristics allow modular robots to explore unstructured and hazardous environments. In order to accomplish the aforementioned evolutionary modular robotic promises, this paper reviews current research on evolutionary robotics and modular robots. The motivation behind this work is to identify the most promising methods that can lead to developing autonomous adaptive robotic systems that require the minimum task related knowledge on the designer side.https://doi.org/10.1007/s10846-018-0902-

Autonomous Task-Based Evolutionary Design of Modular Robots

In an attempt to solve the problem of finding a set of multiple unique modular robotic designs that can be constructed using a given repertoire of modules to perform a specific task, a novel synthesis framework is introduced based on design optimization concepts and evolutionary algorithms to search for the optimal design. Designing modular robotic systems faces two main challenges: the lack of basic rules of thumb and design bias introduced by human designers. The space of possible designs cannot be easily grasped by human designers especially for new tasks or tasks that are not fully understood by designers. Therefore, evolutionary computation is employed to design modular robots autonomously. Evolutionary algorithms can efficiently handle problems with discrete search spaces and solutions of variable sizes as these algorithms offer feasible robustness to local minima in the search space; and they can be parallelized easily to reducing system runtime. Moreover, they do not have to make assumptions about the solution form. This dissertation proposes a novel autonomous system for task-based modular robotic design based on evolutionary algorithms to search for the optimal design. The introduced system offers a flexible synthesis algorithm that can accommodate to different task-based design needs and can be applied to different modular shapes to produce homogenous modular robots. The proposed system uses a new representation for modular robotic assembly configuration based on graph theory and Assembly Incidence Matrix (AIM), in order to enable efficient and extendible task-based design of modular robots that can take input modules of different geometries and Degrees Of Freedom (DOFs). Robotic simulation is a powerful tool for saving time and money when designing robots as it provides an accurate method of assessing robotic adequacy to accomplish a specific task. Furthermore, it is difficult to predict robotic performance without simulation. Thus, simulation is used in this research to evaluate the robotic designs by measuring the fitness of the evolved robots, while incorporating the environmental features and robotic hardware constraints. Results are illustrated for a number of benchmark problems. The results presented a significant advance in robotic design automation state of the art

Distributed reinforcement learning for self-reconfiguring modular robots

Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2007.This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections.Includes bibliographical references (p. 101-106).In this thesis, we study distributed reinforcement learning in the context of automating the design of decentralized control for groups of cooperating, coupled robots. Specifically, we develop a framework and algorithms for automatically generating distributed controllers for self-reconfiguring modular robots using reinforcement learning. The promise of self-reconfiguring modular robots is that of robustness, adaptability and versatility. Yet most state-of-the-art distributed controllers are laboriously handcrafted and task-specific, due to the inherent complexities of distributed, local-only control. In this thesis, we propose and develop a framework for using reinforcement learning for automatic generation of such controllers. The approach is profitable because reinforcement learning methods search for good behaviors during the lifetime of the learning agent, and are therefore applicable to online adaptation as well as automatic controller design. However, we must overcome the challenges due to the fundamental partial observability inherent in a distributed system such as a self reconfiguring modular robot. We use a family of policy search methods that we adapt to our distributed problem. The outcome of a local search is always influenced by the search space dimensionality, its starting point, and the amount and quality of available exploration through experience.(cont) We undertake a systematic study of the effects that certain robot and task parameters, such as the number of modules, presence of exploration constraints, availability of nearest-neighbor communications, and partial behavioral knowledge from previous experience, have on the speed and reliability of learning through policy search in self-reconfiguring modular robots. In the process, we develop novel algorithmic variations and compact search space representations for learning in our domain, which we test experimentally on a number of tasks. This thesis is an empirical study of reinforcement learning in a simulated lattice based self-reconfiguring modular robot domain. However, our results contribute to the broader understanding of automatic generation of group control and design of distributed reinforcement learning algorithms.by Paulina Varshavskaya.Ph.D

Systematic strategies for 3-dimensional modular robots

Modular robots have been studied an classified from different perspectives, generally focusing on the mechatronics. But the geometric attributes and constraints are the ones that determine the self-reconfiguration strategies. In two dimensions, robots can be geometrically classified by the grid in which their units are arranged and the free cells required to move a unit to an edge-adjacent or vertex-adjacent cell. Since a similar analysis does not exist in three dimensions, we present here a systematic study of the geometric aspects of three-dimensional modular robots. We find relations among the different designs but there are no general models, except from the pivoting cube one, that lead to deterministic reconfiguration plans. In general the motion capabilities of a single module are very limited and its motion constraints are not simple. A widely used method for reducing the complexity and improving the speed of reconfiguration plans is the use of meta-modules. We present a robust and compact meta-module of M-TRAN and other similar robots that is able to perform the expand/contract operations of the Telecube units, for which efficient reconfiguration is possible. Our meta-modules also perform the scrunch/relax and transfer operations of Telecube meta-modules required by the known reconfiguration algorithms. These reduction proofs make it possible to apply efficient geometric reconfiguration algorithms to this type of robots

TOWARDS A NOVEL RESILIENT ROBOTIC SYSTEM

Resilient robotic systems are a kind of robotic system that is able to recover their original function after partial damage of the system. This is achieved by making changes on the partially damaged robot. In this dissertation study, a general robot, which makes sense by including active joints, passive joints, passive links, and passive adjustable links, was proposed in order to explore its resilience. Note that such a robot is also called an under-actuated robot. This dissertation presents the following studies. First, a novel architecture of robots was proposed, which is characterized as under-actuated robot. The architecture enables three types of recovery strategy, namely (1) change of the robot behavior, (2) change of the robot state, and (3) change of the robot configuration. Second, a novel docking system was developed, which allows for the realization of real-time assembly and disassembly and passive joint and adjustable passive link, and this thus enables the realization of the proposed architecture. Third, an example prototype system was built to experiment the effectiveness of the proposed architecture and to demonstrate the resilient behavior of the robot. Fourth, a novel method for robot configuration synthesis was developed, which is based on the genetic algorithm (GA), to determine the goal configuration of a partially damaged robot, at which the robot can still perform its original function. The novelty of the method lies in the integration of both discrete variables such as the number of modules, type of modules, and assembly patterns between modules and the continuous variables such as the length of modules and initial location of the robot. Fifth, a GA-based method for robot reconfiguration planning and scheduling was developed to actually change the robot from its initial configuration to the goal configuration with a minimum effort (time and energy). Two conclusions can be drawn from the above studies. First, the under-actuated robotic architecture can build a cost effective robot that can achieve the highest degree of resilience. Second, the design of the under-actuated resilient robot with the proposed docking system not only reduces the cost but also overcomes the two common actuator failures: (i) an active joint is unlocked (thus becoming a passive joint) and (ii) an active joint is locked (thus becoming an adjustable link). There are several contributions made by this dissertation to the field of robotics. The first is the finding that an under-actuated robot can be made more resilient. In the field of robotics, the concept of the under-actuated robot is available, but it has not been considered for reconfiguration (in literature, the reconfiguration is mostly about fully actuated robots). The second is the elaboration on the concept of reconfiguration planning, scheduling, and manipulation/control. In the literature of robotics, only the concept of reconfiguration planning is precisely given but not for reconfiguration scheduling. The third is the development of the model along with its algorithm for synthesis of the goal reconfiguration, reconfiguration planning, and scheduling. The application of the proposed under-actuated resilient robot lies in the operations in unknown or dangerous environments, for example, in rescue missions and space explorations. In these applications, replacement or repair of a damaged robot is impossible or cost-prohibited

Modular Self-Reconfigurable Robotic Systems: A Survey on Hardware Architectures

Modular self-reconfigurable robots present wide and unique solutions for growing demands in the domains of space exploration, automation, consumer products, and so forth. The higher utilization factor and self-healing capabilities are most demanded traits in robotics for real world applications and modular robotics offer better solutions in these perspectives in relation to traditional robotics. The researchers in robotics domain identified various applications and prototyped numerous robotic models while addressing constraints such as homogeneity, reconfigurability, form factor, and power consumption. The diversified nature of various modular robotic solutions proposed for real world applications and utilization of different sensor and actuator interfacing techniques along with physical model optimizations presents implicit challenges to researchers while identifying and visualizing the merits/demerits of various approaches to a solution. This paper attempts to simplify the comparison of various hardware prototypes by providing a brief study on hardware architectures of modular robots capable of self-healing and reconfiguration along with design techniques adopted in modeling robots, interfacing technologies, and so forth over the past 25 years