Integration of vision and central pattern generator based locomotion for path planning of a non-holonomic crawling humanoid robot

In this paper we present our work on integrating a locomotion controller based on central pattern generator (CPG) and a motion planning algorithm using artificial potential fields for a non-holonomic crawling humanoid robot, the iCub. We also integrated a vision tracker and an inverse kinematics solver to perform reaching tasks. We study the influence of the various parameters of the potential field equations on the performance of the system and prove the efficiency of our framework by testing it on a physics-based robotics simulator and partially on the real iCub

Towards simple control for complex, autonomous robotic applications: Combining discrete and rhythmic motor primitives

Vertebrates are able to quickly adapt to new environments in a very robust, seemingly effortless way. To explain both this adaptivity and robustness, a very promising perspective in neurosciences is the modular approach to movement generation: Movements results from combinations of a finite set of stable motor primitives organized at the spinal level. In this article we apply this concept of modular generation of movements to the control of robots with a high number of degrees of freedom, an issue that is challenging notably because planning complex, multidimensional trajectories in time-varying environments is a laborious and costly process.We thus propose to decrease the complexity of the planning phase through the use of a combination of discrete and rhythmic motor primitives, leading to the decoupling of the planning phase (i.e. the choice of behavior) and the actual trajectory generation. Such implementation eases the control of, and the switch between, different behaviors by reducing the dimensionality of the high-level commands.Moreover, since the motor primitives are generated by dynamical systems, the trajectories can be smoothly modulated, either by high-level commands to change the current behavior or by sensory feedback information to adapt to environmental constraints. In order to show the generality of our approach, we apply the framework to interactive drumming and infant crawling in a humanoid robot. These experiments illustrate the simplicity of the control architecture in terms of planning, the integration of different types of feedback (vision and contact) and the capacity of autonomously switching between different behaviors (crawling and simple reaching)

Robotics 2010

Without a doubt, robotics has made an incredible progress over the last decades. The vision of developing, designing and creating technical systems that help humans to achieve hard and complex tasks, has intelligently led to an incredible variety of solutions. There are barely technical fields that could exhibit more interdisciplinary interconnections like robotics. This fact is generated by highly complex challenges imposed by robotic systems, especially the requirement on intelligent and autonomous operation. This book tries to give an insight into the evolutionary process that takes place in robotics. It provides articles covering a wide range of this exciting area. The progress of technical challenges and concepts may illuminate the relationship between developments that seem to be completely different at first sight. The robotics remains an exciting scientific and engineering field. The community looks optimistically ahead and also looks forward for the future challenges and new development

Motion planning for manipulation and/or navigation tasks with emphasis on humanoid robots

This thesis handles the motion planning problem for various robotic platforms. This is a fundamental problem, especially referring to humanoid robots for which it is particularly challenging for a number of reasons. The first is the high number of degrees of freedom. The second is that a humanoid robot is not a free-flying system in its configuration space: its motions must be generated appropriately. Finally, the implicit requirement that the robot maintains equilibrium, either static or dynamic, typically constrains the trajectory of the robot center of mass. In particular, we are interested in handling problems in which the robot must execute a task, possibly requiring stepping, in environments cluttered by obstacles. In order to solve this problem, we propose to use offline probabilistic motion planning techniques such as Rapidly Exploring Random Trees (RRTs) that consist in finding a solution by means of a graph built in an appropriately defined configuration space. The novelty of the approach is that it does not separate locomotion from task execution. This feature allows to generate whole-body movements while fulfilling the task. The task can be assigned as a trajectory or a single point in the task space or even combining tasks of different nature (e.g., manipulation and navigation tasks). The proposed method is also able to deform the task, if the assigned one is too difficult to be fulfilled. It automatically detects when the task should be deformed and which kind of deformation to apply. However, there are situations, especially when robots and humans have to share the same workspace, in which the robot has to be equipped with reactive capabilities (as avoiding moving obstacles), allowing to reach a basic level of safety. The final part of the thesis handles the rearrangement planning problem. This problem is interesting in view of manipulation tasks, where the robot has to interact with objects in the environment. Roughly speaking, the goal of this problem is to plan the motion for a robot whose assigned a task (e.g., move a target object in a goal region). Doing this, the robot is allowed to move some movable objects that are in the environment. The problem is difficult because we must plan in continuous, high-dimensional state and action spaces. Additionally, the physical constraints induced by the nonprehensile interaction between the robot and the objects in the scene must be respected. Our insight is to embed physics models in the planning stage, allowing robot manipulation and simultaneous objects interaction. Throughout the thesis, we evaluate the proposed planners through experiments on different robotic platforms

Intelligent System Synthesis for Dynamic Locomotion Behavior in Multi-legged Robots

Robot technology has been implemented in many fields of our life, such as entertainment, security, rescue, rehabilitation, social life, the military, and etc. Multi-legged robot always exist in many fields, therefore it is important to be developed. Motion capabilities of the robot will be a main focus to be developed. Current development or conventional model of motion capabilities have several issues in saturation of development. There are some limitation in dynamic factors such as, locomotion generator, flexibility of motion planning, and smoothness of movement. Therefore, in this research, natural based computation are implemented as the basic model. There are three subsystems to be developed and integrated, (1) locomotion behavior model, (2) stability behavior model, and (3) motion planning model. Since individual people has different walking behavior in each walking direction and walking speed, locomotion behavior learning model of omni-directional bio-inspired locomotion which is generating different walking behavior in different walking provision are required to be developed. Step length in sagital and coronal direction, and degree of turning are considered parameters in walking provision. In proposed omni-directional walking model, interconnection structures composed by 16 neurons where 1 leg is represented by 4 joints and 1 joint is represented by 2 motor neurons. In order to acquire walking behavior in certain walking provision, the interconnection structure is optimized by multi-objectives evolutionary algorithm. For acquiring the diversity of references, several optimized interconnection structures are generated in optimization processes in different walking provisions. Learning models are proposed for solving non-linearity of relationship between walking input and walking output representing the synaptic weight of interconnection structure, where one learning model representing one walking parameter. Furthermore, by using optimized model, walking behavior can be generated with unsealed walking provision. Smooth walking transition with low error of desired walking provision was proved based on several numerical experiments in physical computer simulation. In stability behavior model, neuro-based push recovery controller is applied in multi-legged robot in order to keep the stability with minimum energy required. There are three motion patterns in individual people behavior when it gets external perturbation, those are ankle behavior, hip behavior, and step behavior. We propose a new model of Modular Recurrent Neural Network (MRNN) for performing online learning system in each motion behavior. MRNN consists of several recurrent neural networks (RNNs) working alternatively depending on the condition. MRNN performs online learning process of each motion behavior controller independently. The aim of push recovery controller is to manage the motion behavior controller by minimizing the energy required for responding to the external perturbation. This controller selects the appropriate motion behavior and adjusts the gain that represent the influence of the motion behavior to certain push disturbance based on behavior graphs which is generated by adaptive regression spline. We applied the proposed controller to the humanoid robot that has small footprint in open dynamics engine. Experimental result shows the effectiveness of the push controller stabilizing the external perturbation with minimum energy required. Proposed motion planning model presents a natural mechanism of the human brain for generating a dynamic path planning in 3-D rough terrain. The proposed model not only emphasizes the inner state process of the neuron but also the development process of the neurons in the brain. There are two information transmission processes in this proposed model, the forward transmission activity for constructing the neuron connections to find the possible way and the synaptic pruning activity with backward neuron transmission for finding the best pathway from current position to target position and reducing inefficient neuron with its synaptic connections. In order to respond and avoid the unpredictable obstacle, dynamic path planning is also considered in this proposed model. An integrated system for applying the proposed model in the actual experiments is also presented. In order to confirm the effectiveness of the proposed model, we applied the integrated system in the pathway of a four-legged robot on rough terrain in computer simulation. For analyzing and proving the flexibility of proposed model, unpredictable collision is also performed in those experiments. The model can find the best pathway and facilitate the safe movement of the robot. When the robot found an unpredictable collision, the path planner dynamically changed the pathway. The proposed path planning model is capable to be applied in further advance implementation. In order to implement the motion capabilities in real cases, all subsystem should be integrated into one interconnected motion capabilities model. We applied small quadruped robot equipped with IMU, touch sensor, and dual ultrasonic sensor for performing motion planning in real terrain from starting point to goal point. Before implemented, topological map is generated by Kinect camera. In this implementation, all subsystem were analyzed and performed well and the robot able to stop in the goal point. These implementation proved the effectiveness of the system integration, the motion planning model is able to generate safe path planning, the locomotion model is able to generate flexible movement depending on the walking provision from motion planning model, and the stability model can stabilize the robot on rough terrain. Generally, the proposed model can be expected to bring a great contribution to the motion capabilities development and can be used as alternative model for acquiring the dynamism and efficient model in the future instead of conventional model usage. In the future, the proposed model can be applied into any legged robot as navigation, supporter, or rescue robot in unstable environmental condition. In addition, we will realize a cognitive locomotion that generates multiple gaits depending on the 3 aspects, embodiment, locomotion generator, and cognition model. A dynamic neuro-locomotion integrated with internal and external sensory information for correlating with the environmental condition will be designed.ロボット技術は、エンターテイメント、セキュリティ、救助、リハビリ、社会生活、軍事などの様々な生活分野に実現さている。多脚ロポットは常に多くの分野に存在するため開発することが重要である。ロボットの運動能力が開発の主要となっている。現状の開発されている動作能力は,飽和状態にある。いくつかの動的な要因により、歩行生成器、動作計画の柔軟性、および動作の滑らかさ等に制限がある。そこで、本研究では、基本的なモデルとして自然計算に基づく方法論を実装する、また、本研究では、歩行動作モデル、安定動作モデル、や運動計画モデルからなる3つのサブシステムを開発し統合する。人間は歩行方向と速度に応じて歩行動作が異なるため、異なる歩行軸では異なる歩行動作を生成するという全方位生物的な運動の歩行動作学習モデルが開発には要求される。球欠および制御方向のステップ長や旋回の度合いは,歩行軸のパラメータとして考慮される。提案した全方位歩行モデルでは,1肢につき16個のニューロンによって構成される相互接続構造を4つの関節によって表現する。また、1つの関節は,2個のモータニューロンによって表現する。一定の歩行軸での歩行動作を獲得するために,本研究では,多目的進化アルゴリズムによって最適化を行う。提案手法では、参照点の多様性を獲得するために,異なる歩行軸においていくつかの最適な相互接続構造が生成される。相互接続構造のシナプス重みを表現している歩行入力と出力間の非線形な関係を解くための学習モデルを構築する。本手法では,1つの学習モデルが1つの歩行パラメータで表現され、最適化されたモデルを用いることにより,歩行動作は,スケーリングされていない歩行軸を生成することが可能となる,物理演算シミュレーションを用いた実験により,誤差の少ない歩行軸の滑らかな歩行遷移を本実験では示している。安定動作モデルでは、必要最小限のエネルギーで安定性を維持するため多足歩行ロボットにニューロベースプッシュリカバリ制御器を適用した。外力をを受けたとき,人間の行動には足首の動作・股関節の動作・踏み動作の3つの動作パターンが存在する。本研究では,各運動動作におけるオンライン学習システムを実現するために、モジュラーリカレントニューラルネットワーク(MRNN)を用いた新たな学習モデルを提案する。MRNNは状況に応じて選択される複数のリカレントニューラルネットワーク(RNN)によって構成される。MRNNは各運動動作コントローラのオンライン学習プロセスを独立して実行する。プッシュリカバリ制御器の目的は、外乱に応じてエネルギー最小化を行うことによって運動動作制御器を管理することである。この制御器は適切な運動動作を選択し,適応回帰スプラインにより生成された動作グラフに基づき押し動作に対して最も影響を及ぼす運動動作のゲインの調整を行う。提案した制御器をOpen Dynamics Engine(ODE)上で小さな足の長さを持つヒューマノイドロボットに適用し,必要最小限のエネルギーで外力に対して安定させるプッシュリカバリ制御器の有効性を示している。3次元の不整地における動的な経路計画を生成するために,人間の自然な脳機能に基づいた動作計画手法を提案する。本モデルは、ニューロンの内部状態過程だけでなく、脳内のニューロンの発達過程も重視している。本モデルは二つのアルゴリズムに構成される。1つは、通過可能な道を見つけるために構築される接続的なニューロン活動である順方向伝達活動であり,もう1つは、現在位置から最適経路を見つけるために、シナプス結合を用いて非効率的なニューロンを減少させる逆方向にニューロン伝達を行うシナプスプルーニング活動である。また,予測不可能な衝突を回避するために,動的な経路計画も実行される。さらに、実環境において提案されたモデルを実現するための統合システムも提示される。提案モデルの有効性を検証するために,コンピュータシミュレーション上で、不整地環境の4足歩行ロボットに関するシミュレーション環境を実装した。これらの実験では,予測不能な衝突に関する実験も行った。本モデルは、最適経路を見つけ出しロボットの安全な移動を実現できた。さらに、ロボットが予測できない衝突を検出した場合,経路計画アルゴリズムが経路を動的に変更可能であることを示している。これらのことから、提案された経路計画モデルはさらなる先進的な展開が実現可能であると考えられる。実環境における運動能力を実装するためには、すべてのサブシステムを1つの運動能力モデルに統合する必要がある。そこで本研究では、IMU、タッチセンサ、2つの超音波センサを搭載した小型の4足歩行ロポットを用いた実環境において出発地点から目的地点までの運動計画を行った、本実装では、3次元距離計測センサであるKinecを用い3次元空間の位相構造を生成する。また、本実装では、すべてのサブシステムが分析され、ロボットは目的地点で停止することができた。さらに、安全な経路計画を生成することができたことからシステム統合の有効性が確認できた。また、歩行モデルにより歩行軸に応じた柔軟な動きが生成されることで、この安定性モデルは不整地環撹でもロボットの歩行を安定させることができた。これらのことから、本提案モデルは運動能力への多大な貢献が期待され、ダイナミクスを獲得するための代替モデルとして使用することができ,現在よく使用されているモデルに代わる効率的なモデルとなることが考えられる。今後の課題としては,不安定な環境下におけるナビゲーション・支援・レスキューロボットといった任意の肢の数を持つ多足歩行ロボットへの本提案モデルの適用があげられる。さらに,身体性,歩行生成,認知モデルの3つの観点から複数の歩容を生成する認知的歩行を実現することを考えている。環境と相互作用するためのモデルとして、内界センサと外界センサ情報を統合した動的ニューロ歩行を実現する予定である。首都大学東京, 2018-03-25, 修士（工学）首都大学東

Humanoid Robots

For many years, the human being has been trying, in all ways, to recreate the complex mechanisms that form the human body. Such task is extremely complicated and the results are not totally satisfactory. However, with increasing technological advances based on theoretical and experimental researches, man gets, in a way, to copy or to imitate some systems of the human body. These researches not only intended to create humanoid robots, great part of them constituting autonomous systems, but also, in some way, to offer a higher knowledge of the systems that form the human body, objectifying possible applications in the technology of rehabilitation of human beings, gathering in a whole studies related not only to Robotics, but also to Biomechanics, Biomimmetics, Cybernetics, among other areas. This book presents a series of researches inspired by this ideal, carried through by various researchers worldwide, looking for to analyze and to discuss diverse subjects related to humanoid robots. The presented contributions explore aspects about robotic hands, learning, language, vision and locomotion

Design and Control of Compliant Tensegrity Robots Through Simulation and Hardware Validation

To better understand the role of tensegrity structures in biological systems and their application to robotics, the Dynamic Tensegrity Robotics Lab at NASA Ames Research Center has developed and validated two different software environments for the analysis, simulation, and design of tensegrity robots. These tools, along with new control methodologies and the modular hardware components developed to validate them, are presented as a system for the design of actuated tensegrity structures. As evidenced from their appearance in many biological systems, tensegrity ("tensile-integrity") structures have unique physical properties which make them ideal for interaction with uncertain environments. Yet these characteristics, such as variable structural compliance, and global multi-path load distribution through the tension network, make design and control of bio-inspired tensegrity robots extremely challenging. This work presents the progress in using these two tools in tackling the design and control challenges. The results of this analysis includes multiple novel control approaches for mobility and terrain interaction of spherical tensegrity structures. The current hardware prototype of a six-bar tensegrity, code-named ReCTeR, is presented in the context of this validation

Climbing and Walking Robots

With the advancement of technology, new exciting approaches enable us to render mobile robotic systems more versatile, robust and cost-efficient. Some researchers combine climbing and walking techniques with a modular approach, a reconfigurable approach, or a swarm approach to realize novel prototypes as flexible mobile robotic platforms featuring all necessary locomotion capabilities. The purpose of this book is to provide an overview of the latest wide-range achievements in climbing and walking robotic technology to researchers, scientists, and engineers throughout the world. Different aspects including control simulation, locomotion realization, methodology, and system integration are presented from the scientific and from the technical point of view. This book consists of two main parts, one dealing with walking robots, the second with climbing robots. The content is also grouped by theoretical research and applicative realization. Every chapter offers a considerable amount of interesting and useful information