Evolution of humanoid robot and contribution of various countries in advancing the research and development of the platform

A human like autonomous robot which is capable to adapt itself with the changing of its environment and continue to reach its goal is considered as Humanoid Robot. These characteristics differs the Android from the other kind of robots. In recent years there has been much progress in the development of Humanoid and still there are a lot of scopes in this field. A number of research groups are interested in this area and trying to design and develop a various platforms of Humanoid based on mechanical and biological concept. Many researchers focus on the designing of lower torso to make the Robot navigating as like as a normal human being do. Designing the lower torso which includes west, hip, knee, ankle and toe, is the more complex and more challenging task. Upper torso design is another complex but interesting task that includes the design of arms and neck. Analysis of walking gait, optimal control of multiple motors or other actuators, controlling the Degree of Freedom (DOF), adaptability control and intelligence are also the challenging tasks to make a Humanoid to behave like a human. Basically research on this field combines a variety of disciplines which make it more thought-provoking area in Mechatronics Engineering. In this paper a various platforms for Humanoid Robot development are identified and described based on the evolutionary research on robotics. The paper also depicts a virtual map of humanoid platform development from the ancient time to present time. It is very important and effective to analyze the development phases of androids because of its Business, Educational and Research value. Basic comparisons between the different designs of Humanoid Structures are also analyzed in this paper. ©ICROS

From walking to running: robust and 3D humanoid gait generation via MPC

Humanoid robots are platforms that can succeed in tasks conceived for humans. From locomotion in unstructured environments, to driving cars, or working in industrial plants, these robots have a potential that is yet to be disclosed in systematic every-day-life applications. Such a perspective, however, is opposed by the need of solving complex engineering problems under the hardware and software point of view. In this thesis, we focus on the software side of the problem, and in particular on locomotion control. The operativity of a legged humanoid is subordinate to its capability of realizing a reliable locomotion. In many settings, perturbations may undermine the balance and make the robot fall. Moreover, complex and dynamic motions might be required by the context, as for instance it could be needed to start running or climbing stairs to achieve a certain location in the shortest time. We present gait generation schemes based on Model Predictive Control (MPC) that tackle both the problem of robustness and tridimensional dynamic motions. The proposed control schemes adopt the typical paradigm of centroidal MPC for reference motion generation, enforcing dynamic balance through the Zero Moment Point condition, plus a whole-body controller that maps the generated trajectories to joint commands. Each of the described predictive controllers also feature a so-called stability constraint, preventing the generation of diverging Center of Mass trajectories with respect to the Zero Moment Point. Robustness is addressed by modeling the humanoid as a Linear Inverted Pendulum and devising two types of strategies. For persistent perturbations, a way to use a disturbance observer and a technique for constraint tightening (to ensure robust constraint satisfaction) are presented. In the case of impulsive pushes instead, techniques for footstep and timing adaptation are introduced. The underlying approach is to interpret robustness as a MPC feasibility problem, thus aiming at ensuring the existence of a solution for the constrained optimization problem to be solved at each iteration in spite of the perturbations. This perspective allows to devise simple solutions to complex problems, favoring a reliable real-time implementation. For the tridimensional locomotion, on the other hand, the humanoid is modeled as a Variable Height Inverted Pendulum. Based on it, a two stage MPC is introduced with particular emphasis on the implementation of the stability constraint. The overall result is a gait generation scheme that allows the robot to overcome relatively complex environments constituted by a non-flat terrain, with also the capability of realizing running gaits. The proposed methods are validated in different settings: from conceptual simulations in Matlab to validations in the DART dynamic environment, up to experimental tests on the NAO and the OP3 platforms

A Gentle Introduction to Reinforcement Learning and its Application in Different Fields

Due to the recent progress in Deep Neural Networks, Reinforcement Learning (RL) has become one of the most important and useful technology. It is a learning method where a software agent interacts with an unknown environment, selects actions, and progressively discovers the environment dynamics. RL has been effectively applied in many important areas of real life. This article intends to provide an in-depth introduction of the Markov Decision Process, RL and its algorithms. Moreover, we present a literature review of the application of RL to a variety of fields, including robotics and autonomous control, communication and networking, natural language processing, games and self-organized system, scheduling management and configuration of resources, and computer vision

Model predictive path integral control: Theoretical foundations and applications to autonomous driving

This thesis presents a new approach for stochastic model predictive (optimal) control: model predictive path integral control, which is based on massive parallel sampling of control trajectories. We first show the theoretical foundations of model predictive path integral control, which are based on a combination of path integral control theory and an information theoretic interpretation of stochastic optimal control. We then apply the method to high speed autonomous driving on a 1/5 scale vehicle and analyze the performance and robustness of the method. Extensive experimental results are used to identify and solve key problems relating to robustness of the approach, which leads to a robust stochastic model predictive control algorithm capable of consistently pushing the limits of performance on the 1/5 scale vehicle.Ph.D