Object manipulation by a humanoid robot via single camera pose estimation

Humanoid robots are designed to be used in daily life as assistance robots for people. They are expected to fill the jobs that require physical labor. These robots are also considered in healthcare sector. The ultimate goal in humanoid robotics is to reach a point where robots can truly communicate with people, and to be a part of labor force. Usual daily environment of a common person contains objects with different geometric and texture features. Such objects should be easily recognized, located and manipulated by a robot when needed. These tasks require high amount of information from environment. The Computer Vision field interests in extraction and use of visual cues for computer systems. Visual data captured with cameras contains the most of the information needed about the environment for high level tasks relative to the other sensors. Most of the high level tasks on humanoid robots require the target object to be segmented in image and located in the 3D environment. Also, the object should be kept in image so that the information about the object can be retrieved continuously. This can be achieved by gaze control schemes by using visual feedback to drive neck motors of the robot. In this thesis an object manipulation algorithm is proposed for a humanoid robot. A white object with red square marker is used as the target object. The object is segmented by color information. Corners of the red marker is found and used for the pose estimation algorithm and gaze control. The pose information is used for navigation to the object and for the grasping action. The described algorithm is implemented on the humanoid experiment platform SURALP (Sabanci University ReseArch Labaratory Platform)

Walking trajectory generation & control of the humanoid robot: suralp

In recent years, the operational area of the robots started to extend and new functionalities are planned for them in our daily environments. As the human-robot interaction is being improved, the robots can provide support in elderly care, human assistance, rescue, hospital attendance and many other areas. With this motivation, an intensive research is focused around humanoid robotics in the last four decades. However, due to the nonlinear dynamics of the robot and high number of degrees of freedom, the robust balance of the bipedal walk is a challenging task. Smooth trajectory generation and online compensation methods are necessary to achieve a stable walk. In this thesis, Cartesian foot position references are generated as periodic functions with respect to a body-fixed coordinate frame. The online adjustment of these parameterized trajectories provides an opportunity in tuning the walking parameters without stopping the robot. The major contribution of this thesis in the context of trajectory generation is the smoothening of the foot trajectories and the introduction of ground push motion in the vertical direction. This pushing motion provided a dramatic improvement in the stability of the walking. Even though smooth foot reference trajectories are generated using the parameter based functions, the realization of a dynamically stable walk and maintenance of the robot balance requires walking control algorithms. This thesis introduces various control techniques to cope with disturbances or unevenness of the walking environment and compensate the mismatches between the planned and the actual walking based on sensory feedback. Moreover, an automatic homing procedure is proposed for the adjustment of the initial posture before the walking experiments. The presented control algorithms include ZMP regulation, foot orientation control, trunk orientation control, foot pitch torque difference compensation, body pitch angle correction, ground impact compensation and early landing modification. The effectiveness of the proposed trajectory generation and walking control algorithms is tested on the humanoid robot SURALP and a stable walk is achieved

Review of Anthropomorphic Head Stabilisation and Verticality Estimation in Robots

International audienceIn many walking, running, flying, and swimming animals, including mammals, reptiles, and birds, the vestibular system plays a central role for verticality estimation and is often associated with a head sta-bilisation (in rotation) behaviour. Head stabilisation, in turn, subserves gaze stabilisation, postural control, visual-vestibular information fusion and spatial awareness via the active establishment of a quasi-inertial frame of reference. Head stabilisation helps animals to cope with the computational consequences of angular movements that complicate the reliable estimation of the vertical direction. We suggest that this strategy could also benefit free-moving robotic systems, such as locomoting humanoid robots, which are typically equipped with inertial measurements units. Free-moving robotic systems could gain the full benefits of inertial measurements if the measurement units are placed on independently orientable platforms, such as a human-like heads. We illustrate these benefits by analysing recent humanoid robots design and control approaches

Humanoid robot omnidirectional walking trajectory generation and control

Walking humanoid machines, once only seen or read in science fiction, became reality with the intensive research of the last four decades. However, there is a long way to go in the direction of technical achievements before humanoid robots can be used widely as human assistants. The design of a controller which can achieve a steady and stable walk is central in humanoid robotics. This control cannot be achieved if the reference trajectories are not generated suitably. The Zero Moment Point (ZMP) is the most widely used stability criterion for trajectory generation. The Center of Mass (CoM) reference can be obtained from the ZMP reference in a number of ways. A natural ZMP reference trajectory and a Fourier series approximation based method for computing the CoM reference from it, was previously proposed and published for the Sabanci University Robotics ReseArch Laboratory Platform (SURALP), for a straight walk. This thesis improves these techniques by modifying the straight walk reference trajectory into an omnidirectional one. The second contribution of this thesis is controller designs in order to cope with the changing slopes of the walking surface. The proposed controllers employ the trunk link rotational motion to adapt to the ground surface. A virtual pelvis link is introduced for the robots which do not posses roll and pitch axis in pelvis link. The proposed reference generation and control algorithms are tested on the humanoid robot SURALP. The experiments indicate that these methods are successful under various floor conditions

Open motion control architecture for humanoid robots

This Ph.D. thesis contributes to the development of control architecture for robots. It provides a complex study of a control systems design and makes a proposal for generalized open motion control architecture for humanoid robots. Generally speaking, the development of humanoid robots is a very complex engineering and scientific task that requires new approaches in mechanical design, electronics, software engineering and control. First of all, taking into account all these considerations, this thesis tries to answer the question of why we need the development of such robots. Further, it provides a study of the evolution of humanoid robots, as well as an analysis of modern trends. A complex study of motion, that for humanoid robots, means first of all the biped locomotion is addressed. Requirements for the design of open motion control architecture are posed. This work stresses the motion control algorithms for humanoid robots. The implementation of only servo control for some types of robots (especially for walking systems) is not sufficient. Even having stable motion pattern and well tuned joint control, a humanoid robot can fall down while walking. Therefore, these robots need the implementation of another, upper control loop which will provide the stabilization of their motion. This Ph.D. thesis proposes the study of a joint motion control problem and a new solution to walking stability problem for humanoids. A new original walking stabilization controller based on decoupled double inverted pendulum dynamical model is developed. This Ph.D. thesis proposes novel motion control software and hardware architecture for humanoid robots. The main advantage of this architecture is that it was designed by an open systems approach allowing the development of high-quality humanoid robotics platforms that are technologically up-to-date. The Rh-1 prototype of the humanoid robot was constructed and used as a test platform for implementing the concepts described in this Ph.D. thesis. Also, the implementation of walking stabilization control algorithms was made with OpenHRP platform and HRP-2 humanoid robot. The simulations and walking experiments showed favourable results not only in forward walking but also in turning and backwards walking gaits. It proved the applicability and reliability of designed open motion control architecture for humanoid robots. Finally, it should be noted that this Ph.D. thesis considers the motion control system of a humanoid robot as a whole, stresses the entire concept-design-implementation chain and develops basic guidelines for the design of open motion control architecture that can be easily implemented in other biped platforms

Humanoid Robots

For many years, the human being has been trying, in all ways, to recreate the complex mechanisms that form the human body. Such task is extremely complicated and the results are not totally satisfactory. However, with increasing technological advances based on theoretical and experimental researches, man gets, in a way, to copy or to imitate some systems of the human body. These researches not only intended to create humanoid robots, great part of them constituting autonomous systems, but also, in some way, to offer a higher knowledge of the systems that form the human body, objectifying possible applications in the technology of rehabilitation of human beings, gathering in a whole studies related not only to Robotics, but also to Biomechanics, Biomimmetics, Cybernetics, among other areas. This book presents a series of researches inspired by this ideal, carried through by various researchers worldwide, looking for to analyze and to discuss diverse subjects related to humanoid robots. The presented contributions explore aspects about robotic hands, learning, language, vision and locomotion

Software Architecture and Development for Controlling a Hubo Humanoid Robot

Due to their human-like structure, humanoid robots are capable of doing some complex tasks. Since a humanoid robot has a large number of actuators and sensors, controlling it is a difficult task. For various tasks like balancing, driving a car, and interacting with humans, real-time response of the robot is essential. Efficiently controlling a humanoid robot requires a software that guarantees real-time interface and control mechanism so that real-time response of the robot is possible. Addition- ally, to reduce the development effort and time, the software should be open-source, multi-lingual and should have high-level constructs inbuilt in it. Currently Robot Operating System (ROS) and Microsoft Robotics Developer Studio (MRDS) are most commonly used software packages for controlling robots. Since ROS uses Transmission Control Protocol (TCP) for inter-process communication, the latency in communication is high. Therefore, if ROS is used, the robot cannot respond in real-time. On the other hand, MRDS is not an open-source but a proprietary soft- ware package. Therefore it cannot be optimized for a particular robot. Thus, there is an urgent need to develop a real-time, open-source, modular, and thin software for controlling humanoid robots. This thesis describes the design and architecture of two software packages developed to fill this gap. It is expected that in the near future a large number of humanoid robots will be used all around the world. The humanoid robots will be used to perform various tasks. The developed software packages have the potential to be the most commonly used software packages for controlling humanoid robots. These packages will assist humans in controlling and monitoring humanoid robots to perform search-and-rescue operations, explore the universe, assist in household chores, etc