Visual Servoing in Robotics

Visual servoing is a well-known approach to guide robots using visual information. Image processing, robotics, and control theory are combined in order to control the motion of a robot depending on the visual information extracted from the images captured by one or several cameras. With respect to vision issues, a number of issues are currently being addressed by ongoing research, such as the use of different types of image features (or different types of cameras such as RGBD cameras), image processing at high velocity, and convergence properties. As shown in this book, the use of new control schemes allows the system to behave more robustly, efficiently, or compliantly, with fewer delays. Related issues such as optimal and robust approaches, direct control, path tracking, or sensor fusion are also addressed. Additionally, we can currently find visual servoing systems being applied in a number of different domains. This book considers various aspects of visual servoing systems, such as the design of new strategies for their application to parallel robots, mobile manipulators, teleoperation, and the application of this type of control system in new areas

Polytopic Model Based Interaction Control for Soft Tissue Manipulation

Reliable force control is one of the key components of modern robotic teleoperation. The performance of these systems in terms of safety and stability largely depends on the controller design, as it is desired to account for various disturbing conditions, such as uncertainties of the model parameters or latency-induced problems. This work presents a polytopic qLPV model derived from a previously verified nonlinear soft tissue model, along with a model-based force control scheme that involves a tensor product polytopic state feedback controller. The derivation is based on the Tensor Product (TP) Model Transformation. The proposed force control scheme is verified and evaluated through numerical simulations. Index Terms—Soft tissue modeling, telesurgery control, Polytopic model based control, TP Model Transformation, qLPV modeling, LMI-based controller design

Human-robot cooperation for robust surface treatment using non-conventional sliding mode control

© 2018 ISA This work presents a human-robot closely collaborative solution to cooperatively perform surface treatment tasks such as polishing, grinding, deburring, etc. The method considers two force sensors attached to the manipulator end-effector and tool: one sensor is used to properly accomplish the surface treatment task, while the second one is used by the operator to guide the robot tool. The proposed scheme is based on task priority and adaptive non-conventional sliding mode control. The applicability of the proposed approach is substantiated by experimental results using a redundant 7R manipulator: the Sawyer cobot

Human-robot collaboration for safe object transportation using force feedback

[EN] This work presents an approach based on multi-task, non-conventional sliding mode control and admittance control for human-robot collaboration aimed at handling applications using force feedback. The proposed robot controller is based on three tasks with different priority levels in order to cooperatively perform the safe transportation of an object with a human operator. In particular, a high-priority task is developed using non-conventional sliding mode control to guarantee safe reference parameters imposed by the task, e.g., keeping a load at a desired orientation (to prevent spill out in the case of liquids, or to reduce undue stresses that may compromise fragile items). Moreover, a second task based on a hybrid admittance control algorithm is used for the human operator to guide the robot by means of a force sensor located at the robot tool. Finally, a third low-priority task is considered for redundant robots in order to use the remaining degrees of freedom of the robot to achieve a pre-set secondary goal (e.g., singularity avoidance, remaining close to a homing configuration for increased safety, etc.) by means of the gradient projection method. The main advantages of the proposed method are robustness and low computational cost. The applicability and effectiveness of the proposed approach are substantiated by experimental results using a redundant 7R manipulator: the Sawyer collaborative robot. (C) 2018 Elsevier B.V. All rights reserved.This work was supported in part by the Spanish Government under Project DPI2017-87656-C2-1-R, and the Generalitat Valenciana under Grants VALi+d APOSTD/2016/044 and BEST/2017/029.Solanes Galbis, JE.; Gracia Calandin, LI.; Muñoz-Benavent, P.; Valls Miro, J.; Carmichael, MG.; Tornero Montserrat, J. (2018). Human-robot collaboration for safe object transportation using force feedback. Robotics and Autonomous Systems. 107:196-208. https://doi.org/10.1016/j.robot.2018.06.003S19620810

Human-robot cooperation for robust surface treatment using non-conventional sliding mode control

[EN] This work presents a human-robot closely collaborative solution to cooperatively perform surface treatment tasks such as polishing, grinding, deburring, etc. The method considers two force sensors attached to the manipulator end-effector and tool: one sensor is used to properly accomplish the surface treatment task, while the second one is used by the operator to guide the robot tool. The proposed scheme is based on task priority and adaptive non-conventional sliding mode control. The applicability of the proposed approach is substantiated by experimental results using a redundant 7R manipulator: the Sawyer cobot.This work was supported in part by the Spanish Government under the project DPI2017-87656-C2-1-R and the Generalitat Valenciana under Grants VALi + d APOSTD/2016/044 and APOSTD/2017/055.Solanes Galbis, JE.; Gracia Calandin, LI.; Muñoz-Benavent, P.; Valls Miro, J.; Girbés, V.; Tornero Montserrat, J. (2018). Human-robot cooperation for robust surface treatment using non-conventional sliding mode control. ISA Transactions. 80(1):528-541. https://doi.org/10.1016/j.isatra.2018.05.013S52854180

Towards Developing Gripper to obtain Dexterous Manipulation

Artificial hands or grippers are essential elements in many robotic systems, such as, humanoid, industry, social robot, space robot, mobile robot, surgery and so on. As humans, we use our hands in different ways and can perform various maneuvers such as writing, altering posture of an object in-hand without having difficulties. Most of our daily activities are dependent on the prehensile and non-prehensile capabilities of our hand. Therefore, the human hand is the central motivation of grasping and manipulation, and has been explicitly studied from many perspectives such as, from the design of complex actuation, synergy, use of soft material, sensors, etc; however to obtain the adaptability to a plurality of objects along with the capabilities of in-hand manipulation of our hand in a grasping device is not easy, and not fully evaluated by any developed gripper. Industrial researchers primarily use rigid materials and heavy actuators in the design for repeatability, reliability to meet dexterity, precision, time requirements where the required flexibility to manipulate object in-hand is typically absent. On the other hand, anthropomorphic hands are generally developed by soft materials. However they are not deployed for manipulation mainly due to the presence of numerous sensors and consequent control complexity of under-actuated mechanisms that significantly reduce speed and time requirements of industrial demand. Hence, developing artificial hands or grippers with prehensile capabilities and dexterity similar to human like hands is challenging, and it urges combined contributions from multiple disciplines such as, kinematics, dynamics, control, machine learning and so on. Therefore, capabilities of artificial hands in general have been constrained to some specific tasks according to their target applications, such as grasping (in biomimetic hands) or speed/precision in a pick and place (in industrial grippers). Robotic grippers developed during last decades are mostly aimed to solve grasping complexities of several objects as their primary objective. However, due to the increasing demands of industries, many issues are rising and remain unsolved such as in-hand manipulation and placing object with appropriate posture. Operations like twisting, altering orientation of object within-hand, require significant dexterity of the gripper that must be achieved from a compact mechanical design at the first place. Along with manipulation, speed is also required in many robotic applications. Therefore, for the available speed and design simplicity, nonprehensile or dynamic manipulation is widely exploited. The nonprehensile approach however, does not focus on stable grasping in general. Also, nonprehensile or dynamic manipulation often exceeds robot\u2019s kinematic workspace, which additionally urges installation of high speed feedback and robust control. Hence, these approaches are inapplicable especially when, the requirements are grasp oriented such as, precise posture change of a payload in-hand, placing payload afterward according to a strict final configuration. Also, addressing critical payload such as egg, contacts (between gripper and egg) cannot be broken completely during manipulation. Moreover, theoretical analysis, such as contact kinematics, grasp stability cannot predict the nonholonomic behaviors, and therefore, uncertainties are always present to restrict a maneuver, even though the gripper is capable of doing the task. From a technical point of view, in-hand manipulation or within-hand dexterity of a gripper significantly isolates grasping and manipulation skills from the dependencies on contact type, a priory knowledge of object model, configurations such as initial or final postures and also additional environmental constraints like disturbance, that may causes breaking of contacts between object and finger. Hence, the property (in-hand manipulation) is important for a gripper in order to obtain human hand skill. In this research, these problems (to obtain speed, flexibility to a plurality of grasps, within-hand dexterity in a single gripper) have been tackled in a novel way. A gripper platform named Dexclar (DEXterous reConfigurable moduLAR) has been developed in order to study in-hand manipulation, and a generic spherical payload has been considered at the first place. Dexclar is mechanism-centric and it exploits modularity and reconfigurability to the aim of achieving within-hand dexterity rather than utilizing soft materials. And hence, precision, speed are also achievable from the platform. The platform can perform several grasps (pinching, form closure, force closure) and address a very important issue of releasing payload with final posture/ configuration after manipulation. By exploiting 16 degrees of freedom (DoF), Dexclar is capable to provide 6 DoF motions to a generic spherical or ellipsoidal payload. And since a mechanism is reliable, repeatable once it has been properly synthesized, precision and speed are also obtainable from them. Hence Dexclar is an ideal starting point to study within-hand dexterity from kinematic point of view. As the final aim is to develop specific grippers (having the above capabilities) by exploiting Dexclar, a highly dexterous but simply constructed reconfigurable platform named VARO-fi (VARiable Orientable fingers with translation) is proposed, which can be used as an industrial end-effector, as well as an alternative of bio-inspired gripper in many robotic applications. The robust four fingered VARO-fi addresses grasp, in-hand manipulation and release (payload with desired configuration) of plurality of payloads, as demonstrated in this thesis. Last but not the least, several tools and end-effectors have been constructed to study prehensile and non-prehensile manipulation, thanks to Bayer Robotic challenge 2017, where the feasibility and their potentiality to use them in an industrial environment have been validated. The above mentioned research will enhance a new dimension for designing grippers with the properties of dexterity and flexibility at the same time, without explicit theoretical analysis, algorithms, as those are difficult to implement and sometime not feasible for real system

An Energy Efficient Electro-Hydraulic Control System For A Collaborative Humanoid Robot

DissertationThis study presents the design of an energy efficient electro-hydraulic control system for a collaborative humanoid robot. Robots can be found in almost every aspect of our lives with different applications such as manufacturing, construction, agriculture, surgery, and transportation. The need for robots is on the rise as they perform certain tasks much faster and with more precision than humans. The lack of them having cognitive ability limits them in certain tasks as human interaction is often needed. Humans are currently better than robots in performing some tasks such as decision making and problem solving. In collaborative robotics, humans and robots are required to work together to achieve a common goal. In most cases, this is achieved by confining both entities in the same space. This allows for better accuracy for these robots with the flexibility and cognition of humans. Furthermore, research lately shows an increase in robots that use hydraulics with most showing that these hydraulics have energy saving abilities in robotic actuation. It is known that hydraulics have a high power to weight ratio thus allowing for more powerful yet compact robots to be built. An electro-hydraulic control system is thus described in this research in which the system allows the human user to manipulate the robot by having it mimic the user’s moves. This approach allows the user to not do any strenuous activities while the robot does the heavy lifting. Furthermore, the system does not need to be reprogrammed for a new task therefore reducing the reconfiguration time of the system. The proposed approach further allows the robot to work in hazardous situations while the user is in a safe environment. The system uses a proportional-integral-derivative (PID) algorithm to control a hydraulic cylinder allowing it to move with the user. Experiments performed to validate the study shows the reaction time as well as energy saving abilities of the system. Additionally, the results show that hydraulic systems have the ability to save energy during stall as well as increasing power density of the robot. Furthermore, an improved response time was recorded for the hydraulic system when being controlled by a remote operator