Development of Object-Based Teleoperator Control for Unstructured Applications

For multi-fingered end effectors in unstructured applications, the main issues are control in the presence of uncertainties and providing grasp stability and object manipulability. The suggested concept in this thesis is object based teleoperator control which provides an intuitive way to control the robot in terms of the grasped object and reduces the operator\u27s conceptual constraints. The general control law is developed using a hierarchical control structure, i.e., human interface I gross motion control level in teleoperation control and fine motion control/object grasp stability in autonomous control. The gross motion control is required to provide the position/orientation of the Super Object (SO), and the sufficient grasping force to the fine motion control. Impedance control is applied to the gross motion control to respond to the environmental forces. The fine motion control consists of serially connecting the finger in position control and the Fingertip Actuation System (FAS) in force control. The FAS has a higher bandwidth response than does the finger actuation system and operates near the center of its joint range. The finger motion controller attempts not only to track the displacement of the FAS but also to provide an FAS centering action. Simulation experiments in both gross and fine motion control are performed. The integrated gross / flue motion control is implemented using the planar configuration of PUMA 560. The results show that the desired contact force can be maintained in the direction of FAS motion. The mathematical proof of system stability and the extension to spatial systems are required to complete the research

Basic set of behaviours for programming assembly robots

We know from the well established Church-Turing thesis that any computer program­ming language needs just a limited set of commands in order to perform any computable process. However, programming in these terms is so very inconvenient that a larger set of machine codes need to be introduced and on top of these higher programming languages are erected.In Assembly Robotics we could theoretically formulate any assembly task, in terms of moves. Nevertheless, it is as tedious and error prone to program assemblies at this low level as it would be to program a computer by using just Turing Machine commands.An interesting survey carried out in the beginning of the nineties showed that the most common assembly operations in manufacturing industry cluster in just seven classes. Since the research conducted in this thesis is developed within the behaviour-based assembly paradigm which views every assembly task as the external manifestation of the execution of a behavioural module, we wonder whether there exists a limited and ergonomical set of elementary modules with which to program at least 80% of the most common operations.IIn order to investigate such a problem, we set a project in which, taking into account the statistics of the aforementioned survey, we analyze the experimental behavioural decomposition of three significant assembly tasks (two similar benchmarks, the STRASS assembly, and a family of torches). From these three we establish a basic set of such modules.The three test assemblies with which we ran the experiments can not possibly exhaust ah the manufacturing assembly tasks occurring in industry, nor can the results gathered or the speculations made represent a theoretical proof of the existence of the basic set. They simply show that it is possible to formulate different assembly tasks in terms of a small set of about 10 modules, which may be regarded as an embryo of a basic set of elementary modules.Comparing this set with Kondoleon’s tasks and with Balch’s general-purpose robot routines, we observed that ours was general enough to represent 80% of the most com­mon manufacturing assembly tasks and ergonomical enough to be easily used by human operators or automatic planners. A final discussion shows that it would be possible to base an assembly programming language on this kind of set of basic behavioural modules

Survey of Visual and Force/Tactile Control of Robots for Physical Interaction in Spain

Sensors provide robotic systems with the information required to perceive the changes that happen in unstructured environments and modify their actions accordingly. The robotic controllers which process and analyze this sensory information are usually based on three types of sensors (visual, force/torque and tactile) which identify the most widespread robotic control strategies: visual servoing control, force control and tactile control. This paper presents a detailed review on the sensor architectures, algorithmic techniques and applications which have been developed by Spanish researchers in order to implement these mono-sensor and multi-sensor controllers which combine several sensors

Objekt-Manipulation und Steuerung der Greifkraft durch Verwendung von Taktilen Sensoren

This dissertation describes a new type of tactile sensor and an improved version of the dynamic tactile sensing approach that can provide a regularly updated and accurate estimate of minimum applied forces for use in the control of gripper manipulation. The pre-slip sensing algorithm is proposed and implemented into two-finger robot gripper. An algorithm that can discriminate between types of contact surface and recognize objects at the contact stage is also proposed. A technique for recognizing objects using tactile sensor arrays, and a method based on the quadric surface parameter for classifying grasped objects is described. Tactile arrays can recognize surface types on contact, making it possible for a tactile system to recognize translation, rotation, and scaling of an object independently.Diese Dissertation beschreibt eine neue Art von taktilen Sensoren und einen verbesserten Ansatz zur dynamischen Erfassung von taktilen daten, der in regelmäßigen Zeitabständen eine genaue Bewertung der minimalen Greifkraft liefert, die zur Steuerung des Greifers nötig ist. Ein Berechnungsverfahren zur Voraussage des Schlupfs, das in einen Zwei-Finger-Greifarm eines Roboters eingebaut wurde, wird vorgestellt. Auch ein Algorithmus zur Unterscheidung von verschiedenen Oberflächenarten und zur Erkennung von Objektformen bei der Berührung wird vorgestellt. Ein Verfahren zur Objekterkennung mit Hilfe einer Matrix aus taktilen Sensoren und eine Methode zur Klassifikation ergriffener Objekte, basierend auf den Daten einer rechteckigen Oberfläche, werden beschrieben. Mit Hilfe dieser Matrix können unter schiedliche Arten von Oberflächen bei Berührung erkannt werden, was es für das Tastsystem möglich macht, Verschiebung, Drehung und Größe eines Objektes unabhängig voneinander zu erkennen

Trying to Grasp a Sketch of a Brain for Grasping

Ritter H, Haschke R, Steil JJ. Trying to Grasp a Sketch of a Brain for Grasping. In: Sendhoff B, ed. Creating Brain-Like Intelligence. Lecture Notes in Artificial Intelligence; 5436. Berlin, Heidelberg: Springer; 2009: 84-102

Graphical modelling of modular machines

This research is aimed at advancing machine design through specifying and implementing (in "proof of concept" form) a set of tools which graphically model modular machines. The tools allow mechanical building elements (or machine modules) to be selected and configured together in a highly flexible manner so that operation of the chosen configuration can be simulated and performance properties evaluated. Implementation of the tools has involved an extension in capability of a proprietary robot simulation system. This research has resulted in a general approach to graphically modelling manufacturing machines built from modular elements. A focus of study has been on a decomposition of machine functionality leading to the establishment of a library of modular machine primitives. This provides a useful source of commonly required machine building elements for use by machine designers. Study has also focussed on the generation of machine configuration tools which facilitate the construction of a simulation model and ultimately the physical machine itself. Simulation aspects of machine control are also considered which depict methods of manipulating a machine model in the simulation phase. In addition methods of achieving machine programming have been considered which specify the machine and its operational tasks. Means of adopting common information data structures are also considered which can facilitate interfacing with other systems, including the physical machine system constructed as an issue of the simulation phase. Each of these study areas is addressed in its own context, but collectively they provide a means of creating a complete modular machine design environment which can provide significant assistance to machine designers. Part of the methodology employed in the study is based on the use of the discrete event simulation technique. To easily and effectively describe a modular machine and its activity in a simulation model, a hierarchical ring and tree data structure has been designed and implemented. The modularity and reconfigurability are accommodated by the data structure, and homogeneous transformations are adopted to determine the spatial location and orientation of each of the machine elements. A three-level machine task programming approach is used to describe the machine's activities. A common data format method is used to interface the machine design environment with the physical machine and other building blocks of manufacturing systems (such as CAD systems) where systems integration approaches can lead to enhanced product realisation. The study concludes that a modular machine design environment can be created by employing the graphical simulation approach together with a set of comprehensive configuration. tools. A generic framework has been derived which outlines the way in which machine design environments can be constructed and suggestions are made as to how the proof of concept design environment implemented in this study can be advanced

Object Handovers: a Review for Robotics

This article surveys the literature on human-robot object handovers. A handover is a collaborative joint action where an agent, the giver, gives an object to another agent, the receiver. The physical exchange starts when the receiver first contacts the object held by the giver and ends when the giver fully releases the object to the receiver. However, important cognitive and physical processes begin before the physical exchange, including initiating implicit agreement with respect to the location and timing of the exchange. From this perspective, we structure our review into the two main phases delimited by the aforementioned events: 1) a pre-handover phase, and 2) the physical exchange. We focus our analysis on the two actors (giver and receiver) and report the state of the art of robotic givers (robot-to-human handovers) and the robotic receivers (human-to-robot handovers). We report a comprehensive list of qualitative and quantitative metrics commonly used to assess the interaction. While focusing our review on the cognitive level (e.g., prediction, perception, motion planning, learning) and the physical level (e.g., motion, grasping, grip release) of the handover, we briefly discuss also the concepts of safety, social context, and ergonomics. We compare the behaviours displayed during human-to-human handovers to the state of the art of robotic assistants, and identify the major areas of improvement for robotic assistants to reach performance comparable to human interactions. Finally, we propose a minimal set of metrics that should be used in order to enable a fair comparison among the approaches.Comment: Review paper, 19 page

Soft Robotics: Design for Simplicity, Performance, and Robustness of Robots for Interaction with Humans.

This thesis deals with the design possibilities concerning the next generation of advanced Robots. Aim of the work is to study, analyse and realise artificial systems that are essentially simple, performing and robust and can live and coexist with humans. The main design guideline followed in doing so is the Soft Robotics Approach, that implies the design of systems with intrinsic mechanical compliance in their architecture. The first part of the thesis addresses design of new soft robotics actuators, or robotic muscles. At the beginning are provided information about what a robotic muscle is and what is needed to realise it. A possible classification of these systems is analysed and some criteria useful for their comparison are explained. After, a set of functional specifications and parameters is identified and defined, to characterise a specific subset of this kind of actuators, called Variable Stiffness Actuators. The selected parameters converge in a data-sheet that easily defines performance and abilities of the robotic system. A complete strategy for the design and realisation of this kind of system is provided, which takes into account their me- chanical morphology and architecture. As consequence of this, some new actuators are developed, validated and employed in the execution of complex experimental tasks. In particular the actuator VSA-Cube and its add-on, a Variable Damper, are developed as the main com- ponents of a robotics low-cost platform, called VSA-CubeBot, that v can be used as an exploratory platform for multi degrees of freedom experiments. Experimental validations and mathematical models of the system employed in multi degrees of freedom tasks (bimanual as- sembly and drawing on an uneven surface), are reported. The second part of the thesis is about the design of multi fingered hands for robots. In this part of the work the Pisa-IIT SoftHand is introduced. It is a novel robot hand prototype designed with the purpose of being as easily usable, robust and simple as an industrial gripper, while exhibiting a level of grasping versatility and an aspect comparable to that of the human hand. In the thesis the main theo- retical tool used to enable such simplification, i.e. the neuroscience– based notion of soft synergies, are briefly reviewed. The approach proposed rests on ideas coming from underactuated hand design. A synthesis method to realize a desired set of soft synergies through the principled design of adaptive underactuated mechanisms, which is called the method of adaptive synergies, is discussed. This ap- proach leads to the design of hands accommodating in principle an arbitrary number of soft synergies, as demonstrated in grasping and manipulation simulations and experiments with a prototype. As a particular instance of application of the method of adaptive syner- gies, the Pisa–IIT SoftHand is then described in detail. The design and implementation of the prototype hand are shown and its effec- tiveness demonstrated through grasping experiments. Finally, control of the Pisa/IIT Hand is considered. Few different control strategies are adopted, including an experimental setup with the use of surface Electromyographic signals

A Human Gesture Mapping Method to Control a Multi‐Functional Hand for Robot‐Assisted Laparoscopic Surgery: The MUSHA Case

This work presents a novel technique to control multi-functional hand for robot-assisted laparoscopic surgery. We tested the technique using the MUSHA multi-functional hand, a robot-aided minimally invasive surgery tool with more degrees of freedom than the standard commercial end-effector of the da Vinci robot. Extra degrees of freedom require the development of a proper control strategy to guarantee high performance and avoid an increasing complexity of control consoles. However, developing reliable control algorithms while reducing the control side's mechanical complexity is still an open challenge. In the proposed solution, we present a control strategy that projects the human hand motions into the robot actuation space. The human hand motions are tracked by a LeapMotion camera and mapped into the actuation space of the virtualized end-effector. The effectiveness of the proposed method was evaluated in a twofold manner. Firstly, we verified the Lyapunov stability of the algorithm, then an user study with 10 subjects assessed the intuitiveness and usability of the system