Development of an intelligent object for grasp and manipulation research

Kõiva R, Haschke R, Ritter H. Development of an intelligent object for grasp and manipulation research. Presented at the ICAR 2011, Tallinn, Estonia.In this paper we introduce a novel device, called iObject, which is equipped with tactile and motion tracking sensors that allow for the evaluation of human and robot grasping and manipulation actions. Contact location and contact force, object acceleration in space (6D) and orientation relative to the earth (3D magnetometer) are measured and transmitted wirelessly over a Bluetooth connection. By allowing human-human, human-robot and robot-robot comparisons to be made, iObject is a versatile tool for studying manual interaction. To demonstrate the efficiency and flexibility of iObject for the study of bimanual interactions, we report on a physiological experiment and evaluate the main parameters of the considered dual-handed manipulation task

An integrated dexterous robotic testbed for space applications

An integrated dexterous robotic system was developed as a testbed to evaluate various robotics technologies for advanced space applications. The system configuration consisted of a Utah/MIT Dexterous Hand, a PUMA 562 arm, a stereo vision system, and a multiprocessing computer control system. In addition to these major subsystems, a proximity sensing system was integrated with the Utah/MIT Hand to provide capability for non-contact sensing of a nearby object. A high-speed fiber-optic link was used to transmit digitized proximity sensor signals back to the multiprocessing control system. The hardware system was designed to satisfy the requirements for both teleoperated and autonomous operations. The software system was designed to exploit parallel processing capability, pursue functional modularity, incorporate artificial intelligence for robot control, allow high-level symbolic robot commands, maximize reusable code, minimize compilation requirements, and provide an interactive application development and debugging environment for the end users. An overview is presented of the system hardware and software configurations, and implementation is discussed of subsystem functions

Dexterous manipulation of unknown objects using virtual contact points

The manipulation of unknown objects is a problem of special interest in robotics since it is not always possible to have exact models of the objects with which the robot interacts. This paper presents a simple strategy to manipulate unknown objects using a robotic hand equipped with tactile sensors. The hand configurations that allow the rotation of an unknown object are computed using only tactile and kinematic information, obtained during the manipulation process and reasoning about the desired and real positions of the fingertips during the manipulation. This is done taking into account that the desired positions of the fingertips are not physically reachable since they are located in the interior of the manipulated object and therefore they are virtual positions with associated virtual contact points. The proposed approach was satisfactorily validated using three fingers of an anthropomorphic robotic hand (Allegro Hand), with the original fingertips replaced by tactile sensors (WTS-FT). In the experimental validation, several everyday objects with different shapes were successfully manipulated, rotating them without the need of knowing their shape or any other physical property.Peer ReviewedPostprint (author's final draft

Impact of end effector technology on telemanipulation performance

Generic requirements for end effector design are briefly summarized as derived from generic functional and operational requirements. Included is a brief summary of terms and definitions related to end effector technology. The second part contains a brief overview of end effector technology work as JPL during the past ten years, with emphasis on the evolution of new mechanical, sensing and control capabilities of end effectors. The third and major part is devoted to the description of current end effector technology. The ongoing work addresses mechanical, sensing and control details with emphasis on mechanical ruggedness, increased resolution in sensing, and close electronic and control integration with overall telemanipulator control system

Ground Robotic Hand Applications for the Space Program study (GRASP)

This document reports on a NASA-STDP effort to address research interests of the NASA Kennedy Space Center (KSC) through a study entitled, Ground Robotic-Hand Applications for the Space Program (GRASP). The primary objective of the GRASP study was to identify beneficial applications of specialized end-effectors and robotic hand devices for automating any ground operations which are performed at the Kennedy Space Center. Thus, operations for expendable vehicles, the Space Shuttle and its components, and all payloads were included in the study. Typical benefits of automating operations, or augmenting human operators performing physical tasks, include: reduced costs; enhanced safety and reliability; and reduced processing turnaround time

ROTEX-TRIIFEX: Proposal for a joint FRG-USA telerobotic flight experiment

The concepts and main elements of a RObot Technology EXperiment (ROTEX) proposed to fly with the next German spacelab mission, D2, are presented. It provides a 1 meter size, six axis robot inside a spacelab rack, equipped with a multisensory gripper (force-torque sensors, an array of range finders, and mini stereo cameras). The robot will perform assembly and servicing tasks in a generic way, and will grasp a floating object. The man machine and supervisory control concepts for teleoperation from the spacelab and from ground are discussed. The predictive estimation schemes for an extensive use of time-delay compensating 3D computer graphics are explained

Local sensory control of a dexterous end effector

A numerical scheme was developed to solve the inverse kinematics for a user-defined manipulator. The scheme was based on a nonlinear least-squares technique which determines the joint variables by minimizing the difference between the target end effector pose and the actual end effector pose. The scheme was adapted to a dexterous hand in which the joints are either prismatic or revolute and the fingers are considered open kinematic chains. Feasible solutions were obtained using a three-fingered dexterous hand. An algorithm to estimate the position and orientation of a pre-grasped object was also developed. The algorithm was based on triangulation using an ideal sensor and a spherical object model. By choosing the object to be a sphere, only the position of the object frame was important. Based on these simplifications, a minimum of three sensors are needed to find the position of a sphere. A two dimensional example to determine the position of a circle coordinate frame using a two-fingered dexterous hand was presented

Grasping With Mechanical Intelligence

Many robotic hands have been designed and a number have been built. Because of the difficulty of controlling and using complex hands, which usually have nine or more degrees of freedom, the simple one- or two-degree-of-freedom gripper is still the most common robotic end effector. This thesis presents a new category of device: a medium-complexity end effector. With three to five degrees of freedom, such a tool is much easier to control and use, as well as more economical, compact and lightweight than complex hands. In order to increase the versatility, it was necessary to identify grasping primitives and to implement them in the mechanism. In addition, power and enveloping grasps are stressed over fingertip and precision grasps. The design is based upon analysis of object apprehension types, requisite characteristics for active sensing, and a determination of necessary environmental interactions. Contained in this thesis are the general concepts necessary to the design of a medium-complexity end effector, an analysis of typica.1 performance, and a computer simulation of a grasp planning algorithm specific to this type of mechanism. Finally, some details concerning the UPenn Hand - a tool designed for the research laboratory - are presented

A Mechanical Hand-Tracking System with Tactile Feedback Designed for Telemanipulation

: In this paper, we present a mechanical hand-tracking system with tactile feedback designed for fine manipulation in teleoperation scenarios. Alternative tracking methods based on artificial vision and data gloves have become an asset for virtual reality interaction. Yet, occlusions, lack of precision, and the absence of effective haptic feedback beyond vibrotactile still appear as a limit for teleoperation applications. In this work, we propose a methodology to design a linkage mechanism for hand pose tracking purposes, preserving complete finger mobility. Presentation of the method is followed by design and implementation of a working prototype, and by evaluation of the tracking accuracy using optical markers. Moreover, a teleoperation experiment involving a dexterous robotic arm and hand was proposed to ten participants. It investigated the effectiveness and repeatability of the hand tracking with combined haptic feedback during a proposed pick and place manipulation tasks

A Novel Minimally Invasive Tumour Localization Device

Lung cancer is one of the leading causes of death, by cancer. The usual treatment is surgical resection of tumours. However, patients who are weak or have poor pulmonary function are deemed unfit for surgery. For these patients, a minimally-invasive approach is desired. A major problem associated with minimally-invasive approaches is tumour localization in real time and accurate measurement of tool--tissue forces. This thesis describes the design, analysis, manufacturing and validation of a minimally-invasive instrument for tumour localization, named Palpatron. The instrument has an end effector that is able to support two previously designed jaws, one containing an ultrasound sensor and the other a tactile sensor. The jaws can move with two degrees of freedom to palpate tissue and rotate about the central axis of the instrument. The Palpatron has uncoupled jaw motion that allows for optimal alignment of sensors to improve data acquisition. The instrument can be easily assembled and disassembled allowing it to be cleaned and sterilized. The mechanism is articulated using push rods, each actuated by a motor. A semi-automatic control system was created for palpation. It is composed of a microcontroller that controls four motors via serial communication. In addition, the Palpatron has the ability to prevent tissue damage by measuring tool--tissue forces. Finite element analysis was used to guide material selection for designed components. Grade 5 titanium was selected for end effector links to provide a factor of safety of 1.2 against yielding under a 10 N point load at the tip of a jaw. The design was fabricated and validated by conducting experiments to test articulation and load carrying capacity. An 8-N force was applied to the instrument, which was successfully supported. The semi-automatic control system was used to perform basic maneuvering tasks to verify jaw motion capabilities. With positive testing results, the Palpatron forms the next step towards a comprehensive robotic-assisted palpation technology