Haptic feedback in teleoperation in Micro-and Nano-Worlds.

International audienceRobotic systems have been developed to handle very small objects, but their use remains complex and necessitates long-duration training. Simulators, such as molecular simulators, can provide access to large amounts of raw data, but only highly trained users can interpret the results of such systems. Haptic feedback in teleoperation, which provides force-feedback to an operator, appears to be a promising solution for interaction with such systems, as it allows intuitiveness and flexibility. However several issues arise while implementing teleoperation schemes at the micro-nanoscale, owing to complex force-fields that must be transmitted to users, and scaling differences between the haptic device and the manipulated objects. Major advances in such technology have been made in recent years. This chapter reviews the main systems in this area and highlights how some fundamental issues in teleoperation for micro- and nano-scale applications have been addressed. The chapter considers three types of teleoperation, including: (1) direct (manipulation of real objects); (2) virtual (use of simulators); and (3) augmented (combining real robotic systems and simulators). Remaining issues that must be addressed for further advances in teleoperation for micro-nanoworlds are also discussed, including: (1) comprehension of phenomena that dictate very small object (< 500 micrometers) behavior; and (2) design of intuitive 3-D manipulation systems. Design guidelines to realize an intuitive haptic feedback teleoperation system at the micro-nanoscale level are proposed

A Review of Haptic Feedback Teleoperation Systems for Micromanipulation and Microassembly

International audienceThis paper presents a review of the major haptic feedback teleoperation systems for micromanipulation. During the last decade, the handling of micrometer-sized objects has become a critical issue. Fields of application from material science to electronics demonstrate an urgent need for intuitive and flexible manipulation systems able to deal with small-scale industrial projects and assembly tasks. Two main approaches have been considered: fully automated tasks and manual operation. The first one require fully pre determined tasks, while the later necessitates highly trained operators. To overcome these issues the use of haptic feedback teleoperation where the user manipulates the tool through a joystick whilst feeling a force feedback, appears to be a promising solution as it allows high intuitiveness and flexibility. Major advances have been achieved during this last decade, starting with systems that enable the operator to feel the substrate topology, to the current state-of-the-art where 3D haptic feedback is provided to aid manipulation tasks. This paper details the major achievements and the solutions that have been developed to propose 3D haptic feedback for tools that often lack 3D force measurements. The use of virtual reality to enhance the immersion is also addressed. The strategies developed provide haptic feedback teleoperation systems with a high degree of assistance and for a wide range of micromanipulation tools. Based on this expertise on haptic for micromanipulation and virtual reality assistance it is now possible to propose microassembly systems for objects as small as 1 to 10 micrometers. This is a mature field and will benefit small-scale industrial projects where precision and flexibility in microassembly are required

Bilaterally controlled micromanipulation by pushing in 1-D with nano-Newton scale force feedback

In this thesis the focus is on mechanical micromanipulation which means manipulation of micro objects using mechanical tools. Pushing is a type of motion of the micro parts and pushing ability on micro scale is inevitable for many applications such as micro assembly of systems or characterization of tribological properties of micro scale things. The aim of the work in this thesis was to obtain an improved performance in 1-D pushing of micrometer scaled objects in the sense of giving more control to human operator where it allows human intervention via bilateral control with force feedback in nano-Newton scale. For this purpose a system which can practice 1-D pushing of micrometer scaled objects by human operator is built. A bilateral architecture which is composed of master and slave sides has been used in the system. The micrometer scaled object is pushed by the piezoactuator which constitutes the slave side and the master side is a DC motor where the shaft is turned by the human operator via a rectangular prism rod. This system can be considered as an improved system comparing with the ones in literature, since it has a number of different advantages together. One of them is the ability to calibrate the relation between the movement of the slave system and the cycle that is made by the DC motor shaft which is controlled by the operator. This gives the availability to decide how sensitive will the slave side motion be to the master side motion. Moreover, thanks to the nano-Newton scale force sensing ability of the system user has the chance to use this as a force feedback within the bilateral structure, where by the way the operator will understand when the piezoresistive cantilever beam touched the object that is going to be pushed by it. The operator also understands when there is an obstacle or opposite force that keeps the object from continuing on its track

Micromanipulation-force feedback pushing

In micromanipulation applications, it is often desirable to position and orient polygonal micro-objects lying on a planar surface. Pushing micro-objects using point contact provides more flexibility and less complexity compared to pick and place operation. Due to the fact that in micro-world surface forces are much more dominant than inertial forces and these forces are distributed unevenly, pushing through the center of mass of the micro-object will not yield a pure translational motion. In order to translate a micro-object, the line of pushing should pass through the center of friction. Moreover, due to unexpected nature of the frictional forces between the micro-object and substrate, the maximum force applied to the micro-object needs to be limited to prevent any damage either to the probe or micro-object. In this dissertation, a semi-autonomous manipulation scheme is proposed to push microobjects with human assistance using a custom built tele-micromanipulation setup to achieve pure translational motion. The pushing operation can be divided into two concurrent processes: In one process human operator who acts as an impedance controller to switch between force-position controllers and alters the velocity of the pusher while in contact with the micro-object through scaled bilateral teleoperation with force feedback. In the other process, the desired line of pushing for the micro-object is determined continuously so that it always passes through the varying center of friction. Visual feedback procedures are adopted to align the resultant velocity vector at the contact point to pass through the center of friction in order to achieve pure translational motion of the micro-object. Experimental results are demonstrated to prove the effectiveness of the proposed controller along with nanometer scale position control, nano-Newton range force sensing, scaled bilateral teleoperation with force feedback

Bilateral Macro-Micro Teleoperation Using A Magnetic Actuation Mechanism

In recent years, there has been increasing interest in the advancement of microrobotic systems in micro-engineering, micro-fabrication, biological research and biomedical applications. Untethered magnetic-based microrobotic systems are one of the most widely developing groups of microrobotic systems that have been extensively explored for biological and biomedical micro-manipulations. These systems show promise in resolving problems related to on-board power supply limitations as well as mechanical contact sealing and lubrication. In this thesis, a high precision magnetic untethered microrobotic system is demonstrated for micro-handling tasks. A key aspect of the proposed platform concerns the integration of magnetic levitation technology and bilateral macro-micro teleoperation for human intervention to avoid imperceptible failures in poorly observed micro-domain environments. The developed platform has three basic subsystems: a magnetic untethered microrobotic system (MUMS), a haptic device, and a scaled bilateral teleoperation system. The MUMS produces and regulates a magnetic field for non-contact propelling of a microrobot. In order to achieve a controlled motion of the magnetically levitated microrobot, a mathematical force model of the magnetic propulsion mechanism is developed and used to design various control systems. In the workspace of 30 × 32 × 32 mm 3, both PID and LQG\LTR controllers perform similarly the position accuracy of 10 µ m in a vertical direction and 2 µ m in a horizontal motion. The MUMS is equipped with an eddy-current damper to enhance its inherent damping factor in the microrobot's horizontal motions. This paper deals with the modeling and analysis of an eddy-current damper that is formed by a conductive plate placed below the levitated microrobot to overcome inherent dynamical vibrations and improve motion precision. The modeling of eddy-current distribution in the conductive plate is investigated by solving the diffusion equation for vector magnetic potential, and an analytical expression for the horizontal damping force is presented and experimentally validated. It is demonstrated that eddy-current damping is a crucial technique for increasing the damping coefficient in a non-contact way and for improving levitation performance. The damping can be widely used in applications of magnetic actuation systems in micro-manipulation and micro-fabrication. To determine the position of the microrobot in a workspace, the MUMS uses high-accuracy laser sensors. However, laser positioning techniques can only be used in highly transparent environments. A novel technique based on real-time magnetic flux measurement has been proposed for the position estimation of the microrobot in case of laser beam blockage, whereby a combination of Hall-effect sensors is employed to find the microrobot's position in free motion by using the produced magnetic flux. In free motion, the microrobot tends to move toward the horizontally zero magnetic field gradient, Bmax location. As another key feature of the magnetic flux measurement, it was realized that the applied force from the environment to the microrobot can be estimated as linearly proportional to the distance of the microrobot from the Bmax location. The developed micro-domain force estimation method is verified experimentally with an accuracy of 1.27 µ N. A bilateral macro-micro teleoperation technique is employed in the MUMS for the telepresence of a human operator in the task environment. A gain-switching position-position teleoperation scheme is employed and a human operator controls the motion of the microrobot via a master manipulator for dexterous micro-manipulation tasks. The operator can sense a strong force during micro-domain tasks if the microrobot encounters a stiff environment, and the effect of hard contact is fed back to the operator's hand. The position-position method works for both free motion and hard contact. However, to enhance the feeling of a micro-domain environment in the human operator, the scaled force must be transferred to a human, thereby realizing a direct-force-reflection bilateral teleoperation. Additionally, a human-assisted virtual reality interface is developed to improve a human operator's skills in using the haptic-enabled platform, before carrying out an actual dexterous task.1 yea

Hybrid optical and magnetic manipulation of microrobots

Microrobotic systems have the potential to provide precise manipulation on cellular level for diagnostics, drug delivery and surgical interventions. These systems vary from tethered to untethered microrobots with sizes below a micrometer to a few microns. However, their main disadvantage is that they do not have the same capabilities in terms of degrees-of-freedom, sensing and control as macroscale robotic systems. In particular, their lack of on-board sensing for pose or force feedback, their control methods and interface for automated or manual user control are limited as well as their geometry has few degrees-of-freedom making three-dimensional manipulation more challenging. This PhD project is on the development of a micromanipulation framework that can be used for single cell analysis using the Optical Tweezers as well as a combination of optical trapping and magnetic actuation for recon gurable microassembly. The focus is on untethered microrobots with sizes up to a few tens of microns that can be used in enclosed environments for ex vivo and in vitro medical applications. The work presented investigates the following aspects of microrobots for single cell analysis: i) The microfabrication procedure and design considerations that are taken into account in order to fabricate components for three-dimensional micromanipulation and microassembly, ii) vision-based methods to provide 6-degree-offreedom position and orientation feedback which is essential for closed-loop control, iii) manual and shared control manipulation methodologies that take into account the user input for multiple microrobot or three-dimensional microstructure manipulation and iv) a methodology for recon gurable microassembly combining the Optical Tweezers with magnetic actuation into a hybrid method of actuation for microassembly.Open Acces

Workshop on "Control issues in the micro / nano - world".

International audienceDuring the last decade, the need of systems with micro/nanometers accuracy and fast dynamics has been growing rapidly. Such systems occur in applications including 1) micromanipulation of biological cells, 2) micrassembly of MEMS/MOEMS, 3) micro/nanosensors for environmental monitoring, 4) nanometer resolution imaging and metrology (AFM and SEM). The scale and requirement of such systems present a number of challenges to the control system design that will be addressed in this workshop. Working in the micro/nano-world involves displacements from nanometers to tens of microns. Because of this precision requirement, environmental conditions such as temperature, humidity, vibration, could generate noise and disturbance that are in the same range as the displacements of interest. The so-called smart materials, e.g., piezoceramics, magnetostrictive, shape memory, electroactive polymer, have been used for actuation or sensing in the micro/nano-world. They allow high resolution positioning as compared to hinges based systems. However, these materials exhibit hysteresis nonlinearity, and in the case of piezoelectric materials, drifts (called creep) in response to constant inputs In the case of oscillating micro/nano-structures (cantilever, tube), these nonlinearities and vibrations strongly decrease their performances. Many MEMS and NEMS applications involve gripping, feeding, or sorting, operations, where sensor feedback is necessary for their execution. Sensors that are readily available, e.g., interferometer, triangulation laser, and machine vision, are bulky and expensive. Sensors that are compact in size and convenient for packaging, e.g., strain gage, piezoceramic charge sensor, etc., have limited performance or robustness. To account for these difficulties, new control oriented techniques are emerging, such as[d the combination of two or more ‘packageable' sensors , the use of feedforward control technique which does not require sensors, and the use of robust controllers which account the sensor characteristics. The aim of this workshop is to provide a forum for specialists to present and overview the different approaches of control system design for the micro/nano-world and to initiate collaborations and joint projects

KiloHertz Bandwidth, Dual-Stage Haptic Device Lets You Touch Brownian Motion

This paper describes a haptic interface that has a uniform response over the entire human tactile frequency range. Structural mechanics makes it very difficult to implement articulated mechanical systems that can transmit high frequency signals. Here, we separated the frequency range into two frequency bands. The lower band is within the first structural mode of the corresponding haptic device while the higher one can be transmitted accurately by a fast actuator operating from conservation of momentum, that is, without reaction forces to the ground. To couple the two systems, we adopted a channel separation approach akin to that employed in the design of acoustic reproduction systems. The two channels are recombined at the tip of the device to give a uniform frequency response from DC to one kHz. In terms of mechanical design, the high-frequency transducer was embedded inside the tip of the main stage so that during operation, the human operator has only to interact with a single finger interface. In order to exemplify the type of application that would benefit from this kind of interface, we applied it to the haptic exploration with microscopic scales objects which are known to behave with very fast dynamics. The novel haptic interface was bilaterally coupled with a micromanipulation platform to demonstrate its capabilities. Operators could feel interaction forces arising from contact as well as those resulting from Brownian motion and could manoeuvre a micro bead in the absence of vision