Scaled bilateral teleoperation using discrete-time sliding mode controller

In this paper, the design of a discrete-time slidingmode controller based on Lyapunov theory is presented along with a robust disturbance observer and is applied to a piezostage for high-precision motion. A linear model of a piezostage was used with nominal parameters to compensate the disturbance acting on the system in order to achieve nanometer accuracy. The effectiveness of the controller and disturbance observer is validated in terms of closed-loop position performance for nanometer references. The control structure has been applied to a scaled bilateral structure for the custom-built telemicromanipulation setup. A piezoresistive atomic force microscope cantilever with a built-in Wheatstone bridge is utilized to achieve the nanonewtonlevel interaction forces between the piezoresistive probe tip and the environment. Experimental results are provided for the nanonewton-range force sensing, and good agreement between the experimental data and the theoretical estimates has been demonstrated. Force/position tracking and transparency between the master and the slave has been clearly demonstrated after necessary scalin

Semi-autonomous scheme for pushing micro-objects

-In many microassembly applications, it is often desirable to position and orient polygonal micro-objects lying on a planar surface. Pushing micro-objects using point contact provides more flexibility and less complexity compared to pick and place operation. Due to the fact that in micro-world surface forces are much more dominant than inertial forces and these forces are distributed unevenly, pushing through the center of mass of the micro-object will not yield a pure translational motion. In order to translate a micro-object, the line of pushing should pass through the center of friction. In this paper, a semi-autonomous scheme based on hybrid vision/force feedback is proposed to push microobjects with human assistance using a custom built telemicromanipulation setup to achieve pure translational motion. The pushing operation is divided into two concurrent processes: In one process human operator who acts as an impedance controller alters the velocity of the pusher while in contact with the micro-object through scaled bilateral teleoperation with force feedback. In the other process, the desired line of pushing for the micro-object is determined continuously using visual feedback procedures so that it always passes through the varying center of friction. Experimental results are demonstrated to prove nanoNewton range force sensing, scaled bilateral teleoperation with force feedback and pushing microobjects

Force feedback pushing scheme for micromanipulation applications

Pushing micro-objects using point contact provides more flexibility and less complexity compared to pick and place operation. Due to the fact that in micro-world surface forces are much more dominant than inertial forces and these forces are distributed unevenly, pushing through the center of mass of the micro-object may not yield a pure translational motion. In order to translate a micro-object, the line of pushing should pass through the center of friction. In this paper, a semi-autonomous scheme based on hybrid vision/force feedback procedure is proposed to push micro-objects with human assistance using a custom built tele-micromanipulation setup to achieve translational motion. In the semi-autonomous pushing process, velocity controlled pushing with force feedback is realized along x-axis by the human operator while y-axis orientation is undertaken automatically using visual feedback. This way the desired line of pushing for the micro-object is controlled to pass through the varying center of friction. Experimental results are shown to prove nano-Newton range force sensing, scaled bilateral teleoperation with force feedback and snapshot of pushing operation

Haptic feedback in teleoperation in Micro-and Nano-Worlds.

International audienceRobotic systems have been developed to handle very small objects, but their use remains complex and necessitates long-duration training. Simulators, such as molecular simulators, can provide access to large amounts of raw data, but only highly trained users can interpret the results of such systems. Haptic feedback in teleoperation, which provides force-feedback to an operator, appears to be a promising solution for interaction with such systems, as it allows intuitiveness and flexibility. However several issues arise while implementing teleoperation schemes at the micro-nanoscale, owing to complex force-fields that must be transmitted to users, and scaling differences between the haptic device and the manipulated objects. Major advances in such technology have been made in recent years. This chapter reviews the main systems in this area and highlights how some fundamental issues in teleoperation for micro- and nano-scale applications have been addressed. The chapter considers three types of teleoperation, including: (1) direct (manipulation of real objects); (2) virtual (use of simulators); and (3) augmented (combining real robotic systems and simulators). Remaining issues that must be addressed for further advances in teleoperation for micro-nanoworlds are also discussed, including: (1) comprehension of phenomena that dictate very small object (< 500 micrometers) behavior; and (2) design of intuitive 3-D manipulation systems. Design guidelines to realize an intuitive haptic feedback teleoperation system at the micro-nanoscale level are proposed

A Review of Haptic Feedback Teleoperation Systems for Micromanipulation and Microassembly

International audienceThis paper presents a review of the major haptic feedback teleoperation systems for micromanipulation. During the last decade, the handling of micrometer-sized objects has become a critical issue. Fields of application from material science to electronics demonstrate an urgent need for intuitive and flexible manipulation systems able to deal with small-scale industrial projects and assembly tasks. Two main approaches have been considered: fully automated tasks and manual operation. The first one require fully pre determined tasks, while the later necessitates highly trained operators. To overcome these issues the use of haptic feedback teleoperation where the user manipulates the tool through a joystick whilst feeling a force feedback, appears to be a promising solution as it allows high intuitiveness and flexibility. Major advances have been achieved during this last decade, starting with systems that enable the operator to feel the substrate topology, to the current state-of-the-art where 3D haptic feedback is provided to aid manipulation tasks. This paper details the major achievements and the solutions that have been developed to propose 3D haptic feedback for tools that often lack 3D force measurements. The use of virtual reality to enhance the immersion is also addressed. The strategies developed provide haptic feedback teleoperation systems with a high degree of assistance and for a wide range of micromanipulation tools. Based on this expertise on haptic for micromanipulation and virtual reality assistance it is now possible to propose microassembly systems for objects as small as 1 to 10 micrometers. This is a mature field and will benefit small-scale industrial projects where precision and flexibility in microassembly are required

Application of Simultaneous Localization and Mapping Algorithms for Haptic Teleoperation of Aerial Vehicles

In this thesis, a new type of haptic teleoperator system for remote control of Unmanned Aerial Vehicles (UAVs) has been developed, where the Simultaneous Localization and Mapping (SLAM) algorithms are implemented for the purpose of generating the haptic feedback. Specifically, the haptic feedback is provided to the human operator through interaction with artificial potential field built around the obstacles in the virtual environment which is located at the master site of the teleoperator system. The obstacles in the virtual environment replicate essential features of the actual remote environment where the UAV executes its tasks. The state of the virtual environment is generated and updated in real time using Extended Kalman Filter SLAM algorithms based on measurements performed by the UAV in the actual remote environment. Two methods for building haptic feedback from SLAM algorithms have been developed. The basic SLAM-based haptic feedback algorithm uses fixed size potential field around the obstacles, while the robust SLAM-based haptic feedback algorithm changes the size of potential field around the obstacle depending on the amount of uncertainty in obstacle location, which is represented by the covariance estimate provided by EKF. Simulations and experimental results are presented that evaluate the performance of the proposed teleoperator system

Disturbance observer based bilateral control systems

Bilateral teleoperation is becoming one of the far reaching application areas of robotics science. Enabling a human operator the ability to reach and manipulate a remote location will be possible with the various applications of bilateral control. In that sense, ideal bilateral control allows extension of a person's sensing to a remote environment by a master slave structure. So, the coupled goals of bilateral control is to enforce the slave system track the motion generated on the master system and to reflect the forces from the slave system. This thesis investigates the current state of the art in bilateral teleoperation. For that purpose, design and analysis of bilateral control is made based on the use of disturbance observers. First, a known control structure is investigated in the context of acceleration control. Following this, a case study is made to show a different application of bilateral control, namely grasping force control. Performance improvement in bilateral control is also studied and correspondingly, a novel functional observer is proposed for better estimation of velocity, acceleration and disturbance. In the second half of the thesis, bilateral control with time delay is realized. Design is made via separating the position and force into two different loops. For position control under time delay, a previously proposed control scheme is used in which use of communication disturbance observer with convergence terms was discussed. Observation made about the divergence from the master reference under contact motion is analyzed and a model following control structure is proposed to eliminate the remaining disturbance from the slave plant. For force control under time delay, first the response of a local controller is analyzed. In order to improve the system transparency, a new method is proposed in which environment stiffness was used for force control loop rather than the delayed slave force. In this structure, estimation of environment stiffness was made via an indirect adaptive control scheme. The analyzed structures were also tested experimentally under a master slave system consisting of 1 DOF linear motors. Experiments show the validity of the contributions made for bilateral control with and without time delay

Micromanipulation-force feedback pushing

In micromanipulation applications, it is often desirable to position and orient polygonal micro-objects lying on a planar surface. Pushing micro-objects using point contact provides more flexibility and less complexity compared to pick and place operation. Due to the fact that in micro-world surface forces are much more dominant than inertial forces and these forces are distributed unevenly, pushing through the center of mass of the micro-object will not yield a pure translational motion. In order to translate a micro-object, the line of pushing should pass through the center of friction. Moreover, due to unexpected nature of the frictional forces between the micro-object and substrate, the maximum force applied to the micro-object needs to be limited to prevent any damage either to the probe or micro-object. In this dissertation, a semi-autonomous manipulation scheme is proposed to push microobjects with human assistance using a custom built tele-micromanipulation setup to achieve pure translational motion. The pushing operation can be divided into two concurrent processes: In one process human operator who acts as an impedance controller to switch between force-position controllers and alters the velocity of the pusher while in contact with the micro-object through scaled bilateral teleoperation with force feedback. In the other process, the desired line of pushing for the micro-object is determined continuously so that it always passes through the varying center of friction. Visual feedback procedures are adopted to align the resultant velocity vector at the contact point to pass through the center of friction in order to achieve pure translational motion of the micro-object. Experimental results are demonstrated to prove the effectiveness of the proposed controller along with nanometer scale position control, nano-Newton range force sensing, scaled bilateral teleoperation with force feedback

Bilateral Control - Operational enhancements

A succinct definition of the word bilateral is having two sides [1]. In robotics the term bilateral control is used to define the specific interaction of two systems by means of position and/or force. Bilateral systems are composed of two sides named master and slave side. The aim of such an arrangement is such that position command dictated by master side is followed by a slave side, and at the same time the force sensation of the remote environment experienced by slave is transferred to the mater - human operator. This way bilateral system may be perceived as an “impendanceless” extension of the human operator providing the touch information of the remote (or inaccessible) environment. In a sense bilateral systems are a mechatronics extension of the teleoperated systems. There are many applications of this structure which requires critical manipulations like nuclear material handling, robotic surgery, and micro material handling and assembly. In all these applications a human operator is required to have as close to real as possible contact with object that should be manipulated or in other word the telepresence of the operator is required. In this thesis work various important aspects of bilateral control systems are discussed. These aspects include problems of (i) acquisition of information on master and slave side, (ii) analysis and selection of the proper structure of the control systems to ensure fidelity of the system behavior. The work has been done to enhance the performance of the bilateral control system by: (i) Enhancing position and velocity measurements obtained from incremental encoder having limited number of pulses per revolution. A few algorithms are investigated and their improvements are proposed; (ii) Increasing system robustness by using acceleration controller based on disturbance observer. The robust system design based on disturbance observer is known but its application requires very fast sampling and high bandwidth of the observer. In this work the discrete time realization of the observer is presented in details and selection of the necessary filters and the sampling so to achieve a good trade-off for observer realization is discussed and experimentally confirmed; (iii) Increasing the bandwidth of force sensation by using reaction force observer. For transparent operation of a bilateral system the bandwidth of force sensation is of the major interest. All force sensors do have relatively slow dynamics and observer based structures seems providing better behavior of the overall system. In this work the observer of the interaction force is examined and design procedure is established. In order to verify all of the proposed ideas a versatile bilateral system is designed and built and experimental verification is carried out on this system