135 research outputs found
Visual Servoing
The goal of this book is to introduce the visional application by excellent researchers in the world currently and offer the knowledge that can also be applied to another field widely. This book collects the main studies about machine vision currently in the world, and has a powerful persuasion in the applications employed in the machine vision. The contents, which demonstrate that the machine vision theory, are realized in different field. For the beginner, it is easy to understand the development in the vision servoing. For engineer, professor and researcher, they can study and learn the chapters, and then employ another application method
Novel estimation and control techniques in micromanipulation using vision and force feedback
With the recent advances in the fields of micro and nanotechnology, there has been growing interest for complex micromanipulation and microassembly strategies. Despite the fact that many commercially available micro devices such as the key components in automobile airbags, ink-jet printers and projection display systems are currently produced in a batch technique with little assembly, many other products such as read/write heads for hard disks and fiber optics assemblies require flexible precision assemblies. Furthermore, many biological micromanipulations such as invitro-fertilization, cell characterization and treatment rely on the ability of human operators. Requirement of high-precision, repeatable and financially viable operations in these tasks has given rise to the elimination of direct human involvement, and autonomy in micromanipulation and microassembly. In this thesis, a fully automated dexterous micromanipulation strategy based on vision and force feedback is developed. More specifically, a robust vision based control architecture is proposed and implemented to compensate errors due to the uncertainties about the position, behavior and shape of the microobjects to be manipulated. Moreover, novel estimators are designed to identify the system and to characterize the mechanical properties of the biological structures through a synthesis of concepts from the computer vision, estimation and control theory. Estimated mechanical parameters are utilized to reconstruct the imposed force on a biomembrane and to provide the adequate information to control the position, velocity and acceleration of the probe without damaging the cell/tissue during an injection task
Hybrid optical and magnetic manipulation of microrobots
Microrobotic systems have the potential to provide precise manipulation on cellular level for diagnostics, drug delivery and surgical interventions. These systems vary from tethered to untethered microrobots with sizes below a micrometer to a few microns. However, their main disadvantage is that they do not have the same capabilities in terms of degrees-of-freedom, sensing and control as macroscale robotic systems. In particular, their lack of on-board
sensing for pose or force feedback, their control methods and interface for automated or manual user control are limited as well as their geometry has
few degrees-of-freedom making three-dimensional manipulation more challenging.
This PhD project is on the development of a micromanipulation framework that can be used for single cell analysis using the Optical Tweezers as well as a combination of optical trapping and magnetic actuation
for recon gurable microassembly. The focus is on untethered microrobots with sizes up to a few tens of microns that can be used in enclosed environments for ex vivo and in vitro medical applications. The work presented investigates the following aspects of microrobots for single cell analysis: i) The microfabrication procedure and design considerations that are taken into account in order to fabricate components for three-dimensional micromanipulation and microassembly, ii) vision-based methods to provide 6-degree-offreedom position and orientation feedback which is essential for closed-loop control, iii) manual and shared control manipulation methodologies that take into account the user input for multiple microrobot or three-dimensional microstructure manipulation and iv) a methodology for recon gurable microassembly combining the Optical Tweezers with magnetic actuation into a hybrid method of actuation for microassembly.Open Acces
The optimal use of vision as part of the manipulation of micron-sized objects
This project concerns the development and integration of a sub-millimeter objects manipulation setup and will take part in a CTI project named “Manipulating Microscale Objects with Nanoscale Precision”. On the way of manipulating microscale objects, we need to build a first setup adapted for sub-millimeter objects in order to be able to perform experiences and to validate some assumptions and choices. In the Laboratoire de Systèmes Robotiques (LSRO), ultra high precision parallel robots are developed and, in particular, the Delta3 a micromanipulator that presents three degrees of freedom (XYZ) and has a range of 4mm. This robot might be used within this project. The goal of this project is to develop an interface between vision system, robot and user that will allow measuring the position repeatability of different microscale objects during a manipulation task
Vision Based Automatic Calibration of Microrobotic System
During the last decade, the advancement of microrobotics has provided a powerful tool for micromanipulation in various fields including living cell manipulation, MEMS/MOEMS assembly, and micro-/nanoscale material characterization. Several dexterous micromanipulation systems have been developed and demonstrated. Nowadays, the research on micromanipulation has shifted the scope from the conceptual system development to the industrial applications. Consequently, the future development of this field lies on the industrial applicability of systems that aims to convert the micromanipulation technique to the mass manufacturing process. In order to achieve this goal, the automatic microrobotic system, as the core in the process chain, plays a significant role.
This thesis focuses on the calibration procedure of the positioning control, which is one of the fundamental issues during the automatic microrobotic system development. A novel vision based procedure for three dimensional (3D) calibrations of micromanipulators is proposed. Two major issues in the proposed calibration approach - vision system calibration and manipulator kinematic calibration - are investigated in details in this thesis. For the stereo vision measurement system, the calibration principle and algorithm are presented. Additionally, the manipulator kinematic calibration is carried out in four steps: kinematic modeling, data acquisition, parameter estimation, and compensation implementation. The procedures are presented with two typical models: the matrix model and the polynomial model. Finally, verification and evaluation experiments are conducted on the microrobotic fiber characterization platform in the Micro- and Nano Systems Research Group (MST) at Tampere University of Technology.
The results demonstrate that the proposed calibration models are able to reduce the prediction error below 2.59 micrometers. With those models, the pose error, compensated by the feed-forward compensator, can be reduced to be smaller than 5 µm. The proposed approach also demonstrates the feasibility in calibrating the decoupled motions, by reducing the undesired movement from 28 µm to 8 µm (For 4800 µm desired movement)
Vision Based Automatic Calibration of Microrobotic System
During the last decade, the advancement of microrobotics has provided a powerful tool for micromanipulation in various fields including living cell manipulation, MEMS/MOEMS assembly, and micro-/nanoscale material characterization. Several dexterous micromanipulation systems have been developed and demonstrated. Nowadays, the research on micromanipulation has shifted the scope from the conceptual system development to the industrial applications. Consequently, the future development of this field lies on the industrial applicability of systems that aims to convert the micromanipulation technique to the mass manufacturing process. In order to achieve this goal, the automatic microrobotic system, as the core in the process chain, plays a significant role.
This thesis focuses on the calibration procedure of the positioning control, which is one of the fundamental issues during the automatic microrobotic system development. A novel vision based procedure for three dimensional (3D) calibrations of micromanipulators is proposed. Two major issues in the proposed calibration approach - vision system calibration and manipulator kinematic calibration - are investigated in details in this thesis. For the stereo vision measurement system, the calibration principle and algorithm are presented. Additionally, the manipulator kinematic calibration is carried out in four steps: kinematic modeling, data acquisition, parameter estimation, and compensation implementation. The procedures are presented with two typical models: the matrix model and the polynomial model. Finally, verification and evaluation experiments are conducted on the microrobotic fiber characterization platform in the Micro- and Nano Systems Research Group (MST) at Tampere University of Technology.
The results demonstrate that the proposed calibration models are able to reduce the prediction error below 2.59 micrometers. With those models, the pose error, compensated by the feed-forward compensator, can be reduced to be smaller than 5 µm. The proposed approach also demonstrates the feasibility in calibrating the decoupled motions, by reducing the undesired movement from 28 µm to 8 µm (For 4800 µm desired movement)
Cooperative Manipulation using a Magnetically Navigated Microrobot and a Micromanipulator
The cooperative manipulation of a common object using two or more manipulators is a popular research field in both industry and institutions. Different types of manipulators are used in cooperative manipulation for carrying heavy loads and delicate operations. Their applications range from macro to micro. In this thesis, we are interested in the development of a novel cooperative manipulator for manipulation tasks in a small workspace. The resultant cooperative manipulation system consists of a magnetically navigated microrobot (MNM) and a motorized micromanipulator (MM). The MNM is a small cylinder permanent magnet with 10mm diameter and 10mm height. The MM model is MP-285 which is a commercialized product. Here, the MNM is remotely controlled by an external magnetic field. The property of non-contact manipulation makes it a suitable choice for manipulation in a confined space.
The cooperative manipulation system in this thesis used a master/slave mechanism as the central control strategy. The MM is the master side. The MNM is the slave side. During the manipulation process, the master manipulator MM is always position controlled, and it leads the object translation according to the kinematic constraints of the cooperative manipulation task. The MNM is position controlled at the beginning of the manipulation. In the translation stage, the MNM is switched to force control to maintain a successful holding of the object, and at the same time to prevent damaging the object by large holding force. Under the force control mode, the motion command to the MNM is calculated from a position-based impedance controller that enforces a relationship between the position of the MNM and the force.
In this research, the accurate motion control of both manipulators are firstly studied before the cooperative manipulation is conducted. For the magnetic navigation system, the magnetic field in its workspace is modeled using an experimental measurement data-driven technique. The developed model is then used to develop a motion controller for navigating of a small cylindrical permanent magnet. The accuracy of motion control is reached at 20 µm in three degrees of freedom. For the motorized micromanipulator, a standard PID controller is designed to control its motion stage. The accuracy of the MM navigation is 0.8 µm.
Since the MNM is remotely manipulated by an external magnetic field in a small space, it is challenging to install an on-board force sensor to measure the contact force between the MNM and the object. Therefore, a dual-axial o_-board force determination mechanism is proposed. The force is determined according to the linear relation between the minimum magnetic potential energy point and the real position of the MNM in the workspace.
For convenience, the minimum magnetic potential energy point is defined as the Bmax in the literature. In this thesis, the dual-axial Bmax position is determined by measuring the magnetic ux density passing through the workspace using four Hall-effect sensors installed at the bottom of an iron pole-piece. The force model is experimentally validated in a horizontal plane with an accuracy of 2 µN in the x- and y- direction of horizontal planes.
The proposed cooperative manipulator is then used to translate a hard-shell small object in two directions of a vertical plane, while one direction is constrained with a desired holding force. During the manipulation process, a digital camera is used to capture the real-time position of the MNM, the MM end-effector, and the manipulated object.
To improve the performance of force control on the MNM, the proposed dual-axial force model is used to examine the compliant force control of the MNM while it is navigated to contact with uncertain environments. Here, uncertain refers to unknown environmental stiffness. An adaptive position-based impedance controller is implemented to estimate the stiffness of the environment and the contact force. The controller is examined by navigating the MNM to push a thin aluminum beam whose stiffness is unknown.
The studied cooperative manipulation system has potential applications in biomedical microsurgery and microinjection. It should be clarified that the current system setup with 10mm Ă—10 mm MNM is not proper for this micromanipulation. In order to conduct research on microinjection, the size of the MNM and the end-effector of the MNM should be down-scaled to micrometers. In addition, the navigation accuracy of the MNM should also be improved to adopt the micromanipulation tasks
- …