Hybrid optical and magnetic manipulation of microrobots

Microrobotic systems have the potential to provide precise manipulation on cellular level for diagnostics, drug delivery and surgical interventions. These systems vary from tethered to untethered microrobots with sizes below a micrometer to a few microns. However, their main disadvantage is that they do not have the same capabilities in terms of degrees-of-freedom, sensing and control as macroscale robotic systems. In particular, their lack of on-board sensing for pose or force feedback, their control methods and interface for automated or manual user control are limited as well as their geometry has few degrees-of-freedom making three-dimensional manipulation more challenging. This PhD project is on the development of a micromanipulation framework that can be used for single cell analysis using the Optical Tweezers as well as a combination of optical trapping and magnetic actuation for recon gurable microassembly. The focus is on untethered microrobots with sizes up to a few tens of microns that can be used in enclosed environments for ex vivo and in vitro medical applications. The work presented investigates the following aspects of microrobots for single cell analysis: i) The microfabrication procedure and design considerations that are taken into account in order to fabricate components for three-dimensional micromanipulation and microassembly, ii) vision-based methods to provide 6-degree-offreedom position and orientation feedback which is essential for closed-loop control, iii) manual and shared control manipulation methodologies that take into account the user input for multiple microrobot or three-dimensional microstructure manipulation and iv) a methodology for recon gurable microassembly combining the Optical Tweezers with magnetic actuation into a hybrid method of actuation for microassembly.Open Acces

Depth estimation of optically transparent laser-driven microrobots

Six degree-of-freedom (DoF) pose feedback is essential for the development of closed-loop control techniques for microrobotics. This paper presents two methods for depth estimation of transparent microrobots inside an Optical Tweezers (OT) setup using image sharpness measurements and model-based tracking. The x-y position and the 3D orientation of the object are estimated using online model-based template matching. The proposed depth estimation methodologies are validated experimentally by comparing the results with the ground truth

Workshop on "Robotic assembly of 3D MEMS".

Proceedings of a workshop proposed in IEEE IROS'2007.The increase of MEMS' functionalities often requires the integration of various technologies used for mechanical, optical and electronic subsystems in order to achieve a unique system. These different technologies have usually process incompatibilities and the whole microsystem can not be obtained monolithically and then requires microassembly steps. Microassembly of MEMS based on micrometric components is one of the most promising approaches to achieve high-performance MEMS. Moreover, microassembly also permits to develop suitable MEMS packaging as well as 3D components although microfabrication technologies are usually able to create 2D and "2.5D" components. The study of microassembly methods is consequently a high stake for MEMS technologies growth. Two approaches are currently developped for microassembly: self-assembly and robotic microassembly. In the first one, the assembly is highly parallel but the efficiency and the flexibility still stay low. The robotic approach has the potential to reach precise and reliable assembly with high flexibility. The proposed workshop focuses on this second approach and will take a bearing of the corresponding microrobotic issues. Beyond the microfabrication technologies, performing MEMS microassembly requires, micromanipulation strategies, microworld dynamics and attachment technologies. The design and the fabrication of the microrobot end-effectors as well as the assembled micro-parts require the use of microfabrication technologies. Moreover new micromanipulation strategies are necessary to handle and position micro-parts with sufficiently high accuracy during assembly. The dynamic behaviour of micrometric objects has also to be studied and controlled. Finally, after positioning the micro-part, attachment technologies are necessary

Automatic Microassembly of Tissue Engineering Scaffold

Ph.DDOCTOR OF PHILOSOPH

Real-time 3D model-based tracking: Combining edge and texture information

International audienceThis paper proposes a real-time, robust and efficient 3D model-based tracking algorithm. A non linear minimization approach is used to register 2D and 3D cues for monocular 3D tracking. The integration of texture information in a more classical non-linear edge-based pose computation highly increases the reliability of more conventional edge-based 3D tracker. Robustness is enforced by integrating a M-estimator into the minimization process via an iteratively re-weighted least squares implementation. The method presented in this paper has been validated on several video sequences as well as in visual servoing experiments considering various objects. Results show the method to be robust to large motions and textured environments

Microrobots for wafer scale microfactory: design fabrication integration and control.

Future assembly technologies will involve higher automation levels, in order to satisfy increased micro scale or nano scale precision requirements. Traditionally, assembly using a top-down robotic approach has been well-studied and applied to micro-electronics and MEMS industries, but less so in nanotechnology. With the bloom of nanotechnology ever since the 1990s, newly designed products with new materials, coatings and nanoparticles are gradually entering everyone’s life, while the industry has grown into a billion-dollar volume worldwide. Traditionally, nanotechnology products are assembled using bottom-up methods, such as self-assembly, rather than with top-down robotic assembly. This is due to considerations of volume handling of large quantities of components, and the high cost associated to top-down manipulation with the required precision. However, the bottom-up manufacturing methods have certain limitations, such as components need to have pre-define shapes and surface coatings, and the number of assembly components is limited to very few. For example, in the case of self-assembly of nano-cubes with origami design, post-assembly manipulation of cubes in large quantities and cost-efficiency is still challenging. In this thesis, we envision a new paradigm for nano scale assembly, realized with the help of a wafer-scale microfactory containing large numbers of MEMS microrobots. These robots will work together to enhance the throughput of the factory, while their cost will be reduced when compared to conventional nano positioners. To fulfill the microfactory vision, numerous challenges related to design, power, control and nanoscale task completion by these microrobots must be overcome. In this work, we study three types of microrobots for the microfactory: a world’s first laser-driven micrometer-size locomotor called ChevBot，a stationary millimeter-size robotic arm, called Solid Articulated Four Axes Microrobot (sAFAM), and a light-powered centimeter-size crawler microrobot called SolarPede. The ChevBot can perform autonomous navigation and positioning on a dry surface with the guidance of a laser beam. The sAFAM has been designed to perform nano positioning in four degrees of freedom, and nanoscale tasks such as indentation, and manipulation. And the SolarPede serves as a mobile workspace or transporter in the microfactory environment

Modeling and experimental validation of a parallel microrobot for biomanipulation

The main purpose of this project is the development of a commercial micropositioner's (SmarPod 115.25, SmarAct GmbH) geometrical model. SmarPod is characterized by parallel kinematics and is employed for precise and accurate sample's positioning under SEM microscope, being vacuum-compatible, for various applications. Geometrical modeling represents the preliminar step to fully understand, and possibly improve, robot's closed loop behaviour in terms of task's quality precision, when enterprises does not provide sufficient documentation. The robotic system, in fact, represents in this case a "black box" from which it's possible to extract information. This step is essential in order to improve, consequently, the reliability of bio-microsystem manipulation and characterization. Disposing of a detailed microrobot's model becomes essential to deal with the typical lack of sensing at microscale, as it allows a 3D precise and adequate reconstruction, realized through proper softwares, of the manipulation set-up. The roles of Virtual Reality (VR) and of simulations, carried out, in this case, in Blender environment, are asserted as well as an essential helping tool in mycrosystem's task planning. Blender is a professional free and open-source 3D computer graphics software and it is proven to be a basic instrument to validate microrobot's model, even to simplify it in case of complex system's geometries

Enabling Capillary Self-Assembly for Microsystem Integration

Efficient and precise assembly of very-large quantities of sub-millimeter-sized devices onto pre-processed substrates is presently a key frontier for microelectronics, in its aspiration to large-scale mass production of devices with new functionalities and applications (e.g. thin dies embedded into flexible substrates, 3D microsystem integration). In this perspective, on the one hand established pick&place assembly techniques may be unsuitable, due to a trade-off between throughput and placement accuracy and to difficulties in predictably handling very-small devices. On the other hand, self-assembly processes are massively parallel, may run unsupervised and allow contactless manipulation of objects. The convergence between robotic assembly and self-assembly, epitomized by capillarity-enhanced flip-chip assembly, can therefore enable an ideal technology meeting short-to-medium-term electronic packaging and assembly needs. The objective of this thesis is bridging the gap between academic proofs-of- concept of capillary self-assembly and its industrial application. Our work solves several issues relevant to capillary self-assembly of thin dies onto preprocessed substrates. Very-different phenomena and aspects of both scientific and technological interest coexist in such a broad context. They were tackled both experimentally and theoretically. After a critical review of the state-of-the-art in microsystem integration, a complete quasi-static study of lateral capillary meniscus forces is presented. Our experimental setup enables also a novel method to measure the contact angle of liquids. Recessed binding sites are introduced to obtain perfectly-conformal fluid dip-coating of patterned surfaces, which enables the effective and robust coding of geometrical information into binding sites to direct the assembly of parts. A general procedure to establish solder-mediated electro-mechanical interconnections between parts and substrate is validated. Smart surface chemistries are invoked to solve the issue of mutual adhesion between parts during the capillary self-assembly process. Two chemical kinetic-inspired analytic models of fluidic self-assembly are presented and criticized to introduce a novel agent-based model of the process. The latter approach allows realistic simulations by taking into account spatial factors and collision dynamics. Concluding speculations propose envisioned solutions to residual open issues and further perspectives for this field of rapidly-growing importance

Actuation and control of microfabricated structures using flagellated bacteria

In this work methods of actuation and control of microfabricated structures are investigated using bacteria as configurable, scalable actuators. Bacteria offer many benefits as microfluidic actuators. They draw chemical energy directly from their environment, they can be operated in a wide range of temperature and pH, and literally billions of bacteria may be cultured within hours. Additionally, the well-documented responses of individual motile bacterial cells may be expected to scale up to arrays of cells. On this population scale, the cellular responses can be employed en masse creating controlled forces that actuate inorganic microfabricated elements. For these investigations the bacterium Serratia marcescens has been chosen. S. marcescens has properties that are particularly appropriate for engineering applications. When cultured on soft agar, the bacteria demonstrate a form of surface motility known as swarming. These investigations start with an experimental analysis of the swarming cell motility using a non-labeled cell tracking technique. The results of these studies reveal that the most energetic bacteria populate the progressing edge of the swarm. A technique of biocompatible microfabrication and chemical release of bacteria-driven microstructures is also presented. This method is used to pattern structure surfaces with the rigorous swarming cells by direct blotting. The self-coordinated motion of the cells is investigated for use as arrays of actuators. Control mechanisms are investigated to adjust rotational and translational motion using optical and electrical stimuli, respectively. The fundamentals of the electrokinetics are also investigated and integrated into a system demonstrating controlled manipulation of target objects and phenotypic chemical sensing.Ph.D., Mechanical Engineering -- Drexel University, 200