Robotic micromanipulation for microassembly : modelling by sequencial function chart and achievement by multiple scale visual servoings.

International audienceThe paper investigates robotic assembly by focusing on the manipulation of microparts. This task is formalized through the notion of basic tasks which are organized in a logical sequence represented by a function chart and interpreted as the model of the behavior of the experimental setup. The latter includes a robotic system, a gripping system, an imaging system, and a clean environment. The imaging system is a photon videomicroscope able to work at multiple scales. It is modelled by a linear projective model where the relation between the scale factor and the magnification or zoom is explicitly established. So, the usual visual control law is modified in order to take into account this relation. The manipulation of some silicon microparts (400 μm×400 μm×100 μm) by means of a distributed robotic system (xyθ system, ϕz system), a two-finger gripping system and a controllable zoom and focus videomicroscope shows the relevance of the concepts. The 30 % of failure rate comes mainly from the physical phenomena (electrostatic and capillary forces) instead of the accuracy of control or the occultations of microparts

Highly precise micropositioning task using a direct visual servoing scheme.

International audienceThis paper demonstrates a precise micropositioning scheme based on a direct visual servoing process. This technique uses only the pure image signal (photometric information) to design the control law. With respect to traditional visual servoing approaches that use geometric visual features (points, lines, ...), the visual features used in the control law is nothing but the pixel luminance. The proposed approach was tested in term of precision and robustness in several experimental conditions. The obtained results have demonstrated a good behavior of the control law and very good positioning precision. The obtained precisions are 89 nanometers, 14 nanometers, and 0.001 degrees in the x, y and axes of positioning platform, respectively

Novel estimation and control techniques in micromanipulation using vision and force feedback

With the recent advances in the fields of micro and nanotechnology, there has been growing interest for complex micromanipulation and microassembly strategies. Despite the fact that many commercially available micro devices such as the key components in automobile airbags, ink-jet printers and projection display systems are currently produced in a batch technique with little assembly, many other products such as read/write heads for hard disks and fiber optics assemblies require flexible precision assemblies. Furthermore, many biological micromanipulations such as invitro-fertilization, cell characterization and treatment rely on the ability of human operators. Requirement of high-precision, repeatable and financially viable operations in these tasks has given rise to the elimination of direct human involvement, and autonomy in micromanipulation and microassembly. In this thesis, a fully automated dexterous micromanipulation strategy based on vision and force feedback is developed. More specifically, a robust vision based control architecture is proposed and implemented to compensate errors due to the uncertainties about the position, behavior and shape of the microobjects to be manipulated. Moreover, novel estimators are designed to identify the system and to characterize the mechanical properties of the biological structures through a synthesis of concepts from the computer vision, estimation and control theory. Estimated mechanical parameters are utilized to reconstruct the imposed force on a biomembrane and to provide the adequate information to control the position, velocity and acceleration of the probe without damaging the cell/tissue during an injection task

Robotic Micromanipulation and Microassembly using Mono-view and Multi-scale visual servoing.

International audienceThis paper investigates sequential robotic micromanipulation and microassembly in order to build 3-D microsystems and devices. A mono-view and multiple scale 2-D visual control scheme is implemented for that purpose. The imaging system used is a photon video microscope endowed with an active zoom enabling to work at multiple scales. It is modelled by a non-linear projective method where the relation between the focal length and the zoom factor is explicitly established. A distributed robotic system (xy system, z system) with a twofingers gripping system is used in conjunction with the imaging system. The results of experiments demonstrate the relevance of the proposed approaches. The tasks were performed with the following accuracy: 1.4 m for the positioning error, and 0.5 for the orientation error

Model free visual servoing in macro and micro domain robotic applications

This thesis explores model free visual servoing algorithms by experimentally evaluating their performances for various tasks performed both in macro and micro domains. Model free or so called uncalibrated visual servoing does not need the system (vision system + robotic system) calibration and the model of the observed scene, since it provides an online estimation of the composite (image + robot) Jacobian. It is robust to parameter changes and disturbances. A model free visual servoing scheme is tested on a 7 DOF Mitsubishi PA10 robotic arm and on a microassembly workstation which is developed in our lab. In macro domain, a new approach for planar shape alignment is presented. The alignment task is performed based on bitangent points which are acquired using convex-hull of a curve. Both calibrated and uncalibrated visual servoing schemes are employed and compared. Furthermore, model free visual servoing is used for various trajectory following tasks such as square, circle, sine etc. and these reference trajectories are generated by a linear interpolator which produces midway targets along them. Model free visual servoing can provide more exibility in microsystems, since the calibration of the optical system is a tedious and error prone process, and recalibration is required at each focusing level of the optical system. Therefore, micropositioning and three di erent trajectory following tasks are also performed in micro world. Experimental results validate the utility of model free visual servoing algorithms in both domains

Workshop on "Control issues in the micro / nano - world".

International audienceDuring the last decade, the need of systems with micro/nanometers accuracy and fast dynamics has been growing rapidly. Such systems occur in applications including 1) micromanipulation of biological cells, 2) micrassembly of MEMS/MOEMS, 3) micro/nanosensors for environmental monitoring, 4) nanometer resolution imaging and metrology (AFM and SEM). The scale and requirement of such systems present a number of challenges to the control system design that will be addressed in this workshop. Working in the micro/nano-world involves displacements from nanometers to tens of microns. Because of this precision requirement, environmental conditions such as temperature, humidity, vibration, could generate noise and disturbance that are in the same range as the displacements of interest. The so-called smart materials, e.g., piezoceramics, magnetostrictive, shape memory, electroactive polymer, have been used for actuation or sensing in the micro/nano-world. They allow high resolution positioning as compared to hinges based systems. However, these materials exhibit hysteresis nonlinearity, and in the case of piezoelectric materials, drifts (called creep) in response to constant inputs In the case of oscillating micro/nano-structures (cantilever, tube), these nonlinearities and vibrations strongly decrease their performances. Many MEMS and NEMS applications involve gripping, feeding, or sorting, operations, where sensor feedback is necessary for their execution. Sensors that are readily available, e.g., interferometer, triangulation laser, and machine vision, are bulky and expensive. Sensors that are compact in size and convenient for packaging, e.g., strain gage, piezoceramic charge sensor, etc., have limited performance or robustness. To account for these difficulties, new control oriented techniques are emerging, such as[d the combination of two or more ‘packageable' sensors , the use of feedforward control technique which does not require sensors, and the use of robust controllers which account the sensor characteristics. The aim of this workshop is to provide a forum for specialists to present and overview the different approaches of control system design for the micro/nano-world and to initiate collaborations and joint projects

Spatially guided angiogenesis by laser-bioprinting

L'ingénierie tissulaire est reconnue comme une méthode potentielle pour réparer ou régénérer les tissus endommagés. Malgré de grandes avancées dans l'ingénierie tissulaire, la réussite de la construction de tissus complexes avec des réseaux vascularisés reste un défi. Dans les modèles d'angiogenèse actuels, les cellules endothéliales sont ensemencées au hasard, n'offrant pas de structure organisée. La technologie de bioimpression par laser offre une résolution d'impression précise. Par cette technique, les structures microvasculaires peuvent être construites pour la fabrication d'organes complexes, ou pour modéliser la progression de la maladie ou les modèles de réponse aux médicaments. Dans cette étude, des techniques de bio-impression au laser ont été utilisées pour étudier le guidage de l'angiogenèse in vitro. Deux techniques basées sur le laser, le transfert direct induit par laser (LIFT) et le transfert latéral induit par laser (LIST) sont utilisées. Comparée à LIFT, la technologie LIST offrait des conditions idéales pour l'impression cellulaire telles que la concentration cellulaire requise pour la formation du tubes endothéliaux et l'uniformité du motif désiré. Nous avons réalisé le modelage de la formation de structures de type capillaire dans des motifs organisés via l'impression LIST. Les constructions de type capillaire formées présentent des motifs uniformes. Les structures formées ont été analysées par microscopie confocale et reconstruction d'images 3D. Bien que le développement de la lumière endothéliale soit incomplet, la technique développée possède le potentiel d'atteindre une stabilisation et un développement de la lumière si l'on recrute un deuxième type de cellule tel que les fibroblastes ou les péricytes.Tissue engineering has been well acknowledged as a potential method to repair or regenerate damaged tissues in the human body, fulfilling the limitations and shortage in autologous and organ transplantations. Despite great advances in engineering tissues with simple geometry and low requirement for oxygen and blood supply such as cartilage, skin and cornea, success in constructing 3D complex tissues with vascularized networks remains a major challenge. Angiogenesis plays an important role in vascular development in vivo. In current angiogenesis models, endothelial cells are seeded randomly not offering precise and desired patterning. Laser-based bioprinting technology offers precise and high cell printing resolution. By using laser-based bioprinting technology, microvascular structures can be constructed as a platform for complex organ fabrication, disease progression and drug response models. In this study, laser-based bioprinting techniques are employed to study angiogenesis guidance in vitro by patterning endothelial cells. Two laser-based techniques, Laser-Induced Forward Transfer (LIFT) and Laser-Induced Side Transfer (LIST) are used as patterning tools. Compared to LIFT, LIST technology provided ideal conditions for cell printing such as required cell concentration for endothelial tube formation and pattern uniformity. In this study, we achieved the guidance of capillary-like structure formation in desired patterns via LIST printing. The formed capillary-like constructs featured precise patterns and uniformity. The structures were analyzed by confocal microscopy, 3D image reconstruction and frozen section procedure. Though lumen development was incomplete, it possesses the potential to attain further stabilization and lumen development if recruiting a second cell type such as fibroblast or pericyte

Amorphous silicon e 3D sensors applied to object detection

Nowadays, existing 3D scanning cameras and microscopes in the market use digital or discrete sensors, such as CCDs or CMOS for object detection applications. However, these combined systems are not fast enough for some application scenarios since they require large data processing resources and can be cumbersome. Thereby, there is a clear interest in exploring the possibilities and performances of analogue sensors such as arrays of position sensitive detectors with the final goal of integrating them in 3D scanning cameras or microscopes for object detection purposes. The work performed in this thesis deals with the implementation of prototype systems in order to explore the application of object detection using amorphous silicon position sensors of 32 and 128 lines which were produced in the clean room at CENIMAT-CEMOP. During the first phase of this work, the fabrication and the study of the static and dynamic specifications of the sensors as well as their conditioning in relation to the existing scientific and technological knowledge became a starting point. Subsequently, relevant data acquisition and suitable signal processing electronics were assembled. Various prototypes were developed for the 32 and 128 array PSD sensors. Appropriate optical solutions were integrated to work together with the constructed prototypes, allowing the required experiments to be carried out and allowing the achievement of the results presented in this thesis. All control, data acquisition and 3D rendering platform software was implemented for the existing systems. All these components were combined together to form several integrated systems for the 32 and 128 line PSD 3D sensors. The performance of the 32 PSD array sensor and system was evaluated for machine vision applications such as for example 3D object rendering as well as for microscopy applications such as for example micro object movement detection. Trials were also performed involving the 128 array PSD sensor systems. Sensor channel non-linearities of approximately 4 to 7% were obtained. Overall results obtained show the possibility of using a linear array of 32/128 1D line sensors based on the amorphous silicon technology to render 3D profiles of objects. The system and setup presented allows 3D rendering at high speeds and at high frame rates. The minimum detail or gap that can be detected by the sensor system is approximately 350 μm when using this current setup. It is also possible to render an object in 3D within a scanning angle range of 15º to 85º and identify its real height as a function of the scanning angle and the image displacement distance on the sensor. Simple and not so simple objects, such as a rubber and a plastic fork, can be rendered in 3D properly and accurately also at high resolution, using this sensor and system platform. The nip structure sensor system can detect primary and even derived colors of objects by a proper adjustment of the integration time of the system and by combining white, red, green and blue (RGB) light sources. A mean colorimetric error of 25.7 was obtained. It is also possible to detect the movement of micrometer objects using the 32 PSD sensor system. This kind of setup offers the possibility to detect if a micro object is moving, what are its dimensions and what is its position in two dimensions, even at high speeds. Results show a non-linearity of about 3% and a spatial resolution of < 2µm