A Multi-Robot Cooperation Framework for Sewing Personalized Stent Grafts

This paper presents a multi-robot system for manufacturing personalized medical stent grafts. The proposed system adopts a modular design, which includes: a (personalized) mandrel module, a bimanual sewing module, and a vision module. The mandrel module incorporates the personalized geometry of patients, while the bimanual sewing module adopts a learning-by-demonstration approach to transfer human hand-sewing skills to the robots. The human demonstrations were firstly observed by the vision module and then encoded using a statistical model to generate the reference motion trajectories. During autonomous robot sewing, the vision module plays the role of coordinating multi-robot collaboration. Experiment results show that the robots can adapt to generalized stent designs. The proposed system can also be used for other manipulation tasks, especially for flexible production of customized products and where bimanual or multi-robot cooperation is required.Comment: 10 pages, 12 figures, accepted by IEEE Transactions on Industrial Informatics, Key words: modularity, medical device customization, multi-robot system, robot learning, visual servoing, robot sewin

A Multi-Robot Cooperation Framework for Sewing Personalized Stent Grafts

This paper presents a multi-robot system for manufacturing personalized medical stent grafts. The proposed system adopts a modular design, which includes: a (personalized) mandrel module, a bimanual sewing module, and a vision module. The mandrel module incorporates the personalized geometry of patients, while the bimanual sewing module adopts a learning-by-demonstration approach to transfer human hand-sewing skills to the robots. The human demonstrations were firstly observed by the vision module and then encoded using a statistical model to generate the reference motion trajectories. During autonomous robot sewing, the vision module plays the role of coordinating multi-robot collaboration. Experiment results show that the robots can adapt to generalized stent designs. The proposed system can also be used for other manipulation tasks, especially for flexible production of customized products and where bimanual or multi-robot cooperation is required.Comment: 10 pages, 12 figures, accepted by IEEE Transactions on Industrial Informatics, Key words: modularity, medical device customization, multi-robot system, robot learning, visual servoing, robot sewin

Passive Resonant Coil Based Fast Registration And Tracking System For Real-Time Mri-Guided Minimally Invasive Surgery

This thesis presents a single-slice based fast stereotactic registration and tracking technique along with a corresponding modular system for guiding robotic mechanism or interventional instrument to perform needle-based interventions under live MRI guidance. The system can provide tracking of full 6 degree-of-freedom (DOF) in stereotactic interventional surgery based upon a single, rapidly acquired cross-sectional image. The whole system is constructed with a modular data transmission software framework and mechanical structure so that it supports remote supervision and manipulation between a 3D Matlab tracking user interface (UI) and an existing MRI robot controller by using the OpenIGTLink network communication protocol. It provides better closed-loop control by implementing a feedback output interface to the MRI-guided robot. A new compact fiducial frame design is presented, and the fiducial is wrapped with a passive resonant coil. The coil resonates at the Larmor frequency for 3T MRI to enhance signal strength and enable for rapid imaging. The fiducial can be attached near the distal end of the robot and coaxially with a needle so as to visualize target tissue and track the surgical tool synchronously. The MRI-compatible design of fiducial frame, robust tracking algorithm and modular interface allow this tracking system to be conveniently used on different robots or devices and in different size of MRI bores. Several iterations of the tracking fiducial and passive resonant coils were constructed and evaluated in a Phillips Achieva 3T MRI. To assess accuracy and robustness of the tracking algorithm, 25 groups of images with different poses were successively scanned along specific sequence in and MRI experiment. The translational RMS error along depth is 0.271mm with standard deviation of 0.277mm for totally 100 samples. The overall angular RMS error is less than 0.426 degree with standard deviation of 0.526 degree for totally 150 samples. The passive resonant coils were shown to significantly increase signal intensity in the fiducial relative to the surroundings and provide for rapid imaging with low flip angles

Do-It-Yourself Single Camera 3D Pointer Input Device

We present a new algorithm for single camera 3D reconstruction, or 3D input for human-computer interfaces, based on precise tracking of an elongated object, such as a pen, having a pattern of colored bands. To configure the system, the user provides no more than one labelled image of a handmade pointer, measurements of its colored bands, and the camera's pinhole projection matrix. Other systems are of much higher cost and complexity, requiring combinations of multiple cameras, stereocameras, and pointers with sensors and lights. Instead of relying on information from multiple devices, we examine our single view more closely, integrating geometric and appearance constraints to robustly track the pointer in the presence of occlusion and distractor objects. By probing objects of known geometry with the pointer, we demonstrate acceptable accuracy of 3D localization.Comment: 8 pages, 6 figures, 2018 15th Conference on Computer and Robot Visio

Development of an integrated robotic polishing system

This thesis presents research carried out as part of a project undertaken in fulfilment of the requirements of Loughborough University for the award of Philosophical Doctorate. The main focus of this research is to investigate and develop an appropriate level of automation to the existing manual finishing operations of small metallic components to achieve required surface quality and to remove superficial defects. In the manufacturing industries, polishing processes play a vital role in the development of high precision products, to give a desired surface finish, remove defects, break sharp edges, extend the working life cycle, and meet mechanical specification. The polishing operation is generally done at the final stage of the manufacturing process and can represent up to a third of the production time. Despite the growth automated technology in industry, polishing processes are still mainly carried out manually, due to the complexity and constraints of the process. Manual polishing involves a highly qualified worker polishing the workpiece by hand. These processes are very labour intensive, highly skill dependent, costly, error-prone, environmentally hazardous due to abrasive dust, and - in some cases - inefficient with long process times. In addition, the quality of the finishing is dependent on the training, experience, fatigue, physical ability, and expertise of the operator. Therefore, industries are seeking alternative solutions to be implemented within their current processes. These solutions are mainly aimed at replacing the human operator to improve the health and safety of their workforce and improve their competitiveness. Some automated solutions have already been proposed to assist or replace manual polishing processes. These solutions provide limited capabilities for specific processes or components, and a lack of flexibility and dexterity. One of the reasons for their lack of success is identified as neglecting the study and implementing the manual operations. This research initially hypothesised that for an effective development, an automated polishing system should be designed based on the manual polishing operations. Therefore, a successful implementation of an automated polishing system requires a thorough understanding of the polishing process and their operational parameters. This study began by collaborating with an industrial polishing company. The research was focused on polishing complex small components, similar to the parts typically used in the aerospace industry. The high level business processes of the polishing company were capture through several visits to the site. The low level operational parameters and the understanding of the manual operations were also captured through development of a devices that was used by the expert operators. A number of sensors were embedded to the device to facilitate recording the manual operations. For instance, the device captured the force applied by the operator (avg. 10 N) and the cycle time (e.g. 1 pass every 5 sec.). The capture data was then interpreted to manual techniques and polishing approaches that were used in developing a proof-of-concept Integrated Robotic Polishing System (IRPS). The IRPS was tested successfully through several laboratory based experiments by expert operators. The experiment results proved the capability of the proposed system in polishing a variety of part profiles, without pre-existing geometrical information about the parts. One of the main contributions made by this research is to propose a novel approach for automated polishing operations. The development of an integrated robotic polishing system, based on the research findings, uses a set of smart sensors and a force-position-by-increment control algorithm, and transpose the way that skilled workers carry out polishing processes

Development of a methodology for the human-robot interaction based on vision systems for collaborative robotics

L'abstract è presente nell'allegato / the abstract is in the attachmen

Progress in industrial photogrammetry by means of markerless solutions

174 p.La siguiente tesis está enfocada al desarrollo y uso avanzado de metodologías fotogramétrica sin dianas en aplicaciones industriales. La fotogrametría es una técnica de medición óptica 3D que engloba múltiples configuraciones y aproximaciones. En este estudio se han desarrollado procedimientos de medición, modelos y estrategias de procesamiento de imagen que van más allá que la fotogrametría convencional y buscan el emplear soluciones de otros campos de la visión artificial en aplicaciones industriales. Mientras que la fotogrametría industrial requiere emplear dianas artificiales para definir los puntos o elementos de interés, esta tesis contempla la reducción e incluso la eliminación de las dianas tanto pasivas como activas como alternativas prácticas. La mayoría de los sistemas de medida utilizan las dianas tanto para definir los puntos de control, relacionar las distintas perspectivas, obtener precisión, así como para automatizar las medidas. Aunque en muchas situaciones el empleo de dianas no sea restrictivo existen aplicaciones industriales donde su empleo condiciona y restringe considerablemente los procedimientos de medida empleados en la inspección. Un claro ejemplo es la verificación y control de calidad de piezas seriadas, o la medición y seguimiento de elementos prismáticos relacionados con un sistema de referencia determinado. Es en este punto donde la fotogrametría sin dianas puede combinarse o complementarse con soluciones tradicionales para tratar de mejorar las prestaciones actuales