2D and 3D surface image processing algorithms and their applications

This doctoral dissertation work aims to develop algorithms for 2D image segmentation application of solar filament disappearance detection, 3D mesh simplification, and 3D image warping in pre-surgery simulation. Filament area detection in solar images is an image segmentation problem. A thresholding and region growing combined method is proposed and applied in this application. Based on the filament area detection results, filament disappearances are reported in real time. The solar images in 1999 are processed with this proposed system and three statistical results of filaments are presented. 3D images can be obtained by passive and active range sensing. An image registration process finds the transformation between each pair of range views. To model an object, a common reference frame in which all views can be transformed must be defined. After the registration, the range views should be integrated into a non-redundant model. Optimization is necessary to obtain a complete 3D model. One single surface representation can better fit to the data. It may be further simplified for rendering, storing and transmitting efficiently, or the representation can be converted to some other formats. This work proposes an efficient algorithm for solving the mesh simplification problem, approximating an arbitrary mesh by a simplified mesh. The algorithm uses Root Mean Square distance error metric to decide the facet curvature. Two vertices of one edge and the surrounding vertices decide the average plane. The simplification results are excellent and the computation speed is fast. The algorithm is compared with six other major simplification algorithms. Image morphing is used for all methods that gradually and continuously deform a source image into a target image, while producing the in-between models. Image warping is a continuous deformation of a: graphical object. A morphing process is usually composed of warping and interpolation. This work develops a direct-manipulation-of-free-form-deformation-based method and application for pre-surgical planning. The developed user interface provides a friendly interactive tool in the plastic surgery. Nose augmentation surgery is presented as an example. Displacement vector and lattices resulting in different resolution are used to obtain various deformation results. During the deformation, the volume change of the model is also considered based on a simplified skin-muscle model

Navigation d'une aiguille médicale déformable

Les environnements actuels de navigation de gestes interventionnels avec aiguille font l'hypothèse de l'indéformabilité de celle-ci. Hypothèse non vérifiée cliniquement avec comme conséquence immédiate une perte de précision du geste réalisé et à plus long terme de potentielles conséquences morbides. En pratique, cette aiguille peut être amenée à se déformer du fait des interactions avec les tissus. Il est donc nécessaire d'incorporer dans les systèmes de navigation des données sur la déformée de l'aiguille à l'aide, par exemple, de jauges de déformation. Ces dernières permettent d'accéder en temps réel à des informations locales de déformation, a partir desquelles il sera possible de reconstruire la déformée de l'aiguille. L'objectif de ce travail consiste donc à l'élaboration d'une nouvelle génération de système de navigation permettant de localiser en 3D et en temps réel, la déformée d'une aiguille instrumentée.The current environments of navigation of interventional gestures with needle make the assumption of the indeformability of this one. Unchecked hypothesis clinicaly with as immediate consequence a loss of precision of the gesture carried out and longer-term of potential morbid consequences. In practice, this needle can be brought to deform because of the interactions with tissues. It is thus necessary to incorporate in the navigation systems of the data on the bending of the needle to the assistance, for example, of strain gauges. These last ones allow to reach in real time local information of deformation, has to leave of which it will be possible to rebuild the deformation of the needle. The objective of this work thus consists with the development of a new generation of navigation system allowing to localize in 3D and real time, the deformation of an instrumented needle.SAVOIE-SCD - Bib.électronique (730659901) / SudocGRENOBLE1/INP-Bib.électronique (384210012) / SudocGRENOBLE2/3-Bib.électronique (384219901) / SudocSudocFranceF

Navigation d'une aiguille médicale déformable

The current environments of navigation of interventional gestures with needle make the assumption of the indeformability of this one. Unchecked hypothesis clinicaly with as immediate consequence a loss of precision of the gesture carried out and longer-term of potential morbid consequences. In practice, this needle can be brought to deform because of the interactions with tissues. It is thus necessary to incorporate in the navigation systems of the data on the bending of the needle to the assistance, for example, of strain gauges. These last ones allow to reach in real time local information of deformation, has to leave of which it will be possible to rebuild the deformation of the needle. The objective of this work thus consists with the development of a new generation of navigation system allowing to localize in 3D and real time, the deformation of an instrumented needle.Les environnements actuels de navigation de gestes interventionnels avec aiguille font l'hypothèse de l'indéformabilité de celle-ci. Hypothèse non vérifiée cliniquement avec comme conséquence immédiate une perte de précision du geste réalisé et à plus long terme de potentielles conséquences morbides. En pratique, cette aiguille peut être amenée à se déformer du fait des interactions avec les tissus. Il est donc nécessaire d'incorporer dans les systèmes de navigation des données sur la déformée de l'aiguille à l'aide, par exemple, de jauges de déformation. Ces dernières permettent d'accéder en temps réel à des informations locales de déformation, a partir desquelles il sera possible de reconstruire la déformée de l'aiguille. L'objectif de ce travail consiste donc à l'élaboration d'une nouvelle génération de système de navigation permettant de localiser en 3D et en temps réel, la déformée d'une aiguille instrumentée

Surgical Subtask Automation for Intraluminal Procedures using Deep Reinforcement Learning

Intraluminal procedures have opened up a new sub-field of minimally invasive surgery that use flexible instruments to navigate through complex luminal structures of the body, resulting in reduced invasiveness and improved patient benefits. One of the major challenges in this field is the accurate and precise control of the instrument inside the human body. Robotics has emerged as a promising solution to this problem. However, to achieve successful robotic intraluminal interventions, the control of the instrument needs to be automated to a large extent. The thesis first examines the state-of-the-art in intraluminal surgical robotics and identifies the key challenges in this field, which include the need for safe and effective tool manipulation, and the ability to adapt to unexpected changes in the luminal environment. To address these challenges, the thesis proposes several levels of autonomy that enable the robotic system to perform individual subtasks autonomously, while still allowing the surgeon to retain overall control of the procedure. The approach facilitates the development of specialized algorithms such as Deep Reinforcement Learning (DRL) for subtasks like navigation and tissue manipulation to produce robust surgical gestures. Additionally, the thesis proposes a safety framework that provides formal guarantees to prevent risky actions. The presented approaches are evaluated through a series of experiments using simulation and robotic platforms. The experiments demonstrate that subtask automation can improve the accuracy and efficiency of tool positioning and tissue manipulation, while also reducing the cognitive load on the surgeon. The results of this research have the potential to improve the reliability and safety of intraluminal surgical interventions, ultimately leading to better outcomes for patients and surgeons

Advances on Mechanics, Design Engineering and Manufacturing III

This open access book gathers contributions presented at the International Joint Conference on Mechanics, Design Engineering and Advanced Manufacturing (JCM 2020), held as a web conference on June 2–4, 2020. It reports on cutting-edge topics in product design and manufacturing, such as industrial methods for integrated product and process design; innovative design; and computer-aided design. Further topics covered include virtual simulation and reverse engineering; additive manufacturing; product manufacturing; engineering methods in medicine and education; representation techniques; and nautical, aeronautics and aerospace design and modeling. The book is organized into four main parts, reflecting the focus and primary themes of the conference. The contributions presented here not only provide researchers, engineers and experts in a range of industrial engineering subfields with extensive information to support their daily work; they are also intended to stimulate new research directions, advanced applications of the methods discussed and future interdisciplinary collaborations

Soft pneumatic actuators: a review of design, fabrication, modeling, sensing, control and applications

Soft robotics is a rapidly evolving field where robots are fabricated using highly deformable materials and usually follow a bioinspired design. Their high dexterity and safety make them ideal for applications such as gripping, locomotion, and biomedical devices, where the environment is highly dynamic and sensitive to physical interaction. Pneumatic actuation remains the dominant technology in soft robotics due to its low cost and mass, fast response time, and easy implementation. Given the significant number of publications in soft robotics over recent years, newcomers and even established researchers may have difficulty assessing the state of the art. To address this issue, this article summarizes the development of soft pneumatic actuators and robots up until the date of publication. The scope of this article includes the design, modeling, fabrication, actuation, characterization, sensing, control, and applications of soft robotic devices. In addition to a historical overview, there is a special emphasis on recent advances such as novel designs, differential simulators, analytical and numerical modeling methods, topology optimization, data-driven modeling and control methods, hardware control boards, and nonlinear estimation and control techniques. Finally, the capabilities and limitations of soft pneumatic actuators and robots are discussed and directions for future research are identified

Fabricate

Bringing together pioneers in design and making within architecture, construction, engineering, manufacturing, materials technology and computation, Fabricate is a triennial international conference, now in its third year (ICD, University of Stuttgart, April 2017). Each year it produces a supporting publication, to date the only one of its kind specialising in Digital Fabrication. The 2017 edition features 32 illustrated articles on built projects and works in progress from academia and practice, including contributions from leading practices such as Foster + Partners, Zaha Hadid Architects, Arup, and Ron Arad, and from world-renowned institutions including ICD Stuttgart, Harvard, Yale, MIT, Princeton University, The Bartlett School of Architecture (UCL) and the Architectural Association

3D Reconstruction Using High Resolution Implicit Surface Representations and Memory Management Strategies

La disponibilité de capteurs de numérisation 3D rapides et précis a permis de capturer de très grands ensembles de points à la surface de différents objets qui véhiculent la géométrie des objets. La métrologie appliquée consiste en l'application de mesures dans différents domaines tels que le contrôle qualité, l'inspection, la conception de produits et la rétroingénierie. Une fois que le nuage de points 3D non organisés couvrant toute la surface de l'objet a été capturé, un modèle de la surface doit être construit si des mesures métrologiques doivent être effectuées sur l'objet. Dans la reconstruction 3D en temps réel, à l'aide de scanners 3D portables, une représentation de surface implicite très efficace est le cadre de champ vectoriel, qui suppose que la surface est approchée par un plan dans chaque voxel. Le champ vectoriel contient la normale à la surface et la matrice de covariance des points tombant à l'intérieur d'un voxel. L'approche globale proposée dans ce projet est basée sur le cadre Vector Field. Le principal problème abordé dans ce projet est la résolution de l'incrément de consommation de mémoire et la précision du modèle reconstruit dans le champ vectoriel. Ce tte approche effectue une sélection objective de la taille optimale des voxels dans le cadre de champ vectoriel pour maintenir la consommation de mémoire aussi faible que possible et toujours obtenir un modèle précis de la surface. De plus, un ajustement d e surface d'ordre élevé est utilisé pour augmenter la précision du modèle. Étant donné que notre approche ne nécessite aucune paramétrisation ni calcul complexe, et qu'au lieu de travailler avec chaque point, nous travaillons avec des voxels dans le champ vectoriel, cela réduit la complexité du calcul.The availability of fast and accurate 3D scanning sensors has made it possible to capture very large sets of points at the surface of different objects that convey the geometry of the objects. A pplied metrology consists in the application of measurements in different fields such as quality control, inspection, product design and reverse engineering. Once the cloud of unorganized 3D points covering the entire surface of the object has been capture d, a model of the surface must be built if metrologic measurements are to be performed on the object. In realtime 3D reconstruction, using handheld 3D scanners a very efficient implicit surface representation is the Vector Field framework, which assumes that the surface is approximated by a plane in each voxel. The vector field contains the normal to the surface and the covariance matrix of the points falling inside a voxel. The proposed global approach in this project is based on the Vector Field framew ork. The main problem addressed in this project is solving the memory consumption increment and the accuracy of the reconstructed model in the vector field. This approach performs an objective selection of the optimal voxels size in the vector field frame work to keep the memory consumption as low as possible and still achieve an accurate model of the surface. Moreover, a highorder surface fitting is used to increase the accuracy of the model. Since our approach do not require any parametrization and compl ex calculation, and instead of working with each point we are working with voxels in the vector field, then it reduces the computational complexity

Commande d'un robot de télé-échographie par asservissement visuel

Les robots légers utilisés pour la télé-échographie robotisée permettent, à l'expert médical, d'orienter à distance une sonde ultrasonore 2D. L'analyse en temps réel de l'image ultrasonore du patient, reçue via un lien de communication, permet à l'expert de définir un diagnostic. Les validations cliniques du concept de télé-échographie robotisée montrent qu'il est ainsi possible de pallier le manque d'experts en ultrasonographie sur des sites médicalement isolés. Le robot porte-sonde est positionné et maintenu sur le corps du patient par un assistant à partir des informations communiquées par le spécialiste via visioconférence. Cependant, la faible masse du robot, le fait qu'il soit maintenu par un assistant sur le corps du patient et les mouvements physiologiques du patient provoquent des perturbations dans la position de la sonde et engendrent ainsi des pertes des sections d'intérêt des organes étudiés. Les travaux de cette thèse ont consisté à développer une approche par asservissement visuel basé sur les moments d'image ultrasonore 2D. Le calcul des moments 2D étant basé sur les points du contour de la section d'intérêt, un algorithme de traitement d'images efficace est nécessaire pour détecter et suivre le contour d'intérêt en mouvement. Pour cela, une méthode de contour actif paramétrique basée sur les descripteurs de Fourier est présentée. Les lois de commandes correspondant à trois tâches autonomes autorisant la recherche et le maintien de visibilité d'un organe lors de l'acte médical télé-opéré sont implémentées et validées sur la plateforme robotique du projet ANR Prosit.The light weight robots used for robotized tele-echography allow the medical expert to remotely operate a 2D-ultrasound probe. The real-time analysis of the patient's ultrasound images, received via a standard communication link, provides the expert with relevant information to define a diagnosis. The clinical validations of the robotized tele-echography concept show that it is possible to overcome the lack of sonographers in medically isolated sites. The robot probe-holder is usually positioned and held on the patient's body by a paramedical staff based on information provided by the specialist via videoconferencing. However, the small mass of the robot, the fact that it is held by an assistant on the patient's body and the patient's physiological movements cause disturbances in the position of the probe ; this thus can generate a loss of the region of interest of the organ being under investigation during the teleoperated medical act. This thesis work focuses on the development of a visual servoing approach based on 2D ultrasound image moments. 2D moments calculation is based on the contour points of the image section of interest, therefore an image-processing algorithm is needed to effectively detect and follow the contour of interest in motion. For this reason, a parametric active contour method based on Fourier descriptors is presented. The control laws, corresponding to three independent autonomous tasks to search and maintain the visibility of an organ within a given ultrasound plane during the tele-operated medical act are implemented and validated on robotic platform project ANR Prosit.RENNES1-Bibl. électronique (352382106) / SudocSudocFranceF

A constraint-based approach for assessing the capabilities of existing designs to handle product variation

All production machinery is designed with an inherent capability to handle slight variations in product. This is initially achieved by simply providing adjustments to allow, for example, changes that occur in pack sizes to be accommodated, through user settings or complete sets of change parts. By the appropriate use of these abilities most variations in product can be handled. However when extreme conditions of setups, major changes in product size and configuration, are considered there is no guarantee that the existing machines are able to cope. The problem is even more difficult to deal with when completely new product families are proposed to be made on an existing product line. Such changes in product range are becoming more common as producers respond to demands for ever increasing customization and product differentiation. An issue exists due to the lack of knowledge on the capabilities of the machines being employed. This often forces the producer to undertake a series of practical product trials. These however can only be undertaken once the product form has been decided and produced in sufficient numbers. There is then little opportunity to make changes that could greatly improve the potential output of the line and reduce waste. There is thus a need for a supportive modelling approach that allows the effect of variation in products to be analyzed together with an understanding of the manufacturing machine capability. Only through their analysis and interaction can the capabilities be fully understood and refined to make production possible. This thesis presents a constraint-based approach that offers a solution to the problems above. While employing this approach it has been shown that, a generic process can be formed to identify the limiting factors (constraints) of variant products to be processed. These identified constraints can be mapped to form the potential limits of performance for the machine. The limits of performance of a system (performance envelopes) can be employed to assess the design capability to cope with product variation. The approach is successfully demonstrated on three industrial case studies.EThOS - Electronic Theses Online ServiceGBUnited Kingdo