Doctor of Philosophy

dissertationThis dissertation presents results documenting advancements on the control of untethered magnetic devices, such as magnetic \microrobots" and magnetically actuated capsuleendoscopes, motivated by problems in minimally invasive medicine. This dissertationfocuses on applying rotating magnetic elds for magnetic manipulation. The contributions include advancements in the way that helical microswimmers (devices that mimicthe propulsion of bacterial agella) are controlled in the presence of gravitational forces, advancements in ways that groups of untethered magnetic devices can be dierentiated and semi-independently controlled, advancements in the way that untethered magnetic device can be controlled with a single rotating permanent magnet, and an improved understanding in the nature of the magnetic force applied to an untethered device by a rotating magnet

Doctor of Philosophy

dissertationThis dissertation explores the design and use of an electromagnetic manipulation system that has been optimized for the dipole-eld model. This system can be used for noncontact manipulation of adjacent magnetic tools and combines the eld strength control of current electromagnetic systems with the analytical modeling of permanent-magnet systems. To design such a system, it is rst necessary to characterize how the shape of the eld source aects the shape of the magnetic eld. The magnetic eld generated by permanent magnets and electromagnets can be modeled, far from the source, using a multipole expansion. The error associated with the multipole expansion is quantied, and it is shown that, as long as the point of interest is 1.5 radii of the smallest sphere that can fully contain the magnetic source, the full expansion will have less than 1% error. If only the dipole term, the rst term in the expansion, is used, then the error is minimized for cylindrical shapes with a diameter-to-length ratio of 4=3 and for rectangular-bars with a cube. Applying the multipole expansion to electromagnets, an omnidirectional electromagnet, comprising three orthogonal solenoids and a spherical core, is designed that has minimal dipole-eld error and equal strength in all directions. Although this magnet can be constructed with any size core, the optimal design contains a spherical core with a diameter that is 60% of the outer dimension of the magnet. The resulting magnet's ability to dextrously control the eld at a point is demonstrated by rotating an endoscopic-pill mockup to drive it though a lumen and roll a permanent-magnet ball though several trajectories. Dipole elds also apply forces on adjacent magnetized objects. The ability to control these forces is demonstrated by performing position control on an orientation-constrained magnetic oat and nally by steering a permanent magnet, which is aligned with the applied dipole eld, around a rose curve

Capsule endoscopy of the future: What's on the horizon?

Capsule endoscopes have evolved from passively moving diagnostic devices to actively moving systems with potential therapeutic capability. In this review, we will discuss the state of the art, define the current shortcomings of capsule endoscopy, and address research areas that aim to overcome said shortcomings. Developments in capsule mobility schemes are emphasized in this text, with magnetic actuation being the most promising endeavor. Research groups are working to integrate sensor data and fuse it with robotic control to outperform today's standard invasive procedures, but in a less intrusive manner. With recent advances in areas such as mobility, drug delivery, and therapeutics, we foresee a translation of interventional capsule technology from the bench-top to the clinical setting within the next 10 years

Doctor of Philosophy

dissertationClosed-loop control of wireless capsule endoscopes is an active area of research because it would drastically improve screening of the gastrointestinal tract. Traditional endoscopic procedures are unable to view the entire gastrointestinal tract and current commercial wireless capsule endoscopes are limited in their effectiveness due to their passive nature. This dissertation advances the field of active capsule endoscopy by developing methods to localize the full six-degree-of-freedom (6-DOF) pose of a screw-type magnetic capsule while it is being propelled through a lumen (such as the small intestines) using an external rotating magnetic dipole. The same external magnetic dipole is utilized for both propulsion and localization. Hardware was designed and constructed to enable testing of the magnetic localization and propulsion methods, including a robotic end-effector used as the external actuator magnet, and a prototype capsule embedded with Hall-effect sensors. Due to the use of a rotating magnetic field for propulsion, at any given time, the capsule can be in one of three regimes: synchronously rotating with the applied field, in "step-out" where it is free to move but the external field is rotating too quickly for the capsule to remain synchronously rotating, or completely stationary. We show that it is only necessary to distinguish whether or not the capsule is synchronously rotating (i.e., a single localization method can be used for a capsule in either the step-out or stationary regimes). Two magnetic localization methods are developed. The first uses nonlinear least squares to estimate the capsule's pose when it has no (or approximately no) net motion (e.g., to find the initial capsule pose or when it is stuck in an intestinal fold). The second method estimates the 6-DOF capsule pose as it synchronously rotates with the applied magnetic field using a square-root variant of the Unscented Kalman filter. A simple process model is adopted that restricts the capsule's movement to translation along and rotation about its principle axis. The capsule is actively propelled forward or backward, but it is not actively steered, rather, steering is provided by the lumen. The propulsion parameters that transform magnetic force and torque to the capsule's spatial velocity and angular velocity are estimated with an additional square-root Unscented Kalman filter to enable the capsule to navigate heterogeneous environments such as the small intestines. An optimized localization-propulsion system is described using the two localization algorithms and prior work in screw-type magnetic capsule propulsion with a single rotating dipole field. The capsule's regime is determined and the corresponding localization method is employed. Based on the capsule's estimated pose and the current estimates of its propulsion parameters, the actuator magnet's pose relative to the capsule is optimized to maximize the capsule's forward propulsion. Using this system, our prototype magnetic capsule successfully completed U-shaped and S-shaped trajectories in fresh bovine intestines with an average forward velocity of 5.5mm/s and 3.5 mm/s, respectively. At this rate it would take approximately 18-30 minutes to traverse the 6 meters of a typical human small intestine

Unsupervised Odometry and Depth Learning for Endoscopic Capsule Robots

In the last decade, many medical companies and research groups have tried to convert passive capsule endoscopes as an emerging and minimally invasive diagnostic technology into actively steerable endoscopic capsule robots which will provide more intuitive disease detection, targeted drug delivery and biopsy-like operations in the gastrointestinal(GI) tract. In this study, we introduce a fully unsupervised, real-time odometry and depth learner for monocular endoscopic capsule robots. We establish the supervision by warping view sequences and assigning the re-projection minimization to the loss function, which we adopt in multi-view pose estimation and single-view depth estimation network. Detailed quantitative and qualitative analyses of the proposed framework performed on non-rigidly deformable ex-vivo porcine stomach datasets proves the effectiveness of the method in terms of motion estimation and depth recovery.Comment: submitted to IROS 201

Frontiers of robotic endoscopic capsules: a review

Digestive diseases are a major burden for society and healthcare systems, and with an aging population, the importance of their effective management will become critical. Healthcare systems worldwide already struggle to insure quality and affordability of healthcare delivery and this will be a significant challenge in the midterm future. Wireless capsule endoscopy (WCE), introduced in 2000 by Given Imaging Ltd., is an example of disruptive technology and represents an attractive alternative to traditional diagnostic techniques. WCE overcomes conventional endoscopy enabling inspection of the digestive system without discomfort or the need for sedation. Thus, it has the advantage of encouraging patients to undergo gastrointestinal (GI) tract examinations and of facilitating mass screening programmes. With the integration of further capabilities based on microrobotics, e.g. active locomotion and embedded therapeutic modules, WCE could become the key-technology for GI diagnosis and treatment. This review presents a research update on WCE and describes the state-of-the-art of current endoscopic devices with a focus on research-oriented robotic capsule endoscopes enabled by microsystem technologies. The article also presents a visionary perspective on WCE potential for screening, diagnostic and therapeutic endoscopic procedures

A review of modeling and control of remote-controlled capsule endoscopes.

INTRODUCTION: The significance of this review lies in addressing the limitations of passive locomotion in capsule endoscopes, hindering their widespread use in medical applications. The research focuses on evaluating existing miniature in vivo remote-controlled capsule endoscopes, examining their locomotion designs, and working theories to pave the way for overcoming challenges and enhancing their applicability in diagnostic and treatment settings. AREAS COVERED: This paper explores control methods and dynamic system modeling in the context of self-propelled remote-controlled capsule endoscopes with a two-mass arrangement. The literature search, conducted at Queen Mary University of London Library from 2000 to 2022, utilized a systematic approach starting with the broad keyword 'Capsule Endoscope' and progressively narrowing down to specific aspects such as 'Capsule Endoscope Control' and 'Self-propelled Capsule Endoscope' using various criteria. EXPERT OPINION: Efficiently driving and controlling remote-controlled capsule endoscopes have the potential to overcome the current limitations in medical technology, offering a viable solution for diagnosing and treating gastrointestinal diseases. Successful control of the remote-controlled capsule endoscope, as demonstrated in this review paper, will lead to a step change in medical engineering, establishing the remote-controlled capsule endoscope as a swift standard in the field

Self-assembly of ferromagnetic micro/nano-particles with perpendicular magnetic anisotropy

Magnetic particles offer an interesting platform for self-assembly, as their dipolar interactions and response to magnetic fields can be used to drive and manipulate assembly. Many magnetic particles used so far in these applications are quite simple in their properties, such as iron oxide particles or magnetic colloids. To grow the potential of magnetic self-assembly, more complex particles are being developed to increase the complexity and functionality of the assemblies. In this vein, this work has created magnetic particles based on thin films of CoFeB/Pt with perpendicular magnetic anisotropy (PMA) to use for self-assembly. PMA films have been long developed for magnetic recording and computing applications, so they are well understood and optimized. Their high moment and strong anisotropy make them good candidates for a highly directional equilibrium self-assembly system. The particle construction was first optimized in films, looking at both the magnetic and structural properties needed for particles. The particles are then patterned from the film using top-down lithographic methods. Using top down methods, as opposed to the chemical synthesis methods used for most magnetic particles, is what allows the tuneable magnetic film properties to be transferred to particles. Once in liquid, the individual field response and interactions of the particles were analysed, to understand how they would best assemble. Then, the particles were assembled into 1D and 2D structures, which were then manipulated with magnetic fields to understand how these assemblies could be controlled and actuated. Assemblies of 3D structures on chip were also created and observed. These results demonstrate the fundamental assembly capabilities of the system and begin to show how it might be applied in microrobotics or micromachinery.Cambridge Commonwealth, European & International Trus

Magnetically Assisted Capsule Endoscopy: A Viable Alternative to Conventional Flexible Endoscopy of the Stomach?

INTRODUCTION: Oesophagogastroduodenoscopy is the investigation of choice to identify mucosal lesions of the upper gastrointestinal tract, but it is poorly tolerated by patients. A simple non-invasive technique to image the upper gastrointestinal tract, which could be made widely available, would be beneficial to patients. Capsule endoscopy is well tolerated by patients but the stomach has proved difficult to visualise accurately with capsule technology due to its’ capacious nature and mucosal folds, which can obscure pathology. MiroCam Navi (Intromedic Ltd, Seoul, Korea) is a capsule endoscope containing a small amount of magnetic material which has been made available with a handheld magnet which might allow a degree of control. This body of work aims to address whether this new technology could be a feasible alternative to conventional flexible endoscopy of the stomach. METHODS: Four studies were conducted to test this research question. The first explores the feasibility of magnetically assisted capsule endoscopy of the stomach and operator learning curve in an ex vivo porcine model. This was followed by a randomised, blinded trial comparing magnetically assisted capsule endoscopy to conventional flexible endoscopy in ex vivo porcine stomach models. Subsequently a prospective, single centre randomised controlled trial in humans examined whether magnetically assisted capsule endoscopy could enhance conventional small bowel capsule endoscopy by reducing gastric transit time. Finally a blinded comparison of diagnostic yield of magnetically assisted capsule endoscopy compared to oesophagogastroduodenoscopy was performed in patients with recurrent or refractory iron deficiency anaemia. RESULTS: In the first study all stomach tags were identified in 87.2% of examinations and a learning curve was demonstrated (mean examination times for the first 23 and second 23 procedures 10.28 and 6.26 minutes respectively (p<0.001). In the second study the difference in sensitivities between oesophagogastroduodenoscopy and conventional flexible endoscopy for detecting beads within an ex vivo porcine stomach model was 1.11 (95% CI 0.06, 28.26) proving magnetically assisted capsule endoscopy to be non-inferior to flexible endoscopy. In the first human study, although there was no significant difference in gastric transit time or capsule endoscopy completion rate between the two groups (p=0.12 and p=0.39 respectively), the time to first pyloric image was significantly shorter in the intervention group (p=0.03) suggesting that magnetic control hastens capsular transit to the gastric antrum but cannot impact upon duodenal passage. In the last study, a total of 38 pathological findings were identified in this comparative study of magnetically assisted capsule endoscopy and conventional endoscopy. Of these, 16 were detected at both procedures, while flexible endoscopy identified 14 additional lesions not seen at magnetically assisted capsule endoscopy and magnetically assisted capsule endoscopy detected 8 abnormalities not seen by oesophagogastroduodenoscopy. No adverse events occurred in either of the human trials. Finally magnetically steerable capsule endoscopy induced less procedural pain, discomfort and distress than oesophagogastroduodenoscopy (p=0.0009, p=0.001 and p=0.006 respectively). CONCLUSION: Magnetically assisted capsule endoscopy is safe, well tolerated and a viable alternative to conventional endoscopy. Further research to develop and improve this new procedure is recommended