Towards tactile sensing active capsule endoscopy

Examination of the gastrointestinal(GI) tract has traditionally been performed using tethered endoscopy tools with limited reach and more recently with passive untethered capsule endoscopy with limited capability. Inspection of small intestines is only possible using the latter capsule endoscopy with on board camera system. Limited to visual means it cannot detect features beneath the lumen wall if they have not affected the lumen structure or colour. This work presents an improved capsule endoscopy system with locomotion for active exploration of the small intestines and tactile sensing to detect deformation of the capsule outer surface when it follows the intestinal wall. In laboratory conditions this system is capable of identifying sub-lumen features such as submucosal tumours.Through an extensive literary review the current state of GI tract inspection in particular using remote operated miniature robotics, was investigated, concluding no solution currently exists that utilises tactile sensing with a capsule endoscopy. In order to achieve such a platform, further investigation was made in to tactile sensing technologies, methods of locomotion through the gut, and methods to support an increased power requirement for additional electronics and actuation. A set of detailed criteria were compiled for a soft formed sensor and flexible bodied locomotion system. The sensing system is built on the biomimetic tactile sensing device, Tactip, \cite{Chorley2008, Chorley2010, Winstone2012, Winstone2013} which has been redesigned to fit the form of a capsule endoscopy. These modifications have required a $360^{o}$ cylindrical sensing surface with $360^{o}$ panoramic optical system. Multi-material 3D printing has been used to build an almost complete sensor assembly with a combination of hard and soft materials, presenting a soft compliant tactile sensing system that mimics the tactile sensing methods of the human finger. The cylindrical Tactip has been validated using artificial submucosal tumours in laboratory conditions. The first experiment has explored the new form factor and measured the device's ability to detect surface deformation when travelling through a pipe like structure with varying lump obstructions. Sensor data was analysed and used to reconstruct the test environment as a 3D rendered structure. A second tactile sensing experiment has explored the use of classifier algorithms to successfully discriminate between three tumour characteristics; shape, size and material hardness. Locomotion of the capsule endoscopy has explored further bio-inspiration from earthworm's peristaltic locomotion, which share operating environment similarities. A soft bodied peristaltic worm robot has been developed that uses a tuned planetary gearbox mechanism to displace tendons that contract each worm segment. Methods have been identified to optimise the gearbox parameter to a pipe like structure of a given diameter. The locomotion system has been tested within a laboratory constructed pipe environment, showing that using only one actuator, three independent worm segments can be controlled. This configuration achieves comparable locomotion capabilities to that of an identical robot with an actuator dedicated to each individual worm segment. This system can be miniaturised more easily due to reduced parts and number of actuators, and so is more suitable for capsule endoscopy. Finally, these two developments have been integrated to demonstrate successful simultaneous locomotion and sensing to detect an artificial submucosal tumour embedded within the test environment. The addition of both tactile sensing and locomotion have created a need for additional power beyond what is available from current battery technology. Early stage work has reviewed wireless power transfer (WPT) as a potential solution to this problem. Methods for optimisation and miniaturisation to implement WPT on a capsule endoscopy have been identified with a laboratory built system that validates the methods found. Future work would see this combined with a miniaturised development of the robot presented. This thesis has developed a novel method for sub-lumen examination. With further efforts to miniaturise the robot it could provide a comfortable and non-invasive procedure to GI tract inspection reducing the need for surgical procedures and accessibility for earlier stage of examination. Furthermore, these developments have applicability in other domains such as veterinary medicine, industrial pipe inspection and exploration of hazardous environments

Wireless capsule endoscope for targeted drug delivery

The diagnosis and treatment of pathologies of the gastrointestinal (GI) tract are performed routinely by gastroenterologists using endoscopes and colonoscopes, however the small intestinal tract is beyond the reach of these conventional systems. Attempts have been made to access the small intestines with wireless capsule endoscopes (WCE). These pill-sized cameras take pictures of the intestinal wall and then relay them back for evaluation. This practice enables the detection and diagnosis of pathologies of the GI tract such as Crohn's disease, small intestinal tumours such as lymphoma and small intestinal cancer. The problems with these systems are that they have limited diagnostic capabilities and they do not offer the ability to perform therapy to the affected areas leaving only the options of administering large quantities of drugs or surgical intervention. To address the issue of administering therapy in the small intestinal tract this thesis presents an active swallowable microrobotic platform which has novel functionality enabling the microrobot to treat pathologies through a targeted drug delivery system. This thesis first reviews the state-of-the-art in WCE through the evaluation of current and past literature. A review of current practises such as flexible sigmoidoscopy, virtual colonoscopy and wireless capsule endoscopy are presented. The following sections review the state-of-the-art in methods of resisting peristalsis, drug targeting systems and drug delivery. A review of actuators is presented, in the context of WCE, with a view to evaluate their acceptability in adding functionality to current WCEs. The thesis presents a novel biologically-inspired holding mechanism which overcomes the issue of resisting natural peristalsis in the GI tract. An analysis of the two components of peristaltic force, circumferential and longitudinal peristaltic contractions, are presented to ensure correct functionality of the holding mechanism. A detailed analysis of the motorised method employed to deploy the expanding mechanism is described and a 5:1 scale prototype is presented which characterises the gearbox and validates the holding mechanism. The functionality of WCE is further extended by the inclusion of a novel targeting mechanism capable of delivering a metered dose of medication to a target site of interest in the GI tract. A solution to the problem of positioning a needle within a 360 degree envelope, operating the needle and safely retracting the needle in the GI tract is discussed. A comprehensive analysis of the mechanism to manoeuvre the needle is presented and validation of the mechanism is demonstrated through the evaluation of scale prototypes. Finally a drug delivery system is presented which can expel a 1 ml dose of medication, stored onboard the capsule, into the subcutaneous tissue of the GI tract wall. An analysis of the force required to expel the medication in a set period of time is presented and the design and analysis of a variable pitch conical compression spring which will be used to deliver the medication is discussed. A thermo mechanical trigger mechanism is presented which will be employed to release the compressed conical spring. Experimental results using 1:1 scale prototype parts validate the performance of the mechanisms.Open Acces

Bilateral Macro-Micro Teleoperation Using A Magnetic Actuation Mechanism

In recent years, there has been increasing interest in the advancement of microrobotic systems in micro-engineering, micro-fabrication, biological research and biomedical applications. Untethered magnetic-based microrobotic systems are one of the most widely developing groups of microrobotic systems that have been extensively explored for biological and biomedical micro-manipulations. These systems show promise in resolving problems related to on-board power supply limitations as well as mechanical contact sealing and lubrication. In this thesis, a high precision magnetic untethered microrobotic system is demonstrated for micro-handling tasks. A key aspect of the proposed platform concerns the integration of magnetic levitation technology and bilateral macro-micro teleoperation for human intervention to avoid imperceptible failures in poorly observed micro-domain environments. The developed platform has three basic subsystems: a magnetic untethered microrobotic system (MUMS), a haptic device, and a scaled bilateral teleoperation system. The MUMS produces and regulates a magnetic field for non-contact propelling of a microrobot. In order to achieve a controlled motion of the magnetically levitated microrobot, a mathematical force model of the magnetic propulsion mechanism is developed and used to design various control systems. In the workspace of 30 × 32 × 32 mm 3, both PID and LQG\LTR controllers perform similarly the position accuracy of 10 µ m in a vertical direction and 2 µ m in a horizontal motion. The MUMS is equipped with an eddy-current damper to enhance its inherent damping factor in the microrobot's horizontal motions. This paper deals with the modeling and analysis of an eddy-current damper that is formed by a conductive plate placed below the levitated microrobot to overcome inherent dynamical vibrations and improve motion precision. The modeling of eddy-current distribution in the conductive plate is investigated by solving the diffusion equation for vector magnetic potential, and an analytical expression for the horizontal damping force is presented and experimentally validated. It is demonstrated that eddy-current damping is a crucial technique for increasing the damping coefficient in a non-contact way and for improving levitation performance. The damping can be widely used in applications of magnetic actuation systems in micro-manipulation and micro-fabrication. To determine the position of the microrobot in a workspace, the MUMS uses high-accuracy laser sensors. However, laser positioning techniques can only be used in highly transparent environments. A novel technique based on real-time magnetic flux measurement has been proposed for the position estimation of the microrobot in case of laser beam blockage, whereby a combination of Hall-effect sensors is employed to find the microrobot's position in free motion by using the produced magnetic flux. In free motion, the microrobot tends to move toward the horizontally zero magnetic field gradient, Bmax location. As another key feature of the magnetic flux measurement, it was realized that the applied force from the environment to the microrobot can be estimated as linearly proportional to the distance of the microrobot from the Bmax location. The developed micro-domain force estimation method is verified experimentally with an accuracy of 1.27 µ N. A bilateral macro-micro teleoperation technique is employed in the MUMS for the telepresence of a human operator in the task environment. A gain-switching position-position teleoperation scheme is employed and a human operator controls the motion of the microrobot via a master manipulator for dexterous micro-manipulation tasks. The operator can sense a strong force during micro-domain tasks if the microrobot encounters a stiff environment, and the effect of hard contact is fed back to the operator's hand. The position-position method works for both free motion and hard contact. However, to enhance the feeling of a micro-domain environment in the human operator, the scaled force must be transferred to a human, thereby realizing a direct-force-reflection bilateral teleoperation. Additionally, a human-assisted virtual reality interface is developed to improve a human operator's skills in using the haptic-enabled platform, before carrying out an actual dexterous task.1 yea

Design and implementation of DSP-based magnetic control system for capsule endoscope

PhD ThesisEarly detection methods are key to reducing morbidity rates from digestive tract cancer which is currently one of the fastest growing cancers in the World. Capsule endoscopes (CEs) are a new technology that can be used to improve early detection of the gastrointestinal (GI) tract disorder. The device integrates the technologies such as image processing, optoelectronic engineering, information communication, and biomedical engineering. The capsule is the size and shape of a pill and contains an optoelectronic camera, antenna, transmitter, battery and optoelectronic illuminating light emitting diodes (LEDs). The small size of these devices enables them to offer many advantages over conventional endoscopes such as accessibility to the entire intestine and minimising the risk of perforation, particularly for patients with difficult anatomy (e.g. post-operative scar tissue). Currently used devices are passive and can only follow the natural transit of the intestines, and hence there is considerable interest in methods of controlled actuation for these devices. In this thesis, a novel actuation system based on magnetic levitation is designed, developed and implemented, utilizing a small permanent magnet embedded within the capsule and an arrangement of digitally controlled electromagnets outside the body. The proposed approach is that the magnet can be moved and oriented by DC magnetic force and torque produced by coils placed outside of the human body, with a suitable position feedback sensor enabling closed-loop control. Theoretical analyses of the proposed actuation system are presented which model the magnetic field, force and torque exerted by electromagnetic coil on the embedded magnet. Based on the distribution of the magnetic field, an optimal geometry for the coils is proposed in order to achieve a levitation distance which is realistic for the inspection of the GI tract. Two types of systems are investigated in the thesis, namely single-input single-output (SISO) and multi-input multi-output (MIMO), and the dynamics of these systems are modelled in state space form and hence linear controllers are designed for capsule actuation. The controllers are simulated using Matlab/ Simulink tools to realize the mathematical analysis of the system, and then implemented digitally in real-time using Texas Instruments (TI) TMS320F2812 Digital Signal Processor (DSP) to validate the proposed actuation system. In the SISO system, a linear one degree of freedom (1DOF) proportionalintegral- derivative (PID) controller is designed to move the inserted magnet in the vertical dimension within an area around the operating point and to maintain it at a desired position. A realistic simulation model is designed and implemented to evaluate the proposed controller. Simulation results have shown that the controller is able to successfully hold the embedded magnet in the desired position. For practical validation, the PID controller is implemented in real-time on the DSP system, where pulse width modulation (PWM) is generated to control the coil current, and Hall effect sensors are used for position feedback. Experimental results are obtained under step and square wave input demand. In the proposed system, high frequency noise on the position sensor is initially rejected by hardware implementation of resistor capacitor-low pass filter (RC-LPF) circuit. The accuracy of the position feedback is increased by calibrating the DSP’s on-chip analogue-digital converter (ADC) in order to reduce conversion error due to inherent gain and offset errors. To further reduce the influence of the position feedback noise, an average of ten repeated samples based on mean filter is implemented by the DSP in order to reduce the influctuation of the sensor reading. The tracking performance of the actuation system based on two Hall effect sensors on the opposite coil’s poles is investigated under step trajectory input. In an improved actuation system, position feedback is provided by using an AC magnetic field to obtain the capsule position information, decoupling this from the DC actuation field. The noise of the position feedback in the improved system is reduced by replacing the PWM current drive with a linear power amplifier driven from a digital to analogue converter (DAC), hence reducing AC interference. Positioning sensor noise was found to be further reduced by implementing digital filtering based on a coherent detector using the DSP, without increasing response time. The performance of the actuation system using these position sensors is compared based on settling time, overshoot, steady-state error, and control input parameters in order to validate the proposed improvement in the position feedback. The experimental results have shown that the controller based on both sensing strategies satisfactory control of the magnet’s position. However, the response of the system based on AC position sensing has the shortest settling time, smallest overshoot value and steady-state error. In the MIMO system, several linear controllers such as pole placement (PP), Entire Eigenstructure Assignment (EEA), and linear Quadratic regulator (LQR) techniques are designed and their tracking performances are compared. Simulation results have shown that, based on acceptable control inputs, the LQR controller has the fastest response with minimal overshoot value and steady state error. However, the LQR controller based on 2DOF is unable to maintain stable control of the magnet due to the insufficient position feedback from the two coil sensors. Specifically, it is not possible to achieve a stable 2D system since the orientation angle of the magnet is not resolvable. Therefore, the position feedback is improved by obtaining the device position and orientation information from a pair of 3-axis orthogonal coils. A realistic simulation model for the 3DOF LQR controller is designed and implemented to evaluate the developed system. Simulation results have shown that this controller is can achieve the necessary stability. In conclusion, based on the results from the 1D control system, the thesis shows that the DC magnetic field, which is used for capsule movement, can be also used to provide the controller acceptable position feedback. However, the use of AC magnetic field for positioning purpose provides more accurate position information. In order to implement 2DOF control system successfully, two 3-axis orthogonal coil sensors are considered which are used to provide the actuation algorithm with more accurate feedback of position and orientation information.Ministry of Higher Education, Iraq

The Design and Development of a Mobile Colonoscopy Robot

The conventional colonoscopy is a common procedure used to access the colon. Despite it being considered the Gold Standard procedure for colorectal cancer diagnosis and treatment, it has a number of major drawbacks, including high patient discomfort, infrequent but serious complications and high skill required to perform the procedure. There are a number of potential alternatives to the conventional colonoscopy, from augmenting the colonoscope to using Computed Tomography Colonography (CTC) - a completely non-invasive method. However, a truly effective, all-round alternative has yet to be found. This thesis explores the design and development of a novel solution: a fully mobile colonoscopy robot called “RollerBall”. Unlike current passive diagnostic capsules, such as PillCam, this device uses wheels at the end of adjustable arms to provide locomotion through the colon, while providing a stable platform for the use of diagnostic and therapeutic tools. The work begins by reviewing relevant literature to better understand the problem and potential solutions. RollerBall is then introduced and its design described in detail. A robust prototype was then successfully fabricated using a 3D printing technique and its performance assessed in a series of benchtop experiments. These showed that the mechanisms functioned as intended and encouraged the further development of the concept. Next, the fundamental requirement of gaining traction on the colon was shown to be possible using hexagonal shaped, macro-scale tread patterns. A friction coefficient ranging between 0.29 and 0.55 was achieved with little trauma to the tissue substrate. The electronics hardware and control were then developed and evaluated in a series of tests in silicone tubes. An open-loop strategy was first used to establish the control algorithm to map the user inputs to motor outputs (wheel speeds). These tests showed the efficacy of the locomotion technique and the control algorithm used, but they highlighted the need for autonomy. To address this, feedback was included to automate the adjusting of the arm angle and amount of force applied by the device; a forward facing camera was also used to automate the orientation control by tracking a user-defined target. Force and orientation control were then combined to show that semi-autonomous control was possible and as a result, it was concluded that clinical use may be feasible in future developments

Design, analysis and trajectory tracking control of underactuated mobile capsule robots.

The research on capsule robots (capsubots) has received attraction in recent years because of their compactness, simple structure and their potential use in medical diagnosis (e.g. capsule endoscopy), treatment and surgical assistance. The medical diagnostic capability of a capsule endoscope - which moves with the aid of visceral peristalsis - in the GI (gastro-intestinal) tract can be improved by adding propulsion to it e.g. legged, magnetic or capsubot-type propulsion. Driven by the above needs this thesis presents the design, analysis, trajectory tracking control and implementation of underactuated mobile capsule robots. These capsule robots can be modified and used in in-vivo medical applications. Researches on the capsubottype underactuated system focus on the stabilization of the robot and tracking the actuated configuration. However trajectory tracking control of an unactuated configuration (i.e. the robotmotion)was not considered in the literature though it is the primary requirement of any mobile robot and also crucial for many applications such as in-vivo inspection. Trajectory tracking control for this class of underactuated mechanical systems is still an open issue. This thesis presents a strategy to solve this issue. This thesis presents three robots namely a one-dimensional (1D) capsule robot, a 2D capsule robot and a 2D hybrid capsule robot with incremental capability. Two new acceleration profiles (utroque and contrarium) for the inner mass (IM) - internal moving part of the capsule robot - are proposed, analysed and implemented for the motion generation of the capsule robots. This thesis proposes a two-stage control strategy for the motion control of an underactuated capsule robot. A segment-wise trajectory tracking algorithm is developed for the 1D capsule robot. Theoretical analysis of the algorithm is presented and simulation is performed in the Matlab/Simulink environment based on the theoretical analysis. The algorithm is implemented in the developed capsule robot, the experimentation is performed and the results are critically analyzed. A trajectory tracking control algorithm combining segment-wise and behaviour-based control is proposed for the 2D capsule robot. Detailed theoretical analysis is presented and the simulation is performed to investigate the robustness of the trajectory tracking algorithm to friction uncertainties. A 2D capsule robot prototype is developed and the experimentation is performed. A novel 2D hybrid robot with four modes of operation - legless motion mode, legged motion mode, hybrid motion mode and anchoring mode - is also designed which uses one set of actuators in all operating modes. The theoretical analysis, modelling and simulation is performed. This thesis demonstrates effective ways of propulsion for in-vivo applications. The outer-shape of the 1D and 2D capsule robots can be customized according to the requirement of the applications, as the propulsion mechanisms are completely internal. These robots are also hermetically sealable (enclosed) which is a safety feature for the in-vivo robots. This thesis addresses the trajectory tracking control of the capsubot-type robot for the first time. During the experimentation the 1D robot prototype tracks the desired position trajectory with some error (relative mean absolute error: 16%). The trajectory tracking performance for the 2D capsubot improves as the segment time decreases whereas tracking performance declines as the friction uncertainty increases. The theoretical analysis, simulation and experimental results validate the proposed acceleration profiles and trajectory tracking control algorithms. The designed hybrid robot combines the best aspects of the legless and legged motions. The hybrid robot is capable of stopping in a suspected region and remain stationary for a prolonged observation for the in-vivo applications while withstanding the visceral peristalsis

Intersection between natural and artificial swimmers: a scaling approach to underwater vehicle design.

Approximately 72% of the Earth’s surface is covered by water, yet only 20% has been mapped [1]. Autonomous Underwater Vehicles (AUVs) are one of the main tools for ocean exploration. The demand for AUVs is expected to increase rapidly in the coming years [2], so there is a need for faster and more energy efficient AUVs. A drawback to using this type of vehicle is the finite amount of energy that is stored onboard in the form of batteries. Science and roboticists have been studying nature for ways to move more efficiently. Phillips et al. [3] presents data that contradicts the idea that fish are better swimmers than conventional AUVs when comparing the energetic cost of swimming in the form of the Cost of Transport (COT). The data presented by Phillips et al. only applies to AUVs at higher length and naval displacement (mass) scales, so the question arises of whether an AUV built at different displacements and length scales is more efficient than biological animals and if current bio-inspired platforms are better than conventional AUVs. Besides power requirements, it is also useful to compare the kinematic parameters of natural and artificial swimmers. In this case, kinematic parameters indicate how fast the swimmer travels through the water. Also, they describe how fast the propulsion mechanism must act to reach a certain swimming speed. This research adopts the approach of Gazzola et al. [4] where the Reynolds number is associated with a dimensionless number, Swim number (Sw) in this case, that has all the kinematic information. A newly developed number that extends the swim number to conventional AUVs is the Propulsion number (Jw), which demonstrates excellent agreement with the kinematics of conventional AUVs. Despite being functionally similar, Sw and Jw do not have a one-to-one relationship. Sw, Jw, COT represent key performance metrics for an AUV, herein called performance criteria, which can be used to compare existing platforms with each other and estimate the performance of non-existent designs. The scaling laws are derived by evaluating the performance of 229 biological animals, 163 bioinspire platforms, and 109 conventional AUVs. AUVs and bio-inspired platforms have scarce data compared with biological swimmers. Only 5% of conventional and 38% of bio-inspired AUVs have kinematic data while 30% of conventional and 18% of bio-inspired AUVs have energetic data. The low amount of performance criteria data is due to the nature of most conventional AUVs as commercial products. Only recently has the COT metric been included in the performance criteria for bio-inspired AUVs. For this reason, the research here formulates everything in terms of allometric scaling laws. This type of formulation is used extensively when referring to biological systems and is defined by an exponential relationship f (x) = axb, where x is a physical parameter of the fish or vehicle, like length or displacement. Scaling laws have the added benefit of allowing comparisons with limited data, as is the case for AUVs. The length and displacement scale (physical scale) must be established before estimating the performance criteria. Scale is primarily determined by the payload needed for a particular application. For instance, surveying the water column in deep water will require different scientific tools than taking images of an oyster bed in an estuary. There is no way to identify the size of an AUV until it is designed for that application, since these scientific instruments each have their own volume, length, and weight. A methodology for estimating physical parameters using computer vision is presented to help determine the scale for the vehicle. It allows accurate scaling of physical parameters of biological and bio-inspired swimmers with only a side and top view of the platform. A physical scale can also be determined based on the vehicle’s overall volume, which is useful when determining how much payload is needed for a particular application. Further, this can be used in conjunction with 3D modeling software to scale nonexistent platforms. Following the establishment of a physical scale, which locomotion mode would be most appropriate? Unlike conventional AUVs that use propeller or glider locomotion, bio-inspired platforms use a variety of modes. Kinematics and energy expenditures are different for each of these modes. For bio-inspired vehicles, the focus will be on the body-caudal fin (BCF) locomotion, of which four types exist: anguilliform, carangiform, thunniform, and ostraciiform. There is ample research on anguilliform and carangiform locomotion modes, but little research on thunniform and ostraciiform modes. In order to determine which locomotion mode scales best for a bio-inspired AUV, this research examines the power output and kinematic parameters for all four BCF modes. In order to achieve this, computational fluid dynamics simulations are performed on a 2D swimmer for all four modes. Overset meshes are used in lieu of body-fitted meshes to increase stability and decrease computational time. These simulations were used to scale output power over several decades of Reynolds numbers for each locomotion mode. Carangiform locomotion was found to be the most energy efficient, followed by anguilliform, thunniform, and ostraciiform. In order to utilize the above scaling laws in designing a novel platform, or comparing an existing one, there must be a unifying framework. The framework for choosing a suitable platform is presented with a case study of two bio-inspired vehicles and a conventional one. The framework begins by determining how the platform can be physically scaled depending on the payload. Based on the physical scale and derived scaling laws, it then determines performance criteria. It also describes a method for relative cost scaling for each vehicle, which is not covered in the literature. The cost scaling is based on the assumption that all payloads and materials are the same. The case study shows that a conventional AUV performs better on all performance criteria and would cost less to build