Hybrid 6-DoFs magnetic localization for robotic capsule endoscopes compatible with high-grade magnetic field navigation

This paper proposes a hybrid 6-DoFs localization system for endoscopic magnetic capsules, compatible with external high-grade permanent magnetic locomotion. The proposed localization system, which is able to provide an accurate estimation of the endoscopic capsule pose, finds application in the robotic endoscopy field to provide efficient closed-loop navigation of a magnetically-driven tethered capsule. It takes advantage of two optimization steps based on a triangulation approach, i.e. (1) mathematical approximations of the magnetic field, and (2) minimization of the magnetic field mean square deviation. The proposed localization system was tested in two different in-vitro scenarios for mimicking the clinical cases that a magnetic capsule would encounter during tele-operated magnetic navigation. The development phase was preceded by an in-depth work-space analysis to lay the groundwork for the localization design and implementation. Results of the hybrid 6-DoFs localization system show a significant accuracy in accordance with the state-of-the-art, i.e. < 5 mm and < 5° in position and orientation, but introducing benefits in expanding the work-space by increasing the number of electromagnets on the operating table as an independent solution with respect to the external magnetic locomotion source

Frontiers of robotic endoscopic capsules: a review

Digestive diseases are a major burden for society and healthcare systems, and with an aging population, the importance of their effective management will become critical. Healthcare systems worldwide already struggle to insure quality and affordability of healthcare delivery and this will be a significant challenge in the midterm future. Wireless capsule endoscopy (WCE), introduced in 2000 by Given Imaging Ltd., is an example of disruptive technology and represents an attractive alternative to traditional diagnostic techniques. WCE overcomes conventional endoscopy enabling inspection of the digestive system without discomfort or the need for sedation. Thus, it has the advantage of encouraging patients to undergo gastrointestinal (GI) tract examinations and of facilitating mass screening programmes. With the integration of further capabilities based on microrobotics, e.g. active locomotion and embedded therapeutic modules, WCE could become the key-technology for GI diagnosis and treatment. This review presents a research update on WCE and describes the state-of-the-art of current endoscopic devices with a focus on research-oriented robotic capsule endoscopes enabled by microsystem technologies. The article also presents a visionary perspective on WCE potential for screening, diagnostic and therapeutic endoscopic procedures

Endoscopic Tactile Capsule for Non-Polypoid Colorectal Tumour Detection

An endoscopic tactile robotic capsule, embedding miniaturized MEMS force sensors, is presented. The capsule is conceived to provide automatic palpation of non-polypoid colorectal tumours during colonoscopy, since it is characterized by high degree of dysplasia, higher invasiveness and lower detection rates with respect to polyps. A first test was performed employing a silicone phantom that embedded inclusions with variable hardness and curvature. A hardness-based classification was implemented, demonstrating detection robustness to curvature variation. By comparing a set of supervised classification algorithms, a weighted 3-nearest neighbor classifier was selected. A bias force normalization model was introduced in order to make different acquisition sets consistent. Parameters of this model were chosen through a particle swarm optimization method. Additionally, an ex-vivo test was performed to assess the capsule detection performance when magnetically-driven along a colonic tissue. Lumps were identified as voltage peaks with a prominence depending on the total magnetic force applied to the capsule. Accuracy of 94 % in hardness classification was achieved, while a 100 % accuracy is obtained for the lump detection within a tolerance of 5 mm from the central path described by the capsule. In real application scenario, we foresee our device aiding physicians to detect tumorous tissues

A Magnetic Actuated Fully Insertable Robotic Camera System for Single Incision Laparoscopic Surgery

Minimally Invasive Surgery (MIS) is a common surgical procedure which makes tiny incisions in the patients anatomy, inserting surgical instruments and using laparoscopic cameras to guide the procedure. Compared with traditional open surgery, MIS allows surgeons to perform complex surgeries with reduced trauma to the muscles and soft tissues, less intraoperative hemorrhaging and postoperative pain, and faster recovery time. Surgeons rely heavily on laparoscopic cameras for hand-eye coordination and control during a procedure. However, the use of a standard laparoscopic camera, achieved by pushing long sticks into a dedicated small opening, involves multiple incisions for the surgical instruments. Recently, single incision laparoscopic surgery (SILS) and natural orifice translumenal endoscopic surgery (NOTES) have been introduced to reduce or even eliminate the number of incisions. However, the shared use of a single incision or a natural orifice for both surgical instruments and laparoscopic cameras further reduces dexterity in manipulating instruments and laparoscopic cameras with low efficient visual feedback. In this dissertation, an innovative actuation mechanism design is proposed for laparoscopic cameras that can be navigated, anchored and orientated wirelessly with a single rigid body to improve surgical procedures, especially for SILS. This design eliminates the need for an articulated design and the integrated motors to significantly reduce the size of the camera. The design features a unified mechanism for anchoring, navigating, and rotating a fully insertable camera by externally generated rotational magnetic field. The key component and innovation of the robotic camera is the magnetic driving unit, which is referred to as a rotor, driven externally by a specially designed magnetic stator. The rotor, with permanent magnets (PMs) embedded in a capsulated camera, can be magnetically coupled to a stator placed externally against or close to a dermal surface. The external stator, which consists of PMs and coils, generates 3D rotational magnetic field that thereby produces torque to rotate the rotor for desired camera orientation, and force to serve as an anchoring system that keeps the camera steady during a surgical procedure. Experimental assessments have been implemented to evaluate the performance of the camera system

Capsule endoscopy of the future: What's on the horizon?

Capsule endoscopes have evolved from passively moving diagnostic devices to actively moving systems with potential therapeutic capability. In this review, we will discuss the state of the art, define the current shortcomings of capsule endoscopy, and address research areas that aim to overcome said shortcomings. Developments in capsule mobility schemes are emphasized in this text, with magnetic actuation being the most promising endeavor. Research groups are working to integrate sensor data and fuse it with robotic control to outperform today's standard invasive procedures, but in a less intrusive manner. With recent advances in areas such as mobility, drug delivery, and therapeutics, we foresee a translation of interventional capsule technology from the bench-top to the clinical setting within the next 10 years

Photometric Stereo-Based Depth Map Reconstruction for Monocular Capsule Endoscopy

The capsule endoscopy robot can only use monocular vision due to the dimensional limit. To improve the depth perception of the monocular capsule endoscopy robot, this paper proposes a photometric stereo-based depth map reconstruction method. First, based on the characteristics of the capsule endoscopy robot system, a photometric stereo framework is established. Then, by combining the specular property and Lambertian property of the object surface, the depth of the specular highlight point is estimated, and the depth map of the whole object surface is reconstructed by a forward upwind scheme. To evaluate the precision of the depth estimation of the specular highlight region and the depth map reconstruction of the object surface, simulations and experiments are implemented with synthetic images and pig colon tissue, respectively. The results of the simulations and experiments show that the proposed method provides good precision for depth map reconstruction in monocular capsule endoscopy

Conformal antenna-based wireless telemetry system for capsule endoscopy

Capsule endoscopy for imaging the gastrointestinal tract is an innovative tool for carrying out medical diagnosis and therapy. Additional modalities beyond optical imaging would enhance current capabilities at the expense of denser integration, due to the limited space available within the capsule. We therefore need new designs and technologies to increase the smartness of the capsules for a given volume. This thesis presents the design, manufacture and performance characterisation of a helical antenna placed conformally outside an endoscopic capsule, and the characterisation in-silico, in-vitro and in-vivo of the telemetry system in alive and euthanised pigs. This method does not use the internal volume of the capsule, but does use an extra coating to protect the antenna from the surrounding tissue and maintain biocompatibility for safe use inside the human body. The helical antenna, radiating at 433 MHz with a bandwidth of 20 MHz within a muscle-type tissue, presents a low gain and efficiency, which is typical for implantable and ingestible medical devices. Telemetry capsule prototypes were simulated, manufactured and assembled with the necessary internal electronics, including a commercially available transceiver unit. Thermistors were embedded into each capsule shell, to record any temperature increase in the tissue surrounding the antenna during the experiments. A temperature increase of less than 1°C was detected for the tissue surrounding the antenna. The process of coating the biocompatible insulation layer over the full length of the capsule is described in detail. Data transmission programmes were established to send programmed data packets to an external receiver. The prototypes radiated at different power levels ranging from -10 to 10 dBm, and all capsules demonstrated a satisfactory performance at a data rate of 16 kbps during phantom and in-vivo experiments. Data transmission was achieved with low bit-error rates below 10-5. A low signal strength of only -54 dBm still provided effective data transfer, irrespective of the orientation and location of the capsule, and this successfully demonstrated the feasibility of the system

The Future of Capsule Endoscopy: The Role of Artificial Intelligence and Other Technical Advancements

Capsule endoscopy has revolutionized the management of small-bowel diseases owing to its convenience and noninvasiveness. Capsule endoscopy is a common method for the evaluation of obscure gastrointestinal bleeding, Crohn’s disease, small-bowel tumors, and polyposis syndrome. However, the laborious reading process, oversight of small-bowel lesions, and lack of locomotion are major obstacles to expanding its application. Along with recent advances in artificial intelligence, several studies have reported the promising performance of convolutional neural network systems for the diagnosis of various small-bowel lesions including erosion/ulcers, angioectasias, polyps, and bleeding lesions, which have reduced the time needed for capsule endoscopy interpretation. Furthermore, colon capsule endoscopy and capsule endoscopy locomotion driven by magnetic force have been investigated for clinical application, and various capsule endoscopy prototypes for active locomotion, biopsy, or therapeutic approaches have been introduced. In this review, we will discuss the recent advancements in artificial intelligence in the field of capsule endoscopy, as well as studies on other technological improvements in capsule endoscopy

Development of An In Vivo Robotic Camera for Dexterous Manipulation and Clear Imaging

Minimally invasive surgeriy (MIS) techniques are becoming more popular as replacements for traditional open surgeries. These methods benefit patients with lowering blood loss and post-operative pain, reducing recovery period and hospital stay time, decreasing surgical area scarring and cosmetic issues, and lessening the treatment costs, hence greater patient satisfaction would be earned. Manipulating surgical instruments from outside of abdomen and performing surgery needs precise hand-eye coordination which is provided by insertable cameras. The traditional MIS insertable cameras suffer from port complexity and reduced manipulation dexterity, which leads to defection in Hand-eye coordination and surgical flow. Fully insertable robotic camera systems emerged as a promising solution in MIS. Implementing robotic camera systems faces multiple challenges in fixation, manipulation, orientation control, tool-tissue interaction, in vivo illumination and clear imaging.In this dissertation a novel actuation and control mechanism is developed and validated for an insertable laparoscopic camera. This design uses permanent magnets and coils as force/torque generators in an external control unit to manipulate an in vivo camera capsule. The motorless design of this capsule reduces the, wight, size and power consumption of the driven unit. In order to guarantee the smooth motion of the camera inside the abdominal cavity, an interaction force control method was proposed and validated.Optimizing the system\u27s design, through minimizing the control unit size and power consumption and extending maneuverability of insertable camera, was achieved by a novel transformable design, which uses a single permanent magnet in the control unit. The camera robot uses a permanent magnet as fixation and translation unit, and two embedded motor for tilt motion actuation, as well as illumination actuation. Transformable design provides superior imaging quality through an optimized illumination unit and a cleaning module. The illumination module uses freeform optical lenses to control light beams from the LEDs to achieve optimized illumination over surgical zone. The cleaning module prevents lens contamination through a pump actuated debris prevention system, while mechanically wipes the lens in case of contamination. The performance of transformable design and its modules have been assessed experimentally

Polymer capsules as building blocks for soft, connected mesostructures

We show that polymer capsules can serve as soft building blocks for creating a range of mesoscale (0.1 to 10 mm) structures. The central innovation is a new approach for connecting spherical capsules by exploiting electrostatic complexation. Using this approach, connected structures with complex shapes can be easily assembled, and more importantly, a single connected structure can be made to have a diverse array of functions. The modular approach to shape and function is very much like using Lego bricks of different colors. The connected structures can be made responsive (capable of being actuated) by magnetic fields by including magnetic capsules within them. One motivation for creating these structures is to mimic the mechanics and motility of small creatures such as the earthworm or ant - this could eventually enable the design of autonomous biomimetic robots. In addition, soft connected structures could be employed to transport cargo such as drugs or proteins in blood vessels, or to construct valves, rotors, or mixers in microfluidic or lab-on-a-chip devices