A WI-FI BASED SMART DATA LOGGER FOR CAPSULE ENDOSCOPY AND MEDICAL APPLICATIONS

Wireless capsule endoscopy (WCE) is a non-invasive technology for capturing images of a human digestive system for medical diagnostics purpose. With WCE, the patient swallows a miniature capsule with camera, data processing unit, RF transmitter and batteries. The capsule captures and transmits images wirelessly from inside the human gastrointestinal (GI) tract. The external data logger worn by the patient stores the images and is later on transferred to a computer for presentation and image analysis. In this research, we designed and built a Wi-Fi based, low cost, miniature, versatile wearable data logger. The data logger is used with Wi-Fi enabled smart devices, smart phones and data servers to store and present images captured by capsule. The proposed data logger is designed to work with wireless capsule endoscopy and other biosensors like- temperature and heart rate sensors. The data logger is small enough to carry and conduct daily activities, and the patient do not need to carry traditional bulky data recorder all the time during diagnosis. The doctors can remotely access data and analyze the images from capsule endoscopy using remote access feature of the data logger. Smartphones and tablets have extensive processing power with expandable memory. This research exploits those capabilities to use with wireless capsule endoscopy and medical data logging applications. The application- specific data recorders are replaced by the proposed Wi-Fi data logger and smartphone. The data processing application is distributed on smart devices like smartphone /tablets and data logger. Once data are stored in smart devices, the data can be accessed remotely, distributed to the cloud and shared within networks to enable telemedicine. The data logger can work in both standalone and network mode. In the normal mode of the device, data logger stores medical data locally into a micro Secure Digital card for future download using the universal serial bus to the computer. In network mode, the real-time data is streamed into a smartphone and tablet for further processing and storage. The proposed Wi-Fi based data logger is prototyped in the lab and tested with the capsule hardware developed in our laboratory. The supporting Android app is also developed to collect data from the data logger and present the processed data to the viewer. The PC based software is also developed to access the data recorder and capture and download data from the data logger in real-time remotely. Both in vivo and ex vivo trials using live pig have been conducted to validate the performance of the proposed device

Systematic Design of edical Capsule Robots

Medical capsule robots that navigate inside the body as diagnostic and interventional tools are an emerging and challenging research area within medical CPSs. These robots must provide locomotion, sensing, actuation, and communication within severe size, power, and computational constraints. This paper presents the first effort for an open architecture, platform design, software infrastructure, and a supporting modular design environment for medical capsule robots to further this research area

Capsule endoscopy system with novel imaging algorithms

Wireless capsule endoscopy (WCE) is a state-of-the-art technology to receive images of human intestine for medical diagnostics. In WCE, the patient ingests a specially designed electronic capsule which has imaging and wireless transmission capabilities inside it. While the capsule travels through the gastrointestinal (GI) tract, it captures images and sends them wirelessly to an outside data logger unit. The data logger stores the image data and then they are transferred to a personal computer (PC) where the images are reconstructed and displayed for diagnosis. The key design challenge in WCE is to reduce the area and power consumption of the capsule while maintaining acceptable image reconstruction. In this research, the unique properties of WCE images are identified by analyzing hundreds of endoscopic images and video frames, and then these properties are used to develop novel and low complexity compression algorithms tailored for capsule endoscopy. The proposed image compressor consists of a new YEF color space converter, lossless prediction coder, customizable chrominance sub-sampler and an efficient Golomb-Rice encoder. The scheme has both lossy and lossless modes and is further customized to work with two lighting modes – conventional white light imaging (WLI) and emerging narrow band imaging (NBI). The average compression ratio achieved using the proposed lossy compression algorithm is 80.4% for WBI and 79.2% for NBI with high reconstruction quality index for both bands. Two surveys have been conducted which show that the reconstructed images have high acceptability among medical imaging doctors and gastroenterologists. The imaging algorithms have been realized in hardware description language (HDL) and their functionalities have been verified in field programmable gate array (FPGA) board. Later it was implemented in a 0.18 μm complementary metal oxide semiconductor (CMOS) technology and the chip was fabricated. Due to the low complexity of the core compressor, it consumes only 43 µW of power and 0.032 mm2 of area. The compressor is designed to work with commercial low-power image sensor that outputs image pixels in raster scan fashion, eliminating the need of significant input buffer memory. To demonstrate the advantage, a prototype of the complete WCE system including an FPGA based electronic capsule, a microcontroller based data logger unit and a Windows based image reconstruction software have been developed. The capsule contains the proposed low complexity image compressor and can generate both lossy and lossless compressed bit-stream. The capsule prototype also supports both white light imaging (WLI) and narrow band imaging (NBI) imaging modes and communicates with the data logger in full duplex fashion, which enables configuring the image size and imaging mode in real time during the examination. The developed data logger is portable and has a high data rate wireless connectivity including Bluetooth, graphical display for real time image viewing with state-of-the-art touch screen technology. The data are logged in micro SD cards and can be transferred to PC or Smartphone using card reader, USB interface, or Bluetooth wireless link. The workstation software can decompress and show the reconstructed images. The images can be navigated, marked, zoomed and can be played as video. Finally, ex-vivo testing of the WCE system has been done in pig's intestine to validate its performance

Magnetic Surgical Instruments for Robotic Abdominal Surgery.

This review looks at the implementation of magnetic-based approaches in surgical instruments for abdominal surgeries. As abdominal surgical techniques advance toward minimizing surgical trauma, surgical instruments are enhanced to support such an objective through the exploration of magnetic-based systems. With this design approach, surgical devices are given the capabilities to be fully inserted intraabdominally to achieve access to all abdominal quadrants, without the conventional rigid link connection with the external unit. The variety of intraabdominal surgical devices are anchored, guided, and actuated by external units, with power and torque transmitted across the abdominal wall through magnetic linkage. This addresses many constraints encountered by conventional laparoscopic tools, such as loss of triangulation, fulcrum effect, and loss/lack of dexterity for surgical tasks. Design requirements of clinical considerations to aid the successful development of magnetic surgical instruments, are also discussed

Component based design of a drug delivery capsule robot

Since the introduction of Wireless Capsule Endoscopy (WCE) researchers have started exploring the design space of Medical Capsule Robots (MCRs): embedded micro-systems that can operate autonomously within the human body and can diagnose, prevent, monitor, and cure diseases. Although the research in the area of MCRs is an active topic and has grown exponentially, current devices provide only limited functionalities because their design process is expensive and time consuming. To open this research field to a wider community and, at the same time, create better designs through advanced tool support, in our previous works we presented a design environment for the rapid development of MCRs. In this paper, this environment was adopted to design a Drug Delivery Capsule (DDC) based on a coil-magnet-piston mechanism. The force of the coil acting on the magnetic piston and the drug release profile were modeled and assessed on bench-top with a maximum relative error below 5%. Then, in vivo trials were performed to validate the DDC functionality with a scheduled drug release profile for a 5 h and 24 min procedure. The resulting design environment template is available open source for further development of drug delivery applications as well as to serve as guideline in prototyping novel MCRs addressing other clinical needs

SMAC — A Modular Open Source Architecture for Medical Capsule Robots

The field of Medical Capsule Robots (MCRs) is gaining momentum in the robotics community, with applications spanning from abdominal surgery to gastrointestinal (GI) endoscopy. MCRs are miniature multifunctional devices usually constrained in both size and on-board power supply. The design process for MCRs is time consuming and resource intensive, as it involves the development of custom hardware and software components. In this work, we present the STORM Lab Modular Architecture for Capsules (SMAC), a modular open source architecture for MCRs aiming to provide the MCRs research community with a tool for shortening the design and development time for capsule robots. The SMAC platform consists of both hardware modules and firmware libraries that can be used for developing MCRs. In particular, the SMAC modules are miniature boards of uniform diameter (i.e., 9.8 mm) that are able to fulfill five different functions: signal coordination combined with wireless data transmission, sensing, actuation, powering and vision/illumination. They are small in size, low power, and have reconfigurable software libraries for the Hardware Abstraction Layer (HAL), which has been proven to work reliably for different types of MCRs. A design template for a generic SMAC application implementing a robust communication protocol is presented in this work, together with its finite state machine abstraction, capturing all the architectural components involved. The reliability of the wireless link is assessed for different levels of data transmission power and separation distances. The current consumption for each SMAC module is quantified and the timing of a SMAC radio message transmission is characterized. Finally, the applicability of SMAC in the field of MCRs is discussed by analysing examples from the literature

Challenges of continuum robots in clinical context: a review

With the maturity of surgical robotic systems based on traditional rigid-link principles, the rate of progress slowed as limits of size and controllable degrees of freedom were reached. Continuum robots came with the potential to deliver a step change in the next generation of medical devices, by providing better access, safer interactions and making new procedures possible. Over the last few years, several continuum robotic systems have been launched commercially and have been increasingly adopted in hospitals. Despite the clear progress achieved, continuum robots still suffer from design complexity hindering their dexterity and scalability. Recent advances in actuation methods have looked to address this issue, offering alternatives to commonly employed approaches. Additionally, continuum structures introduce significant complexity in modelling, sensing, control and fabrication; topics which are of particular focus in the robotics community. It is, therefore, the aim of the presented work to highlight the pertinent areas of active research and to discuss the challenges to be addressed before the potential of continuum robots as medical devices may be fully realised

sCAM: An Untethered Insertable Laparoscopic Surgical Camera Robot

Fully insertable robotic imaging devices represent a promising future of minimally invasive laparoscopic vision. Emerging research efforts in this field have resulted in several proof-of-concept prototypes. One common drawback of these designs derives from their clumsy tethering wires which not only cause operational interference but also reduce camera mobility. Meanwhile, these insertable laparoscopic cameras are manipulated without any pose information or haptic feedback, which results in open loop motion control and raises concerns about surgical safety caused by inappropriate use of force.This dissertation proposes, implements, and validates an untethered insertable laparoscopic surgical camera (sCAM) robot. Contributions presented in this work include: (1) feasibility of an untethered fully insertable laparoscopic surgical camera, (2) camera-tissue interaction characterization and force sensing, (3) pose estimation, visualization, and feedback with sCAM, and (4) robotic-assisted closed-loop laparoscopic camera control. Borrowing the principle of spherical motors, camera anchoring and actuation are achieved through transabdominal magnetic coupling in a stator-rotor manner. To avoid the tethering wires, laparoscopic vision and control communication are realized with dedicated wireless links based on onboard power. A non-invasive indirect approach is proposed to provide real-time camera-tissue interaction force measurement, which, assisted by camera-tissue interaction modeling, predicts stress distribution over the tissue surface. Meanwhile, the camera pose is remotely estimated and visualized using complementary filtering based on onboard motion sensing. Facilitated by the force measurement and pose estimation, robotic-assisted closed-loop control has been realized in a double-loop control scheme with shared autonomy between surgeons and the robotic controller.The sCAM has brought robotic laparoscopic imaging one step further toward less invasiveness and more dexterity. Initial ex vivo test results have verified functions of the implemented sCAM design and the proposed force measurement and pose estimation approaches, demonstrating the technical feasibility of a tetherless insertable laparoscopic camera. Robotic-assisted control has shown its potential to free surgeons from low-level intricate camera manipulation workload and improve precision and intuitiveness in laparoscopic imaging

Detection of Intestinal Bleeding in Wireless Capsule Endoscopy using Machine Learning Techniques

Gastrointestinal (GI) bleeding is very common in humans, which may lead to fatal consequences. GI bleeding can usually be identified using a flexible wired endoscope. In 2001, a newer diagnostic tool, wireless capsule endoscopy (WCE) was introduced. It is a swallow-able capsule-shaped device with a camera that captures thousands of color images and wirelessly sends those back to a data recorder. After that, the physicians analyze those images in order to identify any GI abnormalities. But it takes a longer screening time which may increase the danger of the patients in emergency cases. It is therefore necessary to use a real-time detection tool to identify bleeding in the GI tract. Each material has its own spectral ‘signature’ which shows distinct characteristics in specific wavelength of light [33]. Therefore, by evaluating the optical characteristics, the presence of blood can be detected. In the study, three main hardware designs were presented: one using a two-wavelength based optical sensor and others using two six-wavelength based spectral sensors with AS7262 and AS7263 chips respectively to determine the optical characteristics of the blood and non-blood samples. The goal of the research is to develop a machine learning model to differentiate blood samples (BS) and non-blood samples (NBS) by exploring their optical properties. In this experiment, 10 levels of crystallized bovine hemoglobin solutions were used as BS and 5 food colors (red, yellow, orange, tan and pink) with different concentrations totaling 25 non-blood samples were used as NBS. These blood and non-blood samples were also combined with pig’s intestine to mimic in-vivo experimental environment. The collected samples were completely separated into training and testing data. Different spectral features are analyzed to obtain the optical information about the samples. Based on the performance on the selected most significant features of the spectral wavelengths, k-nearest neighbors algorithm (k-NN) is finally chosen for the automated bleeding detection. The proposed k-NN classifier model has been able to distinguish the BS and NBS with an accuracy of 91.54% using two wavelengths features and around 89% using three combined wavelengths features in the visible and near-infrared spectral regions. The research also indicates that it is possible to deploy tiny optical detectors to detect GI bleeding in a WCE system which could eliminate the need of time-consuming image post-processing steps

Towards tactile sensing active capsule endoscopy

Examination of the gastrointestinal(GI) tract has traditionally been performed using tethered endoscopy tools with limited reach and more recently with passive untethered capsule endoscopy with limited capability. Inspection of small intestines is only possible using the latter capsule endoscopy with on board camera system. Limited to visual means it cannot detect features beneath the lumen wall if they have not affected the lumen structure or colour. This work presents an improved capsule endoscopy system with locomotion for active exploration of the small intestines and tactile sensing to detect deformation of the capsule outer surface when it follows the intestinal wall. In laboratory conditions this system is capable of identifying sub-lumen features such as submucosal tumours.Through an extensive literary review the current state of GI tract inspection in particular using remote operated miniature robotics, was investigated, concluding no solution currently exists that utilises tactile sensing with a capsule endoscopy. In order to achieve such a platform, further investigation was made in to tactile sensing technologies, methods of locomotion through the gut, and methods to support an increased power requirement for additional electronics and actuation. A set of detailed criteria were compiled for a soft formed sensor and flexible bodied locomotion system. The sensing system is built on the biomimetic tactile sensing device, Tactip, \cite{Chorley2008, Chorley2010, Winstone2012, Winstone2013} which has been redesigned to fit the form of a capsule endoscopy. These modifications have required a $360^{o}$ cylindrical sensing surface with $360^{o}$ panoramic optical system. Multi-material 3D printing has been used to build an almost complete sensor assembly with a combination of hard and soft materials, presenting a soft compliant tactile sensing system that mimics the tactile sensing methods of the human finger. The cylindrical Tactip has been validated using artificial submucosal tumours in laboratory conditions. The first experiment has explored the new form factor and measured the device's ability to detect surface deformation when travelling through a pipe like structure with varying lump obstructions. Sensor data was analysed and used to reconstruct the test environment as a 3D rendered structure. A second tactile sensing experiment has explored the use of classifier algorithms to successfully discriminate between three tumour characteristics; shape, size and material hardness. Locomotion of the capsule endoscopy has explored further bio-inspiration from earthworm's peristaltic locomotion, which share operating environment similarities. A soft bodied peristaltic worm robot has been developed that uses a tuned planetary gearbox mechanism to displace tendons that contract each worm segment. Methods have been identified to optimise the gearbox parameter to a pipe like structure of a given diameter. The locomotion system has been tested within a laboratory constructed pipe environment, showing that using only one actuator, three independent worm segments can be controlled. This configuration achieves comparable locomotion capabilities to that of an identical robot with an actuator dedicated to each individual worm segment. This system can be miniaturised more easily due to reduced parts and number of actuators, and so is more suitable for capsule endoscopy. Finally, these two developments have been integrated to demonstrate successful simultaneous locomotion and sensing to detect an artificial submucosal tumour embedded within the test environment. The addition of both tactile sensing and locomotion have created a need for additional power beyond what is available from current battery technology. Early stage work has reviewed wireless power transfer (WPT) as a potential solution to this problem. Methods for optimisation and miniaturisation to implement WPT on a capsule endoscopy have been identified with a laboratory built system that validates the methods found. Future work would see this combined with a miniaturised development of the robot presented. This thesis has developed a novel method for sub-lumen examination. With further efforts to miniaturise the robot it could provide a comfortable and non-invasive procedure to GI tract inspection reducing the need for surgical procedures and accessibility for earlier stage of examination. Furthermore, these developments have applicability in other domains such as veterinary medicine, industrial pipe inspection and exploration of hazardous environments