Wireless capsule gastrointestinal endoscopy: direction of arrival estimation based localization survey

One of the significant challenges in Capsule Endoscopy (CE) is to precisely determine the pathologies location. The localization process is primarily estimated using the received signal strength from sensors in the capsule system through its movement in the gastrointestinal (GI) tract. Consequently, the wireless capsule endoscope (WCE) system requires improvement to handle the lack of the capsule instantaneous localization information and to solve the relatively low transmission data rate challenges. Furthermore, the association between the capsule’s transmitter position, capsule location, signal reduction and the capsule direction should be assessed. These measurements deliver significant information for the instantaneous capsule localization systems based on TOA (time of arrival) approach, PDOA (phase difference of arrival), RSS (received signal strength), electromagnetic, DOA (direction of arrival) and video tracking approaches are developed to locate the WCE precisely. The current article introduces the acquisition concept of the GI medical images using the endoscopy with a comprehensive description of the endoscopy system components. Capsule localization and tracking are considered to be the most important features of the WCE system, thus the current article emphasizes the most common localization systems generally, highlighting the DOA-based localization systems and discusses the required significant research challenges to be addressed

Wireless Capsule Endoscope Localization with Phase Detection Algorithm and Simplified Human Body Model

Wireless endoscopic capsules can visualize the inside of the digestive tract for the purpose of gastrointestinal diseases diagnose. In order to implement the appropriate treatment method, the transmitted picture should be followed by the information on the location of the endoscope. The article presents the method of localization of endoscopic capsules with wireless transmitter based on the detection of phase difference of signals in the receiver located on patients body. The proposed method uses simplified human body models that can change their dielectric properties to improve the location of the capsule endoscope

On the Accuracy of Wireless Capsule Endoscope RF and Visual Localization

Wireless capsule endoscope (WCE) is becoming one of the most patient-friendly inspection device which provides visual investigation of entire gastrointestinal (GI) tract, while the other traditional (wired) endoscopic devices are usually designed for colon inspection. Locating abnormalities tract such as tumors, polyps and bleedings with wire-connected endoscope in GI tract is simple as long as we could measure the length of the wires inside human body. When WCE is applied, however, this becomes a critical challenge of examination since there is no wires connected to WCE while physicians need to find the exact locations of WCE to identify the position of abnormalities. To locate the WCE accurately, methods have come up in last decade including time of arrival (TOA) based methods, received signal strength (RSS) based methods, phase difference of arrival (PDOA) based methods, electromagnetic methods and video-based tracking methods, etc.. In this thesis, time of arrival (TOA), phase difference of arrival (PDOA) and video based localization methods are proposed and their performance are analyzed. We first propose an novel video-based tracking technique based on maximum mutual information. With this technique, we can tell the displacement and rotation between consecutive frames. Then in TOA chapter, the Cramer-Rao lower bound (CRLB) of TOA ranging inside homogeneous tissue is calculated first then three TOA ranging methods are proposed and compared with the CRLB which is used as the performance guideline. After that, PDOA based ranging technique is applied exploiting phase difference of two signals. Since the phase difference is taken into consideration, the ranging ambiguity is eliminated. We also evaluate the performance of the proposed PDOA ranging method. Finally, these ranging methods are evaluated in non-homogeneous tissues, the results of which are also compared to that in homogeneous tissue to analyze the impact of non-homogeneity

On Simultaneous Localization and Mapping inside the Human Body (Body-SLAM)

Wireless capsule endoscopy (WCE) offers a patient-friendly, non-invasive and painless investigation of the entire small intestine, where other conventional wired endoscopic instruments can barely reach. As a critical component of the capsule endoscopic examination, physicians need to know the precise position of the endoscopic capsule in order to identify the position of intestinal disease after it is detected by the video source. To define the position of the endoscopic capsule, we need to have a map of inside the human body. However, since the shape of the small intestine is extremely complex and the RF signal propagates differently in the non-homogeneous body tissues, accurate mapping and localization inside small intestine is very challenging. In this dissertation, we present an in-body simultaneous localization and mapping technique (Body-SLAM) to enhance the positioning accuracy of the WCE inside the small intestine and reconstruct the trajectory the capsule has traveled. In this way, the positions of the intestinal diseases can be accurately located on the map of inside human body, therefore, facilitates the following up therapeutic operations. The proposed approach takes advantage of data fusion from two sources that come with the WCE: image sequences captured by the WCE\u27s embedded camera and the RF signal emitted by the capsule. This approach estimates the speed and orientation of the endoscopic capsule by analyzing displacements of feature points between consecutive images. Then, it integrates this motion information with the RF measurements by employing a Kalman filter to smooth the localization results and generate the route that the WCE has traveled. The performance of the proposed motion tracking algorithm is validated using empirical data from the patients and this motion model is later imported into a virtual testbed to test the performance of the alternative Body-SLAM algorithms. Experimental results show that the proposed Body-SLAM technique is able to provide accurate tracking of the WCE with average error of less than 2.3cm

Capsule endoscopy of the future: What's on the horizon?

Capsule endoscopes have evolved from passively moving diagnostic devices to actively moving systems with potential therapeutic capability. In this review, we will discuss the state of the art, define the current shortcomings of capsule endoscopy, and address research areas that aim to overcome said shortcomings. Developments in capsule mobility schemes are emphasized in this text, with magnetic actuation being the most promising endeavor. Research groups are working to integrate sensor data and fuse it with robotic control to outperform today's standard invasive procedures, but in a less intrusive manner. With recent advances in areas such as mobility, drug delivery, and therapeutics, we foresee a translation of interventional capsule technology from the bench-top to the clinical setting within the next 10 years

Development of A Soft Robotic Approach for An Intra-abdominal Wireless Laparoscopic Camera

In Single-Incision Laparoscopic Surgery (SILS), the Magnetic Anchoring and Guidance System (MAGS) arises as a promising technique to provide larger workspaces and field of vision for the laparoscopes, relief space for other instruments, and require fewer incisions. Inspired by MAGS, many concept designs related to fully insertable magnetically driven laparoscopes are developed and tested on the transabdominal operation. However, ignoring the tissue interaction and insertion procedure, most of the designs adopt rigid structures, which not only damage the patients\u27 tissue with excess stress concentration and sliding motion but also require complicated operation for the insertion. Meanwhile, lacking state tracking of the insertable camera including pose and contact force, the camera systems operate in open-loop control. This provides mediocre locomotion precision and limited robustness to uncertainties in the environment. This dissertation proposes, develops, and validates a soft robotic approach for an intra-abdominal wireless laparoscopic camera. Contributions presented in this work include (1) feasibility of a soft intra-abdominal laparoscopic camera with friendly tissue interaction and convenient insertion, (2) six degrees of freedom (DOF) real-time localization, (3) Closed-loop control for a robotic-assisted laparoscopic system and (4) untethering solution for wireless communication and high-quality video transmission. Embedding magnet pairs into the camera and external actuator, the camera can be steered and anchored along the abdominal wall through transabdominal magnetic coupling. To avoid the tissue rapture by the sliding motion and dry friction, a wheel structure is applied to achieve rolling motion. Borrowing the ideas from soft robotic research, the main body of the camera implements silicone material, which grants it the bendability to passively attach along the curved abdominal wall and the deformability for easier insertion. The six-DOF pose is estimated in real-time with internal multi-sensor fusion and Newton-Raphson iteration. Combining the pose tracking and force-torque sensor measurement, an interaction model between the deformable camera and tissue is established to evaluate the interaction force over the tissue surface. Moreover, the proposed laparoscopic system is integrated with a multi-DOF manipulator into a robotic-assisted surgical system, where a closed-loop control is realized based on a feedback controller and online optimization. Finally, the wireless control and video streaming are accomplished with Bluetooth Low Energy (BLE) and Analog Video (AV) transmission. Experimental assessments have been implemented to evaluate the performance of the laparoscopic system

Determining the Position and Orientation of In-body Medical Instruments Using Reactive Magnetic Field Mapping

There has been a huge demand for localizing in-body medical instruments (IBMI), such as wireless capsule endoscope (WCE) and nasogastric tube (NGT). Some stud ies have been conducted to solve this issue over the last three decades. In these studies, they either used a permanent magnet (PM), a static current source (SCS), radio frequency (RF) fields or integration of two of these. The PM is a stable and reliable magnetic field source. However, due to the size restriction of the NGT and the WCE, only a small PM can be used. Subsequently, the small size issue causes low power delivery at the larger tracking distance. Also, the PM field is very susceptible to ambient noise, and the PM-based localization is not possible in ap plications requiring robotic actuation. Even though an SCS can be used to replace the permanent magnet, and thus the current level can be varied in relation to the dis tance for optimized power delivery, it requires a relatively high power to generate a higher strength magnetic field. Consequently, a more powerful and larger battery is needed to feed the circuit.Radio frequency field sources require high frequencies to achieve sufficient precision, but these frequencies undergo high attenuation in the body. Therefore, the low-frequency RF field is preferred 1 . In the near-field 2 , plane wave assumption of the far-field fails for localization methods since the waves in this region are spherical. Hence, the wave-front has to be formulated by both the range and the direction of arrival (DOA). The DOA requires the phase difference of neighbouring sensors to be calculated. However, if the operating wavelength is much larger than the distance between the source and the receiver, it is not feasible to compute the phase difference between the neigh bouring sensors. Thus, there are numerous algorithms in the literature to overcome these issues, such as MUSIC or ESPRIT which are either complicated or computa tionally expensive. In RF-based localization, generally the time of arrival (TA), the time differ ence of arrival (TDA), the angle of arrival (AOA) and the received signal strength (RSS) are widely used for localization. However, the TA and TDA require accu rate knowledge of field speed and good time synchronization. It is not possible to accurately know while travelling through the body tissues due to complexity of the tissues. The AOA is also impractical for intra-body applications owing to multiple reflections signal from the tissues, commonly known as the multipath effect. The RSS precision is dependent on good knowledge of power loss in complex body tis sues. Also, the RSS method requires accurate knowledge of the transmitted signal strength. However, the power of transmitted frequencies may vary due to the ca pacitive effect of human tissue on Resonant frequency of source, hence RSS-based techniques prove difficult in practice. Therefore, a novel method of mapping the magnetic field vector in the near field region is proposed. This magnetic field mapping (MFM) uses single-axis coils placed orthogonally with respect to a sensor plane (SP). These single-axis sensors pick up only the orthogonal component of the magnetic field, which varies as a function of the orientation of the source and distance to the source. Thus, using this information, the field strength captured by each sensor is mapped to its correspond ing position on the SP as pixels. Next, these field strengths with known positions are used to detect the location and orientation of the field source relative to the SP. MATLAB and CST Microwave simulation were conducted, and many laboratory experiments were performed, and we show that the novel technique not only over comes the issues faced in the methods mentioned above but also accomplishes an accurate source positioning with a precision of better than ± 0.5 cm in 3-D and orientation with a maximum error of ±5◦

Analysis of the Localization Error for Capsule Endoscopy Applications at UWB Frequencies

Localization for Wireless Capsule Endoscopy (WCE) in the Ultra-Wideband frequency band is a very active field of investigation due to its potential advantages in future endoscopy applications. Received Signal Strength (RSS) based localization is commonly preferred due to its simplicity. Previous studies on Ultra-Wideband (UWB) RSS-based localization showed that the localization accuracy depends on the average ranging error related to the selected combination of receivers, which not always is the one experiencing the highest level of received power. In this paper the tendency of the localization error is further investigated through supplementary software simulations and previously conducted laboratory measurements. Two-dimensional (2D) and three-dimensional (3D) positioning are performed and the trend of the localization error compared in both cases. Results shows that the distribution of the selected path loss values, corresponding to the receivers used for localization, around the in-body position to estimate also affects the localization accuracy.This work was supported by the H2020:MSCA:ITN program for the “Wireless In-body Environment Communication- WiBEC” project under the grant agreement no. 675353. This work was also supported by the European Union’s H2020:MSCA:ITN program for the ”mmWave Communications in the Built Environments - WaveComBE” project under the grant agreement no. 766231.Barbi, M.; Pérez-Simbor, S.; Garcia-Pardo, C.; Cardona Marcet, N. (2019). Analysis of the Localization Error for Capsule Endoscopy Applications at UWB Frequencies. IEEE. https://doi.org/10.1109/ISMICT.2019.8743813

Barometer-Assisted 3D Indoor WiFi Localization for Smart Devices-Map Selection and Performance Evaluation

Recently, indoor localization becomes a hot topic no matter in industry or academic field. Smart phones are good candidates for localization since they are carrying various sensors such as GPS, Wi-Fi, accelerometer, barometer and etc, which can be used to estimate the current location. But there are still many challenges for 3D indoor geolocation using smart phones, among which the map selection and 3D performance evaluation problems are the most common and crucial. In the indoor environment, the popular outdoor Google maps cannot be utilized since we need maps showing the layout of every individual floor. Also, layout of different floors differ from one another. Therefore, algorithms are required to detect whether we are inside or outside a building and determine on which floor we are located so that an appropriate map can be selected accordingly. For Wi-Fi based indoor localization, the performance of location estimation is closely related to the algorithms and deployment that we are using. It is difficult to find out a general approach that can be used to evaluate any localization system. On one hand, since the RF signal will suffer extra loss when traveling through the ceilings between floors, its propagation property will be different from the empirical ones and consequently we should design a new propagation model for 3D scenarios. On the other hand, properties of sensors are unique so that corresponding models are required before we analyze the localization scheme. In-depth investigation on the possible hybrid are also needed in case more than one sensor is operated in the localization system. In this thesis, we firstly designed two algorithms to use GPS signal for detecting whether the smart device is operating inside or outside a building, which is called outdoor-indoor transition detection. We also design another algorithm to use barometer data for determining on which floor are we located, which is considered as a multi-floor transition detection. With three scenarios designed inside the Akwater Kent Laboratory building (AK building) at Worcester Polytechnic Institute (WPI), we collected raw data from an Android phone with a version of 4.3 and conducted experimental analysis based on that. An efficient way to quantitatively evaluate the 3D localization systems is using Cramer-Rao Lower Bound (CRLB), which is considered as the lower bound of the estimated error for any localization system. The characteristics of Wi-Fi and barometer signals are explored and proper models are introduced as a foundation. Then we extended the 2D CRLB into a 3D format so that it can fit the our 3D scenarios. A barometer-assisted CRLB is introduced as an improvement for the existing Wi-Fi Receive Signal Strength (RSS)-only scheme and both of the two schemes are compared with the contours in every scenario and the statistical analysis