Multimodal Noncontact Tracking of Surgical Instruments

For many procedures, open surgery is being replaced with minimally invasive surgical (MIS) techniques. The advantages of MIS include reduced operative trauma and fewer complications leading to faster patient recovery, better cosmetic results and shorter hospital stays. As the demand for MIS procedures increases, effective surgical training tools must be developed to improve procedure efficiency and patient safety. Motion tracking of laparoscopic instruments can provide objective skills assessment for novices and experienced users. The most common approaches to noncontact motion capture are optical and electromagnetic (EM) tracking systems, though each approach has operational limitations. Optical trackers are prone to occlusion and the performance of EM trackers degrades in the presence of magnetic and ferromagnetic material. The cost of these systems also limits their availability for surgical training and clinical environments. This thesis describes the development and validation of a novel, noncontact laparoscopic tracking system as an inexpensive alternative to current technology. This system is based on the fusion of inertial, magnetic and distance sensing to generate real-time, 6-DOF pose data. Orientation is estimated using a Kalman-filtered attitude-heading reference system (AHRS) and restricted motion at the trocar provides a datum from which position information can be recovered. The Inertial and Range-Enhanced Surgical (IRES) Tracker was prototyped, then validated using a MIS training box and by comparison to an EM tracking system. Results of IRES tracker testing showed similar performance to an EM tracker with position error as low as 1.25 mm RMS and orientation error \u3c0.58 degrees RMS along each axis. The IRES tracker also displayed greater precision and superior magnetic interference rejection capabilities. At a fraction of the cost of current laparoscopic tracking methods, the IRES tracking system would provide an excellent alternative for use in surgical training and skills assessment

A Non-Inductive Magnetic Eye-Tracker: From Dipole Tracking to Gaze Retrieval

We analyze the information that can be retrieved from the tracking parameters produced by an innovative wearable eye tracker. The latter is based on a permanent-magnet marked corneal lens and by an array of magnetoresistive detectors that measure the magnetostatic field in several positions in the eye proximity. We demonstrate that, despite missing information due to the axial symmetry of the measured field, physiological constraints or measurement conditions make possible to infer complete eye-pose data. Angular precision and accuracy achieved with the current prototypical device are also assessed and briefly discussed. The results show that the instrumentation considered is suitable as a new, moderately invasive medical diagnostics for the characterization of ocular movements and associated disorders

Determining the Position and Orientation of In-body Medical Instruments Using Reactive Magnetic Field Mapping

There has been a huge demand for localizing in-body medical instruments (IBMI), such as wireless capsule endoscope (WCE) and nasogastric tube (NGT). Some stud ies have been conducted to solve this issue over the last three decades. In these studies, they either used a permanent magnet (PM), a static current source (SCS), radio frequency (RF) fields or integration of two of these. The PM is a stable and reliable magnetic field source. However, due to the size restriction of the NGT and the WCE, only a small PM can be used. Subsequently, the small size issue causes low power delivery at the larger tracking distance. Also, the PM field is very susceptible to ambient noise, and the PM-based localization is not possible in ap plications requiring robotic actuation. Even though an SCS can be used to replace the permanent magnet, and thus the current level can be varied in relation to the dis tance for optimized power delivery, it requires a relatively high power to generate a higher strength magnetic field. Consequently, a more powerful and larger battery is needed to feed the circuit.Radio frequency field sources require high frequencies to achieve sufficient precision, but these frequencies undergo high attenuation in the body. Therefore, the low-frequency RF field is preferred 1 . In the near-field 2 , plane wave assumption of the far-field fails for localization methods since the waves in this region are spherical. Hence, the wave-front has to be formulated by both the range and the direction of arrival (DOA). The DOA requires the phase difference of neighbouring sensors to be calculated. However, if the operating wavelength is much larger than the distance between the source and the receiver, it is not feasible to compute the phase difference between the neigh bouring sensors. Thus, there are numerous algorithms in the literature to overcome these issues, such as MUSIC or ESPRIT which are either complicated or computa tionally expensive. In RF-based localization, generally the time of arrival (TA), the time differ ence of arrival (TDA), the angle of arrival (AOA) and the received signal strength (RSS) are widely used for localization. However, the TA and TDA require accu rate knowledge of field speed and good time synchronization. It is not possible to accurately know while travelling through the body tissues due to complexity of the tissues. The AOA is also impractical for intra-body applications owing to multiple reflections signal from the tissues, commonly known as the multipath effect. The RSS precision is dependent on good knowledge of power loss in complex body tis sues. Also, the RSS method requires accurate knowledge of the transmitted signal strength. However, the power of transmitted frequencies may vary due to the ca pacitive effect of human tissue on Resonant frequency of source, hence RSS-based techniques prove difficult in practice. Therefore, a novel method of mapping the magnetic field vector in the near field region is proposed. This magnetic field mapping (MFM) uses single-axis coils placed orthogonally with respect to a sensor plane (SP). These single-axis sensors pick up only the orthogonal component of the magnetic field, which varies as a function of the orientation of the source and distance to the source. Thus, using this information, the field strength captured by each sensor is mapped to its correspond ing position on the SP as pixels. Next, these field strengths with known positions are used to detect the location and orientation of the field source relative to the SP. MATLAB and CST Microwave simulation were conducted, and many laboratory experiments were performed, and we show that the novel technique not only over comes the issues faced in the methods mentioned above but also accomplishes an accurate source positioning with a precision of better than ± 0.5 cm in 3-D and orientation with a maximum error of ±5◦

Mapeamento magnético para navegação robótica em ambientes interiores

Localization has always been one of the fundamental problems in the field of robotic navigation. The emergence of GPS came as a solution for localization systems in outdoor environments. However, the accuracy of GPS is not always sufficient and GPS based systems often fail and are not suited for indoor environments. Considering this, today there is a variety of real time localization technologies. It is quite common to see magnetic anomalies in indoor environments, which arise due to the presence of ferromagnetic objects, such as concrete or steel infrastructures. In the conventional ambient magnetic field based robotic navigation, which uses the direction of the Earth’s magnetic field to determine orientation, these anomalies are seen as undesirable. However, if the environment is rich in anomalies with sufficient local variability, they can be mapped and used as features for localization purposes. The work presented in this dissertation aims at demonstrating that it is possible to combine the odometric measurements of a mobile robot with magnetic field measurements, in order to effectively estimate the position of the robot in real time in an indoor environment. For this purpose, it is necessary to map the navigation space and develop a localization algorithm. First, the issues addressed to create a magnetic map are presented, namely data acquisition, employed interpolation methods and validation processes. Subsequently, the developed localization algorithm, based on a particle filter, is depicted, as well as the respective experimental validation tests.A localização sempre fui um dos problemas fundamentais a resolver no âmbito da navegação robótica. O surgimento do GPS veio a servir de solução para bastantes sistemas de localização em ambientes exteriores. No entanto, a exatidão do GPS nem sempre é suficiente e os sistemas baseados em GPS falham frequentemente e não são aplicáveis em ambientes interiores. À vista disso, hoje existe uma variedade de tecnologias de localização em tempo real. É bastante comum verificarem-se anomalias magnéticas em ambientes interiores, que provêm de objetos ferromagnéticos, como infraestruturas de betão ou aço. Na navegação robótica baseada na leitura do campo magnético convencional, que utiliza a direção do campo magnético terrestre para determinar a orientação, estas anomalias são vistas como indesejáveis. No entanto, se o ambiente for rico em anomalias com variabilidade local suficiente, estas podem ser mapeadas e utilizadas como caraterísticas para efeitos de localização. O trabalho apresentado nesta dissertação visa a demonstrar que é possível conjugar as medidas odométricas de um robô móvel com medições do campo magnético, para efetivamente localizar o robô em tempo real num ambiente interior. Para esse efeito, é necessário mapear o espaço de navegação e desenvolver um algoritmo de localização. Primeiramente, são apresentadas as questões abordadas para criar um mapa magnético, nomeadamente as aquisições de dados, os métodos de interpolação e os processos de validação. Posteriormente, é retratado o algoritmo de localização desenvolvido, baseado num filtro de partículas, assim como os respetivos testes experimentais de validação.Mestrado em Engenharia Eletrónica e Telecomunicaçõe

Magnetic sensors and gradiometers for detection of objects

Disertační práce popisuje vývoj nových detekčních zařízení s anizotropními magnetorezistoryThis thesis describes development of innovative sensor systems based on anisotropi

A Soft Multiple-Degree of Freedom Load Cell Based on The Hall Effect

The goal of this thesis is to develop a soft multiple-degree-of-freedom (multi-DOF) load cell that is robust and light weight for use in robotics applications to sense three axes of force and a single axis of torque. The displacement of the magnet within the elastomer changes the magnetic flux density which is sensed by two 3-axis Hall effect sensors. Experimental measurements of magnetic flux density within the area of interest were used to formulate analytic expressions that relate magnet field strength to the position of the magnet. The displacement and orientation measurement and the material properties of the elastomer are used to calibrate and calculate the applied load. The ability to measure 3-DOF force and axial torque was evaluated with combined loading applied by a robotic arm (KUKA, LBR r820 iiwa). The decoupled results show the 4-DOF load cell was able to distinguish 3-axis force and 1-axis torque with 6.9% averaged error for normal force, 4.3% and 2.6% for shear force in the X and Y axis and 8.6% for the torque. The results show good accuracy for a soft multi-axis sensor that would be applicable in many robotic applications where high accuracy is not required

A Review of pedestrian indoor positioning systems for mass market applications

In the last decade, the interest in Indoor Location Based Services (ILBS) has increased stimulating the development of Indoor Positioning Systems (IPS). In particular, ILBS look for positioning systems that can be applied anywhere in the world for millions of users, that is, there is a need for developing IPS for mass market applications. Those systems must provide accurate position estimations with minimum infrastructure cost and easy scalability to different environments. This survey overviews the current state of the art of IPSs and classifies them in terms of the infrastructure and methodology employed. Finally, each group is reviewed analysing its advantages and disadvantages and its applicability to mass market applications