Multimodal Noncontact Tracking of Surgical Instruments

For many procedures, open surgery is being replaced with minimally invasive surgical (MIS) techniques. The advantages of MIS include reduced operative trauma and fewer complications leading to faster patient recovery, better cosmetic results and shorter hospital stays. As the demand for MIS procedures increases, effective surgical training tools must be developed to improve procedure efficiency and patient safety. Motion tracking of laparoscopic instruments can provide objective skills assessment for novices and experienced users. The most common approaches to noncontact motion capture are optical and electromagnetic (EM) tracking systems, though each approach has operational limitations. Optical trackers are prone to occlusion and the performance of EM trackers degrades in the presence of magnetic and ferromagnetic material. The cost of these systems also limits their availability for surgical training and clinical environments. This thesis describes the development and validation of a novel, noncontact laparoscopic tracking system as an inexpensive alternative to current technology. This system is based on the fusion of inertial, magnetic and distance sensing to generate real-time, 6-DOF pose data. Orientation is estimated using a Kalman-filtered attitude-heading reference system (AHRS) and restricted motion at the trocar provides a datum from which position information can be recovered. The Inertial and Range-Enhanced Surgical (IRES) Tracker was prototyped, then validated using a MIS training box and by comparison to an EM tracking system. Results of IRES tracker testing showed similar performance to an EM tracker with position error as low as 1.25 mm RMS and orientation error \u3c0.58 degrees RMS along each axis. The IRES tracker also displayed greater precision and superior magnetic interference rejection capabilities. At a fraction of the cost of current laparoscopic tracking methods, the IRES tracking system would provide an excellent alternative for use in surgical training and skills assessment

JENTIL: responsive clothing that promotes an ‘holistic approach to fashion as a new vehicle to treat psychological conditions’

This paper explores an ongoing interdisciplinary research project at the cutting edge of sensory, aroma and medical work, which seeks to change the experience of fragrance to a more intimate communication of identity, by employing emerging technologies with the ancient art of perfumery. The project illustrates .holistic' clothing called the JENTIL® Collection, following on from the Author’s SmartSecondSkin' PhD research, which describes a new movement in functional, emotional clothing that incorporates scent. The project investigates the emergent interface between the arts and biomedical sciences, around new emerging technologies and science platforms, and their applications in the domain of health and well-being. The JENTIL® Collection focuses on the development of .gentle., responsive clothing that changes with emotion, since the garments are designed for psychological end benefit to reduce stress. This is achieved by studying the mind and advancing knowledge and understanding of how known well-being fragrances embedded in holistic Fashion, could impact on mental health. This paper aims to combine applied theories about human well-being, with multisensory design, in order to create experimental strategies to improve self and social confidence for individuals suffering from depressive illnesses. The range of methodologies employed extends beyond the realm of fashion and textile techniques, to areas such as neuroscience, psychiatry, human sensory systems and affective states, and the increase in popularity of complementary therapies. In this paper the known affective potential of the sense of smell is discussed, by introducing Aroma-Chology as a tool that is worn as an emotional support system to create a personal scent bubble. around the body, with the capacity to regulate mood, physiological and psychological state and improve self-confidence in social situations. The clothing formulates a healing platform around the wearer, by creating novel olfactory experiences in textiles that are not as passive as current microencapsulated capsule systems generally are

Cryogenic Photogrammetry and Radiometry for the James Webb Space Telescope Microshutters

The James Webb Space Telescope (JWST) relies on several innovations to complete its five year mission. One vital technology is microshutters, the programmable field selectors that enable the Near Infrared Spectrometer (NIRSpec) to perform multi-object spectroscopy. Mission success depends on acquiring spectra from large numbers of galaxies by positioning shutter slits over faint targets. Precise selection of faint targets requires field selectors that are both high in contrast and stable in position. We have developed test facilities to evaluate microshutter contrast and alignment stability at their 35K operating temperature. These facilities used a novel application of image registration algorithms to obtain non-contact, sub-micron measurements in cryogenic conditions. The cryogenic motion of the shutters was successfully characterized. Optical results also demonstrated that shutter contrast far exceeds the NIRSpec requirements. Our test program has concluded with the delivery of a flight-qualified field selection subsystem to the NIRSpec bench

Calibrating a high-resolution wavefront corrector with a static focal-plane camera

We present a method to calibrate a high-resolution wavefront-correcting device with a single, static camera, located in the focal plane; no moving of any component is needed. The method is based on a localized diversity and differential optical transfer functions (dOTF) to compute both the phase and amplitude in the pupil plane located upstream of the last imaging optics. An experiment with a spatial light modulator shows that the calibration is sufficient to robustly operate a focal-plane wavefront sensing algorithm controlling a wavefront corrector with ~40 000 degrees of freedom. We estimate that the locations of identical wavefront corrector elements are determined with a spatial resolution of 0.3% compared to the pupil diameter.Comment: 12 pages, 12 figures, accepted for publication in Applied Optic

On the use of smartphones as novel photogrammetric water gauging instruments: Developing tools for crowdsourcing water levels

The term global climate change is omnipresent since the beginning of the last decade. Changes in the global climate are associated with an increase in heavy rainfalls that can cause nearly unpredictable flash floods. Consequently, spatio-temporally high-resolution monitoring of rivers becomes increasingly important. Water gauging stations continuously and precisely measure water levels. However, they are rather expensive in purchase and maintenance and are preferably installed at water bodies relevant for water management. Small-scale catchments remain often ungauged. In order to increase the data density of hydrometric monitoring networks and thus to improve the prediction quality of flood events, new, flexible and cost-effective water level measurement technologies are required. They should be oriented towards the accuracy requirements of conventional measurement systems and facilitate the observation of water levels at virtually any time, even at the smallest rivers. A possible solution is the development of a photogrammetric smartphone application (app) for crowdsourcing water levels, which merely requires voluntary users to take pictures of a river section to determine the water level. Today’s smartphones integrate high-resolution cameras, a variety of sensors, powerful processors, and mass storage. However, they are designed for the mass market and use low-cost hardware that cannot comply with the quality of geodetic measurement technology. In order to investigate the potential for mobile measurement applications, research was conducted on the smartphone as a photogrammetric measurement instrument as part of the doctoral project. The studies deal with the geometric stability of smartphone cameras regarding device-internal temperature changes and with the accuracy potential of rotation parameters measured with smartphone sensors. The results show a high, temperature-related variability of the interior orientation parameters, which is why the calibration of the camera should be carried out during the immediate measurement. The results of the sensor investigations show considerable inaccuracies when measuring rotation parameters, especially the compass angle (errors up to 90° were observed). The same applies to position parameters measured by global navigation satellite system (GNSS) receivers built into smartphones. According to the literature, positional accuracies of about 5 m are possible in best conditions. Otherwise, errors of several 10 m are to be expected. As a result, direct georeferencing of image measurements using current smartphone technology should be discouraged. In consideration of the results, the water gauging app Open Water Levels (OWL) was developed, whose methodological development and implementation constituted the core of the thesis project. OWL enables the flexible measurement of water levels via crowdsourcing without requiring additional equipment or being limited to specific river sections. Data acquisition and processing take place directly in the field, so that the water level information is immediately available. In practice, the user captures a short time-lapse sequence of a river bank with OWL, which is used to calculate a spatio-temporal texture that enables the detection of the water line. In order to translate the image measurement into 3D object space, a synthetic, photo-realistic image of the situation is created from existing 3D data of the river section to be investigated. Necessary approximations of the image orientation parameters are measured by smartphone sensors and GNSS. The assignment of camera image and synthetic image allows for the determination of the interior and exterior orientation parameters by means of space resection and finally the transfer of the image-measured 2D water line into the 3D object space to derive the prevalent water level in the reference system of the 3D data. In comparison with conventionally measured water levels, OWL reveals an accuracy potential of 2 cm on average, provided that synthetic image and camera image exhibit consistent image contents and that the water line can be reliably detected. In the present dissertation, related geometric and radiometric problems are comprehensively discussed. Furthermore, possible solutions, based on advancing developments in smartphone technology and image processing as well as the increasing availability of 3D reference data, are presented in the synthesis of the work. The app Open Water Levels, which is currently available as a beta version and has been tested on selected devices, provides a basis, which, with continuous further development, aims to achieve a final release for crowdsourcing water levels towards the establishment of new and the expansion of existing monitoring networks.Der Begriff des globalen Klimawandels ist seit Beginn des letzten Jahrzehnts allgegenwärtig. Die Veränderung des Weltklimas ist mit einer Zunahme von Starkregenereignissen verbunden, die nahezu unvorhersehbare Sturzfluten verursachen können. Folglich gewinnt die raumzeitlich hochaufgelöste Überwachung von Fließgewässern zunehmend an Bedeutung. Pegelmessstationen erfassen kontinuierlich und präzise Wasserstände, sind jedoch in Anschaffung und Wartung sehr teuer und werden vorzugsweise an wasserwirtschaftlich-relevanten Gewässern installiert. Kleinere Gewässer bleiben häufig unbeobachtet. Um die Datendichte hydrometrischer Messnetze zu erhöhen und somit die Vorhersagequalität von Hochwasserereignissen zu verbessern, sind neue, kostengünstige und flexibel einsetzbare Wasserstandsmesstechnologien erforderlich. Diese sollten sich an den Genauigkeitsanforderungen konventioneller Messsysteme orientieren und die Beobachtung von Wasserständen zu praktisch jedem Zeitpunkt, selbst an den kleinsten Flüssen, ermöglichen. Ein Lösungsvorschlag ist die Entwicklung einer photogrammetrischen Smartphone-Anwendung (App) zum Crowdsourcing von Wasserständen mit welcher freiwillige Nutzer lediglich Bilder eines Flussabschnitts aufnehmen müssen, um daraus den Wasserstand zu bestimmen. Heutige Smartphones integrieren hochauflösende Kameras, eine Vielzahl von Sensoren, leistungsfähige Prozessoren und Massenspeicher. Sie sind jedoch für den Massenmarkt konzipiert und verwenden kostengünstige Hardware, die nicht der Qualität geodätischer Messtechnik entsprechen kann. Um das Einsatzpotential in mobilen Messanwendungen zu eruieren, sind Untersuchungen zum Smartphone als photogrammetrisches Messinstrument im Rahmen des Promotionsprojekts durchgeführt worden. Die Studien befassen sich mit der geometrischen Stabilität von Smartphone-Kameras bezüglich geräteinterner Temperaturänderungen und mit dem Genauigkeitspotential von mit Smartphone-Sensoren gemessenen Rotationsparametern. Die Ergebnisse zeigen eine starke, temperaturbedingte Variabilität der inneren Orientierungsparameter, weshalb die Kalibrierung der Kamera zum unmittelbaren Messzeitpunkt erfolgen sollte. Die Ergebnisse der Sensoruntersuchungen zeigen große Ungenauigkeiten bei der Messung der Rotationsparameter, insbesondere des Kompasswinkels (Fehler von bis zu 90° festgestellt). Selbiges gilt auch für Positionsparameter, gemessen durch in Smartphones eingebaute Empfänger für Signale globaler Navigationssatellitensysteme (GNSS). Wie aus der Literatur zu entnehmen ist, lassen sich unter besten Bedingungen Lagegenauigkeiten von etwa 5 m erreichen. Abseits davon sind Fehler von mehreren 10 m zu erwarten. Infolgedessen ist von einer direkten Georeferenzierung von Bildmessungen mittels aktueller Smartphone-Technologie abzusehen. Unter Berücksichtigung der gewonnenen Erkenntnisse wurde die Pegel-App Open Water Levels (OWL) entwickelt, deren methodische Entwicklung und Implementierung den Kern der Arbeit bildete. OWL ermöglicht die flexible Messung von Wasserständen via Crowdsourcing, ohne dabei zusätzliche Ausrüstung zu verlangen oder auf spezifische Flussabschnitte beschränkt zu sein. Datenaufnahme und Verarbeitung erfolgen direkt im Feld, so dass die Pegelinformationen sofort verfügbar sind. Praktisch nimmt der Anwender mit OWL eine kurze Zeitraffersequenz eines Flussufers auf, die zur Berechnung einer Raum-Zeit-Textur dient und die Erkennung der Wasserlinie ermöglicht. Zur Übersetzung der Bildmessung in den 3D-Objektraum wird aus vorhandenen 3D-Daten des zu untersuchenden Flussabschnittes ein synthetisches, photorealistisches Abbild der Aufnahmesituation erstellt. Erforderliche Näherungen der Bildorientierungsparameter werden von Smartphone-Sensoren und GNSS gemessen. Die Zuordnung von Kamerabild und synthetischem Bild erlaubt die Bestimmung der inneren und äußeren Orientierungsparameter mittels räumlichen Rückwärtsschnitt. Nach Rekonstruktion der Aufnahmesituation lässt sich die im Bild gemessene 2D-Wasserlinie in den 3D-Objektraum projizieren und der vorherrschende Wasserstand im Referenzsystem der 3D-Daten ableiten. Im Soll-Ist-Vergleich mit konventionell gemessenen Pegeldaten zeigt OWL ein erreichbares Genauigkeitspotential von durchschnittlich 2 cm, insofern synthetisches und reales Kamerabild einen möglichst konsistenten Bildinhalt aufweisen und die Wasserlinie zuverlässig detektiert werden kann. In der vorliegenden Dissertation werden damit verbundene geometrische und radiometrische Probleme ausführlich diskutiert sowie Lösungsansätze, auf der Basis fortschreitender Entwicklungen von Smartphone-Technologie und Bildverarbeitung sowie der zunehmenden Verfügbarkeit von 3D-Referenzdaten, in der Synthese der Arbeit vorgestellt. Mit der gegenwärtig als Betaversion vorliegenden und auf ausgewählten Geräten getesteten App Open Water Levels wurde eine Basis geschaffen, die mit kontinuierlicher Weiterentwicklung eine finale Freigabe für das Crowdsourcing von Wasserständen und damit den Aufbau neuer und die Erweiterung bestehender Monitoring-Netzwerke anstrebt

MEMS micro-contact printing engines

This thesis investigates micro-contact printing (µCP) engines using micro-electro-mechanical systems (MEMS). Such engines are self-contained and do not require further optical alignment and precision manipulation equipment. Hence they provide a low-cost and accessible method of multilevel surface patterning with sub-micron resolution. Applications include the field of biotechnology where the placement of biological ligands at well controlled locations on substrates is often required for biological assays, cell studies and manipulation, or for the fabrication of biosensors. A miniaturised silicon µCP engine is designed and fabricated using a wafer-scale MEMS fabrication process and single level and bi-level µCP are successfully demonstrated. The performance of the engine is fully characterised and two actuation modes, mechanical and electrostatic, are investigated. In addition, a novel method of integrating the stamp material into the MEMS process flow by spray coating is reported. A second µCP engine formed by wafer-scale replica moulding of a polymer is developed to further drive down cost and complexity. This system carries six complementary patterns and allows six-level µCP with a layer-to-layer accuracy of 10 µm over a 5 mm x 5 mm area without the use of external aligning equipment. This is the first such report of aligned multilevel µCP. Lastly, the integration of the replica moulded engine with a hydraulic drive for controlled actuation is investigated. This approach is promising and proof of concept has been provided for single-level patterning

Electromechanical Analysis (MEMS) of a Capacitive Pressure Sensor of a Neuromate Robot Probe

The domain of medicine, especially neurosurgery, is very concerned in the integration of robots in many procedures. In this work, we are interested in the Neuromate robot. The latter uses the procedure of stereotaxic surgery but with better planning, greater precision and simpler execution. The Neuromate robot allows in particular the registration with intraoperative images (ventriculographies, and especially angiographies) in order to perfect the planning. In this book, we focus on the contact force measurement system required for the effectiveness of the stimulation between the robot probe and the patient’s head and thus ensure the safety of the patient. A force sensor is integrated upstream of the wrist, the pressure sensor is part of a silicon matrix that has been bonded to a metal plate at 70°C. The study was carried out under the software COMSOL Multiphysics, ideally suited for the simulation of applications (Microelectromechanical systems) “MEMS”. After electromechanical stationary survey, deflection of the quadrant when the pressure difference across the membrane was 25 kPa, as expected, the deviation was expected to be greatest at the center of the membrane. The proposed sensor structure is a suitable selection for MEMS capacitive pressure sensors