Optical techniques for 3D surface reconstruction in computer-assisted laparoscopic surgery

One of the main challenges for computer-assisted surgery (CAS) is to determine the intra-opera- tive morphology and motion of soft-tissues. This information is prerequisite to the registration of multi-modal patient-specific data for enhancing the surgeon’s navigation capabilites by observ- ing beyond exposed tissue surfaces and for providing intelligent control of robotic-assisted in- struments. In minimally invasive surgery (MIS), optical techniques are an increasingly attractive approach for in vivo 3D reconstruction of the soft-tissue surface geometry. This paper reviews the state-of-the-art methods for optical intra-operative 3D reconstruction in laparoscopic surgery and discusses the technical challenges and future perspectives towards clinical translation. With the recent paradigm shift of surgical practice towards MIS and new developments in 3D opti- cal imaging, this is a timely discussion about technologies that could facilitate complex CAS procedures in dynamic and deformable anatomical regions

Bootstrapping the Coronal Magnetic Field with STEREO: I. Unipolar Potential Field Modeling

We investigate the recently quantified misalignment of $\alpha_{mis} \approx 20^\circ-40^\circ$ between the 3-D geometry of stereoscopically triangulated coronal loops observed with STEREO/EUVI (in four active regions) and theoretical (potential or nonlinear force-free) magnetic field models extrapolated from photospheric magnetograms. We develop an efficient method of bootstrapping the coronal magnetic field by forward-fitting a parameterized potential field model to the STEREO-observed loops. The potential field model consists of a number of unipolar magnetic charges that are parameterized by decomposing a photospheric magnetogram from MDI. The forward-fitting method yields a best-fit magnetic field model with a reduced misalignment of $\alpha_{PF} \approx 13^\circ-20^\circ$. We evaluate also stereoscopic measurement errors and find a contribution of $\alpha_{SE}\approx 7^\circ-12^\circ$, which constrains the residual misalignment to $\alpha_{NP}=\alpha_{PF}-\alpha_{SE}\approx 5^\circ -9^\circ$, which is likely due to the nonpotentiality of the active regions. The residual misalignment angle $\alpha_{NP}$ of the potential field due to nonpotentiality is found to correlate with the soft X-ray flux of the active region, which implies a relationship between electric currents and plasma heating.Comment: 12 figures, manuscript submitted to ApJ, 2010 Apr 2

Data-Optimized Coronal Field Model: I. Proof of Concept

Deriving the strength and direction of the three-dimensional (3D) magnetic field in the solar atmosphere is fundamental for understanding its dynamics. Volume information on the magnetic field mostly relies on coupling 3D reconstruction methods with photospheric and/or chromospheric surface vector magnetic fields. Infrared coronal polarimetry could provide additional information to better constrain magnetic field reconstructions. However, combining such data with reconstruction methods is challenging, e.g., because of the optical-thinness of the solar corona and the lack and limitations of stereoscopic polarimetry. To address these issues, we introduce the Data-Optimized Coronal Field Model (DOCFM) framework, a model-data fitting approach that combines a parametrized 3D generative model, e.g., a magnetic field extrapolation or a magnetohydrodynamic model, with forward modeling of coronal data. We test it with a parametrized flux rope insertion method and infrared coronal polarimetry where synthetic observations are created from a known "ground truth" physical state. We show that this framework allows us to accurately retrieve the ground truth 3D magnetic field of a set of force-free field solutions from the flux rope insertion method. In observational studies, the DOCFM will provide a means to force the solutions derived with different reconstruction methods to satisfy additional, common, coronal constraints. The DOCFM framework therefore opens new perspectives for the exploitation of coronal polarimetry in magnetic field reconstructions and for developing new techniques to more reliably infer the 3D magnetic fields that trigger solar flares and coronal mass ejections.Comment: 14 pages, 6 figures; Accepted for publication in Ap

Airborne photogrammetry and LIDAR for DSM extraction and 3D change detection over an urban area : a comparative study

A digital surface model (DSM) extracted from stereoscopic aerial images, acquired in March 2000, is compared with a DSM derived from airborne light detection and ranging (lidar) data collected in July 2009. Three densely built-up study areas in the city centre of Ghent, Belgium, are selected, each covering approximately 0.4 km(2). The surface models, generated from the two different 3D acquisition methods, are compared qualitatively and quantitatively as to what extent they are suitable in modelling an urban environment, in particular for the 3D reconstruction of buildings. Then the data sets, which are acquired at two different epochs t(1) and t(2), are investigated as to what extent 3D (building) changes can be detected and modelled over the time interval. A difference model, generated by pixel-wise subtracting of both DSMs, indicates changes in elevation. Filters are proposed to differentiate 'real' building changes from false alarms provoked by model noise, outliers, vegetation, etc. A final 3D building change model maps all destructed and newly constructed buildings within the time interval t(2) - t(1). Based on the change model, the surface and volume of the building changes can be quantified

Visualization and Correction of Automated Segmentation, Tracking and Lineaging from 5-D Stem Cell Image Sequences

Results: We present an application that enables the quantitative analysis of multichannel 5-D (x, y, z, t, channel) and large montage confocal fluorescence microscopy images. The image sequences show stem cells together with blood vessels, enabling quantification of the dynamic behaviors of stem cells in relation to their vascular niche, with applications in developmental and cancer biology. Our application automatically segments, tracks, and lineages the image sequence data and then allows the user to view and edit the results of automated algorithms in a stereoscopic 3-D window while simultaneously viewing the stem cell lineage tree in a 2-D window. Using the GPU to store and render the image sequence data enables a hybrid computational approach. An inference-based approach utilizing user-provided edits to automatically correct related mistakes executes interactively on the system CPU while the GPU handles 3-D visualization tasks. Conclusions: By exploiting commodity computer gaming hardware, we have developed an application that can be run in the laboratory to facilitate rapid iteration through biological experiments. There is a pressing need for visualization and analysis tools for 5-D live cell image data. We combine accurate unsupervised processes with an intuitive visualization of the results. Our validation interface allows for each data set to be corrected to 100% accuracy, ensuring that downstream data analysis is accurate and verifiable. Our tool is the first to combine all of these aspects, leveraging the synergies obtained by utilizing validation information from stereo visualization to improve the low level image processing tasks.Comment: BioVis 2014 conferenc

Бесконтактный мониторинг дыхания с использованием оптических датчиков

Ціллю даної роботи є класифікація підходів до безконтактного моніторингу дихання і розробка структури системи моніторингу з усуненням артефактів міміки. Усі наявні методи були розділені на дві основні групи: методи на основі визначення дихання з 3-D зображення об'єкта і методи на основі 2-D обробки зображень. Була розроблена структура системи моніторингу дихання на основі оптичних сенсорів з можливістю видалення артефактів міміки. Новий підхід дозволяє покращити моніторинг дихання для об'єктів в положенні лежачи на спині і в позиції сидячи.The main goal of this paper is to develop classification of non-contact respiration monitoring approaches and proposal of structure for system with facial artifacts rejection. All available techniques were divided into two main groups: based on reconstruction of respiration from 3-D image of object and based on 2-D image processing of techniques. Structure of system for respiration monitoring using optical sensors with facial artifacts removing was developed. New approach allows improving of respiration monitoring for objects in supine position and in a sitting position.Целью работы является классификация подходов к бесконтактному мониторингу дыхания и разработка структуры системы мониторинга с устранением артефактов мимики. Все имеющиеся методы были разделены на две основные группы: методы на основе определения дыхания из 3-D изображения объекта и методы на основе 2-D обработки изображений. Была разработана структура системы мониторинга дыхания на основе оптических датчиков с возможностью удаления артефактов мимики. Новый подход позволяет улучшить мониторинг дыхания для объектов в положении лежа на спине и в позиции сидя