Depth Fields: Extending Light Field Techniques to Time-of-Flight Imaging

A variety of techniques such as light field, structured illumination, and time-of-flight (TOF) are commonly used for depth acquisition in consumer imaging, robotics and many other applications. Unfortunately, each technique suffers from its individual limitations preventing robust depth sensing. In this paper, we explore the strengths and weaknesses of combining light field and time-of-flight imaging, particularly the feasibility of an on-chip implementation as a single hybrid depth sensor. We refer to this combination as depth field imaging. Depth fields combine light field advantages such as synthetic aperture refocusing with TOF imaging advantages such as high depth resolution and coded signal processing to resolve multipath interference. We show applications including synthesizing virtual apertures for TOF imaging, improved depth mapping through partial and scattering occluders, and single frequency TOF phase unwrapping. Utilizing space, angle, and temporal coding, depth fields can improve depth sensing in the wild and generate new insights into the dimensions of light's plenoptic function.Comment: 9 pages, 8 figures, Accepted to 3DV 201

Optical techniques for 3D surface reconstruction in computer-assisted laparoscopic surgery

One of the main challenges for computer-assisted surgery (CAS) is to determine the intra-opera- tive morphology and motion of soft-tissues. This information is prerequisite to the registration of multi-modal patient-specific data for enhancing the surgeon’s navigation capabilites by observ- ing beyond exposed tissue surfaces and for providing intelligent control of robotic-assisted in- struments. In minimally invasive surgery (MIS), optical techniques are an increasingly attractive approach for in vivo 3D reconstruction of the soft-tissue surface geometry. This paper reviews the state-of-the-art methods for optical intra-operative 3D reconstruction in laparoscopic surgery and discusses the technical challenges and future perspectives towards clinical translation. With the recent paradigm shift of surgical practice towards MIS and new developments in 3D opti- cal imaging, this is a timely discussion about technologies that could facilitate complex CAS procedures in dynamic and deformable anatomical regions

Single-shot compressed ultrafast photography: a review

Compressed ultrafast photography (CUP) is a burgeoning single-shot computational imaging technique that provides an imaging speed as high as 10 trillion frames per second and a sequence depth of up to a few hundred frames. This technique synergizes compressed sensing and the streak camera technique to capture nonrepeatable ultrafast transient events with a single shot. With recent unprecedented technical developments and extensions of this methodology, it has been widely used in ultrafast optical imaging and metrology, ultrafast electron diffraction and microscopy, and information security protection. We review the basic principles of CUP, its recent advances in data acquisition and image reconstruction, its fusions with other modalities, and its unique applications in multiple research fields

Three-dimensional reconstruction of the tissue-specific multielemental distribution within Ceriodaphnia dubia via multimodal registration using laser ablation ICP-mass spectrometry and X-ray spectroscopic techniques

In this work, the three-dimensional elemental, distribution profile within the freshwater crustacean Ceriodaphnia dubia was constructed at a spatial resolution down to S mu m via a data, fusion approach employing state-of-the-art laser ablation inductively coupled plasma-time-of-flight mass spectrometry (LAICP-TOFMS) and laboratory-based absorption microcomputed tomography (mu-CT). C. dubia was exposed to elevated Cu, Ni, and Zn concentrations, chemically fixed, dehydrated, stained, and embedded, prior to mu-CT analysis. Subsequently, the sample was cut into 5 pm thin sections that were subjected to LA-ICPTOFMS imaging. Multimodal image registration was performed to spatially align the 2D LA-ICP-TOFMS images relative to the Corresponding slices of the 3D mu-CT reconstruction. Mass channels corresponding to the isotopes of a single element were merged to improve the signal-to-noise ratios within the elemental images. In order to aid the visual interpretation of the data, LA-ICP-TOEMS data wete projected onto the mu-CT voxels representing tissue. Additionally, the image resolution and elemental sensitivity were compared to those obtained with synchrotron radiation based 3D confocal mu-X-ray fluorescence imaging upon a chemically fixed and air-dried C. dubia specimen

Kinect Range Sensing: Structured-Light versus Time-of-Flight Kinect

Recently, the new Kinect One has been issued by Microsoft, providing the next generation of real-time range sensing devices based on the Time-of-Flight (ToF) principle. As the first Kinect version was using a structured light approach, one would expect various differences in the characteristics of the range data delivered by both devices. This paper presents a detailed and in-depth comparison between both devices. In order to conduct the comparison, we propose a framework of seven different experimental setups, which is a generic basis for evaluating range cameras such as Kinect. The experiments have been designed with the goal to capture individual effects of the Kinect devices as isolatedly as possible and in a way, that they can also be adopted, in order to apply them to any other range sensing device. The overall goal of this paper is to provide a solid insight into the pros and cons of either device. Thus, scientists that are interested in using Kinect range sensing cameras in their specific application scenario can directly assess the expected, specific benefits and potential problem of either device.Comment: 58 pages, 23 figures. Accepted for publication in Computer Vision and Image Understanding (CVIU

The role of embryo movement in the development of the furcula

The pectoral girdle is a complex structure which varies in its morphology between species. A major component in birds is the furcula, which can be considered equivalent to a fusion of the paired clavicles found in many mammals, and the single interclavicle found in many reptiles. These elements are a remnant of the dermal skeleton and the only intramembranous bones in the trunk. Postnatally, the furcula plays important mechanical roles by stabilising the shoulder joint and acting as a mechanical spring during flight. In line with its mechanical role, previous studies indicate that, unlike many other intramembranous bones, furcula growth during development can be influenced by mechanical stimuli. This study investigated the response of individual aspects of furcula growth to both embryo immobilisation and hypermotility in the embryonic chicken. The impact of altered incubation temperature, which influences embryo motility, on crocodilian interclavicle development was also explored. We employed whole‐mount bone and cartilage staining and 3D imaging by microCT to quantify the impact of rigid paralysis, flaccid paralysis and hypermobility on furcula growth in the chicken, and 3D microCT imaging to quantify the impact of reduced temperature (32–28 °C) and motility on interclavicle growth in the crocodile. This revealed that the growth rates of the clavicular and interclavicular components of the furcula differ during normal development. Total furcula area was reduced by total unloading produced by flaccid paralysis, but not by rigid paralysis which maintains static loading of embryonic bones. This suggests that dynamic loading, which is required for postnatal bone adaptation, is not a requirement for prenatal furcula growth. Embryo hypermotility also had no impact on furcula area or arm length. Furcula 3D shape did, however, differ between groups; this was marked in the interclavicular component of the furcula, the hypocleideum. Hypocleideum length was reduced by both methods of immobilisation, and interclavicle area was reduced in crocodile embryos incubated at 28 °C, which are less motile than embryos incubated at 32 °C. These data suggest that the clavicular and interclavicle components of the avian furcula respond differently to alterations in embryo movement, with the interclavicle requiring both the static and dynamic components of movement‐related loading for normal growth, while static loading preserved most aspects of clavicle growth. Our data suggest that embryo movement, and the mechanical loading this produces, is important in shaping these structures during development to suit their postnatal mechanical roles

Aerospace Medicine and Biology: A continuing bibliography with indexes (supplement 156)

This bibliography lists 170 reports, articles, and other documents introduced into the NASA scientific and technical information system in June 1976