Adaptive User Perspective Rendering for Handheld Augmented Reality

Handheld Augmented Reality commonly implements some variant of magic lens rendering, which turns only a fraction of the user's real environment into AR while the rest of the environment remains unaffected. Since handheld AR devices are commonly equipped with video see-through capabilities, AR magic lens applications often suffer from spatial distortions, because the AR environment is presented from the perspective of the camera of the mobile device. Recent approaches counteract this distortion based on estimations of the user's head position, rendering the scene from the user's perspective. To this end, approaches usually apply face-tracking algorithms on the front camera of the mobile device. However, this demands high computational resources and therefore commonly affects the performance of the application beyond the already high computational load of AR applications. In this paper, we present a method to reduce the computational demands for user perspective rendering by applying lightweight optical flow tracking and an estimation of the user's motion before head tracking is started. We demonstrate the suitability of our approach for computationally limited mobile devices and we compare it to device perspective rendering, to head tracked user perspective rendering, as well as to fixed point of view user perspective rendering

Dynamic metasurface lens based on MEMS Technology

In the recent years, metasurfaces, being flat and lightweight, have been designed to replace bulky optical components with various functions. We demonstrate a monolithic Micro-Electro-Mechanical System (MEMS) integrated with a metasurface-based flat lens that focuses light in the mid-infrared spectrum. A two-dimensional scanning MEMS platform controls the angle of the lens along the two orthogonal axes (tip-tilt) by +-9 degrees, thus enabling dynamic beam steering. The device can compensate for off-axis incident light and thus correct for aberrations such as coma. We show that for low angular displacements, the integrated lens-on-MEMS system does not affect the mechanical performance of the MEMS actuators and preserves the focused beam profile as well as the measured full width at half maximum. We envision a new class of flat optical devices with active control provided by the combination of metasurfaces and MEMS for a wide range of applications, such as miniaturized MEMS-based microscope systems, LIDAR scanners, and projection systems

Next generation optical instruments and space experiment based on the LDEF thermal control surfaces experiment (S0069)

The Thermal Control Surfaces Experiment (TCSE) was a successful experiment to study the effects of the space environment on thermal control surfaces using in-space optical properties measurements combined with post-flight analyses. The TCSE reflectometer performed well on the LDEF mission demonstrating that a portable compact integrating sphere spectroreflectometer can be built that is rugged and space rated. Since the retrieval of the TCSE package from space, several other instruments have evolved from its pioneering technologies. These are the Optical Properties Monitor (OPM), the Laboratory Portable SpectroReflectometer (LPSR), and the Space Portable SpectroReflectometer (SPSR). These instruments and experiment packages are described

Comparative Analysis of Mobile 3D Scanning Technologies for Design, Manufacture of Interior and Exterior Tensile Material Structures and Canvasman Ltd. Case Study

This report aimed to investigate mobile 3D Scanning technologies to improve the 3D data capture and efficiency into Canvasman’s CAD design and manufacturing processes with focus on accurate resolution. The Santander funded Collaborative Venture Fund (CVF) project has provided research, survey data, evaluation and analysis for Canvasman Ltd. on 3D portable scanning hardware and software. The project solutions recommended in this report offers impartial product information on the current appropriate 3D scanning technology that potentially could improve efficiency of data capturing, design and manufacture of interior and exterior spaces, boats, vehicles and other similar constructions for creating and installing flexible coverings and indoor and outdoor structures

Development of real-time dual-display handheld and bench-top hybrid-mode SD-OCTs

Development of a dual-display handheld optical coherence tomography (OCT) system for retina and optic-nerve-head diagnosis beyond the volunteer motion constraints is reported. The developed system is portable and easily movable, containing the compact portable OCT system that includes the handheld probe and computer. Eye posterior chambers were diagnosed using the handheld probe, and the probe could be fixed to the bench-top cradle depending on the volunteers' physical condition. The images obtained using this handheld probe were displayed in real time on the computer monitor and on a small secondary built-in monitor; the displayed images were saved using the handheld probe's built-in button. Large-scale signal-processing procedures such as k-domain linearization, fast Fourier transform (FFT), and log-scaling signal processing can be rapidly applied using graphics-processing-unit (GPU) accelerated processing rather than central-processing-unit (CPU) processing. The Labview-based system resolution is 1,024 ?? 512 pixels, and the frame rate is 56 frames/s, useful for real-time display. The 3D images of the posterior chambers including the retina, optic-nerve head, blood vessels, and optic nerve were composed using real-time displayed images with 500 ?? 500 ?? 500 pixel resolution. A handheld and bench-top hybrid mode with a dual-display handheld OCT was developed to overcome the drawbacks of the conventional method.open0

MEMS-Based Endomicroscopes for High Resolution in vivo Imaging

Intravital microscopy is an emerging methodology for performing real time imaging in live animals. This technology is playing a greater role in the study of cellular and molecular biology because in vitro systems cannot adequately recapitulate the microenvironment of living tissues and systems. Conventional intravital microscopes use large, bulky objectives that require wide surgical exposure to image internal organs and result in terminal experiments. If these instruments can be reduced sufficiently in size, biological phenomena can be observed in a longitudinal fashion without animal sacrifice. The epithelium is a thin layer of tissue in hollow organs, and is the origin of many types of human diseases. In vivo assessment of biomarkers expressed in the epithelium in animal models can provide valuable information of disease development and drug efficacy. The overall goal of this work is to develop miniature imaging instruments capable of visualizing the epithelium in live animals with subcellular resolution. The dissertation is divided into four projects, where each contains an imaging system developed for small animal imaging. These systems are all designed using laser beam scanning technology with tiny mirrors developed with microelectromechanical systems (MEMS) technology. By using these miniature scanners, we are able to develop endomicroscopes small enough for hollow organs in small animals. The performance of these systems has been demonstrated by imaging either excised tissue or colon of live mice. The final version of the instrument can collect horizontal/oblique plane images in the mouse colon in real time (>10 frames/sec) with sub-micron resolution (<1 um), deep tissue penetration (~200 um) and large field of view (700 x 500 um). A novel side-viewing architecture with distal MEMS scanning was developed to create clear and stable image in the mouse colon. With the use of the instrument, it is convenient to pinpoint location of interest and create a map of the colon using image mosaicking. Multispectral fluorescence images can by collected at excitation wavelength ranging from 445 nm to 780 nm. The instruments have been used to 1) validate specific binding of a cancer targeting agent in the mouse colon and 2) study the tumor development in a mouse model with endogenous fluorescence protein expression. We use these studies to show that we have developed an enabling technology which will allow biologist to perform longitudinal imaging in animal models with subcellular resolution.PHDBiomedical EngineeringUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttps://deepblue.lib.umich.edu/bitstream/2027.42/136954/2/dxy_1.pd

The threshold of the real: A site for participatory resistance in Blast Theory's Uncle Roy all around you (2003)

This article examines the collision of virtual and real spaces through simultaneous live and online play in Uncle Roy All Around You, and how this disruption of immersion is used to expose the habitual engagements associated with the digital interface. The nature of the participants' immersion and the subsequent reintegration into the real will be explored, before attempting to articulate what defines this piece as politically resistant, through discussion of a self reflexive participation, which undermines what Baudrillard terms the 'simulated response' (Baudrillard 1985/1988 p.216

In vivo measurement of human brain elasticity using a light aspiration device

The brain deformation that occurs during neurosurgery is a serious issue impacting the patient "safety" as well as the invasiveness of the brain surgery. Model-driven compensation is a realistic and efficient solution to solve this problem. However, a vital issue is the lack of reliable and easily obtainable patient-specific mechanical characteristics of the brain which, according to clinicians' experience, can vary considerably. We designed an aspiration device that is able to meet the very rigorous sterilization and handling process imposed during surgery, and especially neurosurgery. The device, which has no electronic component, is simple, light and can be considered as an ancillary instrument. The deformation of the aspirated tissue is imaged via a mirror using an external camera. This paper describes the experimental setup as well as its use during a specific neurosurgery. The experimental data was used to calibrate a continuous model. We show that we were able to extract an in vivo constitutive law of the brain elasticity: thus for the first time, measurements are carried out per-operatively on the patient, just before the resection of the brain parenchyma. This paper discloses the results of a difficult experiment and provide for the first time in-vivo data on human brain elasticity. The results point out the softness as well as the highly non-linear behavior of the brain tissue.Comment: Medical Image Analysis (2009) accept\'

MEMS Technology for Biomedical Imaging Applications

Biomedical imaging is the key technique and process to create informative images of the human body or other organic structures for clinical purposes or medical science. Micro-electro-mechanical systems (MEMS) technology has demonstrated enormous potential in biomedical imaging applications due to its outstanding advantages of, for instance, miniaturization, high speed, higher resolution, and convenience of batch fabrication. There are many advancements and breakthroughs developing in the academic community, and there are a few challenges raised accordingly upon the designs, structures, fabrication, integration, and applications of MEMS for all kinds of biomedical imaging. This Special Issue aims to collate and showcase research papers, short commutations, perspectives, and insightful review articles from esteemed colleagues that demonstrate: (1) original works on the topic of MEMS components or devices based on various kinds of mechanisms for biomedical imaging; and (2) new developments and potentials of applying MEMS technology of any kind in biomedical imaging. The objective of this special session is to provide insightful information regarding the technological advancements for the researchers in the community