Future Directions in Astronomy Visualisation

Despite the large budgets spent annually on astronomical research equipment such as telescopes, instruments and supercomputers, the general trend is to analyse and view the resulting datasets using small, two-dimensional displays. We report here on alternative advanced image displays, with an emphasis on displays that we have constructed, including stereoscopic projection, multiple projector tiled displays and a digital dome. These displays can provide astronomers with new ways of exploring the terabyte and petabyte datasets that are now regularly being produced from all-sky surveys, high-resolution computer simulations, and Virtual Observatory projects. We also present a summary of the Advanced Image Displays for Astronomy (AIDA) survey which we conducted from March-May 2005, in order to raise some issues pertitent to the current and future level of use of advanced image displays.Comment: 13 pages, 2 figures, accepted for publication in PAS

An application driven comparison of depth perception on desktop 3D displays.

Desktop 3D displays vary in their optical design and this results in a significant variation in the way in which stereo images are physically displayed on different 3D displays. When precise depth judgements need to be made these differences may become critical to task performance. Applications where this is a particular issue include medical imaging, geoscience and scientific visualization. We investigate perceived depth thresholds for four classes of desktop 3D display; full resolution, row interleaved, column interleaved and colour-column interleaved. Given the same input image resolution we calculate the physical view resolution for each class of display to geometrically predict its minimum perceived depth threshold. To verify our geometric predictions we present the design of a task where viewers are required to judge which of two neighboring squares lies in front of the other. We report results from a trial using this task where participants are randomly asked to judge whether they can perceive one of four levels of image disparity (0,2,4 and 6 pixels) on seven different desktop 3D displays. The results show a strong effect and the task produces reliable results that are sensitive to display differences. However, we conclude that depth judgement performance cannot always be predicted from display geometry alone. Other system factors, including software drivers, electronic interfaces, and individual participant differences must also be considered when choosing a 3D display to make critical depth judgements

Dynamir: optical manipulations using dynamic mirror brushes

Mirror surfaces are part of our everyday life. Among them, curved mirrors are used to enhance our perception of the physical space, e.g., convex mirrors are used to increase our field of view in the street, and concave mirrors are used to zoom in on parts our face in the bathroom. In this paper, we investigate the opportunities opened when these mirrors are made dynamic, so that their effects can be modulated to adapt to the environment or to a user's actions. We introduce the concept of dynamic mirror brushes that can be moved around a mirror surface. We describe how these brushes can be used for various optical manipulations of the physical space. We also present an implementation using a flexible mirror sheet and three scenarios that demonstrate some of the interaction opportunities

An Advanced, Three-Dimensional Plotting Library for Astronomy

We present a new, three-dimensional (3D) plotting library with advanced features, and support for standard and enhanced display devices. The library - S2PLOT - is written in C and can be used by C, C++ and FORTRAN programs on GNU/Linux and Apple/OSX systems. S2PLOT draws objects in a 3D (x,y,z) Cartesian space and the user interactively controls how this space is rendered at run time. With a PGPLOT inspired interface, S2PLOT provides astronomers with elegant techniques for displaying and exploring 3D data sets directly from their program code, and the potential to use stereoscopic and dome display devices. The S2PLOT architecture supports dynamic geometry and can be used to plot time-evolving data sets, such as might be produced by simulation codes. In this paper, we introduce S2PLOT to the astronomical community, describe its potential applications, and present some example uses of the library.Comment: 12 pages, 10 eps figures (higher resolution versions available from http://astronomy.swin.edu.au/s2plot/paperfigures). The S2PLOT library is available for download from http://astronomy.swin.edu.au/s2plo

Object-based 2D-to-3D video conversion for effective stereoscopic content generation in 3D-TV applications

Three-dimensional television (3D-TV) has gained increasing popularity in the broadcasting domain, as it enables enhanced viewing experiences in comparison to conventional two-dimensional (2D) TV. However, its application has been constrained due to the lack of essential contents, i.e., stereoscopic videos. To alleviate such content shortage, an economical and practical solution is to reuse the huge media resources that are available in monoscopic 2D and convert them to stereoscopic 3D. Although stereoscopic video can be generated from monoscopic sequences using depth measurements extracted from cues like focus blur, motion and size, the quality of the resulting video may be poor as such measurements are usually arbitrarily defined and appear inconsistent with the real scenes. To help solve this problem, a novel method for object-based stereoscopic video generation is proposed which features i) optical-flow based occlusion reasoning in determining depth ordinal, ii) object segmentation using improved region-growing from masks of determined depth layers, and iii) a hybrid depth estimation scheme using content-based matching (inside a small library of true stereo image pairs) and depth-ordinal based regularization. Comprehensive experiments have validated the effectiveness of our proposed 2D-to-3D conversion method in generating stereoscopic videos of consistent depth measurements for 3D-TV applications

Phenomenal regression to the real object in physical and virtual worlds

© 2014, Springer-Verlag London. In this paper, we investigate a new approach to comparing physical and virtual size and depth percepts that captures the involuntary responses of participants to different stimuli in their field of view, rather than relying on their skill at judging size, reaching or directed walking. We show, via an effect first observed in the 1930s, that participants asked to equate the perspective projections of disc objects at different distances make a systematic error that is both individual in its extent and comparable in the particular physical and virtual setting we have tested. Prior work has shown that this systematic error is difficult to correct, even when participants are knowledgeable of its likelihood of occurring. In fact, in the real world, the error only reduces as the available cues to depth are artificially reduced. This makes the effect we describe a potentially powerful, intrinsic measure of VE quality that ultimately may contribute to our understanding of VE depth compression phenomena

Spatial calibration of an optical see-through head-mounted display

We present here a method for calibrating an optical see-through Head Mounted Display (HMD) using techniques usually applied to camera calibration (photogrammetry). Using a camera placed inside the HMD to take pictures simultaneously of a tracked object and features in the HMD display, we could exploit established camera calibration techniques to recover both the intrinsic and extrinsic properties of the~HMD (width, height, focal length, optic centre and principal ray of the display). Our method gives low re-projection errors and, unlike existing methods, involves no time-consuming and error-prone human measurements, nor any prior estimates about the HMD geometry

Measuring the Depth Perception Invoked by a Simple, Sustained, Polarity-Reversed Stereogram

The same-sign hypothesis suggests that only those edges in the two retinal images whose luminance gradients have the same sign can be stereoscopically fused to generate a perception of depth. If true, one would expect that the magnitude of the depth induced by a polarity-reversed stereogram (i.e. one where the corresponding figures in the two stereo half images have opposite luminance polarity) should be determined by the disparity of the samesign edges. Here we present a simple, sustained, polarity-reversed stereogram which we believe to be the first example of a polarity-reversed stereogram where this prediction is shown to be true. We conclude by discussing possible reasons why this prediction fails for other polarity-reversed stereograms.Defense Research Projects Agency and the Office of Naval Research (N00014-95-1-0409); Office of Naval Research (N00014-95-1-0657); National Science Foundation (SBR-9905194)

A shuttle and space station manipulator system for assembly, docking, maintenance, cargo handling and spacecraft retrieval (preliminary design). Volume 4: Simulation studies

Laboratory simulations of three concepts, based on maximum use of available off-the-shelf hardware elements, are described. The concepts are a stereo-foveal-peripheral TV system with symmetric steroscopic split-image registration and 90 deg counter rotation; a computer assisted model control system termed the trajectory following control system; and active manipulator damping. It is concluded that the feasibility of these concepts is established