Survey of image-based representations and compression techniques

In this paper, we survey the techniques for image-based rendering (IBR) and for compressing image-based representations. Unlike traditional three-dimensional (3-D) computer graphics, in which 3-D geometry of the scene is known, IBR techniques render novel views directly from input images. IBR techniques can be classified into three categories according to how much geometric information is used: rendering without geometry, rendering with implicit geometry (i.e., correspondence), and rendering with explicit geometry (either with approximate or accurate geometry). We discuss the characteristics of these categories and their representative techniques. IBR techniques demonstrate a surprising diverse range in their extent of use of images and geometry in representing 3-D scenes. We explore the issues in trading off the use of images and geometry by revisiting plenoptic-sampling analysis and the notions of view dependency and geometric proxies. Finally, we highlight compression techniques specifically designed for image-based representations. Such compression techniques are important in making IBR techniques practical.published_or_final_versio

Capture, Reconstruction, and Representation of the Visual Real World for Virtual Reality

We provide an overview of the concerns, current practice, and limitations for capturing, reconstructing, and representing the real world visually within virtual reality. Given that our goals are to capture, transmit, and depict complex real-world phenomena to humans, these challenges cover the opto-electro-mechanical, computational, informational, and perceptual fields. Practically producing a system for real-world VR capture requires navigating a complex design space and pushing the state of the art in each of these areas. As such, we outline several promising directions for future work to improve the quality and flexibility of real-world VR capture systems

Image-based rendering and synthesis

Multiview imaging (MVI) is currently the focus of some research as it has a wide range of applications and opens up research in other topics and applications, including virtual view synthesis for three-dimensional (3D) television (3DTV) and entertainment. However, a large amount of storage is needed by multiview systems and are difficult to construct. The concept behind allowing 3D scenes and objects to be visualized in a realistic way without full 3D model reconstruction is image-based rendering (IBR). Using images as the primary substrate, IBR has many potential applications including for video games, virtual travel and others. The technique creates new views of scenes which are reconstructed from a collection of densely sampled images or videos. The IBR concept has different classification such as knowing 3D models and the lighting conditions and be rendered using conventional graphic techniques. Another is lightfield or lumigraph rendering which depends on dense sampling with no or very little geometry for rendering without recovering the exact 3D-models.published_or_final_versio

Omnidirectional Stereo

Omnidirectional stereo (ODS) is a type of multi-perspective projection that captures horizontal parallax tangential to a viewing circle. This data allows the creation of stereo panoramas that provide plausible stereo views in all viewing directions on the equatorial plane

Whispering limbs: cross-cultural collaboration in a hybrid of contemporary dance, media, sound and improvisation

Whispering Limbs was a performance collaboration between Cairns-based duo Bonemap, Brisbane-based dance trio Polytoxic, Indigenous Cairns-based dancer Earl Rosas and Townsville-based sound artist Steven Campbell. The collaboration was facilitated by Bonemap's principal artists, Rebecca Youdell and Russell Milledge. Through the lens of cross-cultural collaboration, the work places the dancers in a sweep of surreal landscapes, exploring a range of contemporary cultural and cross-cultural themes within a highly integrated, immersive and improvised performance arena. Devised within two weeks and presented over three nights during the 2009 Cairns On Edge Contemporary Media and Performance Festival, Whispering Limbs presents a cultural mix of Indigenous, Polynesian and Caucasian performance. This paper details the development process, the performance environment, the main themes of the work and the manner in which these themes were realised through a focus on the choreography, video projections and sound design in four of the work's twelve scenes