Mixed Reality Interiors: Exploring Augmented Reality Immersive Space Planning Design Archetypes for the Creation of Interior Spatial Volume 3D User Interfaces

Augmented reality is an increasingly relevant medium of interaction and media reception with the advances in user worn or hand-held input/output technologies endowing perception of the digital nested within and reactive to the native physical. Our interior spaces are becoming the media interface and this emergence affords designers the opportunity to delve further into crafting an aesthetics for the medium. Beyond having the virtual assets and applications in correct registration with the real-world environment, critical topics are addressed such as the compositional roles of virtual and physical design features including their purpose, modulation, interaction potentials and implementation into varying indoor settings. Examining and formulating methodologies for mixed reality interior 3D UI schemes derived from the convergence of digital media and interior design disciplines comprise the scope of this design research endeavor. A holistic approach is investigated to produce a framework for augmented reality 3D user interface interiors through research and development of pattern language systems for the balanced blending of complimentary digital and physical design elements. These foundational attributes serve in the creation, organization and exploration of interactive possibilities and implications of these hybrid futuristic spatial interface layouts.M.S., Digital Media -- Drexel University, 201

Implementing non-photorealistic rendreing enhancements with real-time performance

We describe quality and performance enhancements, which work in real-time, to all well-known Non-photorealistic (NPR) rendering styles for use in an interactive context. These include Comic rendering, Sketch rendering, Hatching and Painterly rendering, but we also attempt and justify a widening of the established definition of what is considered NPR. In the individual Chapters, we identify typical stylistic elements of the different NPR styles. We list problems that need to be solved in order to implement the various renderers. Standard solutions available in the literature are introduced and in all cases extended and optimised. In particular, we extend the lighting model of the comic renderer to include a specular component and introduce multiple inter-related but independent geometric approximations which greatly improve rendering performance. We implement two completely different solutions to random perturbation sketching, solve temporal coherence issues for coal sketching and find an unexpected use for 3D textures to implement hatch-shading. Textured brushes of painterly rendering are extended by properties such as stroke-direction and texture, motion, paint capacity, opacity and emission, making them more flexible and versatile. Brushes are also provided with a minimal amount of intelligence, so that they can help in maximising screen coverage of brushes. We furthermore devise a completely new NPR style, which we call super-realistic and show how sample images can be tweened in real-time to produce an image-based six degree-of-freedom renderer performing at roughly 450 frames per second. Performance values for our other renderers all lie between 10 and over 400 frames per second on homePC hardware, justifying our real-time claim. A large number of sample screen-shots, illustrations and animations demonstrate the visual fidelity of our rendered images. In essence, we successfully achieve our attempted goals of increasing the creative, expressive and communicative potential of individual NPR styles, increasing performance of most of them, adding original and interesting visual qualities, and exploring new techniques or existing ones in novel ways.KMBT_363Adobe Acrobat 9.54 Paper Capture Plug-i

Drawing from motion capture : developing visual languages of animation

The work presented in this thesis aims to explore novel approaches of combining motion capture with drawing and 3D animation. As the art form of animation matures, possibilities of hybrid techniques become more feasible, and crosses between traditional and digital media provide new opportunities for artistic expression. 3D computer animation is used for its keyframing and rendering advancements, that result in complex pipelines where different areas of technical and artistic specialists contribute to the end result. Motion capture is mostly used for realistic animation, more often than not for live-action filmmaking, as a visual effect. Realistic animated films depend on retargeting techniques, designed to preserve actors performances with a high degree of accuracy. In this thesis, we investigate alternative production methods that do not depend on retargeting, and provide animators with greater options for experimentation and expressivity. As motion capture data is a great source for naturalistic movements, we aim to combine it with interactive methods such as digital sculpting and 3D drawing. As drawing is predominately used in preproduction, in both the case of realistic animation and visual effects, we embed it instead to alternative production methods, where artists can benefit from improvisation and expression, while emerging in a three-dimensional environment. Additionally, we apply these alternative methods for the visual development of animation, where they become relevant for the creation of specific visual languages that can be used to articulate concrete ideas for storytelling in animation

Content-aware : investigating tools, character & user behavior

Content—Aware serves as a platform for investigating structure, corruption, and visual interference in the context of present-day technologies. I use fragmentation, movement, repetition, and abstraction to interrogate current methods and tools for engaging with the built environment, here broadly conceived as the material, spatial, and cultural products of human labor. Physical and graphic spaces become grounds for testing visual hypotheses. By testing images and usurping image-making technologies, I challenge the fidelity of vision and representation. Rooted in active curiosity and a willingness to fully engage, I collaborate with digital tools, play with their edges, and build perceptual portholes. Through documentation and curation of visual experience, I expose and challenge a capitalist image infrastructure. I create, collect, and process images using smartphone cameras, screen recordings, and applications such as Shrub and Photoshop. These devices and programs, which have the capacity to produce visual smoothness and polish, also inherently engender repetition and fragmentation. The same set of tools used to perfect images is easily reoriented towards visual destabilization. Projects presented here are not meant to serve as literal translations, but rather as symbols or variables in experimental graphic communication strategies. Employing these strategies, I reveal the frames and tools through which we view the world. By exploring and exploiting the limitations of manmade technologies, I reveal the breadth of our human relationships with them, including those of creators, directors, users, and recipients

FACING EXPERIENCE: A PAINTER’S CANVAS IN VIRTUAL REALITY

Full version unavailable due to 3rd party copyright restrictions.This research investigates how shifts in perception might be brought about through the development of visual imagery created by the use of virtual environment technology. Through a discussion of historical uses of immersion in art, this thesis will explore how immersion functions and why immersion has been a goal for artists throughout history. It begins with a discussion of ancient cave drawings and the relevance of Plato’s Allegory of the Cave. Next it examines the biological origins of “making special.” The research will discuss how this concept, combined with the ideas of “action” and “reaction,” has reinforced the view that art is fundamentally experiential rather than static. The research emphasizes how present-day virtual environment art, in providing a space that engages visitors in computer graphics, expands on previous immersive artistic practices. The thesis examines the technical context in which the research occurs by briefly describing the use of computer science technologies, the fundamentals of visual arts practices, and the importance of aesthetics in new media and provides a description of my artistic practice. The aim is to investigate how combining these approaches can enhance virtual environments as artworks. The computer science of virtual environments includes both hardware and software programming. The resultant virtual environment experiences are technologically dependent on the types of visual displays being used, including screens and monitors, and their subsequent viewing affordances. Virtual environments fill the field of view and can be experienced with a head mounted display (HMD) or a large screen display. The sense of immersion gained through the experience depends on how tracking devices and related peripheral devices are used to facilitate interaction. The thesis discusses visual arts practices with a focus on how illusions shift our cognition and perception in the visual modalities. This discussion includes how perceptual thinking is the foundation of art experiences, how analogies are the foundation of cognitive experiences and how the two intertwine in art experiences for virtual environments. An examination of the aesthetic strategies used by artists and new media critics are presented to discuss new media art. This thesis investigates the visual elements used in virtual environments and prescribes strategies for creating art for virtual environments. Methods constituting a unique virtual environment practice that focuses on visual analogies are discussed. The artistic practice that is discussed as the basis for this research also concentrates on experiential moments and shifts in perception and cognition and references Douglas Hofstadter, Rudolf Arnheim and John Dewey. iv Virtual environments provide for experiences in which the imagery generated updates in real time. Following an analysis of existing artwork and critical writing relative to the field, the process of inquiry has required the creation of artworks that involve tracking systems, projection displays, sound work, and an understanding of the importance of the visitor. In practice, the research has shown that the visitor should be seen as an interlocutor, interacting from a first-person perspective with virtual environment events, where avatars or other instrumental intermediaries, such as guns, vehicles, or menu systems, do not to occlude the view. The aesthetic outcomes of this research are the result of combining visual analogies, real time interactive animation, and operatic performance in immersive space. The environments designed in this research were informed initially by paintings created with imagery generated in a hypnopompic state or during the moments of transitioning from sleeping to waking. The drawings often emphasize emotional moments as caricatures and/or elements of the face as seen from a number of perspectives simultaneously, in the way of some cartoons, primitive artwork or Cubist imagery. In the imagery, the faces indicate situations, emotions and confrontations which can offer moments of humour and reflective exploration. At times, the faces usurp the space and stand in representation as both face and figure. The power of the placement of the caricatures in the paintings become apparent as the imagery stages the expressive moment. The placement of faces sets the scene, establishes relationships and promotes the honesty and emotions that develop over time as the paintings are scrutinized. The development process of creating virtual environment imagery starts with hand drawn sketches of characters, develops further as paintings on “digital canvas”, are built as animated, three-dimensional models and finally incorporated into a virtual environment. The imagery is generated while drawing, typically with paper and pencil, in a stream of consciousness during the hypnopompic state. This method became an aesthetic strategy for producing a snappy straightforward sketch. The sketches are explored further as they are worked up as paintings. During the painting process, the figures become fleshed out and their placement on the page, in essence brings them to life. These characters inhabit a world that I explore even further by building them into three dimensional models and placing them in computer generated virtual environments. The methodology of developing and placing the faces/figures became an operational strategy for building virtual environments. In order to open up the range of art virtual environments, and develop operational strategies for visitors’ experience, the characters and their facial features are used as navigational strategies, signposts and methods of wayfinding in order to sustain a stream of consciousness type of navigation. Faces and characters were designed to represent those intimate moments of self-reflection and confrontation that occur daily within ourselves and with others. They sought to reflect moments of wonderment, hurt, curiosity and humour that could subsequently be relinquished for more practical or purposeful endeavours. They were intended to create conditions in which visitors might reflect upon their emotional state, v enabling their understanding and trust of their personal space, in which decisions are made and the nature of world is determined. In order to extend the split-second, frozen moment of recognition that a painting affords, the caricatures and their scenes are given new dimensions as they become characters in a performative virtual reality. Emotables, distinct from avatars, are characters confronting visitors in the virtual environment to engage them in an interactive, stream of consciousness, non-linear dialogue. Visitors are also situated with a role in a virtual world, where they were required to adapt to the language of the environment in order to progress through the dynamics of a drama. The research showed that imagery created in a context of whimsy and fantasy could bring ontological meaning and aesthetic experience into the interactive environment, such that emotables or facially expressive computer graphic characters could be seen as another brushstroke in painting a world of virtual reality

Anti-Grand: Contemporary Perspectives on Landscape

Anti-Grand: Contemporary Perspectives on Landscape Joel and Lila Harnett Museum of Art University of Richmond Museums, VA January 15 to March 6, 2015 Anti-Grand: Contemporary Perspectives on Landscape features 24 contemporary, international artists, artists’ collectives and game developers who examine, challenge, and re-define the concept of landscape while simultaneously drawing attention to humanity’s hubristic attempts to relate to, preserve, and manage the natural environment. Anti-Grand includes 33 works of art, with video, installation, video games, and traditional two- and three-dimensional work. All of the works in the exhibition were created since 2000 to focus on art made well after the initial developments of the modern and popular discourse on environmentalism and sustainability. The exhibition’s title Anti-Grand suggests an approach to the topic that is opposite one of awe and reverie of the past, approaches that are now difficult to consider without an implicit sense of irony. Contemporary Perspectives of Landscape emphasizes the role of the artist’s and/or viewer’s choice of framing device as applied to both the represented scenery and the genre at large. Engaging humor, tenderness, ambivalence, and respect, the artists look at many facets of this subject. Unifying the exhibition are issues of representation that are inherent to the genre and the various ways in which artists have self-reflexively considered their relationship to the artistic subject.Images from the Exhibitionhttps://scholarship.richmond.edu/exhibition-catalogs/1002/thumbnail.jp

Spatiotemporal Granulation

This document introduces a novel theory and technique called Spatiotemporal Granulation. Through the use of spatially encoded signals, the algorithm segments spatial and temporal information, producing grains that are localized in both space and time. Well-known transformations that are derived from classical granulation, as well as new manipulations that arise are discussed, and outlined. As a means to reassemble the grains into a new configuration, we explore how granulation parameters acquire a different context, and introduce new methods for control. We present findings and limitations of this new technique, and outline some potential creative and analytical uses. The viability of Spatiotemporal Granulation is demonstrated through a software implementation titled Angkasa

Seeing the Spell: Baroque, Decadence, and a Cinema of Digital-Animated Liberation

This dissertation draws on the artistic traditions of seventeenth-century Baroque and nineteenth-century Decadence in seeking to formulate an analytical vocabulary for the aesthetics of digitally-animated spectacle in contemporary cinema. The dissertation seeks to critique binary antinomies of narrative vs. spectacle, and instead propose a concept of narrativized spectacle whereby digital visual effects have brought about a profound liberation in cinemas capacity to envision narrative story-worlds, and depict their workings. It takes the contemporary Hollywood blockbuster as its chief subject for this inquiry, insofar as this is the filmmaking idiom most given to the embrace and deployment of digitally-liberated spectacle, and one which is frequently assumed to be largely bereft of formal and narrative sophistication. This dissertation argues, on the contrary, that the Hollywood blockbusters spectacular nature in fact bears complex utopian implications, and that the crudities which occasionally mar the form in practice are more the result of not being imaginatively hyperbolic enough, rather than being too much so. The dissertations invocation of Baroque and Decadent aesthetics provides a conceptual apparatus for describing this contemporary cinematic idiom of digitized blockbuster spectacle. It identifies a Baroque aesthetic in such stylistic traits as verticality, profusion, and the sublime, as well as narrative themes of transgression of limits, reverence before imposing scale and grandeur, and refusal to ennoble passivity and martyrdom. Likewise, it identifies Decadent aesthetics in stylistics which privilege the gaze, the enclosed and aestheticized space, and formal ritual, as well as narratives ordered around principles of perversity, self-consciousness, and interconnectedness. The ultimate intervention which this dissertation seeks to make, however, is to demonstrate the centrality rather than marginality of animation to cinema, insofar as cel animation has always possessed the graphic freedom to realize any imaginative vision, which digital effects have only recently extended to live-action cinema. All of the aesthetics of Baroque and Decadent blockbuster spectacle that the dissertation traces could be and, the dissertation seeks to show, were deployed in the animated feature years in advance of the liberation of representation that digital effects would bring to live-action