What does augmented reality mean as a medium of expression for computational artists?

As augmented reality (AR) quickly evolves with new technological practice, there is a growing need to question and reevaluate its potential as a medium for creative expression. The authors discuss AR within computational art, framed within AR as a medium, AR aesthetics and applications. The Forum for Augmented Reality Immersive Instruments (ARImI), a two-day event on AR, highlights both possibilities and fundamental concerns for continuing artworks in this field, including visual bias, sensory modalities, interactivity and performativity. The authors offer a new AR definition as real-time computationally mediated perception

Digital sculpture : conceptually motivated sculptural models through the application of three-dimensional computer-aided design and additive fabrication technologies

Thesis (D. Tech.) - Central University of Technology, Free State, 200

Literacy for digital futures : Mind, body, text

The unprecedented rate of global, technological, and societal change calls for a radical, new understanding of literacy. This book offers a nuanced framework for making sense of literacy by addressing knowledge as contextualised, embodied, multimodal, and digitally mediated. In today’s world of technological breakthroughs, social shifts, and rapid changes to the educational landscape, literacy can no longer be understood through established curriculum and static text structures. To prepare teachers, scholars, and researchers for the digital future, the book is organised around three themes – Mind and Materiality; Body and Senses; and Texts and Digital Semiotics – to shape readers’ understanding of literacy. Opening up new interdisciplinary themes, Mills, Unsworth, and Scholes confront emerging issues for next-generation digital literacy practices. The volume helps new and established researchers rethink dynamic changes in the materiality of texts and their implications for the mind and body, and features recommendations for educational and professional practice

Toward an Agent-Agnostic Transmission Model: Synthesizing Anthropocentric and Technocentric Paradigms in Communication

Technological and social evolutions have prompted operational, phenomenological, and ontological shifts in communication processes. These shifts, we argue, trigger the need to regard human and machine roles in communication processes in a more egalitarian fashion. Integrating anthropocentric and technocentric perspectives on communication, we propose an agent-agnostic framework for human-machine communication. This framework rejects exclusive assignment of communicative roles (sender, message, channel, receiver) to traditionally held agents and instead focuses on evaluating agents according to their functions as a means for considering what roles are held in communication processes. As a first step in advancing this agent-agnostic perspective, this theoretical paper offers three potential criteria that both humans and machines could satisfy: agency, interactivity, and influence. Future research should extend our agent-agnostic framework to ensure that communication theory will be prepared to deal with an ostensibly machine-inclusive future

Study of emotion in videogames : understanding presence and behaviour

Only when videogames are released are we able to look at them and analyse them. Nowadays, platforms to share our thoughts and opinions about a videogame, or part of it, are everywhere, with both positive and negative commentaries being shared daily. However, what makes a game be seen as a positive experience and what components satisfy and engage players in it? In this Dissertation, we aim to comprehend how players perceive videogames and what motivates and triggers emotions one has during play. We will take a look at several different concepts that all work together when playing a videogame. We will start by understanding what Interaction is and how humans behave. Afterwards, we will better investigate the widely used topic of Immersion, and its unknown and unrecognized brother Presence. From there, we will divide involvement in game play in two parts, the technological side, which relates to natural interfaces and mastery of controls, and the side of design and implementation of content, more specifically the concept of Agency and how it plays a huge part in making players feel part of the game.Só quando um videojogo é lançado é que o podemos analisar e rever. Atualmente, encontramos plataformas para partilhar a nossa opinião acerca de um videojogo, ou parte dele, em qualquer lado, com comentários positivos e negativos a serem partilhados diariamente. No entanto, o que é que faz um jogo ser visto como uma experiência positiva e quais são os componentes que satisfazem e envolvem jogadores? Nesta Dissertação, pretendemos compreender como é que jogadores percecionam um videojogo e que emoções são despoletadas que os motiva a jogar. Iremos analisar diferentes conceitos que contribuem para o jogar de um videojogo. Começaremos por ver o que é a Interação e como é que o ser humano se comporta e age. Prosseguindo, iremos analisar o já bastante usado conceito de Imersão, e o seu desconhecido e menos reconhecido irmão, Presença. Daí iremos dividir o envolvimento com um videojogo em duas partes, no lado tecnológico, relacionado com interfaces naturais e mestria de controlos, e no lado de design e implementação de conteúdo, mais especificamente no conceito de Agência e a maneira como esta integra os jogadores no jogo

An aesthetics of touch: investigating the language of design relating to form

How well can designers communicate qualities of touch? This paper presents evidence that they have some capability to do so, much of which appears to have been learned, but at present make limited use of such language. Interviews with graduate designer-makers suggest that they are aware of and value the importance of touch and materiality in their work, but lack a vocabulary to fully relate to their detailed explanations of other aspects such as their intent or selection of materials. We believe that more attention should be paid to the verbal dialogue that happens in the design process, particularly as other researchers show that even making-based learning also has a strong verbal element to it. However, verbal language alone does not appear to be adequate for a comprehensive language of touch. Graduate designers-makers’ descriptive practices combined non-verbal manipulation within verbal accounts. We thus argue that haptic vocabularies do not simply describe material qualities, but rather are situated competences that physically demonstrate the presence of haptic qualities. Such competencies are more important than groups of verbal vocabularies in isolation. Design support for developing and extending haptic competences must take this wide range of considerations into account to comprehensively improve designers’ capabilities

Touch- and Walkable Virtual Reality to Support Blind and Visually Impaired Peoples‘ Building Exploration in the Context of Orientation and Mobility

Der Zugang zu digitalen Inhalten und Informationen wird immer wichtiger für eine erfolgreiche Teilnahme an der heutigen, zunehmend digitalisierten Zivilgesellschaft. Solche Informationen werden meist visuell präsentiert, was den Zugang für blinde und sehbehinderte Menschen einschränkt. Die grundlegendste Barriere ist oft die elementare Orientierung und Mobilität (und folglich die soziale Mobilität), einschließlich der Erlangung von Kenntnissen über unbekannte Gebäude vor deren Besuch. Um solche Barrieren zu überbrücken, sollten technische Hilfsmittel entwickelt und eingesetzt werden. Es ist ein Kompromiss zwischen technologisch niedrigschwellig zugänglichen und verbreitbaren Hilfsmitteln und interaktiv-adaptiven, aber komplexen Systemen erforderlich. Die Anpassung der Technologie der virtuellen Realität (VR) umfasst ein breites Spektrum an Entwicklungs- und Entscheidungsoptionen. Die Hauptvorteile der VR-Technologie sind die erhöhte Interaktivität, die Aktualisierbarkeit und die Möglichkeit, virtuelle Räume und Modelle als Abbilder von realen Räumen zu erkunden, ohne dass reale Gefahren und die begrenzte Verfügbarkeit von sehenden Helfern auftreten. Virtuelle Objekte und Umgebungen haben jedoch keine physische Beschaffenheit. Ziel dieser Arbeit ist es daher zu erforschen, welche VR-Interaktionsformen sinnvoll sind (d.h. ein angemessenes Verbreitungspotenzial bieten), um virtuelle Repräsentationen realer Gebäude im Kontext von Orientierung und Mobilität berührbar oder begehbar zu machen. Obwohl es bereits inhaltlich und technisch disjunkte Entwicklungen und Evaluationen zur VR-Technologie gibt, fehlt es an empirischer Evidenz. Zusätzlich bietet diese Arbeit einen Überblick über die verschiedenen Interaktionen. Nach einer Betrachtung der menschlichen Physiologie, Hilfsmittel (z.B. taktile Karten) und technologischen Eigenschaften wird der aktuelle Stand der Technik von VR vorgestellt und die Anwendung für blinde und sehbehinderte Nutzer und der Weg dorthin durch die Einführung einer neuartigen Taxonomie diskutiert. Neben der Interaktion selbst werden Merkmale des Nutzers und des Geräts, der Anwendungskontext oder die nutzerzentrierte Entwicklung bzw. Evaluation als Klassifikatoren herangezogen. Begründet und motiviert werden die folgenden Kapitel durch explorative Ansätze, d.h. im Bereich 'small scale' (mit sogenannten Datenhandschuhen) und im Bereich 'large scale' (mit einer avatargesteuerten VR-Fortbewegung). Die folgenden Kapitel führen empirische Studien mit blinden und sehbehinderten Nutzern durch und geben einen formativen Einblick, wie virtuelle Objekte in Reichweite der Hände mit haptischem Feedback erfasst werden können und wie verschiedene Arten der VR-Fortbewegung zur Erkundung virtueller Umgebungen eingesetzt werden können. Daraus werden geräteunabhängige technologische Möglichkeiten und auch Herausforderungen für weitere Verbesserungen abgeleitet. Auf der Grundlage dieser Erkenntnisse kann sich die weitere Forschung auf Aspekte wie die spezifische Gestaltung interaktiver Elemente, zeitlich und räumlich kollaborative Anwendungsszenarien und die Evaluation eines gesamten Anwendungsworkflows (d.h. Scannen der realen Umgebung und virtuelle Erkundung zu Trainingszwecken sowie die Gestaltung der gesamten Anwendung in einer langfristig barrierefreien Weise) konzentrieren.Access to digital content and information is becoming increasingly important for successful participation in today's increasingly digitized civil society. Such information is mostly presented visually, which restricts access for blind and visually impaired people. The most fundamental barrier is often basic orientation and mobility (and consequently, social mobility), including gaining knowledge about unknown buildings before visiting them. To bridge such barriers, technological aids should be developed and deployed. A trade-off is needed between technologically low-threshold accessible and disseminable aids and interactive-adaptive but complex systems. The adaptation of virtual reality (VR) technology spans a wide range of development and decision options. The main benefits of VR technology are increased interactivity, updatability, and the possibility to explore virtual spaces as proxies of real ones without real-world hazards and the limited availability of sighted assistants. However, virtual objects and environments have no physicality. Therefore, this thesis aims to research which VR interaction forms are reasonable (i.e., offering a reasonable dissemination potential) to make virtual representations of real buildings touchable or walkable in the context of orientation and mobility. Although there are already content and technology disjunctive developments and evaluations on VR technology, there is a lack of empirical evidence. Additionally, this thesis provides a survey between different interactions. Having considered the human physiology, assistive media (e.g., tactile maps), and technological characteristics, the current state of the art of VR is introduced, and the application for blind and visually impaired users and the way to get there is discussed by introducing a novel taxonomy. In addition to the interaction itself, characteristics of the user and the device, the application context, or the user-centered development respectively evaluation are used as classifiers. Thus, the following chapters are justified and motivated by explorative approaches, i.e., in the group of 'small scale' (using so-called data gloves) and in the scale of 'large scale' (using an avatar-controlled VR locomotion) approaches. The following chapters conduct empirical studies with blind and visually impaired users and give formative insight into how virtual objects within hands' reach can be grasped using haptic feedback and how different kinds of VR locomotion implementation can be applied to explore virtual environments. Thus, device-independent technological possibilities and also challenges for further improvements are derived. On the basis of this knowledge, subsequent research can be focused on aspects such as the specific design of interactive elements, temporally and spatially collaborative application scenarios, and the evaluation of an entire application workflow (i.e., scanning the real environment and exploring it virtually for training purposes, as well as designing the entire application in a long-term accessible manner)

MRnews: Design Explorations into Accessibility and News

Creating accessible technology and content is generally seen as beneficial for all users. This is particularly important when the content has a significant societal impact, such as news stories. To find new and innovative ways to engage users, digital news outlets are faced with challenges related to accessibility. In the case of Mixed Reality (MR) technology, the increasing interest emphasizes the need for the technology to be inclusive and accessible. The embodied nature and affordances of MR technology enable users to manipulate virtual objects using real-world knowledge and in real-time and enable them to utilize a wide range of skills when interacting with such systems. In turn, leveraging these affordances can enhance the accessibility of the task at hand. Contributions to developing accessibility guidelines have been made, and the use of MR applications to enhance accessibility is on the rise. However, these contributions are most prominent in education and not for leisurely use. This research project investigates the affordances of MR and of the Augmented Reality (AR) Head Mounted Display (HMD), HoloLens 2 (HL2) in particular, and how these can be leveraged to enhance accessibility when reading digital news. This is a Research through Design (RtD) project carried out in participation with users by conducting design activities and user evaluations. The RtD-process is supported by prototypes developed through an iterative process. MRnews is an application built for Microsoft’s AR HMD, the HL2. The implemented design showcases how news content creators and developers can leverage the affordances of MR technology to achieve accessibility in news stories. The results point toward direct manipulation of virtual content utilizing the spatial nature of MR technology and the use of sensory cues to keep the user oriented and focused impact accessibility.Masteroppgave i medie- og interaksjonsdesignMIX350MASV-MI

XR Academia:Research and Experiences in Virtual Reality, Augmented Reality, Mixed Reality, and Artificial Intelligence in Latin America and Europe

The book XR Academia: Research and Experiences in Virtual Reality, Augmented Reality, Mixed Reality, and Artificial Intelligence in Latin America and Europe, has at its core the objective of making immersive technology accessible and visible worldwide, with the simultaneous breaking-down of linguistic barriers. Both European and Latin American authors can read each other’s work(s), allowing knowledge and experience in extended reality to be shared. Another important aspect of XR Academia is its attempt to introduce an open science contribution to the issues of immersive technologies, in order to inspire new generations that do not have access to increasingly expensive publications. This volume includes fourteen selected chapters from presenters from the 2020 and 2021 events. These chapters describe research and experiences on a wide range of XR applications, which include entertainment, health, narration, education, psychotherapy, guidance, language, culture and arts. Considering that great inventions and innovations are developed in Latin America but fail to be published internationally, our aim was to open a door to allow the permanent exchange between two languages: Spanish and English