Haptic Media Scenes

The aim of this thesis is to apply new media phenomenological and enactive embodied cognition approaches to explain the role of haptic sensitivity and communication in personal computer environments for productivity. Prior theory has given little attention to the role of haptic senses in influencing cognitive processes, and do not frame the richness of haptic communication in interaction design—as haptic interactivity in HCI has historically tended to be designed and analyzed from a perspective on communication as transmissions, sending and receiving haptic signals. The haptic sense may not only mediate contact confirmation and affirmation, but also rich semiotic and affective messages—yet this is a strong contrast between this inherent ability of haptic perception, and current day support for such haptic communication interfaces. I therefore ask: How do the haptic senses (touch and proprioception) impact our cognitive faculty when mediated through digital and sensor technologies? How may these insights be employed in interface design to facilitate rich haptic communication? To answer these questions, I use theoretical close readings that embrace two research fields, new media phenomenology and enactive embodied cognition. The theoretical discussion is supported by neuroscientific evidence, and tested empirically through case studies centered on digital art. I use these insights to develop the concept of the haptic figura, an analytical tool to frame the communicative qualities of haptic media. The concept gauges rich machine- mediated haptic interactivity and communication in systems with a material solution supporting active haptic perception, and the mediation of semiotic and affective messages that are understood and felt. As such the concept may function as a design tool for developers, but also for media critics evaluating haptic media. The tool is used to frame a discussion on opportunities and shortcomings of haptic interfaces for productivity, differentiating between media systems for the hand and the full body. The significance of this investigation is demonstrating that haptic communication is an underutilized element in personal computer environments for productivity and providing an analytical framework for a more nuanced understanding of haptic communication as enabling the mediation of a range of semiotic and affective messages, beyond notification and confirmation interactivity

My Crohn’s disease on real-time information - User experience improvement through cross-platform applications

Reducing hospital institutionalization of citizen with chronic diseases is a major priority of western countries priorities. The more complex the health condition, the harder it is to coordinate clinical care. To improve the disease management and control, most patients need to use mobile applications that are available in online stores or web services because of the difficulty that a personal mobile phone has to get real time access to clinical data outside of a hospital. In terms of IBD - Inflammatory Bowel Disease - existing mobile phone solutions are very complex, because visually the interfaces communicates with the user through inadequate use of symbols in clinical features, which are inconsistent and have poor legibility. They also presents a lack of visual optimization between multiplatform systems. This increases the user's learning curve in terms of how to interpret and interact with these systems, generating an opportunity for these patients with abilities to innovate through the creation and development of solutions that solve their own problems related to the management and coordination of the disease. This thesis aims to analysis IBD patients behaviour related to disease management, identify the type of problems, both functional and communication, which occur in existing IBD m-Health and e-Health systems, and introduces two topics – communication and design studies – in the "User Innovator" model of Von Hippel (1976) which consists of users, that are, for example, patients with chronic diseases, and who innovate by creating solutions to solve personal problems because of unfavourable healthcare conditions. To validate in the design process the three perspectives – design, innovation and patient – were considered, and the framework “Human-social Interaction Model for e-Health Interfaces” was created, enabling a sustainable approach to research, with inputs from personal experience being used, introducing relevant feedback for the final goal of the preliminary studies, when creating the interface for mobile phone application particularly for Crohn’s disease, one of the IBD, with a new healthcare user experience. To reach the objective, a set of studies were conducted that were divided into two stages. The first, a literature review of the relationship between semiotics and interactive communication; the meaning of symbolic representation in interactive projects; new design research guidelines that define interfaces and features and that are more approachable for users; user perspectives towards technology for health supporting and controlling; the design and communication space on technological projects; the challenge for users/ patients who try to create systems to solve personal problems. The second part, presents the practical research that includes a survey of 279 participants with IBD; the empirical analysis of six case studies – mobile applications and multiplatform: context, features, design principles lifting, and usability testing A/B with the design features and principles of design on two of the six systems being compared. The results from the thesis challenge the concepts of mobile interface usability in health, providing users with a structured interpretation of medical information design and a guideline for designers with chronic diseases that would like to create solutions to monitor health problems.Reduzir a institucionalização hospitalar de cidadãos com doenças crónicas é uma das prioridades para os países ocidentais. Quanto maior for a complexidade das condições de saúde, mais difícil se torna a coordenação dos cuidados clínicos. Para melhorar o controle e a gestão da doença, a maioria destes pacientes recorre às aplicações para telemóvel disponíveis em lojas online e aos serviços na web pois, é difícil obter permissão para aceder a dados clínicos em tempo real no telemóvel pessoal a partir do hospital. No contexto da DII – Doença Inflamatória do Intestino – as soluções existentes apresentam níveis de complexidade visual elevados pois, a interface comunica com o utilizador através de símbolos clínicos inadequados em funcionalidades convencionais – fraca legibilidade e inconsistência; Apresenta também, fraca coerência visual entre sistemas multiplataforma. Estes cenários promovem no utilizador, um aumento da curva de aprendizagem relativamente à forma como estes interagem com os sistemas criando assim, uma abertura para o desenvolvimento de soluções pelos que têm habilidade para inovar através da criação e desenvolvimento de sistemas que resolvem os seus problemas com a gestão e coordenação da doença. Esta tese tem como objetivo analisar o comportamento dos pacientes com DII relativamente à gestão da sua doença. Identificar que tipo de problemas – funcionais e de comunicação – existem nas soluções atuais para telemóvel e web no contexto da DII, introduzindo novos temas – estudos em comunicação e design – no modelo "User Innovator" de Von Hippel (1976) que consiste em, utilizadores, como por exemplo, pacientes com doenças crónicas, que inovam ao criarem soluções para resolver os problemas pessoais, tais como, condições de saúde adversas. Para validar no processo de design a integração das três áreas – design, inovação e paciente – criamos a framework “Human-social Interaction Model for e-Health Interfaces” que nos permitiu uma abordagem sustentável à investigação, quando foram aplicados inputs provenientes de experiência pessoal das três perspectivas introduzindo feedback relevante para o objetivo final dos estudos preliminares, também quando criada a interface para dispositivos móveis focada na doença de Crohn, uma das DII, com uma nova experiência de utilizador na área da saúde. Para atingir o objectivo, realizou-se um conjunto de estudos que se encontram divididos em dois momentos: o primeiro, com revisão de literatura sobre a relação da semiótica com a comunicação interativa; o significado da representação simbólica em projetos interativos; as novas linhas de reflexão do Design que definem interfaces e funcionalidades mais próximas do utilizador; a perspectiva dos utilizadores perante a tecnologia como meio de suporte e controle da saúde; o espaço do design e da comunicação em projetos tecnológicos; o desafio para utilizadores/ pacientes que tentam criar sistemas para solucionar problemas pessoais. A segunda parte apresenta a investigação de campo com, um inquérito a 279 participantes com DII; análise empírica de seis casos de estudo – aplicações para telemóvel e multiplataforma: contexto, funcionalidades, levantamento de princípios do design, e testes de usabilidade A/B onde comparamos em dois dos seis sistemas, a articulação entre as funcionalidades e os princípios do design. Os resultados obtidos desafiam a usabilidade das interfaces para telemóvel no contexto da saúde, proporcionando aos utilizadores uma interpretação mais coerente do ponto de vista formal do design de informação médica e um caminho para designers com doenças crónicas que pretendem criar soluções para resolver problemas de monotorização da saúde

The alignment of screens

This thesis makes a distinction between screen and surface. It proposes that an inquiry into screens includes, but is not limited to, the study of surfaces. Screens and screening practices are about doing both divisions and vision. The habit of reducing screens to the display neglects their capacity to emplace separations (think of folding screens). In this thesis an investigation of screens becomes a matter of asking how surfaces and the gaps in between them articulate alignments of people and things with displays that, in practice, always leave something out of sight. Rather than losing touch with screens by reducing them to surfaces, in other words, I am interested in alternative screen configurations. For this task I sketch an approach that touches on screens through the figures of lines, surfaces, textures, folds, knots and cuts. Lines help me to make the case for thinking about screens as alignments. I then ask what kinds of observers emerge from reducing screens to single or digital surfaces. I trace that concern with Google Glass, a pair of “smartglasses” with a transparent display. To distinguish between screen and surface I suggest, through a study of biodetection and assistance dogs, how to qualify or texture screens within webs of relations. I further outline, with snapshots of my workplace and two screens named Vig and Ben, two modes of touching or un/en/folding their locations. Finally, with knots and cuts, I underline the unfolding of self checkouts in supermarkets, and the enfolding of automated tellers outside banks. All of these reconfigurations experiment with screens by moving sideways in order to approach their displays laterally, and make visible their (ab)use by those in power. This method is a way of grasping the embodiment and the materiality of screens, while responding to the practices, agencies, and affects aligned around, through, and away from their displays

From corporeality to virtual reality: theorizing literacy, bodies, and technology in the emerging media of virtual, augmented, and mixed realities

This dissertation explores the relationships between literacy, technology, and bodies in the emerging media of Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR). In response to the recent, rapid emergence of new media forms, questions arise as to how and why we should prepare to compose in new digital media. To interrogate the newness accorded to new media composing, I historicize the literacy practices demanded by new media by examining digital texts, such as video games and software applications, alongside analogous “antiquated” media, such as dioramas and museum exhibits. Comparative textual analysis of analogous digital and non-digital VR, AR, and MR texts reveals new media and “antiquated” media utilize common characteristics of dimensionality, layering, and absence/presence, respectively. The establishment of shared traits demonstrates how media operate on a continuum of mutually held textual practices; despite their distinctive forms, new media texts do not represent either a hierarchical or linear progression of maturing development. Such an understanding aids composing in new VR, AR, and MR media by enabling composers to make fuller use of prior knowledge in a rapidly evolving new media environment, a finding significant both for educators and communicators. As these technologies mature, we will continue to compose both traditional and new forms of texts. As such, we need literacy theory that attends to both the traditional and the new and also is comprehensive enough to encompass future acts of composing in media yet to emerge

Urban environments and new media : redefining a fitness facility through a technologically mediated space

Tese de mestrado. Multimédia. Universidade do Porto. Faculdade de Engenharia. 201

Digital material: tracing new media in everyday life and technology

Three decades of societal and cultural alignment of new media have yielded a host of innovations, trials, and problems, accompanied by versatile popular and academic discourse. New Media Studies crystallized internationally into an established academic discipline, and this begs the question: where do we stand now? Which new questions are emerging now that new media are being taken for granted, and which riddles are still unsolved? Is contemporary digital culture indeed all about 'you', the participating user, or do we still not really understand the digital machinery and how this constitutes us as 'you'? The contributors to the present book, all employed in teaching and researching new media and digital culture, assembled their 'digital material' into an anthology, covering issues ranging from desktop metaphors to Web 2.0 ecosystems, from touch screens to blogging and e-learning, from role-playing games and cybergothic music to wireless dreams. Together the contributions provide a showcase of current research in the field, from what may be called a 'digital-materialist' perspective.Nieuwe media zijn vanaf hun opkomst begeleid door revolutionaire beloften en bedreigingen: hypertekst zou lezers veranderen in auteurs, digitale beelden zouden de waarheid en werkelijkheid ondermijnen, en online communicatie zou alle afstanden overbruggen. 'Cyberspace' werd gevierd dan wel gevreesd als immaterieel en autonoom, losgezongen van onze dagelijkse leefwereld. Na twee decennia 'cyberrevolutie' zijn nieuwe media vanzelfsprekend geworden en blijken zij allesbehalve immaterieel. Vanuit dat perspectief belicht de bundel Digital Material digitale culturen. De bijdragen onderzoeken onder meer computer games, mobiele communicatie, interfacemetaforen, weblogculturen, software ontwikkeling en digitale beeldproductie. Bij elkaar vormen zij een inspirerend theoretisch kader om de hedendaagse betekenis van nieuwe media te doorgronden

Proceedings of the Sixth Danish Human-Computer Interaction Research Symposium.

Proceedings of theSixth Danish Human-Computer Interaction Research Symposium.Aarhus, Denmark, November 15, 200

Discourse and Digital Practices

Discourse and Digital Practices shows how tools from discourse analysis can be used to help us understand new communication practices associated with digital media, from video gaming and social networking to apps and photo sharing. This cutting-edge book: draws together fourteen eminent scholars in the field including James Paul Gee, David Barton, Ilana Snyder, Phil Benson, Victoria Carrington, Guy Merchant, Camilla Vasquez, Neil Selwyn and Rodney Jones answers the central question: "How does discourse analysis enable us to understand digital practices?" addresses a different type of digital media in each chapter demonstrates how digital practices and the associated new technologies challenge discourse analysts to adapt traditional analytic tools and formulate new theories and methodologies examines digital practices from a wide variety of approaches including textual analysis, conversation analysis, interactional sociolinguistics, multimodal discourse analysis, object ethnography, geosemiotics, and critical discourse analysis. Discourse and Digital Practices will be of interest to advanced students studying courses on digital literacies or language and digital practices

Multimodalities in Metadata: Gaia Gate

Metadata is information about objects. Existing metadata standards seldom describe details concerning an object’s context within an environment; this thesis proposes a new concept, external contextual metadata (ECM), examining metadata, digital photography, and mobile interface theory as context for a proposed multimodal framework of media that expresses the internal and external qualities of the digital object and how they might be employed in various use cases. The framework is binded to a digital image as a singular object. Information contained in these ‘images’ can then be processed by a renderer application to reinterpret the context that the image was captured, including non-visually. Two prototypes are developed through the process of designing a renderer for the new multimodal data framework: a proof-of-concept application and a demonstration of ‘figurative’ execution (titled ‘Gaia Gate’), followed by a critical design analysis of the resulting products

A Seeing Place – Connecting Physical and Virtual Spaces

In the experience and design of spaces today, we meet both reality and virtuality. But how is the relation between real and virtual construed? How can we as researchers and designers contribute to resolving the physical-virtual divide regarding spaces? This thesis explores the relations between the physical and the virtual and investigates ways of connecting physical and virtual space, both in theory and practice.\ua0The basic concepts of the thesis are Space, Place, and Stage. The central idea is that the stage is a strong conceptual metaphor that has the capacity to work as a unifying concept relating physical and virtual spaces and forming a place for attention, agreements, and experience – A Seeing Place. The concept of seeing place comes from the Greek word theatre, meaning a “place for seeing”, both in the sense of looking at and understanding.\ua0In certain situations, the relations between physical and virtual spaces become important for users’ experience and understanding of these situations. This thesis presents seven cases of physical-virtual spaces, in the field of architectural and exhibition design. The method of these studies is research by design. The discussion then focuses on how each setting works as a stage, and how conceptual metaphors can contribute to the connection between physical and virtual spaces.\ua0Building upon the explorations and experiments in different domains, the thesis contains a collection of seven papers concerning the relations between physical and virtual space in different contexts outside the world of theatre. These papers range from more technical about Virtual Reality (design of networked collaborative spaces) to more conceptual about staging (methods in interaction design) and virtual space (using a transdisciplinary approach).\ua0The results of those studies suggest that the Stage metaphor of a physical-virtual space can contribute to the elucidating of relations between physical and virtual spaces in number of ways. Conceptually, the stage metaphor links together the semiotic and the hermeneutic views of space and place. And, from a practice-based perspective, A Seeing Place view opens up the way to creating contemporary spaces and resolving the physical-virtual divide