553 research outputs found
Interdisciplinary Insights for Digital Touch Communication
Communication is increasingly moving beyond âways of seeingâ to âways of feelingâ. This Open Access book provides social design insights and implications for HCI research and design exploring digitally mediated touch communication. It offers a socially orientated map to help navigate the complex social landscape of digitally mediated touch for communication: from everyday touch-screens, tangibles, wearables, haptics for virtual reality, to the tactile internet of skin. Drawing on literature reviews, new case-study vignettes, and exemplars of digital touch, the book examines the major social debates provoked by digital touch, and investigates social themes central to the communicative potential and societal consequences of digital touch: · Communication environments, capacities and practices · Norms associations and expectations · Presence, absence and connection · Social imaginaries of digital touch · Digital touch ethics and values The book concludes with a discussion of the significance of social understanding and methods in the context of Interdisciplinary collaborations to explore touch, towards the design of digital touch communication, âways of feelingâ, that are useable, appropriate, ethical and socially aware
Multi-Sensory Interaction for Blind and Visually Impaired People
This book conveyed the visual elements of artwork to the visually impaired through various sensory elements to open a new perspective for appreciating visual artwork. In addition, the technique of expressing a color code by integrating patterns, temperatures, scents, music, and vibrations was explored, and future research topics were presented. A holistic experience using multi-sensory interaction acquired by people with visual impairment was provided to convey the meaning and contents of the work through rich multi-sensory appreciation. A method that allows people with visual impairments to engage in artwork using a variety of senses, including touch, temperature, tactile pattern, and sound, helps them to appreciate artwork at a deeper level than can be achieved with hearing or touch alone. The development of such art appreciation aids for the visually impaired will ultimately improve their cultural enjoyment and strengthen their access to culture and the arts. The development of this new concept aids ultimately expands opportunities for the non-visually impaired as well as the visually impaired to enjoy works of art and breaks down the boundaries between the disabled and the non-disabled in the field of culture and arts through continuous efforts to enhance accessibility. In addition, the developed multi-sensory expression and delivery tool can be used as an educational tool to increase product and artwork accessibility and usability through multi-modal interaction. Training the multi-sensory experiences introduced in this book may lead to more vivid visual imageries or seeing with the mindâs eye
Earth as Interface: Exploring chemical senses with Multisensory HCI Design for Environmental Health Communication
As environmental problems intensify, the chemical senses -that is smell and taste, are the most relevantsenses to evidence them.As such, environmental exposure vectors that can reach human beings comprise air,food, soil and water[1].Within this context, understanding the link between environmental exposures andhealth[2]is crucial to make informed choices, protect the environment and adapt to new environmentalconditions[3].Smell and taste lead therefore to multi-sensorial experiences which convey multi-layered information aboutlocal and global events[4]. However, these senses are usually absent when those problems are represented indigital systems. The multisensory HCIdesign framework investigateschemical sense inclusion withdigital systems[5]. Ongoing efforts tackledigitalization of smell and taste for digital delivery, transmission or substitution [6]. Despite experimentsproved technological feasibility, its dissemination depends on relevant applicationdevelopment[7].This thesis aims to fillthose gaps by demonstratinghow chemical senses provide the means to link environment and health based on scientific andgeolocation narratives [8], [9],[10]. We present a Multisensory HCI design process which accomplished symbolicdisplaying smell and taste and led us to a new multi-sensorial interaction system presented herein.
We describe the conceptualization, design and evaluation of Earthsensum, an exploratory case study project.Earthsensumoffered to 16 participants in the study, environmental smell and taste experiences about real geolocations to participants of the study. These experiences were represented digitally using mobilevirtual reality (MVR) and mobile augmented reality (MAR). Its technologies bridge the real and digital Worlds through digital representations where we can reproduce the multi-sensorial experiences. Our study findings showed that the purposed interaction system is intuitive and can lead not only to a betterunderstanding of smell and taste perception as also of environmental problems. Participants comprehensionabout the link between environmental exposures and health was successful and they would recommend thissystem as education tools. Our conceptual design approach was validated and further developments wereencouraged.In this thesis,we demonstratehow to applyMultisensory HCI methodology to design with chemical senses. Weconclude that the presented symbolic representation model of smell and taste allows communicatingtheseexperiences on digital platforms. Due to its context-dependency, MVR and MAR platforms are adequatetechnologies to be applied for this purpose.Future developments intend to explore further the conceptual approach. These developments are centredon the use of the system to induce hopefully behaviourchange. Thisthesisopens up new application possibilities of digital chemical sense communication,Multisensory HCI Design and environmental health communication.Ă medida que os problemas ambientais se intensificam, os sentidos quĂmicos -isto Ă©, o cheiroe sabor, sĂŁo os sentidos mais relevantes para evidenciĂĄ-los. Como tais, os vetores de exposição ambiental que podem atingir os seres humanos compreendem o ar, alimentos, solo e ĂĄgua [1]. Neste contexto, compreender a ligação entre as exposiçÔes ambientais e a saĂșde [2] Ă© crucial para exercerescolhas informadas, proteger o meio ambiente e adaptar a novas condiçÔes ambientais [3]. O cheiroe o saborconduzemassima experiĂȘncias multissensoriais que transmitem informaçÔes de mĂșltiplas camadas sobre eventos locais e globais [4]. No entanto, esses sentidos geralmente estĂŁo ausentes quando esses problemas sĂŁo representados em sistemas digitais. A disciplina do design de Interação Humano-Computador(HCI)multissensorial investiga a inclusĂŁo dossentidos quĂmicos em sistemas digitais [9]. O seu foco atual residena digitalização de cheirose sabores para o envio, transmissĂŁo ou substituiçãode sentidos[10]. Apesar dasexperimentaçÔescomprovarem a viabilidade tecnolĂłgica, a sua disseminação estĂĄ dependentedo desenvolvimento de aplicaçÔes relevantes [11]. Estatese pretendepreencher estas lacunas ao demonstrar como os sentidos quĂmicos explicitama interconexĂŁoentre o meio ambiente e a saĂșde, recorrendo a narrativas cientĂficas econtextualizadasgeograficamente[12], [13], [14]. Apresentamos uma metodologiade design HCImultissensorial que concretizouum sistema de representação simbĂłlica de cheiro e sabor e nos conduziu a um novo sistema de interação multissensorial, que aqui apresentamos.
Descrevemos o nosso estudo exploratĂłrio Earthsensum, que integra aconceptualização, design e avaliação. Earthsensumofereceu a 16participantes do estudo experiĂȘncias ambientais de cheiro e sabor relacionadas com localizaçÔes geogrĂĄficasreais. Essas experiĂȘncias foram representadas digitalmente atravĂ©s derealidade virtual(VR)e realidade aumentada(AR).Estas tecnologias conectamo mundo real e digital atravĂ©s de representaçÔes digitais onde podemos reproduzir as experiĂȘncias multissensoriais. Os resultados do nosso estudo provaramque o sistema interativo proposto Ă© intuitivo e pode levar nĂŁo apenas a uma melhor compreensĂŁo da perceção do cheiroe sabor, como tambĂ©m dos problemas ambientais. O entendimentosobre a interdependĂȘncia entre exposiçÔes ambientais e saĂșde teve ĂȘxitoe os participantes recomendariam este sistema como ferramenta para aeducação. A nossa abordagem conceptual foi positivamentevalidadae novos desenvolvimentos foram incentivados. Nesta tese, demonstramos como aplicar metodologiasde design HCImultissensorialpara projetar com ossentidos quĂmicos. Comprovamosque o modelo apresentado de representação simbĂłlica do cheiroe do saborpermite comunicar essas experiĂȘnciasem plataformas digitais. Por serem dependentesdocontexto, as plataformas de aplicaçÔes emVR e AR sĂŁo tecnologias adequadaspara este fim.Desenvolvimentos futuros pretendem aprofundar a nossa abordagemconceptual. Em particular, aspiramos desenvolvera aplicaçãodo sistema para promover mudanças de comportamento. Esta tese propĂ”enovas possibilidades de aplicação da comunicação dos sentidos quĂmicos em plataformas digitais, dedesign multissensorial HCI e de comunicação de saĂșde ambiental
Resonating Experiences of Self and Others enabled by a Tangible Somaesthetic Design
Digitalization is penetrating every aspect of everyday life including a
human's heart beating, which can easily be sensed by wearable sensors and
displayed for others to see, feel, and potentially "bodily resonate" with.
Previous work in studying human interactions and interaction designs with
physiological data, such as a heart's pulse rate, have argued that feeding it
back to the users may, for example support users' mindfulness and
self-awareness during various everyday activities and ultimately support their
wellbeing. Inspired by Somaesthetics as a discipline, which focuses on an
appreciation of the living body's role in all our experiences, we designed and
explored mobile tangible heart beat displays, which enable rich forms of bodily
experiencing oneself and others in social proximity. In this paper, we first
report on the design process of tangible heart displays and then present
results of a field study with 30 pairs of participants. Participants were asked
to use the tangible heart displays during watching movies together and report
their experience in three different heart display conditions (i.e., displaying
their own heart beat, their partner's heart beat, and watching a movie without
a heart display). We found, for example that participants reported significant
effects in experiencing sensory immersion when they felt their own heart beats
compared to the condition without any heart beat display, and that feeling
their partner's heart beats resulted in significant effects on social
experience. We refer to resonance theory to discuss the results, highlighting
the potential of how ubiquitous technology could utilize physiological data to
provide resonance in a modern society facing social acceleration.Comment: 18 page
Interdisciplinary Insights for Digital Touch Communication
Communication is increasingly moving beyond âways of seeingâ to âways of feelingâ. This Open Access book provides social design insights and implications for HCI research and design exploring digitally mediated touch communication. It offers a socially orientated map to help navigate the complex social landscape of digitally mediated touch for communication: from everyday touch-screens, tangibles, wearables, haptics for virtual reality, to the tactile internet of skin.
Drawing on literature reviews, new case-study vignettes, and exemplars of digital touch, the book examines the major social debates provoked by digital touch, and investigates social themes central to the communicative potential and societal consequences of digital touch:
· Communication environments, capacities and practices
· Norms associations and expectations
· Presence, absence and connection
· Social imaginaries of digital touch
· Digital touch ethics and values
The book concludes with a discussion of the significance of social understanding and methods in the context of Interdisciplinary collaborations to explore touch, towards the design of digital touch communication, âways of feelingâ, that are useable, appropriate, ethical and socially aware
Mood Glove Enhancing mood in film music through haptic sensations for an enriched film experience
PhDThis research explores a new way of enhancing audience experience in film entertainment,
presenting the design and implementation of a wearable prototype
system that uses haptic sensations to intensify moods in lm music.
The aim of this work is to enrich the musical experience of lm audiences
and might also have implication on the hearing-impaired, providing them with
a new enhanced emotional experience while watching a movie.
Although there has been previous work into music displays of a visual and
haptic nature, and on the importance of music in film, there is no documented
research on musical enhancement experience in film entertainment.
This work focuses on the mood conveyed by lm music in order to understand
what role it plays in creating the film experience, and also explores the possibility
of enhancing those feelings through haptic sensations. Drawing on HCI and
interaction design principles, the design of a piece of haptic wearable technology
is proposed and used as the tool for user studies.
This research contributes to the fields of: HCI, interaction design, user experience
design, multimodal interaction, creative technology, wearable technology,
haptics, entertainment technology and lm music.
This work also provides a set of design suggestions to aid future research and
designers of haptic sensations for media enhancement. Proposed guidelines are
based on a number of empirical findings that describe and explain aspects of
audience emotional response to haptics, providing some first evidence that there
is a correlation between vibrotactile stimuli (such as frequency and intensity)
and perceived feelings.EPSRC Doctoral Training Centre in Digital
Music and Media for the Creative Economy [EP/G03723X/1]
An aesthetics of touch: investigating the language of design relating to form
How well can designers communicate qualities of touch?
This paper presents evidence that they have some capability to do so, much of which appears to have been learned, but at present make limited use of such language. Interviews with graduate designer-makers suggest that they are aware of and value the importance of touch and materiality in their work, but lack a vocabulary to fully relate to their detailed explanations of other aspects such as their intent or selection of materials. We believe that more attention should be paid to the verbal dialogue that happens in the design process, particularly as other researchers show that even making-based learning also has a strong verbal element to it. However, verbal language alone does not appear to be adequate for a comprehensive language of touch. Graduate designers-makersâ descriptive practices combined non-verbal manipulation within verbal accounts. We thus argue that haptic vocabularies do not simply describe material qualities, but rather are situated competences that physically demonstrate the presence of haptic qualities. Such competencies are more important than groups of verbal vocabularies in isolation. Design support for developing and extending haptic competences must take this wide range of considerations into account to comprehensively improve designersâ capabilities
- âŠ