Natural media workshop

This workshop will examine what our current imaging and sensing technologies do to our perception. We will examine, using practical examples, the potential to develop more 'Natural Media’ and technologies by broadening the focus of attention to the whole visual, auditory, tactile and sensual field. The aim is to re-incorporate peripheral awareness into our experience using these multiple sense inputs

Multi-Sensory Interaction for Blind and Visually Impaired People

This book conveyed the visual elements of artwork to the visually impaired through various sensory elements to open a new perspective for appreciating visual artwork. In addition, the technique of expressing a color code by integrating patterns, temperatures, scents, music, and vibrations was explored, and future research topics were presented. A holistic experience using multi-sensory interaction acquired by people with visual impairment was provided to convey the meaning and contents of the work through rich multi-sensory appreciation. A method that allows people with visual impairments to engage in artwork using a variety of senses, including touch, temperature, tactile pattern, and sound, helps them to appreciate artwork at a deeper level than can be achieved with hearing or touch alone. The development of such art appreciation aids for the visually impaired will ultimately improve their cultural enjoyment and strengthen their access to culture and the arts. The development of this new concept aids ultimately expands opportunities for the non-visually impaired as well as the visually impaired to enjoy works of art and breaks down the boundaries between the disabled and the non-disabled in the field of culture and arts through continuous efforts to enhance accessibility. In addition, the developed multi-sensory expression and delivery tool can be used as an educational tool to increase product and artwork accessibility and usability through multi-modal interaction. Training the multi-sensory experiences introduced in this book may lead to more vivid visual imageries or seeing with the mind’s eye

InterFlowCeption: Foundations for Technological Enhancement of Interoception to Foster Flow States during Mental Work: About the potential of technologically supported body awareness to promote flow experiences during mental work

Conducting mental work by interacting with digital technology increases productivity, but strains attentional capacities and mental well-being. In consequence, many mental workers try to cultivate their fow experience. However, this is complex and difcult to achieve. Nevertheless, current technological systems do not yet provide this support in mental work. As interoception, the individual bodily awareness is an underlying mechanism of numerous fow correlates, it might ofer a new approach for fow-supporting systems in these scenarios. Results from a survey study with 176 digital workers show that adaptive regulation of interoceptive sensations correlates with higher levels of fow and engagement. Additionally, regular mindfulness practices improved workers’ adaptive regulation of bodily signals. Based on these results and integrating the current literature, this work conceptualizes three future technological support systems, such as interoceptive biofeedback, and electrical or auditory stimulation to enhance interoceptive awareness and foster fow in mental work

Semefulness: A social semiotics of touch

This paper explores the multiple significances (semefulness) of touch, as experienced by us as embodied subjects. Prompted by the development of a range of touch-based technologies, I consider the current writings about touch in a range of fields and how these have contributed to contemporary understandings of the meanings of touch. I then explore a number of these meanings - connection, engagement, contiguity, differentiation, positioning - for their contribution to our understanding of the world and of our own embodied subjectivity. I also explore the deployment of these meanings by contemporary technologies. © 2011 Taylor & Francis

Audio-based Roughness Sensing and Tactile Feedback for Haptic Perception in Telepresence

Haptic perception is highly important for immersive teleoperation of robots, especially for accomplishing manipulation tasks. We propose a low-cost haptic sensing and rendering system, which is capable of detecting and displaying surface roughness. As the robot fingertip moves across a surface of interest, two microphones capture sound coupled directly through the fingertip and through the air, respectively. A learning-based detector system analyzes the data in real time and gives roughness estimates with both high temporal resolution and low latency. Finally, an audio-based vibrational actuator displays the result to the human operator. We demonstrate the effectiveness of our system through lab experiments and our winning entry in the ANA Avatar XPRIZE competition finals, where briefly trained judges solved a roughness-based selection task even without additional vision feedback. We publish our dataset used for training and evaluation together with our trained models to enable reproducibility of results.Comment: IEEE International Conference on Systems, Man, and Cybernetics (SMC), Honolulu, Hawaii, USA, October 202

Wearable gaming technology: A study on the relationships between wearable features and gameful experiences

With the parallel advancement and evolution of psycho-physiological sensors, haptics, and overall wearable computing, wearable devices have become a mainstay in everyday life. While gaming is one of the most intuitively appealing areas for using wearable devices, most gaming concepts relying on wearable devices have had only moderate success. Therefore, further knowledge is needed by game developers for innovating new gaming concepts, by wearable designers to innovate new affordances for gaming in wearables, and by gamers for seeing the possibilities of what wearables can bring to gaming. To address this research problem, we combined vignette and survey studies (N = 289) to investigate which features of wearables (integrability, wearability, modularity, sociability, programmability, bio-adaptability, audiovisuality, and embodied modality) would lead to gameful experiences. Overall, the results indicate that integrability to games, wearability, modularity, and sociability were dimensions of wearables which were most strongly connected with the expectation of a heightened game experience. The findings of the study contribute to the current understanding on the experiential value of gaming wearables, as well as providing practical guidance for gaming wearables designers and marketers.Peer reviewe

Musical Haptics

Haptic Musical Instruments; Haptic Psychophysics; Interface Design and Evaluation; User Experience; Musical Performanc