Information Olfactation: Theory, Design, and Evaluation

Olfactory feedback for analytical tasks is a virtually unexplored area in spite of the advantages it offers for information recall, feature identification, and location detection. Here we introduce the concept of ‘Information Olfactation’ as the fragrant sibling of information visualization, and discuss how scent can be used to convey data. Building on a review of the human olfactory system and mirroring common visualization practice, we propose olfactory marks, the substrate in which they exist, and their olfactory channels that are available to designers. To exemplify this idea, we present ‘viScent(1.0)’: a six-scent stereo olfactory display capable of conveying olfactory glyphs of varying temperature and direction, as well as a corresponding software system that integrates the display with a traditional visualization display. We also conduct a comprehensive perceptual experiment on Information Olfactation: the use of olfactory marks and channels to convey data. More specifically, following the example from graphical perception studies, we design an experiment that studies the perceptual accuracy of four ``olfactory channels''---scent type, scent intensity, airflow, and temperature---for conveying three different types of data---nominal, ordinal, and quantitative. We also present details of an advanced 24-scent olfactory display: ‘viScent(2.0)’ and its software framework that we designed in order to run this experiment. Our results yield a ranking of olfactory channels for each data type that follows similar principles as rankings for visual channels, such as those derived by Mackinlay, Cleveland & McGill, and Bertin

Examining the sense of agency in human-computer interaction

Humans are agents, we feel that we control the course of events on our everyday life. This refers to the Sense of Agency (SoA). This experience is not only crucial in our daily life, but also in our interaction with technology. When we manipulate a user interface (e.g., computer, smartphone, etc.), we expect that the system responds to our input commands with feedback, as we desire to feel that we are in charge of the interaction. If this interplay elicits a SoA, then the user will perceive an instinctive feeling of “I am controlling this”. Although research in Human-Computer Interaction (HCI) pursuits the design of intuitive and responsive systems, most of the current studies have been focussed mainly on interaction techniques (e.g., software-hardware) and User Experience (UX) (e.g., comfort, usability, etc.), and very little has been investigated in terms of the SoA i.e., the conscious experience of being in control regarding the interaction. In this thesis, we present an experimental exploration of the role of the SoA in interaction paradigms typical of HCI. After two chapters of introduction and related work, we describe a series of studies that explore agency implication in interaction with systems through human senses such as vision, audio, touch and smell. Chapter 3 explores the SoA in mid-air haptic interaction through touchless actions. Then, Chapter 4 examines agency modulation through smell and its application for olfactory interfaces. Chapter 5 describes two novel timing techniques based on auditory and haptic cues that provide alternative timing methods to the traditional Libet clock. Finally, we conclude with a discussion chapter that highlights the importance of our SoA during interactions with technology as well as the implications of the results found, in the design of user interfaces

Multimodal feedback for mid-air gestures when driving

Mid-air gestures in cars are being used by an increasing number of drivers on the road. Us-ability concerns mean good feedback is important, but a balance needs to be found between supporting interaction and reducing distraction in an already demanding environment. Visual feedback is most commonly used, but takes visual attention away from driving. This thesis investigates novel non-visual alternatives to support the driver during mid-air gesture interaction: Cutaneous Push, Peripheral Lights, and Ultrasound feedback. These modalities lack the expressive capabilities of high resolution screens, but are intended to allow drivers to focus on the driving task. A new form of haptic feedback — Cutaneous Push — was defined. Six solenoids were embedded along the rim of the steering wheel, creating three bumps under each palm. Studies 1, 2, and 3 investigated the efficacy of novel static and dynamic Cutaneous Push patterns, and their impact on driving performance. In simulated driving studies, the cutaneous patterns were tested. The results showed pattern identification rates of up to 81.3% for static patterns and 73.5% for dynamic patterns and 100% recognition of directional cues. Cutaneous Push notifications did not impact driving behaviour nor workload and showed very high user acceptance. Cutaneous Push patterns have the potential to make driving safer by providing non-visual and instantaneous messages, for example to indicate an approaching cyclist or obstacle. Studies 4 & 5 looked at novel uni- and bimodal feedback combinations of Visual, Auditory, Cutaneous Push, and Peripheral Lights for mid-air gestures and found that non-visual feedback modalities, especially when combined bimodally, offered just as much support for interaction without negatively affecting driving performance, visual attention and cognitive demand. These results provide compelling support for using non-visual feedback from in-car systems, supporting input whilst letting drivers focus on driving.Studies 6 & 7 investigated the above bimodal combinations as well as uni- and bimodal Ultrasound feedback during the Lane Change Task to assess the impact of gesturing and feedback modality on car control during more challenging driving. The results of study Seven suggests that Visual and Ultrasound feedback are not appropriate for in-car usage,unless combined multimodally. If Ultrasound is used unimodally it is more useful in a binary scenario.Findings from Studies 5, 6, and 7 suggest that multimodal feedback significantly reduces eyes-off-the-road time compared to Visual feedback without compromising driving performance or perceived user workload, thus it can potentially reduce crash risks. Novel design recommendations for providing feedback during mid-air gesture interaction in cars are provided, informed by the experiment findings

Embodied geosensification-models, taxonomies and applications for engaging the body in immersive analytics of geospatial data

This thesis examines how we can use immersive multisensory displays and body-focused interaction technologies to analyze geospatial data. It merges relevant aspects from an array of interdisciplinary research areas, from cartography to the cognitive sciences, to form three taxonomies that describe the senses, data representations, and interactions made possible by these technologies. These taxonomies are then integrated into an overarching design model for such "Embodied Geosensifications". This model provides guidance for system specification and is validated with practical examples

Opportunities for olfactory interaction in an automotive context

Driving is a highly visual task. Nevertheless, it is a process that involves other senses as well. When we drive, we touch the steering wheel; we listen to what is happening around us, and, even if we are not paying attention to that, we smell what is happening with the car or around it. A scent of gasoline, the burning rubber, the plastic heated up by the sunlight - these are just a few examples. Smell is a very important sense for driving, though it has not been studied much in this context [85], despite being able to provide a much more vivid experience than any other human sense [80]. This thesis aims to fill this gap by investigating opportunities for olfactory interaction in an automotive context. The thesis is mainly focused on designing a scent-delivery device suitable for in-car interaction, on the topic of delivering driving-relevant notifications using scents, and on studying the effects scents have on the driving performance and behaviour, as well as the driver’s mood and well-being. This paper-style PhD thesis consists of two parts. Part II is a collection of seven published papers written in the scope of this thesis, and Part I describes how these papers build a coherent story. Part I starts with an introduction (see Chapter 1) that covers the research questions and contributions of the thesis. It continues with a summary of the background research (see Chapter 2). This overview part then moves on to the description of the approach (see Chapter 3) that covers the process of designing the scent delivery device, the olfactory interaction space, and the studies conducted throughout this PhD. Chapter 4 then summarises the core findings of each study, which are finally discussed in Chapter 5. Part I finishes with a conclusion (see Chapter 6)

Ultrasonic mid-air haptic technology in context of science communication

This dissertation charts opportunities and challenges of engaging people with learning about science through the use of mid-air haptic technology. To that end, research has been carried out at the intersection of three multidisciplinary fields: Science Communication, Haptics, and Human-Computer Interaction. For science communication to be effective, different tools are required for different audiences. For example, when a child pours cold milk into hot tea and sips a warm beverage, we can raise awareness of the haptic experience; triggering interest and facilitating learning about thermal equilibrium. Not every scientific concept may be explained through changing temperature, and not everybody likes tea, but the principle of haptic experience facilitated public engagement with science remains a valid basis to examine. Science communicators seek new technological solutions and innovative modalities of communication, some of which include haptic technology and touch interaction. Ultrasonic mid-air haptic technology is a novel tool, which enables the creation of programable, invisible, cutaneous tactile sensations on an airborne interface between humans and the digital world. Mid-air haptic sensations may bring many benefits when used in science communication, but these have not yet been systematically studied

Aerospace Medicine and Biology: A continuing bibliography with indexes, supplement 267, January 1985

This publication is a cumulative index to the abstracts contained in the Supplements 255 through 266 of Aerospace Medicine and Biology: A Continuing Bibliography. It includes seven indexes--subject, personal author, corporate source, foreign technology, contract number, report number, and accession number

Aerospace medicine and biology: A cumulative index to a continuing bibliography (supplement 384)

This publication is a cumulative index to the abstracts contained in Supplements 372 through 383 of Aerospace Medicine and Biology: A Continuing Bibliography. It includes seven indexes: subject, personal author, corporate source, foreign technology, contract number, report number, and accession number

Doctor of Philosophy

dissertationThe compositions in The Healing Machine are assemblages of archival and invented documents, narratives, meditations, and language. Formally, they are assembled from fragments, capitalizing on the human impulse to connect unlike things, to see patterns and invent coherent narratives where they may not exist. Section I contains lyric essays that connect personal with public history. Documents are channeled through and distorted by my particular vision. In "Endnotes to a Seizure," I extend dictionary definitions (e.g., of "seizure" or "Scintillating Scotoma") into associative or metaphorical definitions. "As a Bitch Paces Round Her Tender Whelps..." consists of love letters that collage "high" and "low" diction, juxtapose Homer with contemporary slang, and meditate on the way metaphors--like love-- embody the impossible fusion of unlike things. The stories in Section II blur fiction and nonfiction, often employing the form or text of documents as scaffolding. "Real Silk" features invented characters, but includes snippets from professional development pamphlets written for 1930s silk stocking salesmen. Conversely, some stories in Section II invert this relationship between document and character, featuring historical characters but invented documents. "This Precarious Hive" purports to be a biopic of an artist duo, but neither artists nor document have veracity. In such works, I both rely on and undermine the authority of recorded historical narratives. The stories in Section III, about a dentist and his wife in the early twentieth century, also use documents as scaffolding, but in this section, I create a multifaceted, polyphonic history that emphasizes the story over fact. In the title story of this collection, a man builds a "healing machine" in his shed using found materials. He believed this haphazard wunderkammer healed disease by conducting electricity through the body. While this seems unlikely, I find that even photographs of the "machine" provoke wonder and perhaps--through language, observation, and communication--heal less tangible malaise. The compositions in this collection resemble his arrangements of salt vials and Popsicle sticks, and I hope the formal, aesthetic, and thematic relationships that emerge between them invite consideration of how and why unlike things cohere as narrative within a text or texts