Towards multisensory storytelling with taste and flavor

Film makers, producers, and theaters have continuously looked at ways to embody and/or integrate multiple sensory cues in the experiences they deliver. Here, we present a reflection on past attempts, lessons learnt, and future directions for the community around multisensory TV, film, and multimedia as a historical, though renewed, space of content creation. In particular, we present an overview of what we call "tasty film", that is, film involving taste, flavor, and more broadly food and drink inputs, to influence the audience experience. We suggest that such elements should be considered beyond "add-ons" in film experiences. We advocate for experimentation with new kinds of storytelling taking inspiration from multisensory design research and work on sensory substitution. We position this article as a starting point for anyone interested in multisensory film involving taste, flavor, and foods

I Smell Trouble: Using Multiple Scents To Convey Driving-Relevant Information

Cars provide drivers with task-related information (e.g. "Fill gas") mainly using visual and auditory stimuli. However, those stimuli may distract or overwhelm the driver, causing unnecessary stress. Here, we propose olfactory stimulation as a novel feedback modality to support the perception of visual notifications, reducing the visual demand of the driver. Based on previous research, we explore the application of the scents of lavender, peppermint, and lemon to convey three driving-relevant messages (i.e. "Slow down", "Short inter-vehicle distance", "Lane departure"). Our paper is the first to demonstrate the application of olfactory conditioning in the context of driving and to explore how multiple olfactory notifications change the driving behaviour. Our findings demonstrate that olfactory notifications are perceived as less distracting, more comfortable, and more helpful than visual notifications. Drivers also make less driving mistakes when exposed to olfactory notifications. We discuss how these findings inform the design of future in-car user interfaces

Smell, Taste, and Temperature Interfaces

Everyday life hinges on smell, taste, and temperature-based experiences, from eating to detecting potential hazards (e.g., smell of rotten food, microbial threats, and non-microbial threats such as from hazardous gases) to responding to thermal behavioral changes. These experiences are formative as visceral, vital signals of information, and contribute directly to our safety, well-being, and enjoyment. Despite this, contemporary technology mostly stimulates vision, audition, and - more recently - touch, unfortunately leaving out the senses of smell taste and temperature. In the last decade, smell, taste, and temperature interfaces have gained a renewed attention in the field of Human Computer Interaction, fueled by the growth of virtual reality and wearable devices. As these modalities are further explored, it is imperative to discuss underlying cultural contexts of these experiences, how researchers can robustly stimulate and sense these modalities, and in what contexts such multisensory technologies are meaningful. This workshop addresses these topics and seeks to provoke critical discussions around chemo- and thermo-sensory HCI

Investigating the effects of odour integration in reading and learning experiences

Books are the tools used for reading novels and stories, but also for educational purposes. Conventional books have undergone a radical transformation in recent years due to the use of new technologies. However, even today the technological devices used for reading e-books are still poorly exploited, despite the fact that they represent a fundamental tool to make the reading experience more immersive by using a complete multisensory approach. In this perspective, one sense that represents an important element of human perception is the sense of smell. Consequently, authors make the hypothesis that the introduction of odours during reading sessions could increase the user experience and the learning performances. In order to demonstrate these hypotheses, the authors have defined and carried out several experimental testing sessions. The analysis of the collected data proved that the introduction of odour does not disturb the reader during reading activities but, on the contrary, can actually make the experience more immersive. Similarly, odours do not disturb studying activities, but they can instead increase the level of concentration and people's learning performance

Respite Park: Changing Therapy With Community and Architecture

Architecture can be a driving force of change within communities. Through a new kind of public park with therapeutic experience pavilions based on community interaction and integration, as well as innovative architectural design. This thesis explores the creation of spaces that allow for a further push for a general acceptance of cognitive behavior therapy in culture. Through researching what methods of cognitive behavioral therapy are wildly successful, combining that with research on innovative sensory architectural techniques and interactive art Installations to create perspective altering experiences. In which, for visitors, the physical and emotional distance required for self-reflection is created. The intent is to provide a place where cognitive behavioral therapy can be more easily approached while eliminating a common negative stigma behind seeking help when it is needed

Investigating the effects of odour integration in reading and learning experiences

Books are the tools used for reading novels and stories, but also for educational purposes. Conventional books have undergone a radical transformation in recent years due to the use of new technologies. However, even today the technological devices used for reading e-books are still poorly exploited, despite the fact that they represent a fundamental tool to make the reading experience more immersive by using a complete multisensory approach. In this perspective, one sense that represents an important element of human perception is the sense of smell. Consequently, authors make the hypothesis that the introduction of odours during reading sessions could increase the user experience and the learning performances. In order to demonstrate these hypotheses, the authors have defined and carried out several experimental testing sessions. The analysis of the collected data proved that the introduction of odour does not disturb the reader during reading activities but, on the contrary, can actually make the experience more immersive. Similarly, odours do not disturb studying activities, but they can instead increase the level of concentration and people's learning performance

The Influence of Ambient Scent Temperature on Food Consumption Behavior

This research examines the impact of ambient odor on food consumption. The results of a field experiment and five lab experiments show that the presence of a warm ambient odor (e.g., cedarwood) versus a cool ambient odor (e.g., eucalyptus) reduces the amount of calories consumed and also leads to increased choice of lower-calorie food options. This is due to established implicit associations formed from the human body’s innate physiological response to changes in ambient temperature. Specifically, exposure to a warm (vs. cool) ambient odor, influences perceived ambient temperature, which in turn alters food consumption behaviors. The results of this research extend the limited research examining the temperature dimension of odor and enhance the understanding of the role of sensory cues in influencing food consumption. Further, given calorie consumption’s link to widespread obesity worldwide, this research provides important implications for health and wellbeing

Perception of poverty: Promoting social responsibility through multi-sensory integration

Traditional graphic design and marketing rely heavily on visual forms of communication. With advertisements all around us, the constant visual bombardment has led to an over stimulated consumer, creating a challenge for designers to invent alternative ways to capture the audience\u27s attention. Multi-sensory integration overcomes this challenge in my opinion, by integrating more than the sense of sight and is more effective and memorable, because it conveys the core message through multiple senses rather than one. The integration of additional senses within the field, particularly olfactory in my opinion, helps to enhance the overall communication and facilitate a more potent user experience. According to National Bureau of Economic Research, the United States suffered a significant decline in economic activity resulting in the great recession, which lasted from December 2007 to June 2009. Following the recession, many United States citizens still faced unforeseen financial crisis, sudden loss of income and housing foreclosure. The impact of the recession continues today, causing suffering and severe crisis. As a result of this, many families and individuals continue to find themselves newly poor. According to the National Alliance to End Homelessness, currently in the United States there are 643,067 people experiencing homelessness on any given night; roughly 22 of every 10,000 people are homeless. Of that number, 238,110 are people in families and 404,957 are individuals, 17% of the homeless population are considered chronically homeless and 12% of the homeless population are made up of veterans. The objective of this thesis is to show how utilizing multi-sensory integration to raise awareness of poverty in the United States is effective and to explore the effects of the great recession by allowing observers to digitally experience homelessness. The intention is to give observers a new appreciation of life, inspire individuals to take action and stimulate change within their community

Smells, well-being and the built environment

In this Research Topic, we aimed to collect a range of contributions to understand the emotional and wellbeing responses resulting from smells in different public spaces (museums, highstreets, heritage buildings, food districts, neighborhoods, squares, etc.) to inform future spatial design and management. The articles in this Research Topic are presented according to three types of contributions: reviews and conceptual analyses, empirical research in fieldwork, in laboratory studies and technological applications. Reviews and Conceptual Analyses Xiao et al. reviewed smellscape research studies conducted in the past 10 years to identify the challenges and related areas of future research, namely smell archives and databases, social justice within odor control and management, and research into advanced building materials. Spence reviewed the changing role of smells in the built environment from negative associations with sanitation to meaningful personal and cultural associations with memories and experiences which led to an evaluation of different approaches in examining the impact of smells on people's mood or wellbeing and the challenges of researching smells in the multi-sensory environment. Moving from the sick building sydrome to sick transport sydrome, Spence further reviewed the smells in transport environments as aesthetic and functional, and suggests challenges for future transportation to produce a more tangible vision to integrate smells in the design process to achieve the right balance of olfactory stimulation. Looking backwards to scented past, Bembibre and Strlič make the case for the need of knowledge exchange and interdisciplinary interpretation of findings in the field of olfactory heritage, providing an overview of methodological and museal studies as well as challenges associated with historical scent reconstruction. Empirical Research - Fieldwork Pálsdóttir et al. carried out a field study with participants suffering from stress-related mental disorders and explored how they would describe their smellscape perception of a garden in the context of a nature-based rehabilitation intervention. In a different field study, de Groot investigated whether ambient scents could affect customers' subjective experience and spending behavior in an experiment with customers of a second-hand clothing store. The author concluded that for that to happen, the smellscape should have a meaningful link to the physical context. Masaoka et al. present the results of a study conducted to examine whether continuous odor stimuli associated with autobiographical memories could activate olfactory areas in the brain of older adults and assess whether this odor stimulation could have a protective effect against age-related cognitive decline. Empirical Research - Laboratory Studies and Technological Applications Masaoka et al. investigated the potential protective effect from age-related cognitive decline of continuous odor stimuli associated with autobiographical memories and whether those could activate the above olfactory areas in older adults. Jiang et al. used blood pressure, pulse rate, EEG, POMS, and SD data to examine the odor-visual effects of the Primula forbesii Franch compared with the non-fragrant Primula malacoides Franch on the physiological and psychological state of Chinese female college students in the indoor environment. Courrèges et al. examined the correlations between odor and texture in users' perceptions of cosmetic creams cross-culturally, in laboratory conditions, using questionnaires, minimizing the impacts of branded messages from the packing and retail spaces. Amores et al. discussed the design and technical implementation of Essence- a smartphone-controlled wearable device that monitors users' EEG and real-time sleep staging algorithm to release scents to interact with users- in home-based sleep environments. The articles included in this Research Topic represent a nice balance between the theoretical reviews, empirical studies and laboratory research, showing the vibrance and dynamic in this research field as well as new technological developments such as extended reality, emotional sensors (i.e. EEG, GSR) and odor monitoring devices. New insights are drawn into the theoretical frameworks to understand relationships between smells, wellbeing and emotions, behaviors and physiological aspects; methodological approaches to measure smell triggered emotions, experiences, and quality of life; practical explorations on the process and challenges of using smells to influence user experiences in the built environment