Multisensory Approaches to Human-Food Interaction

Here, we present the outcome of the 4th workshop on Multisensory Approaches to Human-Food Interaction (MHFI), developed in collaboration with ICMI 2020 in Utrecht, The Netherlands. Capitalizing on the increasing interest on multisensory aspects of human-food interaction and the unique contribution that our community offers, we developed a space to discuss ideas ranging from mechanisms of multisensory food perception, through multisensory technologies, to new applications of systems in the context of MHFI. All in all, the workshop involved 11 contributions, which will hopefully further help shape the basis of a field of inquiry that grows as we see progress in our understanding of the senses and the development of new technologies in the context of food

Editorial: Perspectives on Multisensory Human-Food Interaction

Eating and drinking are undoubtedly amongst life’s most multisensory experiences. Take, for instance, the enjoyment of flavor, which is one of the most important elements of such experiences, resulting from the integration of gustatory, (retronasal) olfactory, and possibly also trigeminal/oral-somatosensory cues (Prescott, 2015). Nevertheless, researchers have suggested that all our senses can influence the way in which we perceive flavor, not to mention our eating and drinking experiences. For instance, the color and shape of the food, the background sonic/noise cues in our eating environments, and/or the sounds associated with mastication can all influence our perception and enjoyment of our eating and drinking experiences (Spence, 2020). Human-Food Interaction (HFI) research has been growing steadily in recent years (e.g., Deng et al., 2021). Research into multisensory interactions designed to create, modify, and/or enhance our food-related experiences is one of the core areas of HFI (Multisensory HFI or MHFI, Altarriba Bertran et al., 2019; Velasco and Obrist, 2020). The aim being to further our understanding of the principles that govern the systematic connections between the senses in the context of HFI. In this Research Topic, we called for investigations and applications of systems that create new, or enhance already existing, multisensory eating and drinking experiences (what can be considered the “hacking” of food experiences) in the context of HFI. Moreover, we were also interested in those works that focus on or are based on the principles governing the systematic connections that exist between the senses. HFI also involves the experiencing of food interactions digitally in remote locations. Therefore, we were also interested in sensing and actuation interfaces, new communication mediums, and persisting and retrieving technologies for human food interactions. Enhancing social interactions to augment the eating experience is another issue we wanted to see addressed here, what has been referred to as “digital commensality” (Spence et al., 2019)

Affective brain–computer music interfacing

We aim to develop and evaluate an affective brain–computer music interface (aBCMI) for modulating the affective states of its users. Approach. An aBCMI is constructed to detect a userʼs current affective state and attempt to modulate it in order to achieve specific objectives (for example, making the user calmer or happier) by playing music which is generated according to a specific affective target by an algorithmic music composition system and a casebased reasoning system. The system is trained and tested in a longitudinal study on a population of eight healthy participants, with each participant returning for multiple sessions. Main results. The final online aBCMI is able to detect its users current affective states with classification accuracies of up to 65% (3 class, p < 0.01) and modulate its userʼs affective states significantly above chance level (p < 0.05). Significance. Our system represents one of the first demonstrations of an online aBCMI that is able to accurately detect and respond to userʼs affective states. Possible applications include use in music therapy and entertainmen

Towards disappearing user interfaces for ubiquitous computing: human enhancement from sixth sense to super senses

The enhancement of human senses electronically is possible when pervasive computers interact unnoticeably with humans in Ubiquitous Computing. The design of computer user interfaces towards “disappearing” forces the interaction with humans using a content rather than a menu driven approach, thus the emerging requirement for huge number of non-technical users interfacing intuitively with billions of computers in the Internet of Things is met. Learning to use particular applications in Ubiquitous Computing is either too slow or sometimes impossible so the design of user interfaces must be naturally enough to facilitate intuitive human behaviours. Although humans from different racial, cultural and ethnic backgrounds own the same physiological sensory system, the perception to the same stimuli outside the human bodies can be different. A novel taxonomy for Disappearing User Interfaces (DUIs) to stimulate human senses and to capture human responses is proposed. Furthermore, applications of DUIs are reviewed. DUIs with sensor and data fusion to simulate the Sixth Sense is explored. Enhancement of human senses through DUIs and Context Awareness is discussed as the groundwork enabling smarter wearable devices for interfacing with human emotional memories

Exploring CRM effectiveness: an institutional theory perspective

This study identifies the potential contribution that institutional theory can make to understanding the success of marketing practices. Based on institutional theory, we argue that the effectiveness of marketing practices decreases when firms are motivated to adopt such practices under the influence of institutional pressures originating in firms' environments. However, alignment between a practice and a firm's marketing strategy may buffer against these negative effects. We apply these insights to the case of customer relationship management (CRM). CRM is considered an important way to enhance customer loyalty and firm performance, but it has also been criticized for being expensive and for not living up to expectations. Empirical data from 107 organizations confirm that, in general, adopting CRM for mimetic motives is likely to result in fewer customer insights as a result of using this practice. Our study suggests that institutional theory has much to offer to the investigation of the effectiveness of marketing practices

Post-traumatic anxiety associates with failure of the innate immune receptor TLR9 to evade the pro-inflammatory NFκB pathway

Post-traumatic anxiety notably involves inflammation, but its causes and functional significance are yet unclear. Here, we report that failure of the innate immune system Toll-like receptor 9 (TLR9) to limit inflammation is causally involved with anxiety-associated inflammation and that peripheral administration of specific oligonucleotide activators of TLR9 may prevent post-traumatic consequences in stressed mice. Suggesting involvement of NFκB-mediated enhancement of inflammatory reactions in the post-traumatic phenotype, we found association of serum interleukin-1β increases with symptoms severity and volumetric brain changes in post-traumatic stress disorder patients. In predator scent-stressed mice, the moderate NFκB-activating oligonucleotides mEN101 and its human ortholog BL-7040, but not the canonic NFκB activator oligonucleotide ODN1826, induced anxiolytic effects. In stressed mice, peripherally administered mEN101 prevented delayed stress-inducible serum interleukin-1β increases while limiting stress-characteristic hippocampal transcript modifications and the anxiety-induced EGR1-mediated neuronal activation. Attesting to the TLR9 specificity of this response, BL-7040 suppressed NFκB-mediated luciferase in transfected cells co-expressing TLR9, but not other TLRs. Furthermore, TLR9−/− mice were mEN101 and BL-7040 resistant and presented unprovoked anxiety-like behavior and anxiety-characteristic hippocampal transcripts. Our findings demonstrate functional relevance of TLR9 in protecting stressed mammals from overreacting to traumatic experiences and suggest using oligonucleotide-mediated peripheral TLR9 activation to potentiate the innate immune system and prevent post-traumatic inflammation and anxiety

PKA and Epac cooperate to augment bradykinin-induced interleukin-8 release from human airway smooth muscle cells

Background: Airway smooth muscle contributes to the pathogenesis of pulmonary diseases by secreting inflammatory mediators such as interleukin-8 (IL-8). IL-8 production is in part regulated via activation of G(q)-and G(s)-coupled receptors. Here we study the role of the cyclic AMP (cAMP) effectors protein kinase A (PKA) and exchange proteins directly activated by cAMP (Epac1 and Epac2) in the bradykinin-induced IL-8 release from a human airway smooth muscle cell line and the underlying molecular mechanisms of this response.Methods: IL-8 release was assessed via ELISA under basal condition and after stimulation with bradykinin alone or in combination with fenoterol, the Epac activators 8-pCPT-2'-O-Me-cAMP and Sp-8-pCPT-2'-O-Me-cAMPS, the PKA activator 6-Bnz-cAMP and the cGMP analog 8-pCPT-2'-O-Me-cGMP. Where indicated, cells were pre-incubated with the pharmacological inhibitors Clostridium difficile toxin B-1470 (GTPases), U0126 (extracellular signal-regulated kinases ERK1/2) and Rp-8-CPT-cAMPS (PKA). The specificity of the cyclic nucleotide analogs was confirmed by measuring phosphorylation of the PKA substrate vasodilator-stimulated phosphoprotein. GTP-loading of Rap1 and Rap2 was evaluated via pull-down technique. Expression of Rap1, Rap2, Epac1 and Epac2 was assessed via western blot. Downregulation of Epac protein expression was achieved by siRNA. Unpaired or paired two-tailed Student's t test was used.Results: The beta(2)-agonist fenoterol augmented release of IL-8 by bradykinin. The PKA activator 6-Bnz-cAMP and the Epac activator 8-pCPT-2'-O-Me-cAMP significantly increased bradykinin-induced IL-8 release. The hydrolysis-resistant Epac activator Sp-8-pCPT-2'-O-Me-cAMPS mimicked the effects of 8-pCPT-2'-O-Me-cAMP, whereas the negative control 8-pCPT-2'-O-Me-cGMP did not. Fenoterol, forskolin and 6-Bnz-cAMP induced VASP phosphorylation, which was diminished by the PKA inhibitor Rp-8-CPT-cAMPS. 6-Bnz-cAMP and 8-pCPT-2'-O-Me-cAMP induced GTP-loading of Rap1, but not of Rap2. Treatment of the cells with toxin B-1470 and U0126 significantly reduced bradykinin-induced IL-8 release alone or in combination with the activators of PKA and Epac. Interestingly, inhibition of PKA by Rp-8-CPT-cAMPS and silencing of Epac1 and Epac2 expression by specific siRNAs largely decreased activation of Rap1 and the augmentation of bradykinin-induced IL-8 release by both PKA and Epac.Conclusion: Collectively, our data suggest that PKA, Epac1 and Epac2 act in concert to modulate inflammatory properties of airway smooth muscle via signaling to the Ras-like GTPase Rap1 and to ERK1/2.</p