To “Sketch-a-Scratch”

A surface can be harsh and raspy, or smooth and silky, and everything in between. We are used to sense these features with our fingertips as well as with our eyes and ears: the exploration of a surface is a multisensory experience. Tools, too, are often employed in the interaction with surfaces, since they augment our manipulation capabilities. “Sketch-a-Scratch” is a tool for the multisensory exploration and sketching of surface textures. The user’s actions drive a physical sound model of real materials’ response to interactions such as scraping, rubbing or rolling. Moreover, different input signals can be converted into 2D visual surface profiles, thus enabling to experience them visually, aurally and haptically

Audio-visual detection benefits in the rat

Human psychophysical studies have described multisensory perceptual benefits such as enhanced detection rates and faster reaction times in great detail. However, the neural circuits and mechanism underlying multisensory integration remain difficult to study in the primate brain. While rodents offer the advantage of a range of experimental methodologies to study the neural basis of multisensory processing, rodent studies are still limited due to the small number of available multisensory protocols. We here demonstrate the feasibility of an audio-visual stimulus detection task for rats, in which the animals detect lateralized uni- and multi-sensory stimuli in a two-response forced choice paradigm. We show that animals reliably learn and perform this task. Reaction times were significantly faster and behavioral performance levels higher in multisensory compared to unisensory conditions. This benefit was strongest for dim visual targets, in agreement with classical patterns of multisensory integration, and was specific to task-informative sounds, while uninformative sounds speeded reaction times with little costs for detection performance. Importantly, multisensory benefits for stimulus detection and reaction times appeared at different levels of task proficiency and training experience, suggesting distinct mechanisms inducing these two multisensory benefits. Our results demonstrate behavioral multisensory enhancement in rats in analogy to behavioral patterns known from other species, such as humans. In addition, our paradigm enriches the set of behavioral tasks on which future studies can rely, for example to combine behavioral measurements with imaging or pharmacological studies in the behaving animal or to study changes of integration properties in disease models

To “Sketch-a-Scratch”

A surface can be harsh and raspy, or smooth and silky, and everything in between. We are used to sense these features with our fingertips as well as with our eyes and ears: the exploration of a surface is a multisensory experience. Tools, too, are often employed in the interaction with surfaces, since they augment our manipulation capabilities. “Sketch-a-Scratch” is a tool for the multisensory exploration and sketching of surface textures. The user’s actions drive a physical sound model of real materials’ response to interactions such as scraping, rubbing or rolling. Moreover, different input signals can be converted into 2D visual surface profiles, thus enabling to experience them visually, aurally and haptically

Towards multiple interactions of inner and outer sensations in corporeal awareness

Under normal circumstances, different inner- and outer-body sources are integrated to form coherent and accurate mental experiences of the state of the body, leading to the phenomenon of corporeal awareness. How these processes are affected by changes in inner and outer inputs to the body, remains unclear. Here, we aim to present empirical evidence in which people experiencing a massive sensory disconnect may continue to experience feelings of their body state, suggesting that misperceptions of body awareness are determined by incomplete inner and outer signals. In these clinical populations, despite a long period of massive deafferentation, the activity of the neural structures subserving inner and outer body processing can be manipulated and tuned by means of body illusions that are usually based on multisensory stimulation. We suggest that a multisensory therapeutic approach could be adopted in the context of therapies for patients suffering from deafferentation. In this way, these individuals could regain a more complete feeling of their body state and the sensations they experience, which vary widely depending on their neurological condition

The how and why behind a multisensory art display

Designing multisensory experiences has always fascinated artists and scientists alike. In recent years, there has been a growing interest in multisensory experience design within the HCI community [1]. Next to advances in haptic technologies, we see novel work on olfactory and gustatory systems [2,3] and efforts in determining multisensory design spaces [4]. Moreover, artists, museum curators, and creative industries are interested in those emerging technologies for their own work. Here we present Tate Sensorium, a multisensory art display, as an example case for multisensory design

Third workshop on full-body and multisensory experience

The workshop on "Full-Body and Multisensory Experience" aims at discussing the rich possibilities that the body offers to experience the external world and the prospects that arise for interaction designers when these often-neglected abilities are taken into account. In particular, the workshop will focus on the rediscovery of the human senses, either alone or in a multimodal combination, and of the perceptual-motor abilities of our body. The one-day workshop is divided in three steps: first phase is for the generation of ideas on multisensory interfaces, in the second phase, participants will have the possibilities to explore and rediscover their sensorimotor abilities through several exercises and games; in the third and last phase, there will be a further creative session in order to evaluate how the full body and multisensory activities have fostered people's creative processes. The aim of the whole experience is twofold: first, inspiring participants in designing novel concepts for multisensory interfaces; second, providing a preliminary study on the effect of these exercises in fostering creativity and supporting the design process of multisensory interfaces

Distortions of Subjective Time Perception Within and Across Senses

Background: The ability to estimate the passage of time is of fundamental importance for perceptual and cognitive processes. One experience of time is the perception of duration, which is not isomorphic to physical duration and can be distorted by a number of factors. Yet, the critical features generating these perceptual shifts in subjective duration are not understood. Methodology/Findings: We used prospective duration judgments within and across sensory modalities to examine the effect of stimulus predictability and feature change on the perception of duration. First, we found robust distortions of perceived duration in auditory, visual and auditory-visual presentations despite the predictability of the feature changes in the stimuli. For example, a looming disc embedded in a series of steady discs led to time dilation, whereas a steady disc embedded in a series of looming discs led to time compression. Second, we addressed whether visual (auditory) inputs could alter the perception of duration of auditory (visual) inputs. When participants were presented with incongruent audio-visual stimuli, the perceived duration of auditory events could be shortened or lengthened by the presence of conflicting visual information; however, the perceived duration of visual events was seldom distorted by the presence of auditory information and was never perceived shorter than their actual durations. Conclusions/Significance: These results support the existence of multisensory interactions in the perception of duration and, importantly, suggest that vision can modify auditory temporal perception in a pure timing task. Insofar as distortions in subjective duration can neither be accounted for by the unpredictability of an auditory, visual or auditory-visual event, we propose that it is the intrinsic features of the stimulus that critically affect subjective time distortions

The Teaching of Vocabulary through the Multisensory Approach to EFL Third Age Adults in a Public Nursing Home in Pereira, Colombia

El aprendizaje del idioma inglés es un proceso que conlleva beneficios cognitivos, personales, sociales y de crecimiento. Esta investigación cualitativa tuvo como objetivo integrar a una población de adultos mayores en lecciones de vocabulario en inglés basadas en los principios de la teoría de la andragogía

The Teaching of English Vocabulary through the Multisensory Approach to Older Adults in a Private Nursing Home in Pereira, Colombia

El siguiente documento es un proyecto de investigación cualitativo cuyo objetivo es integrar la teoría andragógica y el enfoque multisensorial para facilitar el aprendizaje de vocabulario en inglés a adultos mayores. Adicionalmente, este estudio es una iniciativa para incluir a los adultos mayores en un proceso de educación bilingüe ya que esta población casi no ha sido tomada en cuenta para la realización de proyectos bilingües. Por esta razón, este proyecto propone nuevas oportunidades para futuras investigaciones El presente estudio fue implementado en el hogar del anciano Casa Santa María en Pereira, Colombia. Este proyecto fue llevado a cabo en 10 clases en las cuales las participantes aprendieron 47 palabras relacionadas con su contexto inmediato. Las participantes del proyecto fueron cuatro mujeres, quienes tenían más de 60 años de edad. Las cuatro fueron consideradas como un proceso de muestreo típico intencional para recopilar los datos, los cuales fueron interpretados por los investigadores. Además, durante la implementación del estudio, tres métodos de recolección de datos fueron empleados: observaciones, diarios de campo, y entrevistas. Los datos recogidos fueron analizados aplicando la teoría fundada, y después de este análisis los datos sugirieron que a) las estrategias de aprendizaje autodirigido pueden facilitar el éxito del aprendizaje de vocabulario y b) los sentidos de los adultos mayores tienen diferentes usos dependiendo de la etapa de la clase. Para concluir, el enfoque multisensorial es efectivo para enseñar vocabulario en inglés a adultos mayores junto con los principios andragógicos