Embodiment, sound and visualization : a multimodal perspective in music education

Recently, many studies have emphasized the role of body movements in processing, sharing and giving meaning to music. At the same time, neuroscience studies, suggest that different parts of the brain are integrated and activated by the same stimuli: sounds, for example, can be perceived by touch and can evoke imagery, energy, fluency and periodicity. This interaction of auditory, visual and motor senses can be found in the verbal descriptions of music and among children during their spontaneous games. The question to be asked is, if a more multisensory and embodied approach could redefine some of our assumptions regarding musical education. Recent research on embodiment and multimodal perception in instrumental teaching could suggest new directions in musical education. Can we consider the integration between the activities of body movement, listening, metaphor visualization, and singing, as more effective than a disembodied and fragmented approach for the process of musical understanding

Atypical audiovisual speech integration in infants at risk for autism

The language difficulties often seen in individuals with autism might stem from an inability to integrate audiovisual information, a skill important for language development. We investigated whether 9-month-old siblings of older children with autism, who are at an increased risk of developing autism, are able to integrate audiovisual speech cues. We used an eye-tracker to record where infants looked when shown a screen displaying two faces of the same model, where one face is articulating/ba/and the other/ga/, with one face congruent with the syllable sound being presented simultaneously, the other face incongruent. This method was successful in showing that infants at low risk can integrate audiovisual speech: they looked for the same amount of time at the mouths in both the fusible visual/ga/− audio/ba/and the congruent visual/ba/− audio/ba/displays, indicating that the auditory and visual streams fuse into a McGurk-type of syllabic percept in the incongruent condition. It also showed that low-risk infants could perceive a mismatch between auditory and visual cues: they looked longer at the mouth in the mismatched, non-fusible visual/ba/− audio/ga/display compared with the congruent visual/ga/− audio/ga/display, demonstrating that they perceive an uncommon, and therefore interesting, speech-like percept when looking at the incongruent mouth (repeated ANOVA: displays x fusion/mismatch conditions interaction: F(1,16) = 17.153, p = 0.001). The looking behaviour of high-risk infants did not differ according to the type of display, suggesting difficulties in matching auditory and visual information (repeated ANOVA, displays x conditions interaction: F(1,25) = 0.09, p = 0.767), in contrast to low-risk infants (repeated ANOVA: displays x conditions x low/high-risk groups interaction: F(1,41) = 4.466, p = 0.041). In some cases this reduced ability might lead to the poor communication skills characteristic of autism

A Review of the "Digital Turn" in the New Literacy Studies

Digital communication has transformed literacy practices and assumed great importance in the functioning of workplace, recreational, and community contexts. This article reviews a decade of empirical work of the New Literacy Studies, identifying the shift toward research of digital literacy applications. The article engages with the central theoretical, methodological, and pragmatic challenges in the tradition of New Literacy Studies, while highlighting the distinctive trends in the digital strand. It identifies common patterns across new literacy practices through cross-comparisons of ethnographic research in digital media environments. It examines ways in which this research is taking into account power and pedagogy in normative contexts of literacy learning using the new media. Recommendations are given to strengthen the links between New Literacy Studies research and literacy curriculum, assessment, and accountability in the 21st century

Translating novel findings of perceptual-motor codes into the neuro-rehabilitation of movement disorders

The bidirectional flow of perceptual and motor information has recently proven useful as rehabilitative tool for re-building motor memories. We analyzed how the visual-motor approach has been successfully applied in neurorehabilitation, leading to surprisingly rapid and effective improvements in action execution. We proposed that the contribution of multiple sensory channels during treatment enables individuals to predict and optimize motor behavior, having a greater effect than visual input alone. We explored how the state-of-the-art neuroscience techniques show direct evidence that employment of visual-motor approach leads to increased motor cortex excitability and synaptic and cortical map plasticity. This super-additive response to multimodal stimulation may maximize neural plasticity, potentiating the effect of conventional treatment, and will be a valuable approach when it comes to advances in innovative methodologies

Storytelling and story-acting: co-construction in action

In the light of sustained interest in the potential value of young children’s narrative play, this paper examines Vivian Gussin Paley’s (1990) approach to storytelling and story-acting, in this case with three to five year-olds. It scrutinizes how children’s narratives are co-constructed during adult-child and peer interactions through spoken and embodied modes, as their stories are scribed by an adult and later dramatised by their peers. Data are drawn from an evaluation of an eight-week training programme, based on Paley’s approach, designed for early years professionals and undertaken in different geographic and demographic locations in England. Naturalistic data collection techniques including video and field notes were used to record the storytelling and story-acting of 18 case study children. The resultant data were subject to close discursive and multimodal analysis of storytelling and story-acting interactions. Findings reveal discursive co-construction ‘in action’ and illustrate how the child story-tellers, story actors and practitioners co-construct narratives through complex combinations of gaze, body posture and speech in responsive and finely-tuned interactional patterns. The study contributes significantly to knowledge about how young children’s narratives are co-constructed through multiple modes in the classroom

Westwood Multimodal Transportation Plan

Westwood is experiencing an industrial regeneration that will change the way the area is utilized by the surrounding communities. To be proactive, Henrico County is planning for the future by creating an overlay zoning district and striving for a multimodal environment to ensure the area grows in a sustainable manner. This plan evaluates the study area, retrieves community engagement, and makes recommendations on streetscape design and public transit improvements to create a multimodal Westwood. Study area observations provided evidence that the streets in Westwood need to be redesigned to accommodate more for pedestrians and cyclists. Community outreach in the form of a survey was conducted to gather input on how the streetscape should be designed and what elements of the study area need the most attention. Results of the surveys and observations were analyzed and used to build the recommendations made for Westwood. Various types of funding options are presented to implement this plan. Sustainable, connected, and integrated transportation is essential to success and livability of the fast-growing study area. The plan aims to supply the knowledge needed to create a livable and thriving Westwood

Effects of congenital hearing loss and cochlear implantation on audiovisual speech perception in infants and children

Purpose: Cochlear implantation has recently become available as an intervention strategy for young children with profound hearing impairment. In fact, infants as young as 6 months are now receiving cochlear implants (CIs), and even younger infants are being fitted with hearing aids (HAs). Because early audiovisual experience may be important for normal development of speech perception, it is important to investigate the effects of a period of auditory deprivation and amplification type on multimodal perceptual processes of infants and children. The purpose of this study was to investigate audiovisual perception skills in normal-hearing (NH) infants and children and deaf infants and children with CIs and HAs of similar chronological ages. Methods: We used an Intermodal Preferential Looking Paradigm to present the same woman\u27s face articulating two words ( judge and back ) in temporal synchrony on two sides of a TV monitor, along with an auditory presentation of one of the words. Results: The results showed that NH infants and children spontaneously matched auditory and visual information in spoken words; deaf infants and children with HAs did not integrate the audiovisual information; and deaf infants and children with CIs initially did not initially integrate the audiovisual information but gradually matched the auditory and visual information in spoken words. Conclusions: These results suggest that a period of auditory deprivation affects multimodal perceptual processes that may begin to develop normally after several months of auditory experience