Ungerechts B, Cesarini D, Hermann T. Real-time Sonification in Swimming – from pressure changes of displaced water to sound. In: Mason B, ed. BMS2014— Proceedings. Australian Institute of Sport, Canberra;  2014: 269-275

Cesarini, Daniel

Hermann, Thomas 

Mason, Bruce

Ungerechts, Bodo

Publications at Bielefeld University

Real-time Sonification in Swimming -from pressure changes of displaced water to sound-B E Ungerechts 1, D Cesarini 2, T Hermann 31 Neurocognition-Biomechanics, Bielefeld University, Germany2 Department of Information Engineering , Pisa University, Italy3 Ambient Intelligence Group, CITEC Bielefeld University, GermanySwimming is based on • a cognitively controlled goal-oriented interaction • of self-induced body action and displaced water mass • under the condition of limited energy-reservoirsCognitive control demands • an appropriate perception of the interaction • called “feel for water”Coachesinfo ( C McCabe, R Sander, Propulsion in Swimming), claims •“… swimmers should be encouraged to feel pressure  changes through the cells sensitive to pressure and kinesthetic proprioceptive system.”IntroductionIn conjunction with •the perception of the locomotion of the CoM  (the end-effect of the interaction) • swimmer becomes better • at controlling • their ability to feel the connection between action and reactionFrom standpoint of flow physics •one question is • “How does hand action best displace water mass • to yield highest propulsive effects (at least energy-costs)?"IntroductionFlow visualisation by PIV shows how water mass is displaced by hand action  Flow visualization aids the experts to gain insight of the flow changes induced by interaction; so it is in human swimming (Matsuuchi et al, 2009)         http://www.sciencedirect.com/science/article/pii/S0021929013002273IntroductionEfficient interaction• does NOT simply mean “pull and push on water mass”• even if this plausibility is copied in so many textbooks on swimming –In fact•efficient interaction is a matter of • induced pressure gradient combined with particular flow effects• resulting in momentum change of water massThe purpose of this paper is to show•the pressure gradient can be measured and •the signals can be transferred into soundIntroductionExzellenzcluster Cognitive Interaction TechnologySonification of Intermediate LevelsMultiple levels of information sources for auditory bio-feedbackHermann, T., Ungerechts, B., Toussaint, H. & Grote,M. (2012)Measuring flow pressure in swimming research has some tradition(Toussaint et al, 2000)In 2012 Hermann, Ungerechts & Toussaint started the first attempt of sonification  of pressure data due to hand action in in crawl stroke swimmingHermann, T., Ungerechts, B., Toussaint, H. & Grote,M. (2012)IntroductionThe natural soundofBreaststroke swimmingIntroductionSonification is a means •to perceptualize undetectable data and complement existing sensory data • by the use of “functional sound”• highlighting aspects of a data flow for the purpose of • facilitating communication or interpretationSonification is more than•audition which means changes of a data set • are mapped simply via change of the loudness of one tone Audition of hand positions and foot position relative to the swimmer‘s trunk in breaststrokeA Effenberg, 2000IntroductionWas made possible by the  COOPERATION of Cesarini, Hermann, Ungerechts•in 2013 at University of BielefeldPressure changes at palmar and dorsal side of the hand were detected via •Piezo-probes  (Ungerechts, 1980)2 Piezo-probes , per hand, •were connected to sensors, respectively•located in a waterproof boxdata were transferred to a Laptop •processed via SuperCollider program : the outcome was a functional sound of the flow pressure-difference per hand in REAL - TIMEReal-time sonificationPiezo-probesas Pressure Tapto determine static pressure of a flow-2 Piezo-Probes per hand one facing palmarone facing dorsalReal-time sonificationVery helpful tools-a pole with - a waterproof box - laptop on hawker’s traythe whole setting Real-time sonificationfirst:  the pressure-time signals during crawl stroke swimmingnext:  the functional soundReal-time sonificationVarious  mappings of functional sound are possibleMapping is the term to describe the exact transformation of data into sound•Without going into details next two different mappings are presented- amplitude – mapping at constant pitch –example crawl stroke-C6-accord – mapping (more aesthetic) –example breaststrokeReal-time sonificationamplitude – mapping at constant pitch –example crawl strokeReal-time sonification‐C6‐accord – mapping (more aesthetic) ‐Examplealternativehand actionsleft and right actionare mappedseparatelyReal-time sonification‐C6-accord – mapping (more aesthetic) Examplesymmetric hand actionsleft and right actionare mappedseparatelyReal-time sonificationReal-time sonification•is an appropriate means of feedback • to support research of undetected signals• like pressure • as a hydrodynamic stimulus• in a non-steady flow situation Moreover•real-time sonification of induced pressure changes  • becomes a new part of sensory channels supporting cognitive control• highlighting the effect of the interaction of two independent bodies Last, but not …•communication about the quality of the swimmer’s strokes is enhancedFurther studies will focus on:  the use of waterproof earphones, the structure of cognitive representationsof stroke actions in long-term memoryswimmer perceives multiple info while the coach shares audible feedbackIntroduction19Thank youvery muchfor your attention

Real-time Sonification in Swimming – from pressure changes of displaced water to sound

https://pub.uni-bielefeld.de/download/2687903/2906628

Real-time Sonification in Swimming – from pressure changes of displaced water to sound

Abstract

Similar works

Full text

Available Versions

Publications at Bielefeld University