Real-time Sonification in Swimming: from pressure changes of displaced water to sound

Cesarini D, Hermann T, Ungerechts B. Real-time Sonification in Swimming: from pressure changes of displaced water to sound. Presented at the Multisensory Motor Behavior: Impact of Sound, Hannover, Germany

Context Aware Computing or the Sense of Context

ITALIANO: I sistemi ubiquitous e pervasivi, speciali categorie di sistemi embedded (immersi), possono essere utilizzati per rilevare il contesto che li circonda. In particolare, i sistemi context-aware sono in grado di alterare il loro stato interno e il loro comportamento in base all’ambiente (context) che percepiscono. Per aiutare le persone nell’espletare le proprie attivitá, tali sistemi possono utilizzare le conoscenze raccolte attorno a loro. Un grande sforzo industriale e di ricerca, orientato all’innovazione dei sensori, processori, sistemi operativi, protocolli di comunicazione, e framework, offre molte tecnologie definibili abilitanti, come le reti di sensori wireless o gli Smartphone. Tuttavia, nonostante tale sforzo significativo, l’adozione di sistemi pervasivi che permettano di migliorare il monitoraggio dello sport, l’allenamento e le tecnologie assistive é ancora piuttosto limitato. Questa tesi individua due fattori determinanti per questo basso utilizzo delle tecnologie pervasive, principalmente relativi agli utenti. Da un lato il tentativo degli esperti e dei ricercatori dell’informatica di indurre l’adozione di soluzioni informatiche, trascurando parzialmente l’interazione con gli utenti finali, dall’altro lato una scarsa attenzione all’interazione tra uomo e computer. Il primo fattore puó essere tradotto nella mancanza di attenzione a ció che é rilevante nel contesto dei bisogni (speciali) dell’utente. Il secondo é rappresentato dall’utilizzo diffuso di interfacce grafiche di presentazione delle informazioni, che richiede un elevato livello di sforzo cognitivo da parte degli utenti. Mentre lo studio della letteratura puó fornire conoscenze sul contesto dell’utente, solo il contatto diretto con lui arricchisce la conoscenza di consapevolezza, fornendo una precisa identificazione dei fattori che sono piú rilevanti per il destinatario dell’applicazione. Per applicare con successo le tecnologie pervasive al campo dello sport e delle tecnologie assistive, l’identificazione dei fattori rilevanti é una premessa necessaria, Tale processo di identificazione rappresenta l’approccio metodologico principale utilizzato per questa tesi. Nella tesi si analizzano diversi sport (canottaggio, nuoto, corsa ) e una disabilitá (la cecitá), per mostrare come la metodologia di investigazione e di progettazione proposta venga messa in pratica. Infatti i fattori rilevanti sono stati identificati grazie alla stretta collaborazione con gli utenti e gli esperti nei rispettivi campi. Si descrive il processo di identificazione, insieme alle soluzioni elaborate su misura per il particolare campo d’uso. L’uso della sonificazione, cioé la trasmissione di informazioni attraverso il suono, si propone di affrontare il secondo problema presentato, riguardante le interfacce utente. L’uso della sonificazione puó facilitare la fruizione in tempo reale delle informazioni sulle prestazioni di attivitá sportive, e puó contribuire ad alleviare parzialmente la disabilitá degli utenti non vedenti. Nel canottaggio, si é identificato nel livello di sincronia del team uno dei fattori rilevanti per una propulsione efficace dell’imbarcazione. Il problema di rilevare il livello di sincronia viene analizzato mediante una rete di accelerometri wireless, proponendo due diverse soluzioni. La prima soluzione é basata sull’indice di correlazione di Pearson e la seconda su un approccio emergente chiamato stigmergia. Entrambi gli approcci sono stati testati con successo in laboratorio e sul campo. Inoltre sono state sviluppate due applicazioni, per smartphone e PC, per fornire la telemetria e la sonificazione del moto di una barca a remi. Nel campo del nuoto é stata condotta una ricerca in letteratura riguardo la convinzione diffusa di considerare la cinematica come il fattore rilevante della propulsione efficace dei nuotatori. Questa indagine ha richiamato l’attenzione sull’importanza di studiare il cosiddetto feel-for-water (sensazione-dell’-acqua) percepito dai nuotatori d’alto livello. É stato progettato un innovativo sistema, per rilevare e comunicare gli effetti fluidodinamici causati dallo spostamento delle masse d’acqua intorno alle mani dei nuotatori. Il sistema é in grado di trasformare la pressione dell’acqua, misurata con sonde Piezo intorno alle mani, in un bio-feedback auditivo, pensato per i nuotatori e gli allenatori, come base per un nuovo modo di comunicare la sensazione-dell’acqua. Il sistema é stato testato con successo nel campo e ha dimostrato di fornire informazioni in tempo reale per il nuotatore e il formatore. Nello sport della corsa sono stati individuati due parametri rilevanti: il tempo di volo e di contatto dei piedi. É stato progettato un sistema innovativo per ottenere questi parametri attraverso un unico accelerometro montato sul tronco del corridore ed é stato implementato su uno smartphone. Per ottenere il risultato voluto é stato necessario progettare e realizzare un sistema per riallineare virtualmente gli assi dell’accelerometro e per estrarre il tempo di volo e di contatto dal segnale dell’accelerometro riallineato. L’applicazione per smartphone completa é stata testata con successo sul campo, confrontando i valori con quelli di attrezzature specializzate, dimostrando la sua idoneitá come ausilio pervasivo all’allenamento di corridori. Per esplorare le possibilitá della sonificazione usata come una base per tecnologia assistiva, abbiamo iniziato una collaborazione con un gruppo di ricerca presso l’Universitá di Scienze Applicate, Ginevra, in Svizzera. Tale collaborazione si é concentrata su un progetto chiamato SeeColOr (See Color with an Orchestra - vedere i colori con un’orchestra). In particolare, abbiamo avuto l’opportunitá di implementare il sistema SeeColOr su smartphone, al fine di consentire agli utenti non vedenti di utilizzare tale tecnologia su dispositivi leggeri e a basso costo. Inoltre, la tesi esplora alcune questioni relative al campo del rilevamento ambientale in ambienti estremi, come i ghiacciai, utilizzando la tecnologia delle Wireless Sensor Networks. Considerando che la tecnologia é simile a quella usata in altri contesti presentati, le considerazioni possono facilmente essere riutilizzate. Si sottolinea infatti che i problemi principali sono legati alla elevata difficoltá e scarsa affidabilitá di questa tecnologia innovativa rispetto alle altre soluzioni disponibili in commercio , definite legacy, basate solitamente su dispositivi piú grandi e costosi, chiamati datalogger. La tesi presenta i problemi esposti e le soluzioni proposte per mostrare l’applicazione dell’approccio progettuale cercato e definito durante lo sviluppo delle attività sperimentali e la ricerca che le ha implementate. ---------------------------------------- ENGLISH: Ubiquitous and pervasive systems, special categories of embedded systems, can be used to sense the context in their surrounding. In particular, context-aware systems are able to alter their internal state and their behaviour based on the context they perceive. To help people in better performing their activities, such systems must use the knowledge gathered about the context. A big research and industrial effort, geared towards the innovation of sensors, processors, operating systems, communication protocols, and frameworks, provides many "enabling" technologies, such as Wireless Sensor Networks or Smartphones. However, despite that significant effort, the adoption of pervasive systems to enhance sports monitoring, training and assistive technologies is still rather small. This thesis identifies two main issues concerning this low usage of pervasive technologies, both mainly related to users. On one side the attempt of computer science experts and researchers to induce the adoption of information technology based solutions, partially neglecting interaction with end users; on the other side a scarce attention to the interaction between humans and computers. The first can be translated into the lack of attention at what is relevant in the context of the user’s (special) needs. The second is represented by the widespread usage of graphical user interfaces to present information, requiring a high level of cognitive effort. While literature studies can provide knowledge about the user’s context, only direct contact with users enriches knowledge with awareness, providing a precise identification of the factors that are more relevant to the user. To successfully apply pervasive technologies to the field of sports engineering and assistive technology, the identification of relevant factors is an obliged premise, and represents the main methodological approach used throughout this thesis. This thesis analyses different sports (rowing, swimming, running) and a disability (blindness), to show how the proposed design methodology is put in practice. Relevant factors were identified thanks to the tight collaboration with users and experts in the respective fields. The process of identification is described, together with the proposed application tailored for the special field. The use of sonification, i.e. conveying information as sound, is proposed to leverage the second presented issue, that regards the user interfaces. The usage of sonification can ease the exploitation of information about performance in real-time for sport activities and can help to partially leverage the disability of blind users. In rowing, the synchrony level of the team was identified as one of the relevant factors for effective propulsion. The problem of detecting the synchrony level is analysed by means of a network of wireless accelerometers, proposing two different solutions. The first solution is based on Pearson’s correlation index and the second on an emergent approach called stigmergy. Both approaches were successfully tested in laboratory and in the field. Moreover two applications, for smartphones and PCs, were developed to provide telemetry and sonification of a rowing boat’s motion. In the field of swimming, an investigation about the widespread belief considering kinematics as the relevant factor of effective propulsion of swimmers drew attention to the importance of studying the so called "feel-for-water" experienced by elite swimmers. An innovative system was designed to sense and communicate fluid-dynamic effects caused by moving water masses around swimmers hands. The system is able to transform water pressure, measured with Piezo-probes, around hands into an auditive biofeedback, to be used by swimmers and trainers, as the base for a new way of communication about the "feel-for-water". The system was successfully tested in the field and proved to provide real-time information for the swimmer and the trainer. In running sports two relevant parameters are time of flight and contact of feet. An innovative system was designed to obtain these parameters using a single trunk mounted accelerometer and was implemented on a smartphone. To achieve the intended result it was necessary to design and implement a system to virtually realign the axes of the accelerometer and to extract time of flight and time of contact phases from the realigned accelerometer signal. The complete smartphone application was successfully tested in the field with specialized equipment, proving its suitability in enhancing training of runners with a pervasive system. To explore possibilities of sonification applied as an assistive technology, we started a collaboration with research group from University of Applied Science, Geneva, Switzerland, focused on a project called SeeColOr (See Color with an Orchestra). In particular we had the opportunity to implement the SeeColOr system on smartphones, in order to enable blind users to use that technology on low cost and lightweight devices. Moreover, the thesis exposes some issues related to a field, environmental sensing in extreme environments, like glaciers, using the innovative Wireless Sensor Networks technology. Considering that the technology is similar to the one used in other presented contexts, learned lessons can easily be reused. It is emphasized that the main problems are related to the high difficulty and low reliability of that innovative technology with respect to other "legacy" commercially available solutions, based on expensive and bigger devices, called dataloggers. The thesis presents the exposed problems and proposed solutions to show the application of the design approach strived during the development and research

Status of the VERITAS Observatory

VERITAS, an Imaging Atmospheric Cherenkov Telescope (IACT) system for gammma-ray astronomy in the GeV-TeV range, has recently completed its first season of observations with a full array of four telescopes. A number of astrophysical gamma-ray sources have been detected, both galactic and extragalactic, including sources previously unknown at TeV energies. We describe the status of the array and some highlight results, and assess the technical performance, sensitivity and shower reconstruction capabilities.Comment: Submitted to Proceedings of "4th Heidelberg International Symposium on High Energy Gamma-Ray Astronomy 2008

Detection of Extended VHE Gamma Ray Emission from G106.3+2.7 with VERITAS

We report the detection of very-high-energy (VHE) gamma-ray emission from supernova remnant (SNR) G106.3+2.7. Observations performed in 2008 with the VERITAS atmospheric Cherenkov gamma-ray telescope resolve extended emission overlapping the elongated radio SNR. The 7.3 sigma (pre-trials) detection has a full angular extent of roughly 0.6deg by 0.4deg. Most notably, the centroid of the VHE emission is centered near the peak of the coincident 12CO (J = 1-0) emission, 0.4deg away from the pulsar PSR J2229+6114, situated at the northern end of the SNR. Evidently the current-epoch particles from the pulsar wind nebula are not participating in the gamma-ray production. The VHE energy spectrum measured with VERITAS is well characterized by a power law dN/dE = N_0(E/3 TeV)^{-G} with a differential index of G = 2.29 +/- 0.33stat +/- 0.30sys and a flux of N_0 = (1.15 +/- 0.27stat +/- 0.35sys)x 10^{-13} cm^{-2} s^{-1} TeV^{-1}. The integral flux above 1 TeV corresponds to ~5 percent of the steady Crab Nebula emission above the same energy. We describe the observations and analysis of the object and briefly discuss the implications of the detection in a multiwavelength context.Comment: 5 pages, 2 figure

Genetic variation associated with differential educational attainment in adults has anticipated associations with school performance in children

Genome-wide association study results have yielded evidence for the association of common genetic variants with crude measures of completed educational attainment in adults. Whilst informative, these results do not inform as to the mechanism of these effects or their presence at earlier ages and where educational performance is more routinely and more precisely assessed. Single nucleotide polymorphisms exhibiting genome-wide significant associations with adult educational attainment were combined to derive an unweighted allele score in 5,979 and 6,145 young participants from the Avon Longitudinal Study of Parents and Children with key stage 3 national curriculum test results (SATS results) available at age 13 to 14 years in English and mathematics respectively. Standardised (z-scored) results for English and mathematics showed an expected relationship with sex, with girls exhibiting an advantage over boys in English (0.433 SD (95%CI 0.395, 0.470), p<10-10) with more similar results (though in the opposite direction) in mathematics (0.042 SD (95%CI 0.004, 0.080), p = 0.030). Each additional adult educational attainment increasing allele was associated with 0.041 SD (95%CI 0.020, 0.063), p = 1.79×10-04 and 0.028 SD (95%CI 0.007, 0.050), p = 0.01 increases in standardised SATS score for English and mathematics respectively. Educational attainment is a complex multifactorial behavioural trait which has not had heritable contributions to it fully characterised. We were able to apply the results from a large study of adult educational attainment to a study of child exam performance marking events in the process of learning rather than realised adult end product. Our results support evidence for common, small genetic contributions to educational attainment, but also emphasise the likely lifecourse nature of this genetic effect. Results here also, by an alternative route, suggest that existing methods for child examination are able to recognise early life variation likely to be related to ultimate educational attainment

VERITAS Observations of the BL Lac Object 1ES 1218+304

The VERITAS collaboration reports the detection of very-high-energy (VHE) gamma-ray emission from the high-frequency-peaked BL Lac object 1ES 1218+304 located at a redshift of z=0.182. A gamma-ray signal was detected with high statistical significance for the observations taken during several months in the 2006-2007 observing season. The photon spectrum between ~160 GeV and ~1.8 TeV is well described by a power law with an index of Gamma = 3.08 +/- 0.34(stat) +/- 0.2(sys). The integral flux above 200 GeV corresponds to ~6% of that of the Crab Nebula. The light curve does not show any evidence for VHE flux variability. Using lower limits on the density of the extragalactic background light (EBL) in the near-IR to mid-IR we are able to limit the range of intrinsic energy spectra for 1ES 1218+304. We show that the intrinsic photon spectrum is harder than a power law with an index of Gamma = 2.32 +/- 0.37. When including constraints from the spectra of 1ES 1101-232 and 1ES 0229+200, the spectrum of 1ES 1218+304 is likely to be harder than Gamma = 1.86 +/- 0.37.Comment: Submitted to Proceedings of "4th Heidelberg International Symposium on High Energy Gamma-Ray Astronomy 2008

VERITAS Observations of the gamma-Ray Binary LS I +61 303

LS I +61 303 is one of only a few high-mass X-ray binaries currently detected at high significance in very high energy gamma-rays. The system was observed over several orbital cycles (between September 2006 and February 2007) with the VERITAS array of imaging air-Cherenkov telescopes. A signal of gamma-rays with energies above 300 GeV is found with a statistical significance of 8.4 standard deviations. The detected flux is measured to be strongly variable; the maximum flux is found during most orbital cycles at apastron. The energy spectrum for the period of maximum emission can be characterized by a power law with a photon index of Gamma=2.40+-0.16_stat+-0.2_sys and a flux above 300 GeV corresponding to 15-20% of the flux from the Crab Nebula.Comment: accepted for publication in The Astrophysical Journa

A Smartphone Based Sonification And Telemetry Platform For On-Water Rowing Training

Presented at the 19th International Conference on Auditory Display (ICAD2013) on July 6-9, 2013 in Lodz, Poland.On water rowing training greatly benefits from sonification. However, no real-time usable smartphone based platform exists for acquisition and sonification of data measured during rowing. We propose the use of a smartphone based system, coupled with an Accrow (BeSB) data acquisition device. The whole system is able to convey the produced sound within 100ms from the movement, thus enabling the presentation of functional real-time feedback to the rowers. The system is thought to be useful for both athletes and coaches. The sonification presented to the athletes is aimed at enhancing their perception for the movement execution with the final aim of synchronizing the crew in a uniform rhythm in order to improve the boat velocity. The sonification presented to the coaches aimed at assisting their visual observation of the boat motion in the daily training routine by listening to the sound in order to detect fluctuations that are not visible. An empirically investigated concept of acoustic feedback that is presented in real-time during on-water rowing training sessions already exists. This paper deals with the extension of the technical hardware currently used in high performance rowing training to a smartphone based platform in order to provide the sonification to more users and to everyday club training including young and older rowers (juniors and masters)