Sonifying ECoG seizure data with overtone mapping: a strategy for creating auditory gestalt from correlated multichannel data

Abstract

Presented at the 18th International Conference on Auditory Display (ICAD2012) on June 18-21, 2012 in Atlanta, Georgia.Reprinted by permission of the International Community for Auditory Display, http://www.icad.org.This paper introduces a mapping method, harmonic mapping, which projects multichannel time-series data onto a harmonic series structure. Because of the common fate effect of gestalt principle, correlated signals are perceived as a unity, while uncorrelated signals are perceived segregated. This method is first examined with sonification of simple, generic datasets. Then, harmonic mapping is applied to sonification of an ECoG data of an epileptic seizure episode. The relationship between the gestalt formation the correlation in the data across channels is discussed in detail using a 16 channels reduced dataset. Finally, sonification of a 56 channel ECoG dataset is provided to demonstrate the advantage of the harmonic mapping.JST-PREST

    Similar works