Listening-Mode-Centered Sonification Design for Data Exploration

Grond F. Listening-Mode-Centered Sonification Design for Data Exploration. Bielefeld: Bielefeld University; 2013.From the Introduction to this thesis: Through the ever growing amount of data and the desire to make them accessible to the user through the sense of listening, sonification, the representation of data by using sound has been subject of active research in the computer sciences and the field of HCI for the last 20 years. During this time, the field of sonification has diversified into different application areas: today, sound in auditory display informs the user about states and actions on the desktop and in mobile devices; sonification has been applied in monitoring applications, where sound can range from being informative to alarming; sonification has been used to give sensory feedback in order to close the action and perception loop; last but not least, sonifications have also been developed for exploratory data analysis, where sound is used to represent data with unknown structures for hypothesis building. Coming from the computer sciences and HCI, the conceptualization of sonification has been mostly driven by application areas. On the other hand, the sonic arts who have always contributed to the community of auditory display have a genuine focus on sound. Despite this close interdisciplinary relation of communities of sound practitioners, a rich and sound- (or listening)-centered concept about sonification is still missing as a point of departure for a more application and task overarching approach towards design guidelines. Complementary to the useful organization along fields of applications, a conceptual framework that is proper to sound needs to abstract from applications and also to some degree from tasks, as both are not directly related to sound. I hence propose in this thesis to conceptualize sonifications along two poles where sound serves either a normative or a descriptive purpose. In the beginning of auditory display research, a continuum between a symbolic and an analogic pole has been proposed by Kramer (1994a, page 21). In this continuum, symbolic stands for sounds that coincide with existing schemas and are more denotative, analogic stands for sounds that are informative through their connotative aspects. (compare Worrall (2009, page 315)). The notions of symbolic and analogic illustrate the struggle to find apt descriptions of how the intention of the listener subjects audible phenomena to a process of meaning making and interpretation. Complementing the analogic-symbolic continuum with descriptive and normative purposes of displays is proposed in the light of the recently increased research interest in listening modes and intentions. Similar to the terms symbolic and analogic, listening modes have been discussed in auditory display since the beginning usually in dichotomic terms which were either identified with the words listening and hearing or understood as musical listening and everyday listening as proposed by Gaver (1993a). More than 25 years earlier, four direct listening modes have been introduced by Schaeffer (1966) together with a 5th synthetic mode of reduced listening which leads to the well-known sound object. Interestingly, Schaeffer’s listening modes remained largely unnoticed by the auditory display community. Particularly the notion of reduced listening goes beyond the connotative and denotative poles of the continuum proposed by Kramer and justifies the new terms descriptive and normative. Recently, a new taxonomy of listening modes has been proposed by Tuuri and Eerola (2012) that is motivated through an embodied cognition approach. The main contribution of their taxonomy is that it convincingly diversifies the connotative and denotative aspects of listening modes. In the recently published sonification handbook, multimodal and interactive aspects in combination with sonification have been discussed as promising options to expand and advance the field by Hunt and Hermann (2011), who point out that there is a big need for a better theoretical foundation in order to systematically integrate these aspects. The main contribution of this thesis is to address this need by providing alternative and complementary design guidelines with respect to existing approaches, all of which have been conceived before the recently increased research interest in listening modes. None of the existing contributions to design frameworks integrates multimodality, and listening modes with a focus on exploratory data analysis, where sonification is conceived to support the understanding of complex data potentially helping to identify new structures therein. In order to structure this field the following questions are addressed in this thesis: • How do natural listening modes and reduced listening relate to the proposed normative and descriptive display purposes? • What is the relationship of multimodality and interaction with listening modes and display purposes? • How can the potential of embodied cognition based listening modes be put to use for exploratory data sonification? • How can listening modes and display purposes be connected to questions of aesthetics in the display? • How do data complexity and Parameter-mapping sonification relate to exploratory data analysis and listening modes

Algorithms for Spectral Analysis of Irregularly Sampled Time Series

In this paper, we present a spectral analysis method based upon least square approximation. Our method deals with nonuniform sampling. It provides meaningful phase information that varies in a predictable way as the samples are shifted in time. We compare least square approximations of real and complex series, analyze their properties for sample count towards infinity as well as estimator behaviour, and show the equivalence to the discrete Fourier transform applied onto uniformly sampled data as a special case. We propose a way to deal with the undesirable side effects of nonuniform sampling in the presence of constant offsets. By using weighted least square approximation, we introduce an analogue to the Morlet wavelet transform for nonuniformly sampled data. Asymptotically fast divide-and-conquer schemes for the computation of the variants of the proposed method are presented. The usefulness is demonstrated in some relevant applications.

A SUPERCOLLIDER CLASS FOR VOWEL SYNTHESIS AND ITS USE FOR SONIFICATION

Presented at the 17th International Conference on Auditory Display (ICAD2011), 20-23 June, 2011 in Budapest, Hungary.In this paper, we present building blocks for the synthesis of vowel sounds in the programming language SuperCollider. We discuss the advantages of using vowel based synthesis, and make a review where it has already been used in sonifications. Then, we describe in detail the main class Vowel which handles all parameters related to the formants that are typically used for vowel synthesis. In order to simplify the handling of the Vowel class, we introduce two auxiliary pseudo Ugens: Formants for additive synthesis, and BPFStack for subtractive synthesis. This introduction of the building blocks is followed by code examples for sound synthesis, which make use of the described classes and their specific features. We finally present sample applications, showing how these building blocks can be used in sonification

Algorithms for Spectral Analysis of Irregularly Sampled Time Series

In this paper, we present a spectral analysis method based upon least square approximation. Our method deals with nonuniform sampling. It provides meaningful phase information that varies in a predictable way as the samples are shifted in time. We compare least square approximations of real and complex series, analyze their properties for sample count towards infinity as well as estimator behaviour, and show the equivalence to the discrete Fourier transform applied onto uniformly sampled data as a special case. We propose a way to deal with the undesirable side effects of nonuniform sampling in the presence of constant offsets. By using weighted least square approximation, we introduce an analogue to the Morlet wavelet transform for nonuniformly sampled data. Asymptotically fast divide-and-conquer schemes for the computation of the variants of the proposed method are presented. The usefulness is demonstrated in some relevant applications

Association between infectious burden, socioeconomic status, and ischemic stroke

Background and aims: Infectious diseases contribute to stroke risk, and are associated with socioeconomic status (SES). We tested the hypotheses that the aggregate burden of infections increases the risk of ischemic stroke (IS) and partly explains the association between low SES and ischemic stroke. Methods: In a case-control study with 470 ischemic stroke patients and 809 age- and sex-matched controls, randomly selected from the population, antibodies against the periodontal microbial agents Aggregatibacter actinomycetemcomitans and Porphyromonas gingivalis, against Chlamydia pneumonia, Mycoplasma pneumoniae (IgA and IgG), and CagA-positive Helicobacter pylori (IgG) were assessed. Results: IgA seropositivity to two microbial agents was significantly associated with IS after adjustment for SES (OR 1.45 95% CI 1.01-2.08), but not in the fully adjusted model (OR 1.32 95% CI 0.86-2.02). By trend, cumulative IgA seropositivity was associated with stroke due to large vessel disease (LVD) after full adjustment (OR 1.88, 95% CI 0.96e3.69). Disadvantageous childhood SES was associated with higher cumulative seropositivity in univariable analyses, however, its strong impact on stroke risk was not influenced by seroepidemiological data in the multivariable model. The strong association between adulthood SES and stroke was rendered nonsignificant when factors of dental care were adjusted for. Conclusions: Infectious burden assessed with five microbial agents did not independently contribute to ischemic stroke consistently, but may contribute to stroke due to LVD. High infectious burden may not explain the association between childhood SES and stroke risk. Lifestyle factors that include dental negligence may contribute to the association between disadvantageous adulthood SES and stroke. (C) 2016 Elsevier Ireland Ltd. All rights reserved.Peer reviewe

Intensive heart rhythm monitoring to decrease ischemic stroke and systemic embolism - the Find-AF 2 study - rationale and design

Background Atrial fibrillation (AF) is one of the most frequent causes of stroke. Several randomized trials have shown that prolonged monitoring increases the detection of AF, but the effect on reducing recurrent cardioembolism, i.e. ischemic stroke and systemic embolism, remains unknown. We aim to evaluate whether a risk-adapted, intensified heart rhythm monitoring with consequent guideline conform treatment, which implies initiation of oral anticoagulation (OAC), leads to a reduction of recurrent cardioembolism. Methods Find-AF 2 is a randomized, controlled, open-label parallel multicenter trial with blinded endpoint assessment. 5,200 patients ≥ 60 years of age with symptomatic ischemic stroke within the last 30 days and without known AF will be included at 52 study centers with a specialized stroke unit in Germany. Patients without AF in an additional 24-hour Holter ECG after the qualifying event will be randomized in a 1:1 fashion to either enhanced, prolonged and intensified ECG-monitoring (intervention arm) or standard of care monitoring (control arm). In the intervention arm, patients with a high risk of underlying AF will receive continuous rhythm monitoring using an implantable cardiac monitor (ICM) whereas those without high risk of underlying AF will receive repeated 7-day Holter ECGs. The duration of rhythm monitoring within the control arm is up to the discretion of the participating centers and is allowed for up to 7 days. Patients will be followed for at least 24 months. The primary efficacy endpoint is the time until recurrent ischemic stroke or systemic embolism occur. Conclusions The Find-AF 2 trial aims to demonstrate that enhanced, prolonged and intensified rhythm monitoring results in a more effective prevention of recurrent ischemic stroke and systemic embolism compared to usual care

Novel genetic loci associated with hippocampal volume

The hippocampal formation is a brain structure integrally involved in episodic memory, spatial navigation, cognition and stress responsiveness. Structural abnormalities in hippocampal volume and shape are found in several common neuropsychiatric disorders. To identify the genetic underpinnings of hippocampal structure here we perform a genome-wide association study (GWAS) of 33,536 individuals and discover six independent loci significantly associated with hippocampal volume, four of them novel. Of the novel loci, three lie within genes (ASTN2, DPP4 and MAST4) and one is found 200 kb upstream of SHH. A hippocampal subfield analysis shows that a locus within the MSRB3 gene shows evidence of a localized effect along the dentate gyrus, subiculum, CA1 and fissure. Further, we show that genetic variants associated with decreased hippocampal volume are also associated with increased risk for Alzheimer's disease (rg =-0.155). Our findings suggest novel biological pathways through which human genetic variation influences hippocampal volume and risk for neuropsychiatric illness

Novel genetic loci underlying human intracranial volume identified through genome-wide association

Intracranial volume reflects the maximally attained brain size during development, and remains stable with loss of tissue in late life. It is highly heritable, but the underlying genes remain largely undetermined. In a genome-wide association study of 32,438 adults, we discovered five novel loci for intracranial volume and confirmed two known signals. Four of the loci are also associated with adult human stature, but these remained associated with intracranial volume after adjusting for height. We found a high genetic correlation with child head circumference (ρgenetic=0.748), which indicated a similar genetic background and allowed for the identification of four additional loci through meta-analysis (Ncombined = 37,345). Variants for intracranial volume were also related to childhood and adult cognitive function, Parkinson’s disease, and enriched near genes involved in growth pathways including PI3K–AKT signaling. These findings identify biological underpinnings of intracranial volume and provide genetic support for theories on brain reserve and brain overgrowth

Identification of genetic variants associated with Huntington's disease progression: a genome-wide association study

Background Huntington's disease is caused by a CAG repeat expansion in the huntingtin gene, HTT. Age at onset has been used as a quantitative phenotype in genetic analysis looking for Huntington's disease modifiers, but is hard to define and not always available. Therefore, we aimed to generate a novel measure of disease progression and to identify genetic markers associated with this progression measure. Methods We generated a progression score on the basis of principal component analysis of prospectively acquired longitudinal changes in motor, cognitive, and imaging measures in the 218 indivduals in the TRACK-HD cohort of Huntington's disease gene mutation carriers (data collected 2008–11). We generated a parallel progression score using data from 1773 previously genotyped participants from the European Huntington's Disease Network REGISTRY study of Huntington's disease mutation carriers (data collected 2003–13). We did a genome-wide association analyses in terms of progression for 216 TRACK-HD participants and 1773 REGISTRY participants, then a meta-analysis of these results was undertaken. Findings Longitudinal motor, cognitive, and imaging scores were correlated with each other in TRACK-HD participants, justifying use of a single, cross-domain measure of disease progression in both studies. The TRACK-HD and REGISTRY progression measures were correlated with each other (r=0·674), and with age at onset (TRACK-HD, r=0·315; REGISTRY, r=0·234). The meta-analysis of progression in TRACK-HD and REGISTRY gave a genome-wide significant signal (p=1·12 × 10−10) on chromosome 5 spanning three genes: MSH3, DHFR, and MTRNR2L2. The genes in this locus were associated with progression in TRACK-HD (MSH3 p=2·94 × 10−8 DHFR p=8·37 × 10−7 MTRNR2L2 p=2·15 × 10−9) and to a lesser extent in REGISTRY (MSH3 p=9·36 × 10−4 DHFR p=8·45 × 10−4 MTRNR2L2 p=1·20 × 10−3). The lead single nucleotide polymorphism (SNP) in TRACK-HD (rs557874766) was genome-wide significant in the meta-analysis (p=1·58 × 10−8), and encodes an aminoacid change (Pro67Ala) in MSH3. In TRACK-HD, each copy of the minor allele at this SNP was associated with a 0·4 units per year (95% CI 0·16–0·66) reduction in the rate of change of the Unified Huntington's Disease Rating Scale (UHDRS) Total Motor Score, and a reduction of 0·12 units per year (95% CI 0·06–0·18) in the rate of change of UHDRS Total Functional Capacity score. These associations remained significant after adjusting for age of onset. Interpretation The multidomain progression measure in TRACK-HD was associated with a functional variant that was genome-wide significant in our meta-analysis. The association in only 216 participants implies that the progression measure is a sensitive reflection of disease burden, that the effect size at this locus is large, or both. Knockout of Msh3 reduces somatic expansion in Huntington's disease mouse models, suggesting this mechanism as an area for future therapeutic investigation