Cough Monitoring Through Audio Analysis

The detection of cough events in audio recordings requires the analysis of a significant amount of data as cough is typically monitored continuously over several hours to capture naturally occurring cough events. The recorded data is mostly composed of undesired sound events such as silence, background noise, and speech. To reduce computational costs and to address the ethical concerns raised from the collection of audio data in public environments, the data requires pre-processing prior to any further analysis. Current cough detection algorithms typically use pre-processing methods to remove undesired audio segments from the collected data but do not preserve the privacy of individuals being recorded while monitoring respiratory events. This study reveals the need for an automatic pre-processing method that removes sensitive data from the recording prior to any further analysis to ensure privacy preservation of individuals. Specific characteristics of cough sounds can be used to discard sensitive data from audio recordings at a pre-processing stage, improving privacy preservation, and decreasing ethical concerns when dealing with cough monitoring through audio analysis. We propose a pre-processing algorithm that increases privacy preservation and significantly decreases the amount of data to be analysed, by separating cough segments from other non-cough segments, including speech, in audio recordings. Our method verifies the presence of signal energy in both lower and higher frequency regions and discards segments whose energy concentrates only on one of them. The method is iteratively applied on the same data to increase the percentage of data reduction and privacy preservation. We evaluated the performance of our algorithm using several hours of audio recordings with manually pre-annotated cough and speech events. Our results showed that 5 iterations of the proposed method can discard up to 88.94% of the speech content present in the recordings, allowing for a strong privacy preservation while considerably reducing the amount of data to be further analysed by 91.79%. The data reduction and privacy preservation achievements of the proposed pre-processing algorithm offers the possibility to use larger datasets captured in public environments and would beneficiate all cough detection algorithms by preserving the privacy of subjects and by-stander conversations recorded during cough monitoring

Intelligent signal processing for digital healthcare monitoring

Ein gesunder Gang ist ein komplexer Prozess und erfordert ein Gleichgewicht zwischen verschiedenen neurophysiologischen Systemen im Körper und gilt als wesentlicher Indikator für den physischen und kognitiven Gesundheitszustand einer Person. Folglich würden Anwendungen im Bereich der Bioinformatik und des Gesundheitswesens erheblich von den Informationen profitieren, die sich aus einer längeren oder ständigen Überwachung des Gangs, der Gewohnheiten und des Verhaltens von Personen unter ihren natürlichen Lebensbedingungen und bei ihren täglichen Aktivitäten mit Hilfe intelligenter Geräte ergeben. Vergleicht man Trägheitsmess- und stationäre Sensorsysteme, so bieten erstere hervorragende Möglichkeiten für Ganganalyseanwendungen und bieten mehrere Vorteile wie geringe Größe, niedriger Preis, Mobilität und sind leicht in tragbare Systeme zu integrieren. Die zweiten gelten als der Goldstandard, sind aber teuer und für Messungen im Freien ungeeignet. Diese Arbeit konzentriert sich auf die Verbesserung der Zeit und Qualität der Gangrehabilitation nach einer Operation unter Verwendung von Inertialmessgeräten, indem sie eine neuartige Metrik zur objektiven Bewertung des Fortschritts der Gangrehabilitation in realen Umgebungen liefert und die Anzahl der verwendeten Sensoren für praktische, reale Szenarien reduziert. Daher wurden die experimentellen Messungen für eine solche Analyse in einer stark kontrollierten Umgebung durchgeführt, um die Datenqualität zu gewährleisten. In dieser Arbeit wird eine neue Gangmetrik vorgestellt, die den Rehabilitationsfortschritt anhand kinematischer Gangdaten von Aktivitäten in Innen- und Außenbereichen quantifiziert und verfolgt. In dieser Arbeit wird untersucht, wie Signalverarbeitung und maschinelles Lernen formuliert und genutzt werden können, um robuste Methoden zur Bewältigung von Herausforderungen im realen Leben zu entwickeln. Es wird gezeigt, dass der vorgeschlagene Ansatz personalisiert werden kann, um den Fortschritt der Gangrehabilitation zu verfolgen. Ein weiteres Thema dieser Arbeit ist die erfolgreiche Anwendung von Methoden des maschinellen Lernens auf die Ganganalyse aufgrund der großen Datenmenge, die von den tragbaren Sensorsystemen erzeugt wird. In dieser Arbeit wird das neuartige Konzept des ``digitalen Zwillings'' vorgestellt, das die Anzahl der verwendeten Wearable-Sensoren in einem System oder im Falle eines Sensorausfalls reduziert. Die Evaluierung der vorgeschlagenen Metrik mit gesunden Teilnehmern und Patienten unter Verwendung statistischer Signalverarbeitungs- und maschineller Lernmethoden hat gezeigt, dass die Einbeziehung der extrahierten Signalmerkmale in realen Szenarien robust ist, insbesondere für das Szenario mit Rehabilitations-Gehübungen in Innenräumen. Die Methodik wurde auch in einer klinischen Studie evaluiert und lieferte eine gute Leistung bei der Überwachung des Rehabilitationsfortschritts verschiedener Patienten. In dieser Arbeit wird ein Prototyp einer mobilen Anwendung zur objektiven Bewertung des Rehabilitationsfortschritts in realen Umgebungen vorgestellt

Recognizing emotions induced by affective sounds through heart rate variability

This paper reports on how emotional states elicited by affective sounds can be effectively recognized by means of estimates of Autonomic Nervous System (ANS) dynamics. Specifically, emotional states are modeled as a combination of arousal and valence dimensions according to the well-known circumplex model of affect, whereas the ANS dynamics is estimated through standard and nonlinear analysis of Heart rate variability (HRV) exclusively, which is derived from the electrocardiogram (ECG). In addition, Lagged Poincaré Plots of the HRV series were also taken into account. The affective sounds were gathered from the International Affective Digitized Sound System and grouped into four different levels of arousal (intensity) and two levels of valence (unpleasant and pleasant). A group of 27 healthy volunteers were administered with these standardized stimuli while ECG signals were continuously recorded. Then, those HRV features showing significant changes (p < 0.05 from statistical tests) between the arousal and valence dimensions were used as input of an automatic classification system for the recognition of the four classes of arousal and two classes of valence. Experimental results demonstrated that a quadratic discriminant classifier, tested through Leave-One-Subject-Out procedure, was able to achieve a recognition accuracy of 84.72 percent on the valence dimension, and 84.26 percent on the arousal dimension

A Proposal for New Evaluation Metrics and Result Visualization Technique for Sentiment Analysis Tasks

Proceedings of: 4th International Conference of the CLEF Initiative (CLEF 2013). 4th International Conference of the CLEF Initiative (CLEF 2013). Valencia, Spain, September 23-26, 2013.In this paper we propound the use of a number of entropybased metrics and a visualization tool for the intrinsic evaluation of Sentiment and Reputation Analysis tasks. We provide a theoretical justification for their use and discuss how they complement other accuracybased metrics. We apply the proposed techniques to the analysis of TASS-SEPLN and RepLab 2012 results and show how the metric is effective for system comparison purposes, for system development and postmortem evaluation.FJVA and JCdA are supported by EU FP7 project LiMoSINe (contract 288024). CPM has been partially supported by the Spanish Government-Comisión Interministerial de Ciencia y Tecnología project TEC2011-26807 for this paper.Publicad

Visualization and categorization of ecological acoustic events based on discriminant features

Although sound classification in soundscape studies are generally performed by experts, the large growth of acoustic data presents a major challenge for performing such task. At the same time, the identification of more discriminating features becomes crucial when analyzing soundscapes, and this occurs because natural and anthropogenic sounds are very complex, particularly in Neotropical regions, where the biodiversity level is very high. In this scenario, the need for research addressing the discriminatory capability of acoustic features is of utmost importance to work towards automating these processes. In this study we present a method to identify the most discriminant features for categorizing sound events in soundscapes. Such identification is key to classification of sound events. Our experimental findings validate our method, showing high discriminatory capability of certain extracted features from sound data, reaching an accuracy of 89.91% for classification of frogs, birds and insects simultaneously. An extension of these experiments to simulate binary classification reached accuracy of 82.64%,100.0% and 99.40% for the classification between combinations of frogs-birds, frogs-insects and birds-insects, respectively

Optimal set of EEG features for emotional state classification and trajectory visualization in Parkinson's disease

In addition to classic motor signs and symptoms, individuals with Parkinson's disease (PD) are characterized by emotional deficits. Ongoing brain activity can be recorded by electroencephalograph (EEG) to discover the links between emotional states and brain activity. This study utilized machine-learning algorithms to categorize emotional states in PD patients compared with healthy controls (HC) using EEG. Twenty non-demented PD patients and 20 healthy age-, gender-, and education level-matched controls viewed happiness, sadness, fear, anger, surprise, and disgust emotional stimuli while fourteen-channel EEG was being recorded. Multimodal stimulus (combination of audio and visual) was used to evoke the emotions. To classify the EEG-based emotional states and visualize the changes of emotional states over time, this paper compares four kinds of EEG features for emotional state classification and proposes an approach to track the trajectory of emotion changes with manifold learning. From the experimental results using our EEG data set, we found that (a) bispectrum feature is superior to other three kinds of features, namely power spectrum, wavelet packet and nonlinear dynamical analysis; (b) higher frequency bands (alpha, beta and gamma) play a more important role in emotion activities than lower frequency bands (delta and theta) in both groups and; (c) the trajectory of emotion changes can be visualized by reducing subject-independent features with manifold learning. This provides a promising way of implementing visualization of patient's emotional state in real time and leads to a practical system for noninvasive assessment of the emotional impairments associated with neurological disorders

In-situ health monitoring for wind turbine blade using acoustic wireless sensor networks at low sampling rates

PhD ThesisThe development of in-situ structural health monitoring (SHM) techniques represents a challenge for offshore wind turbines (OWTs) in order to reduce the cost of the operation and maintenance (O&M) of safety-critical components and systems. This thesis propos- es an in-situ wireless SHM system based on acoustic emission (AE) techniques. The proposed wireless system of AE sensor networks is not without its own challenges amongst which are requirements of high sampling rates, limitations in the communication bandwidth, memory space, and power resources. This work is part of the HEMOW- FP7 Project, ‘The Health Monitoring of Offshore Wind Farms’. The present study investigates solutions relevant to the abovementioned challenges. Two related topics have been considered: to implement a novel in-situ wireless SHM technique for wind turbine blades (WTBs); and to develop an appropriate signal pro- cessing algorithm to detect, localise, and classify different AE events. The major contri- butions of this study can be summarised as follows: 1) investigating the possibility of employing low sampling rates lower than the Nyquist rate in the data acquisition opera- tion and content-based feature (envelope and time-frequency data analysis) for data analysis; 2) proposing techniques to overcome drawbacks associated with lowering sampling rates, such as information loss and low spatial resolution; 3) showing that the time-frequency domain is an effective domain for analysing the aliased signals, and an envelope-based wavelet transform cross-correlation algorithm, developed in the course of this study, can enhance the estimation accuracy of wireless acoustic source localisa- tion; 4) investigating the implementation of a novel in-situ wireless SHM technique with field deployment on the WTB structure, and developing a constraint model and approaches for localisation of AE sources and environmental monitoring respectively. Finally, the system has been experimentally evaluated with the consideration of the lo- calisation and classification of different AE events as well as changes of environmental conditions. The study concludes that the in-situ wireless SHM platform developed in the course of this research represents a promising technique for reliable SHM for OWTBs in which solutions for major challenges, e.g., employing low sampling rates lower than the Nyquist rate in the acquisition operation and resource constraints of WSNs in terms of communication bandwidth and memory space are presente