Models and Analysis of Vocal Emissions for Biomedical Applications

The MAVEBA Workshop proceedings, held on a biannual basis, collect the scientific papers presented both as oral and poster contributions, during the conference. The main subjects are: development of theoretical and mechanical models as an aid to the study of main phonatory dysfunctions, as well as the biomedical engineering methods for the analysis of voice signals and images, as a support to clinical diagnosis and classification of vocal pathologies

Multi-Sensory Deep Learning Architectures for Slam Dunk Scene Classification

Basketball teams at all levels of the game invest a considerable amount of time and effort into collecting, segmenting, and analysing footage from their upcoming opponents previous games. This analysis helps teams identify and exploit the potential weaknesses of their opponents and is commonly cited as one of the key elements required to achieve success in the modern game. The growing importance of this type of analysis has prompted research into the application of computer vision and audio classification techniques to help teams classify scoring sequences and key events using game footage. However, this research tends to focus on classifying scenes based on information from a single sensory source (visual or audio), and fails to analyse the wealth of multi-sensory information available within the footage. This dissertation aims to demonstrate that by analysing the full range of audio and visual features contained in broadcast game footage through a multi-sensory deep learning architecture one can create a more effective key scene classification system when compared to a single sense model. Additionally, this dissertation explores the performance impact of training the audio component of a multi-sensory architecture using different representations of the audio features

Automatic Classification of Autistic Child Vocalisations: A Novel Database and Results

Humanoid robots have in recent years shown great promise for supporting the educational needs of children on the autism spectrum. To further improve the efficacy of such interactions, user-adaptation strategies based on the individual needs of a child are required. In this regard, the proposed study assesses the suitability of a range of speech-based classification approaches for automatic detection of autism severity according to the com- monly used Social Responsiveness Scale ™ second edition (SRS- 2). Autism is characterised by socialisation limitations including child language and communication ability. When compared to neurotypical children of the same age these can be a strong indi- cation of severity. This study introduces a novel dataset of 803 utterances recorded from 14 autistic children aged between 4 – 10 years, during Wizard-of-Oz interactions with a humanoid robot. Our results demonstrate the suitability of support vector machines (SVMs) which use acoustic feature sets from multiple Interspeech C OM P AR E challenges. We also evaluate deep spec- trum features, extracted via an image classification convolutional neural network (CNN) from the spectrogram of autistic speech instances. At best, by using SVMs on the acoustic feature sets, we achieved a UAR of 73.7 % for the proposed 3-class task

The 2nd International Electronic Conference on Applied Sciences

This book is focused on the works presented at the 2nd International Electronic Conference on Applied Sciences, organized by Applied Sciences from 15 to 31 October 2021 on the MDPI Sciforum platform. Two decades have passed since the start of the 21st century. The development of sciences and technologies is growing ever faster today than in the previous century. The field of science is expanding, and the structure of science is becoming ever richer. Because of this expansion and fine structure growth, researchers may lose themselves in the deep forest of the ever-increasing frontiers and sub-fields being created. This international conference on the Applied Sciences was started to help scientists conduct their own research into the growth of these frontiers by breaking down barriers and connecting the many sub-fields to cut through this vast forest. These functions will allow researchers to see these frontiers and their surrounding (or quite distant) fields and sub-fields, and give them the opportunity to incubate and develop their knowledge even further with the aid of this multi-dimensional network

Slough: Revealing the Animal

When making my work I constantly reflect on past mythologies, images, and objects. These served people as a way to make sense of and understand the dynamics of the world around them. As we continue to alter and shape the world into one designed for exclusively human benefit, we need new models that reveal the dynamics of our relationship to the world around us. This is what artists have been doing for centuries, and I specifically look to those using animals and animal imagery in their work to further mythologize our contemporary understanding of the human-other animal relationship. My body of work utilizes methods of drawing, printmaking, sculpture, and video to create contemporary icons, objects, and rituals. Icons are re-appropriated, objects are redefined, and rituals are reinterpreted in my work in a way that becomes relevant again for a contemporary audience. Animal imagery is used in a way that explores current trends in genetics, industry, consumerism, and power to reveal this contemporary mythology. These are certainly informed by the prehistoric understanding of this relationship as it is in jarring contrast to our notions today. This juxtaposition serves to illuminate how this relationship has been distorted in this historically recent time while aiming to enlighten us to the power of the other, the thing-ness or vitality of the animal and re-calibrate contemporary notions in order to achieve reconciliation with a natural order of things

Diagnosis of the sleep apnea-hypopnea syndrome : a comprehensive approach through an intelligent system to support medical decision

[Abstract] This doctoral thesis carries out the development of an intelligent system to support medical decision in the diagnosis of the Sleep Apnea-Hypopnea Syndrome (SAHS). SAHS is the most common disorder within those affecting sleep. The estimates of the disease prevalence range from 3% to 7%. Diagnosis of SAHS requires of a polysomnographic test (PSG) to be done in the Sleep Unit of a medical center. Manual scoring of the resulting recording entails too much effort and time to the medical specialists and as a consequence it implies a high economic cost. In the developed system, automatic analysis of the PSG is accomplished which follows a comprehensive perspective. Firstly an analysis of the neurophysiological signals related to the sleep function is carried out in order to obtain the hypnogram. Then, an analysis is performed over the respiratory signals which have to be subsequently interpreted in the context of the remaining signals included in the PSG. In order to carry out such a task, the developed system is supported by the use of artificial intelligence techniques, specially focusing on the use of reasoning mechanisms capable of handling data imprecision. Ultimately, it is the aim of the proposed system to improve the diagnostic procedure and help physicians in the diagnosis of SAHS.[Resumen] Esta tesis aborda el desarrollo de un sistema inteligente de apoyo a la decisión clínica para el diagnóstico del Síndrome de Apneas-Hipopneas del Sueño (SAHS). El SAHS es el trastorno más común de aquellos que afectan al sueño. Afecta a un rango del 3% al 7% de la población con consecuencias severas sobre la salud. El diagnóstico requiere la realización de un análisis polisomnográfico (PSG) en una Unidad del Sueño de un centro hospitalario. El análisis manual de dicha prueba resulta muy costoso en tiempo y esfuerzo para el médico especialista, y como consecuencia en un elevado coste económico. El sistema desarrollado lleva a cabo el análisis automático del PSG desde una perspectiva integral. A tal efecto, primero se realiza un análisis de las señales neurofisiológicas vinculadas al sueño para obtener el hipnograma, y seguidamente, se lleva a cabo un análisis neumológico de las señales respiratorias interpretándolas en el contexto que marcan las demás señales del PSG. Para lleva a cabo dicha tarea el sistema se apoya en el uso de distintas técnicas de inteligencia artificial, con especial atención al uso mecanismos de razonamiento con soporte a la imprecisión. El principal objetivo del sistema propuesto es la mejora del procedimiento diagnóstico y ayudar a los médicos en diagnóstico del SAHS.[Resumo] Esta tese aborda o desenvolvemento dun sistema intelixente de apoio á decisión clínica para o diagnóstico do Síndrome de Apneas-Hipopneas do Sono (SAHS). O SAHS é o trastorno máis común daqueles que afectan ao sono. Afecta a un rango do 3% ao 7% da poboación con consecuencias severas sobre a saúde. O diagnóstico pasa pola realización dunha análise polisomnográfica (PSG) nunha Unidade do Sono dun centro hospitalario. A análise manual da devandita proba resulta moi custosa en tempo e esforzo para o médico especialista, e como consecuencia nun elevado custo económico. O sistema desenvolvido leva a cabo a análise automática do PSG dende unha perspectiva integral. A tal efecto, primeiro realizase unha análise dos sinais neurofisiolóxicos vinculados ao sono para obter o hipnograma, e seguidamente, lévase a cabo unha análise neumolóxica dos sinais respiratorios interpretándoos no contexto que marcan os demais sinais do PSG. Para leva a cabo esta tarefa o sistema apoiarase no uso de distintas técnicas de intelixencia artificial, con especial atención a mecanismos de razoamento con soporte para a imprecisión. O principal obxectivo do sistema proposto é a mellora do procedemento diagnóstico e axudar aos médicos no diagnóstico do SAHS

Representing meaning: a feature-based model of object and action words

The representation of word meaning has received substantial attention in the psycholinguistic literature over the past decades, yet the vast majority of studies have been limited to words referring to concrete objects. The aim of the present work is to provide a theoretically and neurally plausible model of lexical-semantic representations, not only for words referring to concrete objects but also for words referring to actions and events using a common set of assumptions across domains. In order to do so, features of meaning are generated by naïve speakers, and used as a window into important aspects of representation. A first series of analyses test how the meanings of words of different types are reflected in features associated with different modalities of sensory-motor experience, and how featural properties may be related to patterns of impairment in language-disordered populations. The features of meaning are then used to generate a model of lexical-semantic similarity, in which these different types of words are represented within a single system, under the assumption that lexical-semantic representations serve to provide an interface between conceptual knowledge derived in part from sensory-motor experience, and other linguistic information such as syntax, phonology and orthography. Predictions generated from this model are tested in a series of behavioural experiments designed to test two main questions: whether similarity measures based on speaker- generated features can predict fine-grained semantic similarity effects, and whether the predictive quality of the model is comparable for words referring to objects and words referring to actions. The results of five behavioural experiments consistently reveal graded semantic effects as predicted by the feature-based model, of similar magnitude for objects and actions. The model's fine-grained predictive performance is also found to be superior to other word-based models of representation (Latent Semantic Analysis, and similarity measures derived from Wordnet)

Tabletop Tangible Interfaces for Music Performance: Design and Evaluation

This thesis investigates a new generation of collaborative systems: tabletop tangible interfaces (TTIs) for music performance or musical tabletops. Musical tabletops are designed for professional musical performance, as well as for casual interaction in public settings. These systems support co-located collaboration, offered by a shared interface. However, we still know little about their challenges and opportunities for collaborative musical practice: in particular, how to best support beginners or experts or both. This thesis explores the nature of collaboration on TTIs for music performance between beginners, experts, or both. Empirical work was done in two stages: 1) an exploratory stage; and 2) an experimental stage. In the exploratory stage we studied the Reactable, a commercial musical tabletop designed for beginners and experts. In particular, we explored its use in two environments: a multi-session study with expert musicians in a casual lab setting; and a field study with casual visitors in a science centre. In the experimental stage we conducted a controlled experiment for mixed groups using a bespoke musical tabletop interface, SoundXY4. The design of this study was informed by the previous stage about a need to support better real-time awareness of the group activity (workspace awareness) in early interactions. For the three studies, groups musical improvisation was video-captured unobtrusively with the aim of understanding natural uses during group musical practice. Rich video data was carefully analysed focusing on the nature of social interaction and how workspace awareness was manifested. The findings suggest that musical tabletops can support peer learning during multiple sessions; fluid between-group social interaction in public settings; and a democratic and ecological approach to music performance. The findings also point to how workspace awareness can be enhanced in early interactions with TTIs using auditory feedback with ambisonics spatialisation. The thesis concludes with theoretical, methodological, and practical implications for future research in New Interfaces for Musical Expression (NIME), tabletop studies, and Human-Computer Interaction (HCI)