179 research outputs found

    Multimodal assessment of emotional responses by physiological monitoring: novel auditory and visual elicitation strategies in traditional and virtual reality environments

    Get PDF
    This doctoral thesis explores novel strategies to quantify emotions and listening effort through monitoring of physiological signals. Emotions are a complex aspect of the human experience, playing a crucial role in our survival and adaptation to the environment. The study of emotions fosters important applications, such as Human-Computer and Human-Robot interaction or clinical assessment and treatment of mental health conditions such as depression, anxiety, stress, chronic anger, and mood disorders. Listening effort is also an important area of study, as it provides insight into the listeners’ challenges that are usually not identified by traditional audiometric measures. The research is divided into three lines of work, each with a unique emphasis on the methods of emotion elicitation and the stimuli that are most effective in producing emotional responses, with a specific focus on auditory stimuli. The research fostered the creation of three experimental protocols, as well as the use of an available online protocol for studying emotional responses including monitoring of both peripheral and central physiological signals, such as skin conductance, respiration, pupil dilation, electrocardiogram, blood volume pulse, and electroencephalography. An emotional protocol was created for the study of listening effort using a speech-in-noise test designed to be short and not induce fatigue. The results revealed that the listening effort is a complex problem that cannot be studied with a univariate approach, thus necessitating the use of multiple physiological markers to study different physiological dimensions. Specifically, the findings demonstrate a strong association between the level of auditory exertion, the amount of attention and involvement directed towards stimuli that are readily comprehensible compared to those that demand greater exertion. Continuing with the auditory domain, peripheral physiological signals were studied in order to discriminate four emotions elicited in a subject who listened to music for 21 days, using a previously designed and publicly available protocol. Surprisingly, the processed physiological signals were able to clearly separate the four emotions at the physiological level, demonstrating that music, which is not typically studied extensively in the literature, can be an effective stimulus for eliciting emotions. Following these results, a flat-screen protocol was created to compare physiological responses to purely visual, purely auditory, and combined audiovisual emotional stimuli. The results show that auditory stimuli are more effective in separating emotions at the physiological level. The subjects were found to be much more attentive during the audio-only phase. In order to overcome the limitations of emotional protocols carried out in a laboratory environment, which may elicit fewer emotions due to being an unnatural setting for the subjects under study, a final emotional elicitation protocol was created using virtual reality. Scenes similar to reality were created to elicit four distinct emotions. At the physiological level, it was noted that this environment is more effective in eliciting emotions. To our knowledge, this is the first protocol specifically designed for virtual reality that elicits diverse emotions. Furthermore, even in terms of classification, the use of virtual reality has been shown to be superior to traditional flat-screen protocols, opening the doors to virtual reality for the study of conditions related to emotional control

    Functional network correlates of language and semiology in epilepsy

    Get PDF
    Epilepsy surgery is appropriate for 2-3% of all epilepsy diagnoses. The goal of the presurgical workup is to delineate the seizure network and to identify the risks associated with surgery. While interpretation of functional MRI and results in EEG-fMRI studies have largely focused on anatomical parameters, the focus of this thesis was to investigate canonical intrinsic connectivity networks in language function and seizure semiology. Epilepsy surgery aims to remove brain areas that generate seizures. Language dysfunction is frequently observed after anterior temporal lobe resection (ATLR), and the presurgical workup seeks to identify the risks associated with surgical outcome. The principal aim of experimental studies was to elaborate understanding of language function as expressed in the recruitment of relevant connectivity networks and to evaluate whether it has value in the prediction of language decline after anterior temporal lobe resection. Using cognitive fMRI, we assessed brain areas defined by parameters of anatomy and canonical intrinsic connectivity networks (ICN) that are involved in language function, specifically word retrieval as expressed in naming and fluency. fMRI data was quantified by lateralisation indices and by ICN_atlas metrics in a priori defined ICN and anatomical regions of interest. Reliability of language ICN recruitment was studied in 59 patients and 30 healthy controls who were included in our language experiments. New and established language fMRI paradigms were employed on a three Tesla scanner, while intellectual ability, language performance and emotional status were established for all subjects with standard psychometric assessment. Patients who had surgery were reinvestigated at an early postoperative stage of four months after anterior temporal lobe resection. A major part of the work sought to elucidate the association between fMRI patterns and disease characteristics including features of anxiety and depression, and prediction of postoperative language outcome. We studied the efficiency of reorganisation of language function associated with disease features prior to and following surgery. A further aim of experimental work was to use EEG-fMRI data to investigate the relationship between canonical intrinsic connectivity networks and seizure semiology, potentially providing an avenue for characterising the seizure network in the presurgical workup. The association of clinical signs with the EEG-fMRI informed activation patterns were studied using the data from eighteen patients’ whose seizures and simultaneous EEG-fMRI activations were reported in a previous study. The accuracy of ICN_atlas was validated and the ICN construct upheld in the language maps of TLE patients. The ICN construct was not evident in ictal fMRI maps and simulated ICN_atlas data. Intrinsic connectivity network recruitment was stable between sessions in controls. Amodal linguistic processing and the relevance of temporal intrinsic connectivity networks for naming and that of frontal intrinsic connectivity networks for word retrieval in the context of fluency was evident in intrinsic connectivity networks regions. The relevance of intrinsic connectivity networks in the study of language was further reiterated by significant association between some disease features and language performance, and disease features and activation in intrinsic connectivity networks. However, the anterior temporal lobe (ATL) showed significantly greater activation compared to intrinsic connectivity networks – a result which indicated that ATL functional language networks are better studied in the context of the anatomically demarked ATL, rather than its functionally connected intrinsic connectivity networks. Activation in temporal lobe networks served as a predictor for naming and fluency impairment after ATLR and an increasing likelihood of significant decline with greater magnitude of left lateralisation. Impairment of awareness served as a significant classifying feature of clinical expression and was significantly associated with the inhibition of normal brain functions. Canonical intrinsic connectivity networks including the default mode network were recruited along an anterior-posterior anatomical axis and were not significantly associated with clinical signs

    Transcranial Magnetic Resonance-Guided Focused Ultrasound (tcMRgFUS): An Investigation of the Key Factors to Enhance Treatment Outcomes for Patients with Tremor

    Get PDF
    Transcranial magnetic resonance guided focused ultrasound (tcMRgFUS) is a minimally invasive surgical procedure for the treatment of tremor in movement disorders such as essential tremor (ET), dystonic tremor (DT) and tremor dominant Parkinson’s Disease. This PhD thesis investigates the patient-specific and treatment related factors that influence tremor improvement following treatment with MRgFUS. Patient-specific factors such as the disease type, and properties of the skull were analysed to investigate the relationship with clinical outcomes. Treatment factors such as the MRgFUS lesion location was also investigated with advanced neuroimaging techniques such as diffusion tensor imaging (DTI). The comprehensive study of these factors offers the potential to enhance patient outcomes via improved patient screening and treatment strategy

    State of the Art of Audio- and Video-Based Solutions for AAL

    Get PDF
    It is a matter of fact that Europe is facing more and more crucial challenges regarding health and social care due to the demographic change and the current economic context. The recent COVID-19 pandemic has stressed this situation even further, thus highlighting the need for taking action. Active and Assisted Living technologies come as a viable approach to help facing these challenges, thanks to the high potential they have in enabling remote care and support. Broadly speaking, AAL can be referred to as the use of innovative and advanced Information and Communication Technologies to create supportive, inclusive and empowering applications and environments that enable older, impaired or frail people to live independently and stay active longer in society. AAL capitalizes on the growing pervasiveness and effectiveness of sensing and computing facilities to supply the persons in need with smart assistance, by responding to their necessities of autonomy, independence, comfort, security and safety. The application scenarios addressed by AAL are complex, due to the inherent heterogeneity of the end-user population, their living arrangements, and their physical conditions or impairment. Despite aiming at diverse goals, AAL systems should share some common characteristics. They are designed to provide support in daily life in an invisible, unobtrusive and user-friendly manner. Moreover, they are conceived to be intelligent, to be able to learn and adapt to the requirements and requests of the assisted people, and to synchronise with their specific needs. Nevertheless, to ensure the uptake of AAL in society, potential users must be willing to use AAL applications and to integrate them in their daily environments and lives. In this respect, video- and audio-based AAL applications have several advantages, in terms of unobtrusiveness and information richness. Indeed, cameras and microphones are far less obtrusive with respect to the hindrance other wearable sensors may cause to one’s activities. In addition, a single camera placed in a room can record most of the activities performed in the room, thus replacing many other non-visual sensors. Currently, video-based applications are effective in recognising and monitoring the activities, the movements, and the overall conditions of the assisted individuals as well as to assess their vital parameters. Similarly, audio sensors have the potential to become one of the most important modalities for interaction with AAL systems, as they can have a large range of sensing, do not require physical presence at a particular location and are physically intangible. Moreover, relevant information about individuals’ activities and health status can derive from processing audio signals. Nevertheless, as the other side of the coin, cameras and microphones are often perceived as the most intrusive technologies from the viewpoint of the privacy of the monitored individuals. This is due to the richness of the information these technologies convey and the intimate setting where they may be deployed. Solutions able to ensure privacy preservation by context and by design, as well as to ensure high legal and ethical standards are in high demand. After the review of the current state of play and the discussion in GoodBrother, we may claim that the first solutions in this direction are starting to appear in the literature. A multidisciplinary debate among experts and stakeholders is paving the way towards AAL ensuring ergonomics, usability, acceptance and privacy preservation. The DIANA, PAAL, and VisuAAL projects are examples of this fresh approach. This report provides the reader with a review of the most recent advances in audio- and video-based monitoring technologies for AAL. It has been drafted as a collective effort of WG3 to supply an introduction to AAL, its evolution over time and its main functional and technological underpinnings. In this respect, the report contributes to the field with the outline of a new generation of ethical-aware AAL technologies and a proposal for a novel comprehensive taxonomy of AAL systems and applications. Moreover, the report allows non-technical readers to gather an overview of the main components of an AAL system and how these function and interact with the end-users. The report illustrates the state of the art of the most successful AAL applications and functions based on audio and video data, namely lifelogging and self-monitoring, remote monitoring of vital signs, emotional state recognition, food intake monitoring, activity and behaviour recognition, activity and personal assistance, gesture recognition, fall detection and prevention, mobility assessment and frailty recognition, and cognitive and motor rehabilitation. For these application scenarios, the report illustrates the state of play in terms of scientific advances, available products and research project. The open challenges are also highlighted. The report ends with an overview of the challenges, the hindrances and the opportunities posed by the uptake in real world settings of AAL technologies. In this respect, the report illustrates the current procedural and technological approaches to cope with acceptability, usability and trust in the AAL technology, by surveying strategies and approaches to co-design, to privacy preservation in video and audio data, to transparency and explainability in data processing, and to data transmission and communication. User acceptance and ethical considerations are also debated. Finally, the potentials coming from the silver economy are overviewed

    Variety, flexibility, and use of abstract concepts. A multiple grounded perspective.

    Get PDF
    The nature of concepts is a matter of intense debate in cognitive sciences. While traditional views claim that conceptual knowledge is represented in a unitary symbolic system, recent Embodied and Grounded Cognition theories (EGC) submit the idea that conceptual system is couched in our body and influenced by the environment (Barsalou, 2008). One of the major challenges for EGC is constituted by abstract concepts (ACs), like fantasy. Recently, some EGC proposals addressed this criticism, arguing that the ACs comprise multifaced exemplars that rely on different grounding sources beyond sensorimotor one, including interoception, emotions, language, and sociality (Borghi et al., 2018). However, little is known about how ACs representation varies as a function of life experiences and their use in communication. The theoretical arguments and empirical studies comprised in this dissertation aim to provide evidence on multiple grounding of ACs taking into account their varieties and flexibility. Study I analyzed multiple ratings on a large sample of ACs and identified four distinct subclusters. Study II validated this classification with an interference paradigm involving motor/manual, interoceptive, and linguistic systems during a difficulty rating task. Results confirm that different grounding sources are activated depending on ACs kind. Study III-IV investigate the variability of institutional concepts, showing that the higher the law expertise level, the stronger the concrete/emotional determinants in their representation. Study V introduced a novel interactive task in which abstract and concrete sentences serve as cues to simulate conversation. Analysis of language production revealed that the uncertainty and interactive exchanges increase with abstractness, leading to generating more questions/requests for clarifications with abstract than concrete sentences. Overall, results confirm that ACs are multidimensional, heterogeneous, and flexible constructs and that social and linguistic interactions are crucial to shaping their meanings. Investigating ACs in real-time dialogues may be a promising direction for future research

    The Retina in Health and Disease

    Get PDF
    Vision is the most important sense in higher mammals. The retina is the first step in visual processing and the window to the brain. It is not surprising that problems arising in the retina lead to moderate to severe visual impairments. We offer here a collection of reviews as well as original papers dealing with various aspects of retinal function as well as dysfunction. New approaches in retinal research are described, such as the expression and localization of the endocannabinoid system in the normal retina and the role of cannabinoid receptors that could offer new avenues of research in the development of potential treatments for retinal diseases. Moreover, new insights are offered in advancing knowledge towards the prevention and cure of visual pathologies, mainly AMD, RP, and diabetic retinopathy

    Symmetry in Human Evolution, from Biology to Behaviours

    Get PDF
    Our knowledge of human evolution has made particular progress recently, due to the discovery of new fossils, the use of new methods and multidisciplinary approaches. Moreover, studies on the departure from symmetry, including variations in fluctuating or directional asymmetries, have contributed to the expansion of this knowledge. This Special Issue brings together articles that deal with symmetry and human evolution. The notion of symmetry is addressed, including whether to reconstruct deformed fossil specimens, study biological variations within hominins or compare them with extant primates, address the shape of the brain or seek possible relationships between biological and behavioural data
    • …
    corecore