45 research outputs found

    Evaluating EEG–EMG Fusion-Based Classification as a Method for Improving Control of Wearable Robotic Devices for Upper-Limb Rehabilitation

    Get PDF
    Musculoskeletal disorders are the biggest cause of disability worldwide, and wearable mechatronic rehabilitation devices have been proposed for treatment. However, before widespread adoption, improvements in user control and system adaptability are required. User intention should be detected intuitively, and user-induced changes in system dynamics should be unobtrusively identified and corrected. Developments often focus on model-dependent nonlinear control theory, which is challenging to implement for wearable devices. One alternative is to incorporate bioelectrical signal-based machine learning into the system, allowing for simpler controller designs to be augmented by supplemental brain (electroencephalography/EEG) and muscle (electromyography/EMG) information. To extract user intention better, sensor fusion techniques have been proposed to combine EEG and EMG; however, further development is required to enhance the capabilities of EEG–EMG fusion beyond basic motion classification. To this end, the goals of this thesis were to investigate expanded methods of EEG–EMG fusion and to develop a novel control system based on the incorporation of EEG–EMG fusion classifiers. A dataset of EEG and EMG signals were collected during dynamic elbow flexion–extension motions and used to develop EEG–EMG fusion models to classify task weight, as well as motion intention. A variety of fusion methods were investigated, such as a Weighted Average decision-level fusion (83.01 ± 6.04% accuracy) and Convolutional Neural Network-based input-level fusion (81.57 ± 7.11% accuracy), demonstrating that EEG–EMG fusion can classify more indirect tasks. A novel control system, referred to as a Task Weight Selective Controller (TWSC), was implemented using a Gain Scheduling-based approach, dictated by external load estimations from an EEG–EMG fusion classifier. To improve system stability, classifier prediction debouncing was also proposed to reduce misclassifications through filtering. Performance of the TWSC was evaluated using a developed upper-limb brace simulator. Due to simulator limitations, no significant difference in error was observed between the TWSC and PID control. However, results did demonstrate the feasibility of prediction debouncing, showing it provided smoother device motion. Continued development of the TWSC, and EEG–EMG fusion techniques will ultimately result in wearable devices that are able to adapt to changing loads more effectively, serving to improve the user experience during operation

    Contributions of Human Prefrontal Cortex to the Recogitation of Thought

    Get PDF
    Human beings have a unique ability to not only verbally articulate past and present experiences, as well as potential future ones, but also evaluate the mental representations of such things. Some evaluations do little good, in that they poorly reflect facts, create needless emotional distress, and contribute to the obstruction of personal goals, whereas some evaluations are the converse: They are grounded in logic, empiricism, and pragmatism and, therefore, are functional rather than dysfunctional. The aim of non-pharmacological mental health interventions is to revise dysfunctional thoughts into more adaptive, healthier ones; however, the neurocognitive mechanisms driving cognitive change have hitherto remained unclear. Therefore, this thesis examines the role of the prefrontal cortex (PFC) in this aspect of human higher cognition using the relatively new method of functional near-infrared spectroscopy (fNIRS). Chapter 1 advances recogitation as the mental ability on which cognitive restructuring largely depends, concluding that, as a cognitive task, it is a form of open-ended human problem-solving that uses metacognitive and reasoning faculties. Because these faculties share similar executive resources, Chapter 2 discusses the systems in the brain involved in controlled information processing, specifically the nature of executive functions and their neural bases. Chapter 3 builds on these ideas to propose an information-processing model of recogitation, which predicts the roles of different subsystems localized within the PFC and elsewhere in the context of emotion regulation. This chapter also highlights several theoretical and empirical challenges to investigating this neurocognitive theory and proposes some solutions, such as to use experimental designs that are more ecologically valid. Chapter 4 focuses on a neuroimaging method that is best suited to investigating questions of spatial localization in ecological experiments, namely functional near-infrared spectroscopy (fNIRS). Chapter 5 then demonstrates a novel approach to investigating the neural bases of interpersonal interactions in clinical settings using fNIRS. Chapter 6 explores physical activity as a ‘bottom-up’ approach to upregulating the PFC, in that it might help clinical populations with executive deficits to regulate their mental health from the ‘top-down’. Chapter 7 addresses some of the methodological issues of investigating clinical interactions and physical activity in more naturalistic settings by assessing an approach to recovering functional events from observed brain data. Chapter 8 draws several conclusions about the role of the PFC in improving psychological as well as physiological well-being, particularly that rostral PFC is inextricably involved in the cognitive effort to modulate dysfunctional thoughts, and proposes some important future directions for ecological research in cognitive neuroscience; for example, psychotherapy is perhaps too physically stagnant, so integrating exercise into treatment environments might boost the effectiveness of intervention strategies

    Wearable brain computer interfaces with near infrared spectroscopy

    Full text link
    Brain computer interfaces (BCIs) are devices capable of relaying information directly from the brain to a digital device. BCIs have been proposed for a diverse range of clinical and commercial applications; for example, to allow paralyzed subjects to communicate, or to improve machine human interactions. At their core, BCIs need to predict the current state of the brain from variables measuring functional physiology. Functional near infrared spectroscopy (fNIRS) is a non-invasive optical technology able to measure hemodynamic changes in the brain. Along with electroencephalography (EEG), fNIRS is the only technique that allows non-invasive and portable sensing of brain signals. Portability and wearability are very desirable characteristics for BCIs, as they allow them to be used in contexts beyond the laboratory, extending their usability for clinical and commercial applications, as well as for ecologically valid research. Unfortunately, due to limited access to the brain, non-invasive BCIs tend to suffer from low accuracy in their estimation of the brain state. It has been suggested that feedback could increase BCI accuracy as the brain normally relies on sensory feedback to adjust its strategies. Despite this, presenting relevant and accurate feedback in a timely manner can be challenging when processing fNIRS signals, as they tend to be contaminated by physiological and motion artifacts. In this dissertation, I present the hardware and software solutions we proposed and developed to deal with these challenges. First, I will talk about ninjaNIRS, the wearable open source fNIRS device we developed in our laboratory, which could help fNIRS neuroscience and BCIs to become more accessible. Next, I will present an adaptive filter strategy to recover the neural responses from fNIRS signals in real-time, which could be used for feedback and classification in a BCI paradigm. We showed that our wearable fNIRS device can operate autonomously for up to three hours and can be easily carried in a backpack, while offering noise equivalent power comparable to commercial devices. Our adaptive multimodal Kalman filter strategy provided a six-fold increase in contrast to noise ratio of the brain signals compared to standard filtering while being able to process at least 24 channels at 400 samples per second using a standard computer. This filtering strategy, along with visual feedback during a left vs right motion imagery task, showed a relative increase of accuracy of 37.5% compared to not using feedback. With this, we show that it is possible to present relevant feedback for fNIRS BCI in real-time. The findings on this dissertation might help improve the design of future fNIRS BCIs, and thus increase the usability and reliability of this technology

    Fear Classification using Affective Computing with Physiological Information and Smart-Wearables

    Get PDF
    Mención Internacional en el título de doctorAmong the 17 Sustainable Development Goals proposed within the 2030 Agenda and adopted by all of the United Nations member states, the fifth SDG is a call for action to effectively turn gender equality into a fundamental human right and an essential foundation for a better world. It includes the eradication of all types of violence against women. Focusing on the technological perspective, the range of available solutions intended to prevent this social problem is very limited. Moreover, most of the solutions are based on a panic button approach, leaving aside the usage and integration of current state-of-the-art technologies, such as the Internet of Things (IoT), affective computing, cyber-physical systems, and smart-sensors. Thus, the main purpose of this research is to provide new insight into the design and development of tools to prevent and combat Gender-based Violence risky situations and, even, aggressions, from a technological perspective, but without leaving aside the different sociological considerations directly related to the problem. To achieve such an objective, we rely on the application of affective computing from a realist point of view, i.e. targeting the generation of systems and tools capable of being implemented and used nowadays or within an achievable time-frame. This pragmatic vision is channelled through: 1) an exhaustive study of the existing technological tools and mechanisms oriented to the fight Gender-based Violence, 2) the proposal of a new smart-wearable system intended to deal with some of the current technological encountered limitations, 3) a novel fear-related emotion classification approach to disentangle the relation between emotions and physiology, and 4) the definition and release of a new multi-modal dataset for emotion recognition in women. Firstly, different fear classification systems using a reduced set of physiological signals are explored and designed. This is done by employing open datasets together with the combination of time, frequency and non-linear domain techniques. This design process is encompassed by trade-offs between both physiological considerations and embedded capabilities. The latter is of paramount importance due to the edge-computing focus of this research. Two results are highlighted in this first task, the designed fear classification system that employed the DEAP dataset data and achieved an AUC of 81.60% and a Gmean of 81.55% on average for a subjectindependent approach, and only two physiological signals; and the designed fear classification system that employed the MAHNOB dataset data achieving an AUC of 86.00% and a Gmean of 73.78% on average for a subject-independent approach, only three physiological signals, and a Leave-One-Subject-Out configuration. A detailed comparison with other emotion recognition systems proposed in the literature is presented, which proves that the obtained metrics are in line with the state-ofthe- art. Secondly, Bindi is presented. This is an end-to-end autonomous multimodal system leveraging affective IoT throughout auditory and physiological commercial off-theshelf smart-sensors, hierarchical multisensorial fusion, and secured server architecture to combat Gender-based Violence by automatically detecting risky situations based on a multimodal intelligence engine and then triggering a protection protocol. Specifically, this research is focused onto the hardware and software design of one of the two edge-computing devices within Bindi. This is a bracelet integrating three physiological sensors, actuators, power monitoring integrated chips, and a System- On-Chip with wireless capabilities. Within this context, different embedded design space explorations are presented: embedded filtering evaluation, online physiological signal quality assessment, feature extraction, and power consumption analysis. The reported results in all these processes are successfully validated and, for some of them, even compared against physiological standard measurement equipment. Amongst the different obtained results regarding the embedded design and implementation within the bracelet of Bindi, it should be highlighted that its low power consumption provides a battery life to be approximately 40 hours when using a 500 mAh battery. Finally, the particularities of our use case and the scarcity of open multimodal datasets dealing with emotional immersive technology, labelling methodology considering the gender perspective, balanced stimuli distribution regarding the target emotions, and recovery processes based on the physiological signals of the volunteers to quantify and isolate the emotional activation between stimuli, led us to the definition and elaboration of Women and Emotion Multi-modal Affective Computing (WEMAC) dataset. This is a multimodal dataset in which 104 women who never experienced Gender-based Violence that performed different emotion-related stimuli visualisations in a laboratory environment. The previous fear binary classification systems were improved and applied to this novel multimodal dataset. For instance, the proposed multimodal fear recognition system using this dataset reports up to 60.20% and 67.59% for ACC and F1-score, respectively. These values represent a competitive result in comparison with the state-of-the-art that deal with similar multi-modal use cases. In general, this PhD thesis has opened a new research line within the research group under which it has been developed. Moreover, this work has established a solid base from which to expand knowledge and continue research targeting the generation of both mechanisms to help vulnerable groups and socially oriented technology.Programa de Doctorado en Ingeniería Eléctrica, Electrónica y Automåtica por la Universidad Carlos III de MadridPresidente: David Atienza Alonso.- Secretaria: Susana Patón Álvarez.- Vocal: Eduardo de la Torre Arnan

    Recent Advances and Future Trends in Nanophotonics

    Get PDF
    Nanophotonics has emerged as a multidisciplinary frontier of science and engineering. Due to its high potential to contribute to breakthroughs in many areas of technology, nanophotonics is capturing the interest of many researchers from different fields. This Special Issue of Applied Sciences on “Recent advances and future trends in nanophotonics” aims to give an overview on the latest developments in nanophotonics and its roles in different application domains. Topics of discussion include, but are not limited to, the exploration of new directions of nanophotonic science and technology that enable technological breakthroughs in high-impact areas mainly regarding diffraction elements, detection, imaging, spectroscopy, optical communications, and computing

    Brain Computer Interfaces and Emotional Involvement: Theory, Research, and Applications

    Get PDF
    This reprint is dedicated to the study of brain activity related to emotional and attentional involvement as measured by Brain–computer interface (BCI) systems designed for different purposes. A BCI system can translate brain signals (e.g., electric or hemodynamic brain activity indicators) into a command to execute an action in the BCI application (e.g., a wheelchair, the cursor on the screen, a spelling device or a game). These tools have the advantage of having real-time access to the ongoing brain activity of the individual, which can provide insight into the user’s emotional and attentional states by training a classification algorithm to recognize mental states. The success of BCI systems in contemporary neuroscientific research relies on the fact that they allow one to “think outside the lab”. The integration of technological solutions, artificial intelligence and cognitive science allowed and will allow researchers to envision more and more applications for the future. The clinical and everyday uses are described with the aim to invite readers to open their minds to imagine potential further developments

    Revealing Distinct Neural Signatures in Magnetoencephalography with Hidden Markov Models

    Get PDF
    Magnetoencephalography (MEG) is a functional neuroimaging method which measures the magnetic fields produced by neural communication in the brain. Specifically, the fields induced by dendritic current flow in assemblies of pyramidal neurons. Because these magnetic fields are generated directly by brain electrophysiology, and are mostly unperturbed by the skull, MEG data are rich in spatial and temporal information. This thesis is chiefly concerned with interpreting these data in a way that produces useful results whilst minimising bias. Hidden Markov modelling (HMM) is a robust statistical method which has been applied to fields as diverse as speech recognition and financial market prediction. It parses data into a number of ‘hidden states’, each with their own unique characteristics, in an unsupervised way. Because it is data-driven, it can create a model unique to each participant’s brain activity and specific to each task. In addition, the HMM framework itself is flexible so it can be applied to both sensor and source-space data and can be applied to multiple channels (multivariate) or to a single time course (univariate). Choice of an observation model allows states to be characterised by amplitude, spatial, or spectral content depending on the research question. The aim of this thesis is to apply hidden Markov modelling (HMM) to whole head MEG data to identify repeated patterns of transient neural activity occurring throughout the brain. Once these patterns were identified, the interaction between these short ‘bursts’ of activity across the cortex was established which provided a unique measure of functional connectivity. Three studies were undertaken: The role of transient spectral bursts in MEG functional connectivity: In recent years, the smoothly varying neural oscillations often studied in MEG (such as those trial-averaged responses in the traditional neurophysiological (such as alpha/beta) frequency bands) have been shown to be made up of single-trial high-amplitude ‘bursts’ of activity. These bursts can be observed in the beta frequency band and are therefore often referred to as beta bursts. In this study, a novel time-delay embedded HMM was used to identif bursts in broadband data based on their spectral content for MEG data from 66 healthy adult participants. The burst amplitude, duration and frequency of occurrence were characterised across the cortex in resting state data, and in a motor task the classic movement-related beta desynchronisation and post movement beta rebound were shown to be made up of changes in burst occurrence. A novel functional connectivity metric was then introduced based on the coincidence of bursts from distal brain regions, allowing the known beta band functional connectome to be reproduced. Bursts coincident across spatially separate brain regions were also shown to correspond to periods of heightened coherence, lending evidence to the communication by coherence (Fries 2005, 2015) hypothesis. Post-stimulus responses across the cortex: During a motor task, both primary (during stimulation) and post stimulus responses (PSR) can be observed. These are well characterised in the literature, but little is known about their functional significance. The PSR in particular is modified in a range of seemingly unrelated neurological conditions with variable symptoms, such as schizophrenia (Robson et al. 2016), autism spectrum disorder (Gaetz et al. 2020) and multiple sclerosis (Barratt et al. 2017), indicating that the PSR is a fundamental neurophysiological process, the disturbance of which has implications on both healthy and pathological brain function. This work therefore tested the hypothesis that the PSR is present across the cortex. MEG data were acquired and analysed from two experiments with 15 healthy adult volunteers each – the first was a right-hand grip task with visual feedback, the second involved passive left visual field stimulation. Both experiments varied stimulus duration (2s, 5s and 10s) with a 30s rest-period between trials to allow characterisation of the full PSR. A univariate 3-state time-delay-embedded hidden Markov model (HMM) was used to characterise the spatial distributions of the primary and PSR across the cortex for both tasks. Results showed that for both tasks, the primary response state was more bilateral over the sensorimotor or visual areas (depending on task) where the PSR state was more unilateral and confined to the contralateral sensorimotor or visual areas (again, dependant on task). A state coincidence metric was then used to investigate the integration of the primary and PSR states across brain regions as a measure of task-related functional connectivity. Hidden Markov modelling of the interictal brain: Epilepsy is a highly heterogeneous disease with variations in the temporal morphology and localisation of epileptiform activity across patients. Unsupervised machine learning techniques like the HMM allow us to take into account this variability and ensure that every model is tailored to each individual. In this work, a multivariate time-delay embedded HMM was used to identify brain states based on their spatial and spectral properties in sensor-level MEG data acquired as part of standard clinical care for patients at the Children’s Hospital of Philadelphia. State allocations were used together with a linearly constrained minimum variance (LCMV) beamformer to produce a 3D map of state variance, hence localising probable epileptogenic foci. Clinical MEG epilepsy data are routinely analysed by excess kurtosis mapping (EKM) and so the performance of the HMM was assessed against this for three patient groups, each with increasingly complex epilepsy manifestation (10 patients in total). The difference in localization of epileptogenic foci for the two methods was 7 ± 2mm (mean ± SD over all 10 patients); and 94 ± 13% of EKM temporal markers were matched by an HMM state visit. It is therefore clear that this method localizes epileptogenic areas in agreement with EKM and in patients with more than one focus the HMM provides additional information about the relationship between them

    The Impact of Digital Technologies on Public Health in Developed and Developing Countries

    Get PDF
    This open access book constitutes the refereed proceedings of the 18th International Conference on String Processing and Information Retrieval, ICOST 2020, held in Hammamet, Tunisia, in June 2020.* The 17 full papers and 23 short papers presented in this volume were carefully reviewed and selected from 49 submissions. They cover topics such as: IoT and AI solutions for e-health; biomedical and health informatics; behavior and activity monitoring; behavior and activity monitoring; and wellbeing technology. *This conference was held virtually due to the COVID-19 pandemic

    Mobile Ad-Hoc Networks

    Get PDF
    Being infrastructure-less and without central administration control, wireless ad-hoc networking is playing a more and more important role in extending the coverage of traditional wireless infrastructure (cellular networks, wireless LAN, etc). This book includes state-of the-art techniques and solutions for wireless ad-hoc networks. It focuses on the following topics in ad-hoc networks: vehicular ad-hoc networks, security and caching, TCP in ad-hoc networks and emerging applications. It is targeted to provide network engineers and researchers with design guidelines for large scale wireless ad hoc networks
    corecore