Brain-Switches for Asynchronous Brain−Computer Interfaces: A Systematic Review

A brain–computer interface (BCI) has been extensively studied to develop a novel communication system for disabled people using their brain activities. An asynchronous BCI system is more realistic and practical than a synchronous BCI system, in that, BCI commands can be generated whenever the user wants. However, the relatively low performance of an asynchronous BCI system is problematic because redundant BCI commands are required to correct false-positive operations. To significantly reduce the number of false-positive operations of an asynchronous BCI system, a two-step approach has been proposed using a brain-switch that first determines whether the user wants to use an asynchronous BCI system before the operation of the asynchronous BCI system. This study presents a systematic review of the state-of-the-art brain-switch techniques and future research directions. To this end, we reviewed brain-switch research articles published from 2000 to 2019 in terms of their (a) neuroimaging modality, (b) paradigm, (c) operation algorithm, and (d) performance

Performance of a Self-Paced Brain Computer Interface on Data Contaminated with Eye-Movement Artifacts and on Data Recorded in a Subsequent Session

The performance of a specific self-paced BCI (SBCI) is investigated using two different datasets to determine its suitability for using online: (1) data contaminated with large-amplitude eye movements, and (2) data recorded in a session subsequent to the original sessions used to design the system. No part of the data was rejected in the subsequent session. Therefore, this dataset can be regarded as a “pseudo-online” test set. The SBCI under investigation uses features extracted from three specific neurological phenomena. Each of these neurological phenomena belongs to a different frequency band. Since many prominent artifacts are either of mostly low-frequency (e.g., eye movements) or mostly high-frequency nature (e.g., muscle movements), it is expected that the system shows a fairly robust performance over artifact-contaminated data. Analysis of the data of four participants using epochs contaminated with large-amplitude eye-movement artifacts shows that the system's performance deteriorates only slightly. Furthermore, the system's performance during the session subsequent to the original sessions remained largely the same as in the original sessions for three out of the four participants. This moderate drop in performance can be considered tolerable, since allowing artifact-contaminated data to be used as inputs makes the system available for users at ALL times

Short-term forecast techniques for energy management systems in microgrid applications

A Dissertation Submitted in Partial Fulfilment of the Requirements for the Degree of Doctor of Philosophy in Sustainable Energy Science and Engineering of the Nelson Mandela African Institution of Science and TechnologyIn the 2015 Paris Agreement, 195 countries adopted a global climate agreement to limit the global average temperature rise to less than 2°C. Achieving the set targets involves increasing energy efficiency and embracing cleaner energy solutions. Although advances in computing and Internet of Things (IoT) technologies have been made, there is limited scientific research work in this arena that tackles the challenges of implementing low-cost IoT-based Energy Management System (EMS) with energy forecast and user engagement for adoption by a layman both in off-grid or microgrid tied to a weak grid. This study proposes an EMS approach for short-term forecast and monitoring for hybrid microgrids in emerging countries. This is done by addressing typical submodules of EMS namely: load forecast, blackout forecast, and energy monitoring module. A short-term load forecast model framework consisting of a hybrid feature selection and prediction model was developed. Prediction error performance evaluation of the developed model was done by varying input predictors and using the principal subset features to perform supervised training of 20 different conventional prediction models and their hybrid variants. The proposed principal k-features subset union approach registered low error performance values than standard feature selection methods when it was used with the ‘linear Support Vector Machine (SVM)’ prediction model for load forecast. The hybrid regression model formed from a fusion of the best 2 models (‘linearSVM’ and ‘cubicSVM’) showed improved prediction performance than the individual regression models with a reduction in Mean Absolute Error (MAE) by 5.4%. In the case of the EMS blackout prediction aspect, a hybrid Adaptive Similar Day (ASD) and Random Forest (RF) model for short-term power outage prediction was proposed that predicted accurately almost half of the blackouts (49.16%), thereby performing slightly better than the stand-alone RF (32.23%), and ASD (46.57%) models. Additionally, a low-cost EMS smart meter was developed to realize the implemented energy forecast and offer user engagement through monitoring and control of the microgrid towards the goal of increasing energy efficiency

Study of non-invasive cognitive tasks and feature extraction techniques for brain-computer interface (BCI) applications

A brain-computer interface (BCI) provides an important alternative for disabled people that enables the non-muscular communication pathway among individual thoughts and different assistive appliances. A BCI technology essentially consists of data acquisition, pre-processing, feature extraction, classification and device command. Indeed, despite the valuable and promising achievements already obtained in every component of BCI, the BCI field is still a relatively young research field and there is still much to do in order to make BCI become a mature technology. To mitigate the impediments concerning BCI, the study of cognitive task together with the EEG feature and classification framework have been investigated. There are four distinct experiments have been conducted to determine the optimum solution to those specific issues. In the first experiment, three cognitive tasks namely quick math solving, relaxed and playing games have been investigated. The features have been extracted using power spectral density (PSD), logenergy entropy, and spectral centroid and the extracted feature has been classified through the support vector machine (SVM), K-nearest neighbor (K-NN), and linear discriminant analysis (LDA). In this experiment, the best classification accuracy for single channel and five channel datasets were 86% and 91.66% respectively that have been obtained by the PSD-SVM approach. The wink based facial expressions namely left wink, right wink and no wink have been studied through fast Fourier transform (FFT) and sample range feature and then the extracted features have been classified using SVM, K-NN, and LDA. The best accuracy (98.6%) has been achieved by the sample range-SVM based approach. The eye blinking based facial expression has been investigated following the same methodology as the study of wink based facial expression. Moreover, the peak detection approach has also been employed to compute the number of blinks. The optimum accuracy of 99% has been achieved using the peak detection approach. Additionally, twoclass motor imagery hand movement has been classified using SVM, K-NN, and LDA where the feature has been extracted through PSD, spectral centroid and continuous wavelet transform (CWT). The optimum 74.7% accuracy has been achieved by the PSDSVM approach. Finally, two device command prototypes have been designed to translate the classifier output. One prototype can translate four types of cognitive tasks in terms of 5 watts four different colored bulbs, whereas, another prototype may able to control DC motor utilizing cognitive tasks. This study has delineated the implementation of every BCI component to facilitate the application of brainwave assisted assistive appliances. Finally, this thesis comes to the end by drawing the future direction regarding the current issues of BCI technology and these directions may significantly enhance usability for the implementation of commercial applications not only for the disabled but also for a significant number of healthy users

Analysis of Human Gait Using Hybrid EEG-fNIRS-Based BCI System: A Review

Human gait is a complex activity that requires high coordination between the central nervous system, the limb, and the musculoskeletal system. More research is needed to understand the latter coordination\u27s complexity in designing better and more effective rehabilitation strategies for gait disorders. Electroencephalogram (EEG) and functional near-infrared spectroscopy (fNIRS) are among the most used technologies for monitoring brain activities due to portability, non-invasiveness, and relatively low cost compared to others. Fusing EEG and fNIRS is a well-known and established methodology proven to enhance brain–computer interface (BCI) performance in terms of classification accuracy, number of control commands, and response time. Although there has been significant research exploring hybrid BCI (hBCI) involving both EEG and fNIRS for different types of tasks and human activities, human gait remains still underinvestigated. In this article, we aim to shed light on the recent development in the analysis of human gait using a hybrid EEG-fNIRS-based BCI system. The current review has followed guidelines of preferred reporting items for systematic reviews and meta-Analyses (PRISMA) during the data collection and selection phase. In this review, we put a particular focus on the commonly used signal processing and machine learning algorithms, as well as survey the potential applications of gait analysis. We distill some of the critical findings of this survey as follows. First, hardware specifications and experimental paradigms should be carefully considered because of their direct impact on the quality of gait assessment. Second, since both modalities, EEG and fNIRS, are sensitive to motion artifacts, instrumental, and physiological noises, there is a quest for more robust and sophisticated signal processing algorithms. Third, hybrid temporal and spatial features, obtained by virtue of fusing EEG and fNIRS and associated with cortical activation, can help better identify the correlation between brain activation and gait. In conclusion, hBCI (EEG + fNIRS) system is not yet much explored for the lower limb due to its complexity compared to the higher limb. Existing BCI systems for gait monitoring tend to only focus on one modality. We foresee a vast potential in adopting hBCI in gait analysis. Imminent technical breakthroughs are expected using hybrid EEG-fNIRS-based BCI for gait to control assistive devices and Monitor neuro-plasticity in neuro-rehabilitation. However, although those hybrid systems perform well in a controlled experimental environment when it comes to adopting them as a certified medical device in real-life clinical applications, there is still a long way to go

Tracking Visible Features of Speech for Computer-Based Speech Therapy for Childhood Apraxia of Speech

At present, there are few, if any, effective computer-based speech therapy systems (CBSTs) that support the at-home component for clinical interventions for Childhood Apraxia of Speech (CAS). PROMPT, an established speech therapy intervention for CAS, has the potential to be supported via a CBST, which could increase engagement and provide valuable feedback to the child. However, the necessary computational techniques have not yet been developed and evaluated. In this thesis, I will describe the development of some of the key underlying computational components that are required for the development of such a system. These components concern camera-based tracking of visible features of speech which concern jaw kinematics. These components would also be necessary for the serious game that we have envisioned

Novel methodologies and technologies for the multiscale and multimodal study of Autism Spectrum Disorders (ASDs)

The aim of this PhD thesis was the development of novel bioengineering tools and methodologies that provide a support in the study of ASDs. ASDs are very heterogeneous disturbs and their abnormalities are present both at local and global level. For this reason a multimodal and multiscale approach was followed. The analysis of microstructure was executed on single Purkinje neurons in culture and on organotypic slices extracted from cerebella of GFP wild-type mice and animal models of ASDs. A methodology for the non-invasive imaging of neurons during their growth was set up and a software called NEMO (NEuron MOrphological analysis tool) for the automatic analysis of morphology and connectivity was developed. Microstructure properties can be inferred also in vivo through the quite recent technique of Diffusion Tensor Imaging (DTI). DTI studies in ASDs are based on the hypothesis that the disorder involves aberrant brain connectivity and disruption of white matter tracts between regions implicated in social functioning. In this study DTI was used to investigate structural abnormalities in the white matter structure of young children with ASDs. Moreover the neurostructural bases of echolalia were investigated. The functionality of the brain was analyzed through Functional Magnetic Resonance Imaging (fMRI) using a novel task based on face processing of human, android and robotic faces. A case-control study was performed in order to study how the face processing network is altered in ASDs and how robots are differently processed in ASDs and control groups. Measurements characterizing physiology and behavior of ASD children were also collected using an innovative platform called FACE-T (FACE-Therapy). FACE-T consists of a specially equipped room in which the child, wearing unobtrusive devices for recording physiological and behavioral data as well as gaze information, can interact with an android (FACE, Facial Automaton for Conveying Emotions) and a therapist. The focus was on ECG, as from the analysis of power spectrum density of ECG it is possible to extract features related to the autonomic nervous system that is correlated with brain functionality. These studies give new insights in the study of ASDs exploring aspects not yet addressed. Moreover the methodologies and tools developed could help in the objective characterization of ASD subjects and in the definition of a personalized therapeutic protocol for each child

Immersive analytics for oncology patient cohorts

This thesis proposes a novel interactive immersive analytics tool and methods to interrogate the cancer patient cohort in an immersive virtual environment, namely Virtual Reality to Observe Oncology data Models (VROOM). The overall objective is to develop an immersive analytics platform, which includes a data analytics pipeline from raw gene expression data to immersive visualisation on virtual and augmented reality platforms utilising a game engine. Unity3D has been used to implement the visualisation. Work in this thesis could provide oncologists and clinicians with an interactive visualisation and visual analytics platform that helps them to drive their analysis in treatment efficacy and achieve the goal of evidence-based personalised medicine. The thesis integrates the latest discovery and development in cancer patients’ prognoses, immersive technologies, machine learning, decision support system and interactive visualisation to form an immersive analytics platform of complex genomic data. For this thesis, the experimental paradigm that will be followed is in understanding transcriptomics in cancer samples. This thesis specifically investigates gene expression data to determine the biological similarity revealed by the patient's tumour samples' transcriptomic profiles revealing the active genes in different patients. In summary, the thesis contributes to i) a novel immersive analytics platform for patient cohort data interrogation in similarity space where the similarity space is based on the patient's biological and genomic similarity; ii) an effective immersive environment optimisation design based on the usability study of exocentric and egocentric visualisation, audio and sound design optimisation; iii) an integration of trusted and familiar 2D biomedical visual analytics methods into the immersive environment; iv) novel use of the game theory as the decision-making system engine to help the analytics process, and application of the optimal transport theory in missing data imputation to ensure the preservation of data distribution; and v) case studies to showcase the real-world application of the visualisation and its effectiveness