Synonym Detection Using Syntactic Dependency And Neural Embeddings

Recent advances on the Vector Space Model have significantly improved some NLP applications such as neural machine translation and natural language generation. Although word co-occurrences in context have been widely used in counting-/predicting-based distributional models, the role of syntactic dependencies in deriving distributional semantics has not yet been thoroughly investigated. By comparing various Vector Space Models in detecting synonyms in TOEFL, we systematically study the salience of syntactic dependencies in accounting for distributional similarity. We separate syntactic dependencies into different groups according to their various grammatical roles and then use context-counting to construct their corresponding raw and SVD-compressed matrices. Moreover, using the same training hyperparameters and corpora, we study typical neural embeddings in the evaluation. We further study the effectiveness of injecting human-compiled semantic knowledge into neural embeddings on computing distributional similarity. Our results show that the syntactically conditioned contexts can interpret lexical semantics better than the unconditioned ones, whereas retrofitting neural embeddings with semantic knowledge can significantly improve synonym detection

Signal Processing of Electroencephalogram for the Detection of Attentiveness towards Short Training Videos

This research has developed a novel method which uses an easy to deploy single dry electrode wireless electroencephalogram (EEG) collection device as an input to an automated system that measures indicators of a participant’s attentiveness while they are watching a short training video. The results are promising, including 85% or better accuracy in identifying whether a participant is watching a segment of video from a boring scene or lecture, versus a segment of video from an attentiveness inducing active lesson or memory quiz. In addition, the final system produces an ensemble average of attentiveness across many participants, pinpointing areas in the training videos that induce peak attentiveness. Qualitative analysis of the results of this research is also very promising. The system produces attentiveness graphs for individual participants and these triangulate well with the thoughts and feelings those participants had during different parts of the videos, as described in their own words. As distance learning and computer based training become more popular, it is of great interest to measure if students are attentive to recorded lessons and short training videos. This research was motivated by this interest, as well as recent advances in electronic and computer engineering’s use of biometric signal analysis for the detection of affective (emotional) response. Signal processing of EEG has proven useful in measuring alertness, emotional state, and even towards very specific applications such as whether or not participants will recall television commercials days after they have seen them. This research extended these advances by creating an automated system which measures attentiveness towards short training videos. The bulk of the research was focused on electrical and computer engineering, specifically the optimization of signal processing algorithms for this particular application. A review of existing methods of EEG signal processing and feature extraction methods shows that there is a common subdivision of the steps that are used in different EEG applications. These steps include hardware sensing filtering and digitizing, noise removal, chopping the continuous EEG data into windows for processing, normalization, transformation to extract frequency or scale information, treatment of phase or shift information, and additional post-transformation noise reduction techniques. A large degree of variation exists in most of these steps within the currently documented state of the art. This research connected these varied methods into a single holistic model that allows for comparison and selection of optimal algorithms for this application. The research described herein provided for such a structured and orderly comparison of individual signal analysis and feature extraction methods. This study created a concise algorithmic approach in examining all the aforementioned steps. In doing so, the study provided the framework for a systematic approach which followed a rigorous participant cross validation so that options could be tested, compared and optimized. Novel signal analysis methods were also developed, using new techniques to choose parameters, which greatly improved performance. The research also utilizes machine learning to automatically categorize extracted features into measures of attentiveness. The research improved existing machine learning with novel methods, including a method of using per-participant baselines with kNN machine learning. This provided an optimal solution to extend current EEG signal analysis methods that were used in other applications, and refined them for use in the measurement of attentiveness towards short training videos. These algorithms are proven to be best via selection of optimal signal analysis and optimal machine learning steps identified through both n-fold and participant cross validation. The creation of this new system which uses signal processing of EEG for the detection of attentiveness towards short training videos has created a significant advance in the field of attentiveness measuring towards short training videos

Deep Learning for Distant Speech Recognition

Deep learning is an emerging technology that is considered one of the most promising directions for reaching higher levels of artificial intelligence. Among the other achievements, building computers that understand speech represents a crucial leap towards intelligent machines. Despite the great efforts of the past decades, however, a natural and robust human-machine speech interaction still appears to be out of reach, especially when users interact with a distant microphone in noisy and reverberant environments. The latter disturbances severely hamper the intelligibility of a speech signal, making Distant Speech Recognition (DSR) one of the major open challenges in the field. This thesis addresses the latter scenario and proposes some novel techniques, architectures, and algorithms to improve the robustness of distant-talking acoustic models. We first elaborate on methodologies for realistic data contamination, with a particular emphasis on DNN training with simulated data. We then investigate on approaches for better exploiting speech contexts, proposing some original methodologies for both feed-forward and recurrent neural networks. Lastly, inspired by the idea that cooperation across different DNNs could be the key for counteracting the harmful effects of noise and reverberation, we propose a novel deep learning paradigm called network of deep neural networks. The analysis of the original concepts were based on extensive experimental validations conducted on both real and simulated data, considering different corpora, microphone configurations, environments, noisy conditions, and ASR tasks.Comment: PhD Thesis Unitn, 201

Continuous Estimation of Smoking Lapse Risk from Noisy Wrist Sensor Data Using Sparse and Positive-Only Labels

Estimating the imminent risk of adverse health behaviors provides opportunities for developing effective behavioral intervention mechanisms to prevent the occurrence of the target behavior. One of the key goals is to find opportune moments for intervention by passively detecting the rising risk of an imminent adverse behavior. Significant progress in mobile health research and the ability to continuously sense internal and external states of individual health and behavior has paved the way for detecting diverse risk factors from mobile sensor data. The next frontier in this research is to account for the combined effects of these risk factors to produce a composite risk score of adverse behaviors using wearable sensors convenient for daily use. Developing a machine learning-based model for assessing the risk of smoking lapse in the natural environment faces significant outstanding challenges requiring the development of novel and unique methodologies for each of them. The first challenge is coming up with an accurate representation of noisy and incomplete sensor data to encode the present and historical influence of behavioral cues, mental states, and the interactions of individuals with their ever-changing environment. The next noteworthy challenge is the absence of confirmed negative labels of low-risk states and adequate precise annotations of high-risk states. Finally, the model should work on convenient wearable devices to facilitate widespread adoption in research and practice. In this dissertation, we develop methods that account for the multi-faceted nature of smoking lapse behavior to train and evaluate a machine learning model capable of estimating composite risk scores in the natural environment. We first develop mRisk, which combines the effects of various mHealth biomarkers such as stress, physical activity, and location history in producing the risk of smoking lapse using sequential deep neural networks. We propose an event-based encoding of sensor data to reduce the effect of noises and then present an approach to efficiently model the historical influence of recent and past sensor-derived contexts on the likelihood of smoking lapse. To circumvent the lack of confirmed negative labels (i.e., annotated low-risk moments) and only a few positive labels (i.e., sensor-based detection of smoking lapse corroborated by self-reports), we propose a new loss function to accurately optimize the models. We build the mRisk models using biomarker (stress, physical activity) streams derived from chest-worn sensors. Adapting the models to work with less invasive and more convenient wrist-based sensors requires adapting the biomarker detection models to work with wrist-worn sensor data. To that end, we develop robust stress and activity inference methodologies from noisy wrist-sensor data. We first propose CQP, which quantifies wrist-sensor collected PPG data quality. Next, we show that integrating CQP within the inference pipeline improves accuracy-yield trade-offs associated with stress detection from wrist-worn PPG sensors in the natural environment. mRisk also requires sensor-based precise detection of smoking events and confirmation through self-reports to extract positive labels. Hence, we develop rSmoke, an orientation-invariant smoking detection model that is robust to the variations in sensor data resulting from orientation switches in the field. We train the proposed mRisk risk estimation models using the wrist-based inferences of lapse risk factors. To evaluate the utility of the risk models, we simulate the delivery of intelligent smoking interventions to at-risk participants as informed by the composite risk scores. Our results demonstrate the envisaged impact of machine learning-based models operating on wrist-worn wearable sensor data to output continuous smoking lapse risk scores. The novel methodologies we propose throughout this dissertation help instigate a new frontier in smoking research that can potentially improve the smoking abstinence rate in participants willing to quit

Towards Autonomous Selective Harvesting: A Review of Robot Perception, Robot Design, Motion Planning and Control

This paper provides an overview of the current state-of-the-art in selective harvesting robots (SHRs) and their potential for addressing the challenges of global food production. SHRs have the potential to increase productivity, reduce labour costs, and minimise food waste by selectively harvesting only ripe fruits and vegetables. The paper discusses the main components of SHRs, including perception, grasping, cutting, motion planning, and control. It also highlights the challenges in developing SHR technologies, particularly in the areas of robot design, motion planning and control. The paper also discusses the potential benefits of integrating AI and soft robots and data-driven methods to enhance the performance and robustness of SHR systems. Finally, the paper identifies several open research questions in the field and highlights the need for further research and development efforts to advance SHR technologies to meet the challenges of global food production. Overall, this paper provides a starting point for researchers and practitioners interested in developing SHRs and highlights the need for more research in this field.Comment: Preprint: to be appeared in Journal of Field Robotic

Understanding disease through remote monitoring technology:A mobile health perspective on disease and diagnosis in three conditions: stress, epilepsy, and COVID-19

Mobile systems and wearable technology have developed substantially over the last decade and provide a unique long-term and continuous insight and monitoring into medical condi- tions in health research. The opportunities afforded by mobile health in access, scale, and round-the-clock recording are counterbalanced by pronounced issues in areas like participant engagement, labelling, and dataset size. Throughout this thesis the different aspects of an mHealth study are addressed, from software development and study design to data collection and analysis. Three medically relevant fields are investigated: detection of stress from physiological signals, seizure detection in epilepsy and the characterisation and monitoring of COVID-19 through mobile health techniques.The first two analytical chapters of the thesis focus on models for acute stress and epileptic seizure detection, two conditions with autonomic and physiological manifestations. Firstly, a multi-modal machine learning pipeline is developed targetting focal and general motor seizures in patients with epilepsy. The heterogenity and inter-individual differences present in this study motivated the investigation of methods to personalise models with relatively little data. I subsequently consider meta-learning for few-shot model personalisation within acute stress classification, finding increased performance compared to standard methods.As the COVID-19 pandemic gripped the world the work of this thesis reoriented around using mHealth to understand the disease. Firstly, the study design and software development of Covid Collab, a crowdsourced, remote-enrollment COVID-19 study, are examined. Within these chapters, the patterns of participant enrolment and adherence in Covid Col- lab are also considered. Adherence could impact scientific interpretations if not properly accounted for. While basic drop-out and percent completion are often considered, a more dynamic view of a participant’s behaviour can also be important. A hidden Markov model approach is used to compare participant engagement over time.Secondly, the long-term effects of COVID are investigated through data collected in the Covid Collab study, giving insight into prevalence, risk factors, and symptom manifestation with respect to wearable-recorded physiological signals. Long-term and historical data accessed retrospectively facilitated the findings of significant correlations between development of long-COVID and mHealth-derived fitness and behaviour

Dynamics of large-scale brain activity in health and disease

Tese de doutoramento em Engenharia Biomédica e Biofísica, apresentada à Universidade de Lisboa através da Faculdade de Ciências, 2008Cognition relies on the integration of information processed in widely distributed brain regions. Neuronal oscillations are thought to play an important role in the supporting local and global coordination of neuronal activity. This study aimed at investigating the dynamics of the ongoing healthy brain activity and early changes observed in patients with Alzheimer's disease (AD). Electro- and magnetoencephalography (EEG/MEG) were used due to high temporal resolution of these techniques. In order to evaluate the functional connectivity in AD, a novel algorithm based on the concept of generalized synchronization was improved by defining the embedding parameters as a function of the frequency content of interest. The time-frequency synchronization likelihood (TF SL) revealed a loss of fronto-temporal/parietal interactions in the lower alpha (8 10 Hz) oscillations measured by MEG that was not found with classical coherence. Further, long-range temporal (auto-) correlations (LRTC) in ongoing oscillations were assessed with detrended fluctuation analysis (DFA) on times scales from 1 25 seconds. Significant auto-correlations indicate a dependence of the underlying dynamical processes at certain time scales of separation, which may be viewed as a form of "physiological memory". We tested whether the DFA index could be related to the decline in cognitive memory in AD. Indeed, a significant decrease in the DFA exponents was observed in the alpha band (6 13 Hz) over temporo-parietal regions in the patients compared with the age-matched healthy control subjects. Finally, the mean level of SL of EEG signals was found to be significantly decreased in the AD patients in the beta (13 30 Hz) and in the upper alpha (10 13 Hz) and the DFA exponents computed as a measure of the temporal structure of SL time series were larger for the patients than for subjects with subjective memory complaint. The results obtained indicate that the study of spatio-temporal dynamics of resting-state EEG/MEG brain activity provides valuable information about the AD pathophysiology, which potentially could be developed into clinically useful indices for assessing progression of AD or response to medication

Epilepsy

With the vision of including authors from different parts of the world, different educational backgrounds, and offering open-access to their published work, InTech proudly presents the latest edited book in epilepsy research, Epilepsy: Histological, electroencephalographic, and psychological aspects. Here are twelve interesting and inspiring chapters dealing with basic molecular and cellular mechanisms underlying epileptic seizures, electroencephalographic findings, and neuropsychological, psychological, and psychiatric aspects of epileptic seizures, but non-epileptic as well

Investigating how neural entrainment relates to beat perception by disentangling the stimulus-driven response

Beat perception – the ability to perceive a steady pulse in music – is nearly ubiquitous in humans, but the neural mechanisms underlying this ability are unknown. A growing number of electroencephalography (EEG) studies suggest that beat perception is related to neural entrainment, a phenomenon in which cyclic changes in the excitability of populations of neurons synchronize with a rhythmic stimulus. However, the relationship between acoustically-driven and entrainment-driven neural activity is unclear. This thesis presents EEG research that extends our understanding neural entrainment is related to beat perception by characterizing, equating, and finally removing the stimulus-driven response in the neural signal isolating the entrainment-driven responses. Chapter 1 presents a general overview of how neural entrainment may relate to beat perception, the common methods of measuring neural entrainment, and current debates in the literature about how best to account for the stimulus-driven response in the neural signal and also what the neural power spectrum reflects. Chapter 2 presents research on how perceptual and acoustic factors in auditory stimuli influence neural spectral power in a series of experiments in which beat strength, tone duration, and onset/offset ramp duration were manipulated. The results suggest that both perceptual and acoustic factors influence neural spectral power, and that accounting for the stimulus-driven response in the neural spectrum is more complicated than previously assumed. Chapter 3 presents research on how power and phase of the neural signal relate to beat strength and beat location while controlling the stimulus-driven response. The results indicated a relationship between neural entrainment and beat strength, and also, between oscillatory phase and beat location. Chapter 4 presents research on the potential neural mechanisms of beat perception by examining neural activity during a silent immediately after rhythm perception for testing for ongoing, oscillatory activity. The results, although not statistically robust, suggest that entrained activity continues into silence, indicating a relationship between neural entrainment and beat perception. Chapter 5 presents a general discussion of Chapters 2-4 in the context of the existing literature, limitations, and broader interpretations of how these results relate to future directions in the field

Ultra low power wearable sleep diagnostic systems

Sleep disorders are studied using sleep study systems called Polysomnography that records several biophysical parameters during sleep. However, these are bulky and are typically located in a medical facility where patient monitoring is costly and quite inefficient. Home-based portable systems solve these problems to an extent but they record only a minimal number of channels due to limited battery life. To surmount this, wearable sleep system are desired which need to be unobtrusive and have long battery life. In this thesis, a novel sleep system architecture is presented that enables the design of an ultra low power sleep diagnostic system. This architecture is capable of extending the recording time to 120 hours in a wearable system which is an order of magnitude improvement over commercial wearable systems that record for about 12 hours. This architecture has in effect reduced the average power consumption of 5-6 mW per channel to less than 500 uW per channel. This has been achieved by eliminating sampled data architecture, reducing the wireless transmission rate and by moving the sleep scoring to the sensors. Further, ultra low power instrumentation amplifiers have been designed to operate in weak inversion region to support this architecture. A 40 dB chopper-stabilised low power instrumentation amplifiers to process EEG were designed and tested to operate from 1.0 V consuming just 3.1 uW for peak mode operation with DC servo loop. A 50 dB non-EEG amplifier continuous-time bandpass amplifier with a consumption of 400 nW was also fabricated and tested. Both the amplifiers achieved a high CMRR and impedance that are critical for wearable systems. Combining these amplifiers with the novel architecture enables the design of an ultra low power sleep recording system. This reduces the size of the battery required and hence enables a truly wearable system.Open Acces