309 research outputs found

    Graph-based EEG approach for depression prediction: integrating time-frequency complexity and spatial topology

    Get PDF
    Depression has become the prevailing global mental health concern. The accuracy of traditional depression diagnosis methods faces challenges due to diverse factors, making primary identification a complex task. Thus, the imperative lies in developing a method that fulfills objectivity and effectiveness criteria for depression identification. Current research underscores notable disparities in brain activity between individuals with depression and those without. The Electroencephalogram (EEG), as a biologically reflective and easily accessible signal, is widely used to diagnose depression. This article introduces an innovative depression prediction strategy that merges time-frequency complexity and electrode spatial topology to aid in depression diagnosis. Initially, time-frequency complexity and temporal features of the EEG signal are extracted to generate node features for a graph convolutional network. Subsequently, leveraging channel correlation, the brain network adjacency matrix is employed and calculated. The final depression classification is achieved by training and validating a graph convolutional network with graph node features and a brain network adjacency matrix based on channel correlation. The proposed strategy has been validated using two publicly available EEG datasets, MODMA and PRED+CT, achieving notable accuracy rates of 98.30 and 96.51%, respectively. These outcomes affirm the reliability and utility of our proposed strategy in predicting depression using EEG signals. Additionally, the findings substantiate the effectiveness of EEG time-frequency complexity characteristics as valuable biomarkers for depression prediction

    TLM: Token-Level Masking for Transformers

    Full text link
    Structured dropout approaches, such as attention dropout and DropHead, have been investigated to regularize the multi-head attention mechanism in Transformers. In this paper, we propose a new regularization scheme based on token-level rather than structure-level to reduce overfitting. Specifically, we devise a novel Token-Level Masking (TLM) training strategy for Transformers to regularize the connections of self-attention, which consists of two masking techniques that are effective and easy to implement. The underlying idea is to manipulate the connections between tokens in the multi-head attention via masking, where the networks are forced to exploit partial neighbors' information to produce a meaningful representation. The generality and effectiveness of TLM are thoroughly evaluated via extensive experiments on 4 diversified NLP tasks across 18 datasets, including natural language understanding benchmark GLUE, ChineseGLUE, Chinese Grammatical Error Correction, and data-to-text generation. The results indicate that TLM can consistently outperform attention dropout and DropHead, e.g., it increases by 0.5 points relative to DropHead with BERT-large on GLUE. Moreover, TLM can establish a new record on the data-to-text benchmark Rotowire (18.93 BLEU). Our code will be publicly available at https://github.com/Young1993/tlm.Comment: 13 pages. Accepted by EMNLP2023 main conferenc

    Real-time Hybrid Locomotion Mode Recognition for Lower-limb Wearable Robots

    Get PDF
    Real-time recognition of locomotion-related activities is a fundamental skill that the controller of lower-limb wearable robots should possess. Subject-specific training and reliance on electromyographic interfaces are the main limitations of existing approaches. This study presents a novel methodology for real-time locomotion mode recognition of locomotion-related activities in lower-limb wearable robotics. A hybrid classifier can distinguish among seven locomotion-related activities. First, a time-based approach classifies between static and dynamical states based on gait kinematics data. Second, an event-based fuzzy logic method triggered by foot pressure sensors operates in a subject-independent fashion on a minimal set of relevant biomechanical features to classify among dynamical modes. The locomotion mode recognition algorithm is implemented on the controller of a portable powered orthosis for hip assistance. An experimental protocol is designed to evaluate the controller performance in an out-of-lab scenario without the need for a subject-specific training. Experiments are conducted on six healthy volunteers performing locomotion-related activities at slow, normal, and fast speeds under the zero-torque and assistive mode of the orthosis. The overall accuracy rate of the controller is 99.4% over more than 10,000 steps, including seamless transitions between different modes. The experimental results show a successful subject-independent performance of the controller for wearable robots assisting locomotion-related activities
    • …
    corecore