309 research outputs found
Graph-based EEG approach for depression prediction: integrating time-frequency complexity and spatial topology
Depression has become the prevailing global mental health concern. The accuracy of traditional depression diagnosis methods faces challenges due to diverse factors, making primary identification a complex task. Thus, the imperative lies in developing a method that fulfills objectivity and effectiveness criteria for depression identification. Current research underscores notable disparities in brain activity between individuals with depression and those without. The Electroencephalogram (EEG), as a biologically reflective and easily accessible signal, is widely used to diagnose depression. This article introduces an innovative depression prediction strategy that merges time-frequency complexity and electrode spatial topology to aid in depression diagnosis. Initially, time-frequency complexity and temporal features of the EEG signal are extracted to generate node features for a graph convolutional network. Subsequently, leveraging channel correlation, the brain network adjacency matrix is employed and calculated. The final depression classification is achieved by training and validating a graph convolutional network with graph node features and a brain network adjacency matrix based on channel correlation. The proposed strategy has been validated using two publicly available EEG datasets, MODMA and PRED+CT, achieving notable accuracy rates of 98.30 and 96.51%, respectively. These outcomes affirm the reliability and utility of our proposed strategy in predicting depression using EEG signals. Additionally, the findings substantiate the effectiveness of EEG time-frequency complexity characteristics as valuable biomarkers for depression prediction
TLM: Token-Level Masking for Transformers
Structured dropout approaches, such as attention dropout and DropHead, have
been investigated to regularize the multi-head attention mechanism in
Transformers. In this paper, we propose a new regularization scheme based on
token-level rather than structure-level to reduce overfitting. Specifically, we
devise a novel Token-Level Masking (TLM) training strategy for Transformers to
regularize the connections of self-attention, which consists of two masking
techniques that are effective and easy to implement. The underlying idea is to
manipulate the connections between tokens in the multi-head attention via
masking, where the networks are forced to exploit partial neighbors'
information to produce a meaningful representation. The generality and
effectiveness of TLM are thoroughly evaluated via extensive experiments on 4
diversified NLP tasks across 18 datasets, including natural language
understanding benchmark GLUE, ChineseGLUE, Chinese Grammatical Error
Correction, and data-to-text generation. The results indicate that TLM can
consistently outperform attention dropout and DropHead, e.g., it increases by
0.5 points relative to DropHead with BERT-large on GLUE. Moreover, TLM can
establish a new record on the data-to-text benchmark Rotowire (18.93 BLEU). Our
code will be publicly available at https://github.com/Young1993/tlm.Comment: 13 pages. Accepted by EMNLP2023 main conferenc
Recommended from our members
Regional CO Pollution in China Simulated by the High-Resolution Nested-Grid GEOS-Chem Model
An updated version of the nested-grid GEOS-Chem model is developed allowing for higher horizontal (0.5°×0.667°) and vertical resolution as compared to global models. CO transport over a heavily polluted region, the Beijing-Tianjin-Hebei (BTH) city cluster in China, and the pattern of outflow from East China in summertime are investigated. Comparison of the nested-grid with global models indicates that the fine-resolution nested-grid model is capable of resolving individual cities with high associated emission intensities. The nested-grid model indicates the presence of a high CO column density over the Sichuan Basin in summer, attributable to the low-level stationary vortex associated with the Basin's topographical features. The nested-grid model provides good agreement also with measurements from a suburban monitoring site in Beijing during summer 2005. Tagged CO simulation results suggest that regional emissions make significant contributions to elevated CO levels over Beijing on polluted days and that the southeastward moving cyclones bringing northwest winds to Beijing are the key meteorological mechanisms responsible for dispersion of pollution over Beijing in summer. Overall CO fluxes to the NW Pacific from Asia are found to decrease by a factor of 3–4 from spring to summer. Much of the seasonal change is driven by decreasing fluxes from India and Southeast Asia in summer, while fluxes from East China are only 30% lower in summer than in spring. Compared to spring, summertime outflow from Chinese source regions is strongest at higher latitudes (north of 35° N). The deeper convection in summer transporting CO to higher altitudes where export is more efficient is largely responsible for enhanced export in summer.Engineering and Applied Science
Real-time Hybrid Locomotion Mode Recognition for Lower-limb Wearable Robots
Real-time recognition of locomotion-related activities is a fundamental skill that the controller of lower-limb wearable robots should possess. Subject-specific training and reliance on electromyographic interfaces are the main limitations of existing approaches. This study presents a novel methodology for real-time locomotion mode recognition of locomotion-related activities in lower-limb wearable robotics. A hybrid classifier can distinguish among seven locomotion-related activities. First, a time-based approach classifies between static and dynamical states based on gait kinematics data. Second, an event-based fuzzy logic method triggered by foot pressure sensors operates in a subject-independent fashion on a minimal set of relevant biomechanical features to classify among dynamical modes. The locomotion mode recognition algorithm is implemented on the controller of a portable powered orthosis for hip assistance. An experimental protocol is designed to evaluate the controller performance in an out-of-lab scenario without the need for a subject-specific training. Experiments are conducted on six healthy volunteers performing locomotion-related activities at slow, normal, and fast speeds under the zero-torque and assistive mode of the orthosis. The overall accuracy rate of the controller is 99.4% over more than 10,000 steps, including seamless transitions between different modes. The experimental results show a successful subject-independent performance of the controller for wearable robots assisting locomotion-related activities
- …