Large-scale Foundation Models and Generative AI for BigData Neuroscience

Recent advances in machine learning have made revolutionary breakthroughs in computer games, image and natural language understanding, and scientific discovery. Foundation models and large-scale language models (LLMs) have recently achieved human-like intelligence thanks to BigData. With the help of self-supervised learning (SSL) and transfer learning, these models may potentially reshape the landscapes of neuroscience research and make a significant impact on the future. Here we present a mini-review on recent advances in foundation models and generative AI models as well as their applications in neuroscience, including natural language and speech, semantic memory, brain-machine interfaces (BMIs), and data augmentation. We argue that this paradigm-shift framework will open new avenues for many neuroscience research directions and discuss the accompanying challenges and opportunities

Identification of atypical sleep microarchitecture biomarkers in children with autism spectrum disorder

ImportanceSleep disorders are one of the most frequent comorbidities in children with autism spectrum disorder (ASD). However, the link between neurodevelopmental effects in ASD children with their underlying sleep microarchitecture is not well understood. An improved understanding of etiology of sleep difficulties and identification of sleep-associated biomarkers for children with ASD can improve the accuracy of clinical diagnosis.ObjectivesTo investigate whether machine learning models can identify biomarkers for children with ASD based on sleep EEG recordings.Design, setting, and participantsSleep polysomnogram data were obtained from the Nationwide Children’ Health (NCH) Sleep DataBank. Children (ages: 8–16 yrs) with 149 autism and 197 age-matched controls without neurodevelopmental diagnosis were selected for analysis. An additional independent age-matched control group (n = 79) selected from the Childhood Adenotonsillectomy Trial (CHAT) was also used to validate the models. Furthermore, an independent smaller NCH cohort of younger infants and toddlers (age: 0.5–3 yr.; 38 autism and 75 controls) was used for additional validation.Main outcomes and measuresWe computed periodic and non-periodic characteristics from sleep EEG recordings: sleep stages, spectral power, sleep spindle characteristics, and aperiodic signals. Machine learning models including the Logistic Regression (LR) classifier, Support Vector Machine (SVM), and Random Forest (RF) model were trained using these features. We determined the autism class based on the prediction score of the classifier. The area under the receiver operating characteristics curve (AUC), accuracy, sensitivity, and specificity were used to evaluate the model performance.ResultsIn the NCH study, RF outperformed two other models with a 10-fold cross-validated median AUC of 0.95 (interquartile range [IQR], [0.93, 0.98]). The LR and SVM models performed comparably across multiple metrics, with median AUC 0.80 [0.78, 0.85] and 0.83 [0.79, 0.87], respectively. In the CHAT study, three tested models have comparable AUC results: LR: 0.83 [0.76, 0.92], SVM: 0.87 [0.75, 1.00], and RF: 0.85 [0.75, 1.00]. Sleep spindle density, amplitude, spindle-slow oscillation (SSO) coupling, aperiodic signal’s spectral slope and intercept, as well as the percentage of REM sleep were found to be key discriminative features in the predictive models.Conclusion and relevanceOur results suggest that integration of EEG feature engineering and machine learning can identify sleep-based biomarkers for ASD children and produce good generalization in independent validation datasets. Microstructural EEG alterations may help reveal underlying pathophysiological mechanisms of autism that alter sleep quality and behaviors. Machine learning analysis may reveal new insight into the etiology and treatment of sleep difficulties in autism

Modern Views of Machine Learning for Precision Psychiatry

In light of the NIMH's Research Domain Criteria (RDoC), the advent of functional neuroimaging, novel technologies and methods provide new opportunities to develop precise and personalized prognosis and diagnosis of mental disorders. Machine learning (ML) and artificial intelligence (AI) technologies are playing an increasingly critical role in the new era of precision psychiatry. Combining ML/AI with neuromodulation technologies can potentially provide explainable solutions in clinical practice and effective therapeutic treatment. Advanced wearable and mobile technologies also call for the new role of ML/AI for digital phenotyping in mobile mental health. In this review, we provide a comprehensive review of the ML methodologies and applications by combining neuroimaging, neuromodulation, and advanced mobile technologies in psychiatry practice. Additionally, we review the role of ML in molecular phenotyping and cross-species biomarker identification in precision psychiatry. We further discuss explainable AI (XAI) and causality testing in a closed-human-in-the-loop manner, and highlight the ML potential in multimedia information extraction and multimodal data fusion. Finally, we discuss conceptual and practical challenges in precision psychiatry and highlight ML opportunities in future research

Cortical Pain Processing in the Rat Anterior Cingulate Cortex and Primary Somatosensory Cortex

Pain is a complex multidimensional experience encompassing sensory-discriminative, affective-motivational and cognitive-emotional components mediated by different neural mechanisms. Investigations of neurophysiological signals from simultaneous recordings of two or more cortical circuits may reveal important circuit mechanisms on cortical pain processing. The anterior cingulate cortex (ACC) and primary somatosensory cortex (S1) represent two most important cortical circuits related to sensory and affective processing of pain. Here, we recorded in vivo extracellular activity of the ACC and S1 simultaneously from male adult Sprague-Dale rats (n = 5), while repetitive noxious laser stimulations were delivered to animalÕs hindpaw during pain experiments. We identified spontaneous pain-like events based on stereotyped pain behaviors in rats. We further conducted systematic analyses of spike and local field potential (LFP) recordings from both ACC and S1 during evoked and spontaneous pain episodes. From LFP recordings, we found stronger phase-amplitude coupling (theta phase vs. gamma amplitude) in the S1 than the ACC (n = 10 sessions), in both evoked (p = 0.058) and spontaneous pain-like behaviors (p = 0.017, paired signed rank test). In addition, pain-modulated ACC and S1 neuronal firing correlated with the amplitude of stimulus-induced event-related potentials (ERPs) during evoked pain episodes. We further designed statistical and machine learning methods to detect pain signals by integrating ACC and S1 ensemble spikes and LFPs. Together, these results reveal differential coding roles between the ACC and S1 in cortical pain processing, as well as point to distinct neural mechanisms between evoked and putative spontaneous pain at both LFP and cellular levels

Pain, from perception to action: A computational perspective

Summary: Pain is driven by sensation and emotion, and in turn, it motivates decisions and actions. To fully appreciate the multidimensional nature of pain, we formulate the study of pain within a closed-loop framework of sensory-motor prediction. In this closed-loop cycle, prediction plays an important role, as the interaction between prediction and actual sensory experience shapes pain perception and subsequently, action. In this Perspective, we describe the roles of two prominent computational theories—Bayesian inference and reinforcement learning—in modeling adaptive pain behaviors. We show that prediction serves as a common theme between these two theories, and that each of these theories can explain unique aspects of the pain perception-action cycle. We discuss how these computational theories and models can improve our mechanistic understandings of pain-centered processes such as anticipation, attention, placebo hypoalgesia, and pain chronification

Data_Sheet_1_Identification of atypical sleep microarchitecture biomarkers in children with autism spectrum disorder.PDF

ImportanceSleep disorders are one of the most frequent comorbidities in children with autism spectrum disorder (ASD). However, the link between neurodevelopmental effects in ASD children with their underlying sleep microarchitecture is not well understood. An improved understanding of etiology of sleep difficulties and identification of sleep-associated biomarkers for children with ASD can improve the accuracy of clinical diagnosis.ObjectivesTo investigate whether machine learning models can identify biomarkers for children with ASD based on sleep EEG recordings.Design, setting, and participantsSleep polysomnogram data were obtained from the Nationwide Children’ Health (NCH) Sleep DataBank. Children (ages: 8–16 yrs) with 149 autism and 197 age-matched controls without neurodevelopmental diagnosis were selected for analysis. An additional independent age-matched control group (n = 79) selected from the Childhood Adenotonsillectomy Trial (CHAT) was also used to validate the models. Furthermore, an independent smaller NCH cohort of younger infants and toddlers (age: 0.5–3 yr.; 38 autism and 75 controls) was used for additional validation.Main outcomes and measuresWe computed periodic and non-periodic characteristics from sleep EEG recordings: sleep stages, spectral power, sleep spindle characteristics, and aperiodic signals. Machine learning models including the Logistic Regression (LR) classifier, Support Vector Machine (SVM), and Random Forest (RF) model were trained using these features. We determined the autism class based on the prediction score of the classifier. The area under the receiver operating characteristics curve (AUC), accuracy, sensitivity, and specificity were used to evaluate the model performance.ResultsIn the NCH study, RF outperformed two other models with a 10-fold cross-validated median AUC of 0.95 (interquartile range [IQR], [0.93, 0.98]). The LR and SVM models performed comparably across multiple metrics, with median AUC 0.80 [0.78, 0.85] and 0.83 [0.79, 0.87], respectively. In the CHAT study, three tested models have comparable AUC results: LR: 0.83 [0.76, 0.92], SVM: 0.87 [0.75, 1.00], and RF: 0.85 [0.75, 1.00]. Sleep spindle density, amplitude, spindle-slow oscillation (SSO) coupling, aperiodic signal’s spectral slope and intercept, as well as the percentage of REM sleep were found to be key discriminative features in the predictive models.Conclusion and relevanceOur results suggest that integration of EEG feature engineering and machine learning can identify sleep-based biomarkers for ASD children and produce good generalization in independent validation datasets. Microstructural EEG alterations may help reveal underlying pathophysiological mechanisms of autism that alter sleep quality and behaviors. Machine learning analysis may reveal new insight into the etiology and treatment of sleep difficulties in autism.</p

Fear extinction learning modulates large-scale brain connectivity

Exploring the neural circuits of the extinction of conditioned fear is critical to advance our understanding of fear- and anxiety-related disorders. The field has focused on examining the role of various regions of the medial prefrontal cortex, insular cortex, hippocampus, and amygdala in conditioned fear and its extinction. The contribution of this ‘fear network’ to the conscious awareness of fear has recently been questioned. And as such, there is a need to examine higher/multiple cortical systems that might contribute to the conscious feeling of fear and anxiety. Herein, we studied functional connectivity patterns across the entire brain to examine the contribution of multiple networks to the acquisition of fear extinction learning and its retrieval. We conducted trial-by-trial analyses on data from 137 healthy participants who underwent a two-day fear conditioning and extinction paradigm in a functional magnetic resonance imaging (fMRI) scanner. We found that functional connectivity across a broad range of brain regions, many of which are part of the default mode, frontoparietal, and ventral attention networks, increased from early to late extinction learning only to a conditioned cue. The increased connectivity during extinction learning predicted the magnitude of extinction memory tested 24 h later. Together, these findings provide evidence supporting recent studies implicating distributed brain regions in learning, consolidation and expression of fear extinction memory in the human brain

Deep learning for robust detection of interictal epileptiform discharges

Automatic detection of interictal epileptiform discharges (IEDs, short as ``spikes'') from an epileptic brain can help predict seizure recurrence and support the diagnosis of epilepsy. Developing fast, reliable and robust detection methods for IEDs based on scalp or intracortical EEG may facilitate online seizure monitoring and closed-loop neurostimulation. We developed a new deep learning approach, which employs a long short-term memory (LSTM) network architecture (``IEDnet'') and an auxiliary classifier generative adversarial network (AC-GAN), to train on both expert-annotated and augmented spike events from intracranial electroencephalography (iEEG) recordings of epilepsy patients. We validated our IEDnet with two real-world iEEG datasets, and compared IEDnet with the support vector machine (SVM) and random forest (RF) classifiers on their detection performances. IEDnet achieved excellent cross-validated detection performances in terms of both sensitivity and specificity, and outperformed SVM and RF. Synthetic spike samples augmented by AC-GAN further improved the detection performance. In addition, the performance of IEDnet was robust with respect to the sampling frequency and noise. Furthermore, we also demonstrated the cross-institutional generalization ability of IEDnet while testing between two datasets. IEDnet achieves excellent detection performances in identifying interictal spikes. AC-GAN can produce augmented iEEG samples to improve supervised deep learning