Hybridizing 3-dimensional multiple object tracking with neurofeedback to enhance preparation, performance, and learning

Le vaste domaine de l’amélioration cognitive traverse les applications comportementales, biochimiques et physiques. Aussi nombreuses sont les techniques que les limites de ces premières : des études de pauvre méthodologie, des pratiques éthiquement ambiguës, de faibles effets positifs, des effets secondaires significatifs, des couts financiers importants, un investissement de temps significatif, une accessibilité inégale, et encore un manque de transfert. L’objectif de cette thèse est de proposer une méthode novatrice d’intégration de l’une de ces techniques, le neurofeedback, directement dans un paradigme d’apprentissage afin d’améliorer la performance cognitive et l’apprentissage. Cette thèse propose les modalités, les fondements empiriques et des données à l’appui de ce paradigme efficace d’apprentissage ‘bouclé’. En manipulant la difficulté dans une tâche en fonction de l’activité cérébrale en temps réel, il est démontré que dans un paradigme d’apprentissage traditionnel (3-dimentional multiple object tracking), la vitesse et le degré d’apprentissage peuvent être améliorés de manière significative lorsque comparés au paradigme traditionnel ou encore à un groupe de contrôle actif. La performance améliorée demeure observée même avec un retrait du signal de rétroaction, ce qui suggère que les effets de l’entrainement amélioré sont consolidés et ne dépendent pas d’une rétroaction continue. Ensuite, cette thèse révèle comment de tels effets se produisent, en examinant les corrélés neuronaux des états de préparation et de performance à travers les conditions d’état de base et pendant la tâche, de plus qu’en fonction du résultat (réussite/échec) et de la difficulté (basse/moyenne/haute vitesse). La préparation, la performance et la charge cognitive sont mesurées via des liens robustement établis dans un contexte d’activité cérébrale fonctionnelle mesurée par l’électroencéphalographie quantitative. Il est démontré que l’ajout d’une assistance- à-la-tâche apportée par la fréquence alpha dominante est non seulement appropriée aux conditions de ce paradigme, mais influence la charge cognitive afin de favoriser un maintien du sujet dans sa zone de développement proximale, ce qui facilite l’apprentissage et améliore la performance. Ce type de paradigme d’apprentissage peut contribuer à surmonter, au minimum, un des limites fondamentales du neurofeedback et des autres techniques d’amélioration cognitive : le manque de transfert, en utilisant une méthode pouvant être intégrée directement dans le contexte dans lequel l’amélioration de la performance est souhaitée.The domain of cognitive enhancement is vast, spanning behavioral, biochemical and physical applications. The techniques are as numerous as are the limitations: poorly conducted studies, ethically ambiguous practices, limited positive effects, significant side-effects, high financial costs, significant time investment, unequal accessibility, and lack of transfer. The purpose of this thesis is to propose a novel way of integrating one of these techniques, neurofeedback, directly into a learning context in order to enhance cognitive performance and learning. This thesis provides the framework, empirical foundations, and supporting evidence for a highly efficient ‘closed-loop’ learning paradigm. By manipulating task difficulty based on a measure of cognitive load within a classic learning scenario (3-dimentional multiple object tracking) using real-time brain activity, results demonstrate that over 10 sessions, speed and degree of learning can be substantially improved compared with a classic learning system or an active sham-control group. Superior performance persists even once the feedback signal is removed, which suggests that the effects of enhanced training are consolidated and do not rely on continued feedback. Next, this thesis examines how these effects occur, exploring the neural correlates of the states of preparedness and performance across baseline and task conditions, further examining correlates related to trial results (correct/incorrect) and task difficulty (slow/medium/fast speeds). Cognitive preparedness, performance and load are measured using well-established relationships between real-time quantified brain activity as measured by quantitative electroencephalography. It is shown that the addition of neurofeedback-based task assistance based on peak alpha frequency is appropriate to task conditions and manages to influence cognitive load, keeping the subject in the zone of proximal development more often, facilitating learning and improving performance. This type of learning paradigm could contribute to overcoming at least one of the fundamental limitations of neurofeedback and other cognitive enhancement techniques : a lack of observable transfer effects, by utilizing a method that can be directly integrated into the context in which improved performance is sought

Assessing the transfer of video game play versus attention training using 3D-Multiple Object Tracking

Durant la dernière décennie, la recherche sur les jeux vidéo et leur implication sur les habiletés perceptivo-cognitives a gagné en intérêt. Plusieurs études ont démontré que les jeux vidéo (particulièrement les jeux d’action) possèdent la capacité d’influencer et d’améliorer différentes aptitudes perceptives et cognitives telles que l’attention visuo-spatiale, la vitesse de traitement de l’information, la mémoire visuelle à court terme ainsi que la poursuite d’objets en mouvement. Cependant, plusieurs autres études n’ont pas réussi à reproduire les mêmes résultats. D’un autre côté, un nouveau type d’entraînement perceptivo-cognitif, nommé 3-Dimensional Multiple-Object Tracking (3D-MOT), et qui consiste à traiter des scènes visuelles dynamiques dénuées de contexte, a démontré son implication sur différents types d’attention, la mémoire de travail ainsi que la vitesse de traitement de l’information. L’étude actuelle a examiné quatre groupes de joueurs inexpérimentés qui s’entrainaient durant 10 séances à l’aide d’un exercice perceptivo-cognitif (3D-MOT), ou d’un jeu de haut niveau visuel (jeu vidéo d’action : Call of Duty), de bas niveau visuel (Tetris) ou d’un jeu non-visuel (Sudoku). Des mesures d’électroencéphalographie quantitative et des tests neuropsychologiques effectués avant et après l’entraînement ont démontré que le 3D-MOT, par comparaison aux autres jeux testés, améliorait de façon plus efficace les fonctions reliées à l’attention, la mémoire de travail ainsi que la vitesse de traitement de l’information. Pour la première fois, cette étude démontre que l’entraînement non-contextuel de 3D-MOT améliore les habiletés perceptivo-cognitives plus efficacement que l’entraînement à des jeux de divertissement tels que les jeux vidéo.In the past decade, research on video games and their implications on cognitive abilities have gained significant interest. Various studies suggest that video games (in particular action video games) have the inherent ability to influence and improve attentional abilities such as visual spatial attention, processing speed, visual short-term memory and multiple-object tracking. However, many other studies have been unable to replicate similar results. On the other hand, a recent cognitive enhancement tool that is visually dynamic and void of context called 3-Dimensional Multiple-Object tracking (3D-MOT), has demonstrated robust effects on cognitive-perceptual abilities such as divided, selective, and sustained attention as well as working memory and information processing speed. The current study examines four groups of non-video game players that train for 10 sessions on the cognitive enhancing technique (3D-MOT) or on one of three different visually stimulating games: highly visually stimulating game (Call of Duty), lowly visually stimulating game (Tetris), or non-visually stimulating puzzle (Sudoku). A battery of cognitive tests and quantitative electroencephalography preformed before and after training, demonstrated that training on 3D-MOT improved cognitive functions related to attention, working memory, and visual information processing compared to video games. For the first time, this study demonstrated that non-contextual training with 3D-MOT improves perceptual-cognitive abilities more efficiently than video game playing

The development of sensitivity to threat among children and adolescents

Several theories of adolescent brain development suggest that adolescence is a sensitive period of development characterized by the onset of internalizing problems, such as anxiety. Sensitivity to threat, a heightened responsiveness to aversive situations, has been suggested to be a precursor to anxiety, highlighting the importance of understanding sensitivity to threat among children and adolescents. Yet relatively little is known about the development of sensitivity to threat. Further, identifying the neural indicators that are associated with heightened sensitivity to threat would help classify which youth are most at risk for anxiety. The primary goals of my dissertation were: 1) to explore whether adolescents, compared to children, have heightened sensitive to threat, 2) assess which neural indicators are associated with heightened sensitivity to threat, and 3) assess whether individual differences (e.g., in consistency of sensitivity to threat across time and situation) help predict which youth are most at risk for anxiety-related problems. Study 1 of my dissertation examined, with concurrent data, whether adolescents have greater neural sensitivity to negative feedback compared to children. Study 2 examined whether children and adolescents differ in their longitudinal trajectories of sensitivity to threat (e.g., consistency across time). I also was interested in whether these trajectories were associated with frontal asymmetry, a neural indicator associated with avoidance motivations. Study 3 extended the findings from Study 2 to examine consistency across threatening situations. While Studies 1 through 3 investigated whether adolescence is a period of heightened sensitivity to threat, Study 4 of my dissertation used a latent class analysis to investigate whether individual differences in sensitivity to threat, impulsivity, and emotion dysregulation are associated with anxiety and/or risk taking. Results indicated that adolescence (especially when defined by pubertal status), may be a normative period for sensitivity to threat. At the same time, not all youth who are sensitive to threat go on to develop anxiety; thus, it may be that for many adolescents, sensitivity to threat is an adolescent-limited phenomenon, meaning that threat sensitivity may peak in adolescence, but then tapers off into adulthood. Importantly, neural indicators associated with threat sensitivity helped identify which youth may have the highest levels of threat sensitivity. Overall, my dissertation shows that while some level of sensitivity to threat is normative, it is less common for youth to be consistently sensitive to threats and importantly, these youth who are consistently sensitive appear to be most at risk. Taken together, the four studies of my dissertation incorporate EEG, longitudinal designs, multiple indicators of development (age and pubertal status), and self-report data to gain a holistic understanding of sensitivity to threat from childhood to adolescence

Connecting the Brain to Itself through an Emulation.

Pilot clinical trials of human patients implanted with devices that can chronically record and stimulate ensembles of hundreds to thousands of individual neurons offer the possibility of expanding the substrate of cognition. Parallel trains of firing rate activity can be delivered in real-time to an array of intermediate external modules that in turn can trigger parallel trains of stimulation back into the brain. These modules may be built in software, VLSI firmware, or biological tissue as in vitro culture preparations or in vivo ectopic construct organoids. Arrays of modules can be constructed as early stage whole brain emulators, following canonical intra- and inter-regional circuits. By using machine learning algorithms and classic tasks known to activate quasi-orthogonal functional connectivity patterns, bedside testing can rapidly identify ensemble tuning properties and in turn cycle through a sequence of external module architectures to explore which can causatively alter perception and behavior. Whole brain emulation both (1) serves to augment human neural function, compensating for disease and injury as an auxiliary parallel system, and (2) has its independent operation bootstrapped by a human-in-the-loop to identify optimal micro- and macro-architectures, update synaptic weights, and entrain behaviors. In this manner, closed-loop brain-computer interface pilot clinical trials can advance strong artificial intelligence development and forge new therapies to restore independence in children and adults with neurological conditions

Large‐scale collaboration in ENIGMA‐EEG: A perspective on the meta‐analytic approach to link neurological and psychiatric liability genes to electrophysiological brain activity.

Background and purpose The ENIGMA-EEG working group was established to enable large-scale international collaborations among cohorts that investigate the genetics of brain function measured with electroencephalography (EEG). In this perspective, we will discuss why analyzing the genetics of functional brain activity may be crucial for understanding how neurological and psychiatric liability genes affect the brain. Methods We summarize how we have performed our currently largest genome-wide association study of oscillatory brain activity in EEG recordings by meta-analyzing the results across five participating cohorts, resulting in the first genome-wide significant hits for oscillatory brain function located in/near genes that were previously associated with psychiatric disorders. We describe how we have tackled methodological issues surrounding genetic meta-analysis of EEG features. We discuss the importance of harmonizing EEG signal processing, cleaning, and feature extraction. Finally, we explain our selection of EEG features currently being investigated, including the temporal dynamics of oscillations and the connectivity network based on synchronization of oscillations. Results We present data that show how to perform systematic quality control and evaluate how choices in reference electrode and montage affect individual differences in EEG parameters. Conclusion The long list of potential challenges to our large-scale meta-analytic approach requires extensive effort and organization between participating cohorts; however, our perspective shows that these challenges are surmountable. Our perspective argues that elucidating the genetic of EEG oscillatory activity is a worthwhile effort in order to elucidate the pathway from gene to disease liability

Large-scale collaboration in ENIGMA-EEG: A perspective on the meta-analytic approach to link neurological and psychiatric liability genes to electrophysiological brain activity

BACKGROUND AND PURPOSE: The ENIGMA-EEG working group was established to enable large-scale international collaborations among cohorts that investigate the genetics of brain function measured with electroencephalography (EEG). In this perspective, we will discuss why analyzing the genetics of functional brain activity may be crucial for understanding how neurological and psychiatric liability genes affect the brain. METHODS: We summarize how we have performed our currently largest genome-wide association study of oscillatory brain activity in EEG recordings by meta-analyzing the results across five participating cohorts, resulting in the first genome-wide significant hits for oscillatory brain function located in/near genes that were previously associated with psychiatric disorders. We describe how we have tackled methodological issues surrounding genetic meta-analysis of EEG features. We discuss the importance of harmonizing EEG signal processing, cleaning, and feature extraction. Finally, we explain our selection of EEG features currently being investigated, including the temporal dynamics of oscillations and the connectivity network based on synchronization of oscillations. RESULTS: We present data that show how to perform systematic quality control and evaluate how choices in reference electrode and montage affect individual differences in EEG parameters. CONCLUSION: The long list of potential challenges to our large-scale meta-analytic approach requires extensive effort and organization between participating cohorts; however, our perspective shows that these challenges are surmountable. Our perspective argues that elucidating the genetic of EEG oscillatory activity is a worthwhile effort in order to elucidate the pathway from gene to disease liability