Modelling human emotions using immersive virtual reality, physiological signals and behavioural responses

Tesis por compendio[ES] El uso de la realidad virtual (RV) se ha incrementado notablemente en la comunidad científica para la investigación del comportamiento humano. En particular, la RV inmersiva ha crecido debido a la democratización de las gafas de realidad virtual o head mounted displays (HMD), que ofrecen un alto rendimiento con una inversión económica. Uno de los campos que ha emergido con fuerza en la última década es el Affective Computing, que combina psicofisiología, informática, ingeniería biomédica e inteligencia artificial, desarrollando sistemas que puedan reconocer emociones automáticamente. Su progreso es especialmente importante en el campo de la investigación del comportamiento humano, debido al papel fundamental que las emociones juegan en muchos procesos psicológicos como la percepción, la toma de decisiones, la creatividad, la memoria y la interacción social. Muchos estudios se han centrado en intentar obtener una metodología fiable para evocar y automáticamente identificar estados emocionales, usando medidas fisiológicas objetivas y métodos de aprendizaje automático. Sin embargo, la mayoría de los estudios previos utilizan imágenes, audios o vídeos para generar los estados emocionales y, hasta donde llega nuestro conocimiento, ninguno de ellos ha desarrollado un sistema de reconocimiento emocional usando RV inmersiva. Aunque algunos trabajos anteriores sí analizan las respuestas fisiológicas en RV inmersivas, estos no presentan modelos de aprendizaje automático para procesamiento y clasificación automática de bioseñales. Además, un concepto crucial cuando se usa la RV en investigación del comportamiento humano es la validez: la capacidad de evocar respuestas similares en un entorno virtual a las evocadas por el espacio físico. Aunque algunos estudios previos han usado dimensiones psicológicas y cognitivas para comparar respuestas entre entornos reales y virtuales, las investigaciones que analizan respuestas fisiológicas o comportamentales están mucho menos extendidas. Según nuestros conocimientos, este es el primer trabajo que compara entornos físicos con su réplica en RV, empleando respuestas fisiológicas y algoritmos de aprendizaje automático y analizando la capacidad de la RV de transferir y extrapolar las conclusiones obtenidas al entorno real que se está simulando. El objetivo principal de la tesis es validar el uso de la RV inmersiva como una herramienta de estimulación emocional usando respuestas psicofisiológicas y comportamentales en combinación con algoritmos de aprendizaje automático, así como realizar una comparación directa entre un entorno real y virtual. Para ello, se ha desarrollado un protocolo experimental que incluye entornos emocionales 360º, un museo real y una virtualización 3D altamente realista del mismo museo. La tesis presenta novedosas contribuciones del uso de la RV inmersiva en la investigación del comportamiento humano, en particular en lo relativo al estudio de las emociones. Esta ayudará a aplicar metodologías a estímulos más realistas para evaluar entornos y situaciones de la vida diaria, superando las actuales limitaciones de la estimulación emocional que clásicamente ha incluido imágenes, audios o vídeos. Además, en ella se analiza la validez de la RV realizando una comparación directa usando una simulación altamente realista. Creemos que la RV inmersiva va a revolucionar los métodos de estimulación emocional en entornos de laboratorio. Además, su sinergia junto a las medidas fisiológicas y las técnicas de aprendizaje automático, impactarán transversalmente en muchas áreas de investigación como la arquitectura, la salud, la evaluación psicológica, el entrenamiento, la educación, la conducción o el marketing, abriendo un nuevo horizonte de oportunidades para la comunidad científica. La presente tesis espera contribuir a caminar en esa senda.[EN] In recent years the scientific community has significantly increased its use of virtual reality (VR) technologies in human behaviour research. In particular, the use of immersive VR has grown due to the introduction of affordable, high performance head mounted displays (HMDs). Among the fields that has strongly emerged in the last decade is affective computing, which combines psychophysiology, computer science, biomedical engineering and artificial intelligence in the development of systems that can automatically recognize emotions. The progress of affective computing is especially important in human behaviour research due to the central role that emotions play in many background processes, such as perception, decision-making, creativity, memory and social interaction. Several studies have tried to develop a reliable methodology to evoke and automatically identify emotional states using objective physiological measures and machine learning methods. However, the majority of previous studies used images, audio or video to elicit emotional statements; to the best of our knowledge, no previous research has developed an emotion recognition system using immersive VR. Although some previous studies analysed physiological responses in immersive VR, they did not use machine learning techniques for biosignal processing and classification. Moreover, a crucial concept when using VR for human behaviour research is validity: the capacity to evoke a response from the user in a simulated environment similar to the response that might be evoked in a physical environment. Although some previous studies have used psychological and cognitive dimensions to compare responses in real and virtual environments, few have extended this research to analyse physiological or behavioural responses. Moreover, to our knowledge, this is the first study to compare VR scenarios with their real-world equivalents using physiological measures coupled with machine learning algorithms, and to analyse the ability of VR to transfer and extrapolate insights obtained from VR environments to real environments. The main objective of this thesis is, using psycho-physiological and behavioural responses in combination with machine learning methods, and by performing a direct comparison between a real and virtual environment, to validate immersive VR as an emotion elicitation tool. To do so we develop an experimental protocol involving emotional 360º environments, an art exhibition in a real museum, and a highly-realistic 3D virtualization of the same art exhibition. This thesis provides novel contributions to the use of immersive VR in human behaviour research, particularly in relation to emotions. VR can help in the application of methodologies designed to present more realistic stimuli in the assessment of daily-life environments and situations, thus overcoming the current limitations of affective elicitation, which classically uses images, audio and video. Moreover, it analyses the validity of VR by performing a direct comparison using highly-realistic simulation. We believe that immersive VR will revolutionize laboratory-based emotion elicitation methods. Moreover, its synergy with physiological measurement and machine learning techniques will impact transversely in many other research areas, such as architecture, health, assessment, training, education, driving and marketing, and thus open new opportunities for the scientific community. The present dissertation aims to contribute to this progress.[CA] L'ús de la realitat virtual (RV) s'ha incrementat notablement en la comunitat científica per a la recerca del comportament humà. En particular, la RV immersiva ha crescut a causa de la democratització de les ulleres de realitat virtual o head mounted displays (HMD), que ofereixen un alt rendiment amb una reduïda inversió econòmica. Un dels camps que ha emergit amb força en l'última dècada és el Affective Computing, que combina psicofisiologia, informàtica, enginyeria biomèdica i intel·ligència artificial, desenvolupant sistemes que puguen reconéixer emocions automàticament. El seu progrés és especialment important en el camp de la recerca del comportament humà, a causa del paper fonamental que les emocions juguen en molts processos psicològics com la percepció, la presa de decisions, la creativitat, la memòria i la interacció social. Molts estudis s'han centrat en intentar obtenir una metodologia fiable per a evocar i automàticament identificar estats emocionals, utilitzant mesures fisiològiques objectives i mètodes d'aprenentatge automàtic. No obstant això, la major part dels estudis previs utilitzen imatges, àudios o vídeos per a generar els estats emocionals i, fins on arriba el nostre coneixement, cap d'ells ha desenvolupat un sistema de reconeixement emocional mitjançant l'ús de la RV immersiva. Encara que alguns treballs anteriors sí que analitzen les respostes fisiològiques en RV immersives, aquests no presenten models d'aprenentatge automàtic per a processament i classificació automàtica de biosenyals. A més, un concepte crucial quan s'utilitza la RV en la recerca del comportament humà és la validesa: la capacitat d'evocar respostes similars en un entorn virtual a les evocades per l'espai físic. Encara que alguns estudis previs han utilitzat dimensions psicològiques i cognitives per a comparar respostes entre entorns reals i virtuals, les recerques que analitzen respostes fisiològiques o comportamentals estan molt menys esteses. Segons els nostres coneixements, aquest és el primer treball que compara entorns físics amb la seua rèplica en RV, emprant respostes fisiològiques i algorismes d'aprenentatge automàtic i analitzant la capacitat de la RV de transferir i extrapolar les conclusions obtingudes a l'entorn real que s'està simulant. L'objectiu principal de la tesi és validar l'ús de la RV immersiva com una eina d'estimulació emocional usant respostes psicofisiològiques i comportamentals en combinació amb algorismes d'aprenentatge automàtic, així com realitzar una comparació directa entre un entorn real i virtual. Per a això, s'ha desenvolupat un protocol experimental que inclou entorns emocionals 360º, un museu real i una virtualització 3D altament realista del mateix museu. La tesi presenta noves contribucions de l'ús de la RV immersiva en la recerca del comportament humà, en particular quant a l'estudi de les emocions. Aquesta ajudarà a aplicar metodologies a estímuls més realistes per a avaluar entorns i situacions de la vida diària, superant les actuals limitacions de l'estimulació emocional que clàssicament ha inclòs imatges, àudios o vídeos. A més, en ella s'analitza la validesa de la RV realitzant una comparació directa usant una simulació altament realista. Creiem que la RV immersiva revolucionarà els mètodes d'estimulació emocional en entorns de laboratori. A més, la seua sinergia al costat de les mesures fisiològiques i les tècniques d'aprenentatge automàtic, impactaran transversalment en moltes àrees de recerca com l'arquitectura, la salut, l'avaluació psicològica, l'entrenament, l'educació, la conducció o el màrqueting, obrint un nou horitzó d'oportunitats per a la comunitat científica. La present tesi espera contribuir a caminar en aquesta senda.Marín Morales, J. (2020). Modelling human emotions using immersive virtual reality, physiological signals and behavioural responses [Tesis doctoral no publicada]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/148717TESISCompendi

DeReFrame: a design-research framework to study game mechanics and game aesthetics in an engineering design process

The main aim of this research is to study gaming techniques and elements that may potentially be beneficial to the future development of CAD systems for engineering design, in particular to maintain cognitive engagement. A design-research framework, called DeReFrame, was employed to construct an experimental game-based CAD framework exploring this. This research is based on reviews from the literature and experimental studies and include quantitative and qualitative data analysis methods measuring engineers’ performance and emotional responses. The thesis presents the construction process of the framework (DeReframe) to study a set of game mechanics and game aesthetics in an engineering design process and compare this with the traditional CAD. The framework was used to design and implement a game-based CAD system, called ICAD which was embedded with the following game mechanics of Directional Goals, Progression, Performance-Feedback and Rewards-Achievement. The DeReFrame and ICAD evolved through the experimental studies. In each case, selected game mechanics were at the core of each interaction and iteration which gave rise to feelings of progress, competence and mastery. The final results from the DeReFrame framework and ICAD indicated that gamified approaches should be included in engineering design with CAD: in particular the game mechanics of performance feedback and rewards-achievements influence engineers’ behaviour by supporting them within the problem-solving process creating an engaging-challenging interaction. In conclusion, this research has shown that a framework, that includes both engineering requirements and gamified aspects into consideration, cam serve as a basis for implementing game-based CAD to facilitate performance by providing engaging experiences for engineers

Anticipatory Mobile Computing: A Survey of the State of the Art and Research Challenges

Today's mobile phones are far from mere communication devices they were ten years ago. Equipped with sophisticated sensors and advanced computing hardware, phones can be used to infer users' location, activity, social setting and more. As devices become increasingly intelligent, their capabilities evolve beyond inferring context to predicting it, and then reasoning and acting upon the predicted context. This article provides an overview of the current state of the art in mobile sensing and context prediction paving the way for full-fledged anticipatory mobile computing. We present a survey of phenomena that mobile phones can infer and predict, and offer a description of machine learning techniques used for such predictions. We then discuss proactive decision making and decision delivery via the user-device feedback loop. Finally, we discuss the challenges and opportunities of anticipatory mobile computing.Comment: 29 pages, 5 figure

Analysis and evaluation of the pilot attentional model

Pendant les opérations de vol, les pilotes sont exposés à une variété de conditions émotionnelles, mentales et physiques qui peuvent affecter leurs performances et leur attention. Par conséquent, il est crucial de surveiller leur charge de travail et leurs niveaux d'attention pour maintenir la sécurité et l'efficacité de l'aviation, notamment dans les situations d'urgence. La charge de travail fait référence aux exigences cognitives et physiques imposées aux pilotes lors d'un vol. Des niveaux élevés de charge de travail peuvent entraîner une fatigue mentale, une attention réduite et une surcharge cognitive, ce qui peut entraver leur capacité à effectuer leurs tâches de manière efficace et efficiente. L'attention est un processus cognitif complexe qui limite la capacité de se concentrer et de comprendre tout en même temps. Dans les tâches de traitement de l'information visuelle, la vision humaine est la principale source du mécanisme d'attention visuelle. Le mode de distribution de l'attention d'un pilote a un impact significatif sur la quantité d'informations qu'il acquiert, car la vision est le canal le plus critique pour l'acquisition d'informations. Une mauvaise allocation des ressources attentionnelles peut amener les pilotes à négliger ou à oublier des paramètres spécifiques, ce qui entraîne des risques graves pour la sécurité des aéronefs. Ainsi, cette étude vise à étudier les niveaux d'attention des pilotes lors d'une procédure de décollage simulée, en mettant l'accent particulièrement sur les périodes critiques telles que les pannes de moteur. Pour ce faire, l'étude examine s'il existe une corrélation entre la dilatation de la pupille, mesurée à l'aide de la technologie de suivi oculaire, et les niveaux d'engagement, mesurés à l'aide de l'EEG. Les résultats indiquent que les changements de taille de la pupille sont effectivement corrélés aux changements d'activité de l'EEG, suggérant que la dilatation de la pupille peut être utilisée comme un indicateur fiable de l'engagement et de l'attention. Sur la base de ces résultats, la dilatation de la pupille et l'EEG peuvent être utilisés en combinaison pour examiner de manière globale le comportement des pilotes, car les deux mesures sont des indicateurs valides de l'engagement et de la charge cognitive. De plus, l'utilisation de ces mesures peut aider à identifier les périodes critiques où les niveaux d'attention des pilotes nécessitent une surveillance étroite pour garantir la sécurité et l'efficacité de l'aviation. Cette étude met en évidence l'importance de surveiller la charge de travail et les niveaux d'attention des pilotes et recommande d'utiliser les mesures de dilatation de la pupille et d'EEG pour évaluer la charge cognitive et l'engagement d'un pilote pendant les opérations de vol, améliorant ainsi la sécurité et l'efficacité de l'aviation.During flight operations, pilots are exposed to a variety of emotional, mental, and physical conditions that can affect their performance and attention. Therefore, it is crucial to monitor their workload and attention levels to maintain aviation safety and efficiency, particularly in emergency situations. Workload refers to the cognitive and physical demands placed on pilots during a flight. High levels of workload can lead to mental fatigue, reduced attention, and cognitive overload, which can hinder their ability to perform their tasks effectively and efficiently. Attention is a complex cognitive process that limits the ability to focus and comprehend everything simultaneously. In visual information processing tasks, human vision is the primary source of the visual attention mechanism. A pilot's attention distribution mode significantly impacts the amount of information they acquire, as vision is the most critical channel for information acquisition. Improper allocation of attention resources can cause pilots to overlook or forget specific parameters, resulting in severe risks to aircraft safety. Thus, this study aims to investigate pilots' attention levels during a simulated takeoff procedure, with a specific focus on critical periods such as engine failures. To achieve this, the study examines whether there is a correlation between pupil dilation, measured using eye-tracking technology, and engagement levels, measured using EEG. The results indicate that changes in pupil size are indeed correlated with changes in EEG activity, suggesting that pupil dilation can be used as a reliable indicator of engagement and attention. Based on these findings, pupil dilation and EEG can be used in combination to comprehensively examine pilot behavior since both measures are valid indicators of engagement and cognitive workload. Furthermore, using these measures can help identify critical periods where pilots' attention levels require close monitoring to ensure aviation safety and efficiency. This study emphasizes the significance of monitoring pilots' workload and attention levels and recommends using pupil dilation and EEG measures to assess a pilot's cognitive workload and engagement during flight operations, ultimately enhancing aviation safety and efficiency

Exploring Effects of Background Music in A Serious Game on Attention by Means of EEG Signals in Children

Music and Serious Games are separately useful alternative therapy methods for helping people with a cognitive disorder, including Attention Deficit Hyperactivity Disorder (ADHD). The goal of this thesis is to explore the effect of background music on children with and without ADHD. In this study, a simple Tetris game is designed with Beethoven, Mozart music, and no-music. There are different brainwave techniques for recording; among others, the electroencephalography (EEG) allows for the most efficient use of BCI. We recorded the EEG brain signals of the regular and ADHD subjects who played the Tetris we designed according to our protocol that consists of three trials with three different background music. Attention related Alpha and Beta waves of EEG signals analyzed based on time and time-frequency domain features. The changes in the data over the 1-minute Tetris game sections are investigated with the Short-time Fourier Transform (STFT) method. The results showed that music has a considerable impact on attention of children. When it comes to music types, in general, Mozart music increases Beta waves while decreasing the Alpha band waves for subjects without ADHD. On the other hand, Beethoven music increased both Alpha and Beta band values for children with ADHD

Effectiveness analysis of traditional and mixed reality simulations in medical training: a methodological approach for the assessment of stress, cognitive load and performance

La simulazione nell'educazione in medicina è considerata un metodo di formazione in grado di migliorare le competenze cliniche e il comportamento degli operatori sanitari e, di conseguenza, la qualità dell'assistenza per il paziente. Inoltre, l'utilizzo di nuove tecnologie come la Realtà Aumentata, offre ai discenti l'opportunità di esercitarsi in un ambiente immersivo. L'opportunità di sperimentare questo innovativo metodo didattico è efficace non solo nel ridurre il rischio di errori e approcci sbagliati ma anche nel provare ansia e stress simili a quelli avvertiti nella pratica reale. La sfida sta nel trovare il giusto equilibrio. I discenti devono infatti provare lo stesso stress che avvertirebbero lavorando ad un vero caso clinico ma, allo stesso tempo, devono essere controllati ed evitati possibili disturbi da stress post-traumatico, verificabili soprattutto nel campo della gestione delle emergenze (pronto soccorso). Inoltre, è fondamentale anche ottenere alte prestazioni e un apprendimento adeguato, evitando sovraccarichi cognitivi che influenzerebbero negativamente l’apprendimento. Tuttavia, ad oggi mancano ancora studi approfonditi sull'impatto che le simulazioni mediche hanno su stress, frustrazione, carico cognitivo e apprendimento dei discenti. Per questo motivo, l'obiettivo principale di questo studio è valutare l'efficacia del training tramite simulazione, analizzando prestazioni, ansia, stress e carico cognitivo durante simulazioni cliniche tradizionali (con manichino) ed avanzate (in realtà mista). A questo scopo, è stato sviluppato un approccio metodologico strutturato e completo per valutare le prestazioni, le condizioni emotive e cognitive degli studenti. Questo comprende l'acquisizione e l'analisi di parametri psicologici (valutazione soggettiva), segnali biometrici (valutazione oggettiva) e prestazioni. Questa indagine consente di evidenziare i punti deboli delle simulazioni e offre l'opportunità di definire utili linee guida per la riprogettazione e l'ottimizzazione delle stesse. La metodologia è stata applicata su tre casi studio: il primo si riferisce a simulazioni ad alta fedeltà per la gestione del paziente in pronto soccorso, il secondo si riferisce a simulazioni a bassa fedeltà per la pratica della rachicentesi. Per il terzo caso studio, è stato progettato e sviluppato un prototipo di simulatore in realtà mista per la rachicentesi, con l'obiettivo di migliorare il senso di realismo e immersione della simulazione a bassa fedeltà. 148 studenti sono stati coinvolti nei primi due casi studio osservazionali, mentre soltanto 36 studenti hanno preso parte allo studio pilota sulla simulazione in realtà mista. In tutti i casi di studio sono state effettuate analisi descrittive delle prestazioni, degli stati cognitivi ed emotivi. Per le simulazioni ad alta e bassa fedeltà, le analisi di regressione statistica hanno evidenziato quali variabili influenzano le prestazioni, lo stress e il carico cognitivo degli studenti. Per lo studio pilota sulla realtà mista, l'analisi della user experience ha sottolineato i limiti tecnici della nuova tecnologia.Simulation in medical education is considered a training method capable of improving clinical competence and practitioners’ behaviour, and, consequently quality of care and patient’s outcome. Moreover, the use of new technologies, such as augmented reality, offers to the learners the opportunity to engage themselves in an immersive environment. The opportunity to experiment with this innovative instructional method is effective not only in reducing the risk of errors and wrong approaches but also in experiencing anxiety and stress as in real practice. The challenge is to find the right stress balance: learners have to feel as if they were practicing in the real stressful clinical case, and, at the same time, post-traumatic stress disorders, verifiable especially in the emergency field, must be controlled and avoided. Moreover, it is fundamental also to obtain high performance and learning, thus avoiding cognitive overloads. However, extensive researches about the impact of medical simulations on students’ stress, frustration, cognitive load, and learning are still lacking. For this reason, the main objective of this study is to assess simulation training effectiveness by analysing performance, anxiety, stress, and cognitive load during traditional (with manikin) and advanced (with augmented reality) clinical simulations. A structured and comprehensive methodological approach to assess performance, emotional and cognitive conditions of students has been developed. It includes the acquisition and analysis of psychological parameters (subjective assessment), biometric signals (objective assessment), and task performance. This investigation allows to point out simulations’ weaknesses and offers the opportunity to define useful optimisation guidelines. The methodology has been applied to three case studies: the first one refers to high-fidelity simulations, for the patient management in the emergency room, the second one refers to low-fidelity simulation for rachicentesis. For the third case study, a prototype of a mixed reality simulator for the rachicentesis practice has been designed and developed aiming at improving the sense of realism and immersion of the low-fidelity simulation. While 148 students have been enrolled in the first two case studies, only 36 students have taken part in the pilot study about mixed reality simulation. Descriptive analysis about performance, cognitive and emotional states have been done in all the case studies. For the high-fidelity and low-fidelity simulations, the statistical regression analysis has pointed out which variables affect students’ performance, stress, and cognitive load. For the pilot study about mixed reality, the user experience analysis highlighted the technical limitations of the new technology

Identification of the Neurobiological Basis of Hemodynamic Responses Correlated with Cognitive Stroop Task Performance After an Acute Bout of Aerobic Exercise

Cardiovascular activities may increase the brain blood flow improving neuronal activities leading to improved cognition. Consequently, the effects of an acute bout of moderate intensity aerobic exercise on brain hemodynamics and its correlation with cognitive color-word Stroop task performance were tested. The Stroop tasks were congruent (color matches word) and incongruent (color does not match word). Prefrontal (PFC) and motor cortex (MC) blood flow was recorded by fNIRS (functional near-infrared spectroscopy) while the subject was performing the Stroop tasks before and after the 30 minutes of exercise or equivalent time of rest controls (checking for practice effects). Ninety human subjects of age 24± 6, 20 ADHD (attention-deficit hyper-activity disorder), 27 High-BMI (>25), 29 males were recruited. Reaction time ‘RT' decreased (p<0.05) after exercise for both the congruent (12%) and incongruent (10%) Stroop tasks, compared to 8% with practice alone. Accuracy did not change after practice or exercise. HR changes after exercise correlated (p<0.05) with better accuracy and faster RT for the incongruent Stroop task. In general, a metabolic lag occurred in the neuronal deoxy- hemoglobin (Hb) signals behind the systemic oxy-Hb signals. PFC showed the highest effect sizes of Stroop task-responsive systemic hemodynamic changes compared to baseline irrespective of rest or exercise. Yet, PFC showed most significant (p<0.001) neuronal hemodynamic changes between the before and after exercise sessions, and these changes were opposite for right and left PFC, and opposite for congruent and incongruent Stroop tasks. Correlating the RT and mistakes with hemodynamics for both the Stroop tasks revealed that, after exercise, neuronal hemodynamic changes occurred at both PFC and MC associated with faster RT (p<0.05), and systemic hemodynamic responses occurred at PFC correlated (p<0.05) with mistakes. Overall, it was concluded that exercise changed the neuronal hemodynamic changes affecting speed; however, neuronal metabolic changes did not occur sufficiently to help improve accuracy in all subjects

Cognitive Decay And Memory Recall During Long Duration Spaceflight

This dissertation aims to advance the efficacy of Long-Duration Space Flight (LDSF) pre-flight and in-flight training programs, acknowledging existing knowledge gaps in NASA\u27s methodologies. The research\u27s objective is to optimize the cognitive workload of LDSF crew members, enhance their neurocognitive functionality, and provide more meaningful work experiences, particularly for Mars missions.The study addresses identified shortcomings in current training and learning strategies and simulation-based training systems, focusing on areas requiring quantitative measures for astronaut proficiency and training effectiveness assessment. The project centers on understanding cognitive decay and memory loss under LDSF-related stressors, seeking to establish when such cognitive decline exceeds acceptable performance levels throughout mission phases. The research acknowledges the limitations of creating a near-orbit environment due to resource constraints and the need to develop engaging tasks for test subjects. Nevertheless, it underscores the potential impact on future space mission training and other high-risk professions. The study further explores astronaut training complexities, the challenges encountered in LDSF missions, and the cognitive processes involved in such demanding environments. The research employs various cognitive and memory testing events, integrating neuroimaging techniques to understand cognition\u27s neural mechanisms and memory. It also explores Rasmussen\u27s S-R-K behaviors and Brain Network Theory’s (BNT) potential for measuring forgetting, cognition, and predicting training needs. The multidisciplinary approach of the study reinforces the importance of integrating insights from cognitive psychology, behavior analysis, and brain connectivity research. Research experiments were conducted at the University of North Dakota\u27s Integrated Lunar Mars Analog Habitat (ILMAH), gathering data from selected subjects via cognitive neuroscience tools and Electroencephalography (EEG) recordings to evaluate neurocognitive performance. The data analysis aimed to assess brain network activations during mentally demanding activities and compare EEG power spectra across various frequencies, latencies, and scalp locations. Despite facing certain challenges, including inadequacies of the current adapter boards leading to analysis failure, the study provides crucial lessons for future research endeavors. It highlights the need for swift adaptation, continual process refinement, and innovative solutions, like the redesign of adapter boards for high radio frequency noise environments, for the collection of high-quality EEG data. In conclusion, while the research did not reveal statistically significant differences between the experimental and control groups, it furnished valuable insights and underscored the need to optimize astronaut performance, well-being, and mission success. The study contributes to the ongoing evolution of training methodologies, with implications for future space exploration endeavors