Using a serious game to assess spatial memory in children and adults

Short-term spatial memory has traditionally been assessed using visual stimuli, but not auditory stimuli. In this paper, we design and test a serious game with auditory stimuli for assessing short-term spatial memory. The interaction is achieved by gestures (by raising your arms). The auditory stimuli are emitted by smart devices placed at different locations. A total of 70 participants (32 children and 38 adults) took part in the study. The outcomes obtained with our game were compared with traditional methods. The results indicated that the outcomes in the game for the adults were significantly greater than those obtained by the children. This result is consistent with the assumption that the ability of humans increases continuously during maturation. Correlations were found between our game and traditional methods, suggesting its validity for assessing spatial memory. The results indicate that both groups easily learn how to perform the task and are good at recalling the locations of sounds emitted from different positions. With regard to satisfaction with our game, the mean scores of the children were higher for nearly all of the questions. The mean scores for all of the questions, except one, were greater than 4 on a scale from 1 to 5. These results show the satisfaction of the participants with our game. The results suggest that our game promotes engagement and allows the assessment of spatial memory in an ecological way

Expertise in chess

This chapter provides an overview of research into chess expertise. After an historical background and a brief description of the game and the rating system, it discusses the information processes enabling players to choose good moves, and in particular the trade-offs between knowledge and search. Other topics include blindfold chess, talent, and the role of deliberate practice and tournament experience

A Serious Game-Derived Index for Detecting Children With Heterogeneous Developmental Disabilities: Randomized Controlled Trial

BACKGROUND: Developmental disabilities are a set of heterogeneous delays or difficulties in one or more areas of neuropsychological development. Considering that childhood is an essential stage of brain development and developmental delays lead to personal or social burdens, the early detection of childhood developmental disabilities is important. However, early screening for developmental disabilities has been a challenge because of the fear of positive results, expensive tests, differences in diagnosis depending on examiners' abilities, and difficulty in diagnosis arising from the need for long-term follow-up observation. OBJECTIVE: This study aimed to assess the feasibility of using a serious game-derived index to identify heterogeneous developmental disabilities. This study also examines the correlation between the game-derived index and existing neuropsychological test results. METHODS: The randomized controlled trial involved 48 children with either normal development or developmental disabilities. In this clinical trial, we used 19 features (6 from the Korean-Wechsler Preschool and Primary Scale of Intelligence, 8 from the Psychoeducational Profile Revised, 2 from the Bruininks-Oseretsky Test of Motor Proficiency, Second Edition, and 3 from the Pediatric Evaluation of Disability Inventory) from neuropsychological tests and 9 (7 game scores, path accuracy, and completion rate) from the serious game, DoBrain. The following analysis was conducted based on participants' baseline information and neuropsychological test and game-derived index data for one week: (1) we compared the baseline information between the normal development and developmental disabilities groups; (2) then we measured the correlation between the game-derived index and the neuropsychological test scores for each group; and (3) we built a classifier based on the game-derived index with a Gaussian process method and then compared the area under the curve (AUC) with a model based on neuropsychological test results. RESULTS: A total of 16 children (normal development=9; developmental disabilities=7) were analyzed after selection. Their developmental abilities were assessed before they started to play the serious games, and statistically significant differences were found in both groups. Specifically, the normal development group was more developed than the developmental disabilities group in terms of social function, gross motor function, full-scale IQ, and visual motor imitation, in that order. Similarly, the normal development group obtained a higher score on the game-derived index than the developmental disabilities group. In the correlation analysis between the game-derived index and the neuropsychological tests, the normal development group showed greater correlation with more variables than the developmental disabilities group. The game-derived index-based model had an AUC=0.9, a similar detection value as the neuropsychological test-based model's AUC=0.86. CONCLUSIONS: A game-derived index based on serious games can detect children with heterogenous developmental disabilities. This suggests that serious games can be used as a potential screening tool for developmental disabilities. TRIAL REGISTRATION: Clinical Research Information Service KCT0003247; https://cris.nih.go.kr/cris/en/search/search_result_st01 .jsp?seq=12365.ope

Visualization and Interaction Technologies in Serious and Exergames for Cognitive Assessment and Training: A Survey on Available Solutions and Their Validation

Exergames and serious games, based on standard personal computers, mobile devices and gaming consoles or on novel immersive Virtual and Augmented Reality techniques, have become popular in the last few years and are now applied in various research fields, among which cognitive assessment and training of heterogeneous target populations. Moreover, the adoption of Web based solutions together with the integration of Artificial Intelligence and Machine Learning algorithms could bring countless advantages, both for the patients and the clinical personnel, as allowing the early detection of some pathological conditions, improving the efficacy and adherence to rehabilitation processes, through the personalisation of training sessions, and optimizing the allocation of resources by the healthcare system. The current work proposes a systematic survey of existing solutions in the field of cognitive assessment and training. We evaluate the visualization and interaction technologies commonly adopted and the measures taken to fulfil the need of the pathological target populations. Moreover, we analyze how implemented solutions are validated, i.e. The chosen experimental designs, data collection and analysis. Finally, we consider the availability of the applications and raw data to the large community of researchers and medical professionals and the actual application of proposed solutions in the standard clinical practice. Despite the potential of these technologies, research is still at an early stage. Although the recent release of accessible immersive virtual reality headsets and the increasing interest on vision-based techniques for tracking body and hands movements, many studies still rely on non-immersive virtual reality (67.2%), mainly mobile and personal computers, and standard gaming tools for interactions (41.5%). Finally, we highlight that although the interest of research community in this field is increasingly higher, the sharing of dataset (10.6%) and implemented applications (3.8%) should be promoted and the number of healthcare structures which have successfully introduced the new technological approaches in the treatment of their host patients is limited (10.2%)

An immersive virtual reality task with physical movement for the assessment of spatial memory

Tesis por compendioLa Realidad Virtual (RV) aún no se ha explotado en la evaluación de la memoria espacial. Los sistemas actuales de RV para la evaluación de la memoria espacial incluyen interacción mediante el uso de dispositivos tradicionales (por ejemplo, pantallas y teclados). Este tipo de interacción clásica con el sistema es ineficaz porque la sensación de presencia del usuario es muy pobre. Si el usuario no tiene la sensación de "estar ahí" en el entorno virtual, es posible que la memoria espacial no se evalúe correctamente. Por tanto, desarrollar un sistema que permita a los participantes estar activos en el entorno virtual, podría evaluar la memoria espacial de la misma forma que se puede evaluar en un entorno real. El objetivo principal de esta tesis fue diseñar, desarrollar y validar un sistema inmersivo de RV en el que el usuario pueda interactuar mediante movimiento físico. El entorno virtual se diseñó a partir de una ciudad con forma cuadrada. La tarea cognitiva, basada en dicho entorno, constaba de seis niveles. El objetivo de los niveles para la tarea principal era evaluar la memoria a corto plazo de los niños para la localización de objetos en el entorno virtual. El sistema de RV incorporó dos tipos de interacción. 1) Una condición física activa (caminar físicamente sobre una Wii Balance Board y cambiar la dirección girando un volante inalámbrico). 2) Una condición inactiva (estando de pie y usando un gamepad). Para la visualización de la tarea, se utilizó una pantalla grande y estéreo. Para la validación, se realizaron dos estudios (N=212). El rendimiento de nuestra tarea se comparó con métodos tradicionales. Se encontraron correlaciones entre nuestra tarea y los métodos tradicionales, lo que indica que nuestra tarea ha demostrado ser una herramienta válida para evaluar la memoria espacial a corto plazo en niños. Con respecto al tipo de interacción, los resultados mostraron que no hubo diferencias estadísticamente significativas con respecto a la puntuación obtenida en nuestra tarea y en función de la interacción utilizada. Éste es un buen resultado porque significa que la tarea es adecuada para la evaluación de la memoria espacial y que los dos tipos de interacción se pueden utilizar para este fin. Con respecto a las diferencias de género en la puntuación de la tarea y Corsi Block Tapping Test, los resultados indicaron que no hubo diferencias estadísticamente significativas para el género. Con respecto a facilidad de uso y satisfacción, se demostró que el uso de la condición inactiva no difirió significativamente de la condición física activa para las preguntas de usabilidad y satisfacción. Previamente al desarrollo del sistema de RV mencionado, desarrollamos un sistema de RV, con interfaces de usuario naturales (NUI) y una pantalla autoestereoscópica, para aprendizaje dental. El sistema incluye dos modos: fondo neutro y mundo real. Este sistema fue validado con 33 estudiantes. Con este primer desarrollo, se adquirió el conocimiento necesario para poder afrontar el segundo desarrollo, núcleo de la tesis. Las siguientes conclusiones generales se extrajeron de los 2 desarrollos y los 3 estudios: Aprendizaje - Los sistemas de RV con autoestereoscopía, con diferentes fondos y NUI, han demostrado ser herramientas eficaces para aprender la morfología dental - Con este tipo de sistemas, los niños pueden aprender y, al mismo tiempo, pueden divertirse - La estereoscopía y NUI son apropiadas para el desarrollo de juegos educativos y pueden ser explotadas en su desarrollo Memoria espacial - Los sistemas de RV, con estereoscopía y dos interfaces de usuario diferentes, han demostrado ser herramientas fiables y efectivas para evaluar la memoria espacial en niños - Con este tipo de sistemas, los niños pueden ser evaluados mientras se divierten - Nuestra tarea y tareas similares podrían usarse para evaluación y entrenamiento de la memoria en niños y adultosLa Realitat Virtual (RV) encara no s'ha explotat en l'avaluació de la memòria espacial. Els sistemes actuals de RV per a l'avaluació de la memòria espacial inclouen interacció mitjançant l'ús de dispositius tradicionals (per exemple, pantalles, ratolins o teclats). Aquest tipus d'interacció clàssica amb el sistema és ineficaç perquè la sensació de presència de l'usuari és molt pobre. Si l'usuari no té la sensació de "ser-hi" en l'entorn virtual, és possible que la memòria espacial no siga avaluada correctament. Per tant, desenvolupar un sistema que permeta als participants estar actius en l'entorn virtual, podria avaluar la memòria espacial de la mateixa manera que es pot avaluar en un entorn real. L'objectiu principal d'aquesta tesi va ser dissenyar, desenvolupar i validar un sistema immersiu de RV en el qual l'usuari puga interactuar mitjançant moviment físic. L'entorn virtual es va dissenyar a partir d'una ciutat amb forma quadrada. La tasca cognitiva constava de sis nivells. L'objectiu dels nivells per a la tasca principal era avaluar la memòria a curt termini dels xiquets per a la localització d'objectes en l'entorn virtual. El sistema de RV va incorporar dos tipus d'interacció. 1) Una condició física activa (caminar físicament sobre una Wii Balance Board i canviar la direcció girant un volant inalàmbric). 2) Una condició inactiva (estar dret i fent servir un gamepad). Per a la visualització de la tasca, es va utilitzar una pantalla gran i estèreo. Per a la validació, es van realitzar dos estudis (N=212). El rendiment de la nostra tasca es va comparar amb mètodes tradicionals. Es van trobar correlacions entre la nostra tasca i els mètodes tradicionals, el que indica que la nostra tasca ha demostrat ser una eina vàlida per avaluar la memòria espacial a curt termini en xiquets. Pel que fa al tipus d'interacció, els resultats van mostrar que no hi va haver diferències estadísticament significatives respecte a la puntuació obtinguda en la nostra tasca i en funció de la interacció utilitzada. Aquest és un bon resultat perquè significa que la tasca és adequada per a l'avaluació de la memòria espacial i que els dos tipus d'interacció es poden utilitzar per a aquest fi. Pel que fa a les diferències de gènere en la puntuació de la tasca i Corsi Block Tapping Test, els resultats van indicar que no hi va haver diferències estadísticament significatives per al gènere. Pel que fa a facilitat d'ús i satisfacció, els nostres estudis han demostrat que l'ús de la condició inactiva no va diferir significativament de la condició física activa per a les preguntes d'usabilitat i satisfacció. Prèviament al desenvolupament del sistema de RV esmentat, vam desenvolupar un sistema de RV, amb interfícies d'usuari naturals (NUI) i una pantalla autoestereoscòpica, per aprenentatge dental. El sistema inclou dos tipus de fons: fons neutre i món real. Aquest sistema va ser validat amb 33 estudiants. Amb aquest primer desenvolupament, es va adquirir el coneixement necessari per poder afrontar el segon desenvolupament, nucli de la tesi. Les següents conclusions generals es van extraure dels dos desenvolupaments i els tres estudis: Aprenentatge - Els sistemes de RV amb autoestereoscòpia, amb diferents fons i NUI, han demostrat ser eines eficaces per a aprendre la morfologia dental - Amb aquest tipus de sistemes, els xiquets poden aprendre i, al mateix temps, poden divertir-se - La estereoscòpia i NUI són apropiades per al desenvolupament de jocs educatius i poden ser explotades en el seu desenvolupament Memòria espacial - Els sistemes de RV, amb estereoscòpia i dues interfícies d'usuari diferents, han demostrat ser eines fiables i efectives per avaluar la memòria espacial en xiquets - Amb aquest tipus de sistemes, els xiquets poden ser avaluats mentre es diverteixen - La nostra tasca i tasques similars podrien usar-se per avaluació i entrenament de la memòria en xiquet i adultsVirtual Reality (VR) has not yet been exploited in the assessment of spatial memory. Current VR systems for the assessment of spatial memory include interaction by using traditional devices (e.g., computer screens, mouses or keyboards). This classical type of interaction with the system is ineffective because the user's sense of presence is very poor. If the user does not have the feeling of "being there" in the virtual environment, the spatial memory may not be assessed correctly. The user's physical movement can contribute to a high level of presence. Therefore, by developing a system that allows the participants to become active in a virtual environment, spatial memory can be assessed as the same way it could be evaluated in a real environment. The main objective of this thesis was to design, develop and validate an immersive VR system in which the user could interact by physical movements. The virtual environment was designed based on a city square. The cognitive task, based on this environment, comprised six levels. The goal of the levels for the main task was to assess children short-term memory for object location in the virtual environment. The VR system incorporated two types of interaction. 1) A physical active condition (physically walking on a Wii Balance Board and changing the direction by turning a wireless steering wheel). 2) An inactive condition (stand up and use a gamepad). For the visualization of the task, a large stereo screen was used. For the validation, two studies were carried out. The performance of our task was compared with traditional methods (the Corsi Block Tapping Test). We carried out two studies involving 212 children. Correlations were found between our task and traditional methods, indicating that our task has proven to be a valid tool for assessing spatial short-term memory in children. With regard to the interaction type, the results showed that there were no statistically significant differences regarding the score obtained in our task based on the interaction used (inactive condition vs. physical active condition). Although unexpected, this is a good result because it means that the task is well suited for the assessment of spatial memory and that the two interaction types can be used for this purpose. With regard to gender differences in the task score and the Corsi Block Tapping Test, the results indicated that there were no statistically significant differences for gender. With regard to usability and satisfaction, our studies have shown that the use of the inactive condition did not differ significantly from the physical active condition for the usability and satisfaction questions. Previously to the development of the mentioned VR system, we developed a VR system, with Natural User Interfaces (NUI) and an autostereoscopic screen, for dental learning. The system included two modes: neutral and real world background. This system was validated with 33 dentistry students. With this first development, the required knowledge for facing the second development, core of the thesis, was acquired. The following general conclusions were extracted from the two developments and the three studies: Learning - Autostereoscopic VR systems, with different background modes and NUI, have proven to be effective tools for learning teeth morphology - With this type of systems, children can learn and at the same time, they can have a good time - Stereoscopy and NUI are appropriated for developing educational games and they can be exploited in their development Spatial memory - VR systems, with stereoscopy and two different user interfaces (inactive and physical active conditions), have proven to be reliable and effective tools to assess spatial memory in children - With this type of systems, the children can be assessed meanwhile are having a good time - Our task and similar tasks could be used for assessment and training of spatial memory in children and adultsRodríguez Andrés, D. (2018). An immersive virtual reality task with physical movement for the assessment of spatial memory [Tesis doctoral no publicada]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/114823TESISCompendi

Applying self-processing biases in education:improving learning through ownership

Accepting ownership of an item is an effective way of associating it with self, evoking self-processing biases that enhance memory. This memory advantage occurs even in ownership games, where items are arbitrarily divided between participants to temporarily ‘own’. The current study tested the educational applications of ownership games across two experiments. In Experiment 1, 7 to 9-year-old children were asked to choose three novel, labelled shapes from an array of nine. The experimenter chose three shapes and three remained ‘un-owned’. A subsequent free-recall test showed that children reliably learned more self-owned than other-owned or un-owned shapes. Experiment 2 replicated this finding for shapes that were assigned to owners rather than chosen, and showed that ownership enhanced memory more effectively than a control game with no ownership manipulation. Together, these experiments show that ownership games can evoke self-processing biases in children’s memory, enhancing learning. Implications for education strategies are discussed

Children’s Use of a ‘Time Line’ to Indicate When Events Occurred

Children who allege abuse are often asked to provide temporal information such as when the events occurred. Yet, young children often have difficulty recalling temporal information due to their limited knowledge of temporal patterns and linguistic capabilities. As time is an abstract concept (we cannot see it), some investigators have begun to use ‘time-lines’ or pictorial representations of time to aid children. Yet, there is no published research testing whether children are able to use time-lines and whether they can provide adequate temporal information using them. We tested whether children could indicate the time-of-day of events using a pictorial time-line and then compared their responses to their parents’. Seven- to 8-year-olds were most consistent with parental estimates while 4-year-olds were least consistent. Responses from the 5- to 6-year-olds depended on the temporal task. Guessing and using general knowledge to estimate the time-of-day were ruled out, and so children were genuinely drawing on episodic memory when making time-line judgments. Thus, there was a developmental progression in children’s use of physical representations to communicate abstract information. These results are promising for the use of the time-line in forensic settings but much more research is needed