Are 3D virtual environments better than 2D interfaces in serious games performance? An explorative study for the assessment of executive functions

This is an Accepted Manuscript of an article published by Taylor & Francis in Applied Neuropsychology: Adult on 05/09/2019, available online: http://www.tandfonline.com/10.1080/23279095.2019.1607735[EN] Executive functions refer to higher-order cognitive processes that supervise and guide goaldirected and adaptive behaviors in response to everyday situations. The traditional measures used to assess executive functions include paper-and-pencil tests and/or computerized tests that have been found to have a moderate level of ecological validity in predicting real-world performance. Serious games (SG) represent a novel methodological approach, allowing investigating subjects¿ performance in real-simulated situations. Serious games are computer games whose primary purposes include investigating human behaviors and changes. Furthermore, SG can also vary according to the technology used and the interaction. Indeed, a SG can be rendered via a nonimmersive screen-based (2D) or via an immersive virtual reality game (3D). Starting from these premises, we compared a narrativecontextualized SG in 2D and 3D, correlating them with traditional tests. Findings showed different condition correlations with the traditional tasks and the comparison between the two systems have revealed that 3D is able to generate lower reaction times, higher correct answers, and lower perseverative responses in attentional abilities, inhibition control, and cognitive shifting than 2D condition. The present study yielded evidence on the use of more ecological tools to identify the functional cognitive status in real-simulated contexts along with traditional evaluation.This work was supported by the Spanish Ministry of Economy, Industry, and Competitiveness funded project Advanced Therapeutically Tools for Mental Health (DPI2016-77396-R).Chicchi-Giglioli, IA.; Juan-Ripoll, CD.; Parra Vargas, E.; Alcañiz Raya, ML. (2019). Are 3D virtual environments better than 2D interfaces in serious games performance? An explorative study for the assessment of executive functions. Applied Neuropsychology. Adult (Online). 1-10. https://doi.org/10.1080/23279095.2019.1607735S110Baddeley, A. (1981). The cognitive psychology of everyday life*. British Journal of Psychology, 72(2), 257-269. doi:10.1111/j.2044-8295.1981.tb02184.xChaytor, N., & Schmitter-Edgecombe, M. (2003). The Ecological Validity of Neuropsychological Tests: A Review of the Literature on Everyday Cognitive Skills. Neuropsychology Review, 13(4), 181-197. doi:10.1023/b:nerv.0000009483.91468.fbCHAYTOR, N., SCHMITTEREDGECOMBE, M., & BURR, R. (2006). Improving the ecological validity of executive functioning assessment. Archives of Clinical Neuropsychology, 21(3), 217-227. doi:10.1016/j.acn.2005.12.002Chelune, G. J. & Moehle, K. A. (1986). Neuropsychological assessment and everyday functioning. In D.Wedding, A.M. Horton, Jr. & J.S. Webster (Eds.), The neuropsychology handbook: Behavioral and clinical perspectives (pp. 489-525). New York, NY, US: Springer Publishing Co.Chevignard, M., Pillon, B., Pradat-Diehl, P., Taillefer, C., Rousseau, S., Le Bras, C., & Dubois, B. (2000). An Ecological Approach to Planning Dysfunction: Script Execution. Cortex, 36(5), 649-669. doi:10.1016/s0010-9452(08)70543-4Connolly, T. M., Boyle, E. A., MacArthur, E., Hainey, T., & Boyle, J. M. (2012). A systematic literature review of empirical evidence on computer games and serious games. Computers & Education, 59(2), 661-686. doi:10.1016/j.compedu.2012.03.004Díaz-Orueta, U., Garcia-López, C., Crespo-Eguílaz, N., Sánchez-Carpintero, R., Climent, G., & Narbona, J. (2013). AULA virtual reality test as an attention measure: Convergent validity with Conners’ Continuous Performance Test. Child Neuropsychology, 20(3), 328-342. doi:10.1080/09297049.2013.792332Elkind, J. S., Rubin, E., Rosenthal, S., Skoff, B., & Prather, P. (2001). A Simulated Reality Scenario Compared with the Computerized Wisconsin Card Sorting Test: An Analysis of Preliminary Results. CyberPsychology & Behavior, 4(4), 489-496. doi:10.1089/109493101750527042Fillmore, M. T., Rush, C. R., & Hays, L. (2006). Acute effects of cocaine in two models of inhibitory control: implications of non-linear dose effects. Addiction, 101(9), 1323-1332. doi:10.1111/j.1360-0443.2006.01522.xFleming, T. M., Bavin, L., Stasiak, K., Hermansson-Webb, E., Merry, S. N., Cheek, C., … Hetrick, S. (2017). Serious Games and Gamification for Mental Health: Current Status and Promising Directions. Frontiers in Psychiatry, 7. doi:10.3389/fpsyt.2016.00215Folstein, M. F., Folstein, S. E., & McHugh, P. R. (1975). «Mini-mental state». Journal of Psychiatric Research, 12(3), 189-198. doi:10.1016/0022-3956(75)90026-6Fleming, T. M., Cheek, C., Merry, S. N., Thabrew, H., Bridgman, H., Stasiak, K., Shepherd, M., Perry, Y. Hetrick, S. (2014). Serious games for the treatment or prevention of depression: A systematic review.Chicchi Giglioli, I. A., de Juan Ripoll, C., Parra, E., & Alcañiz Raya, M. (2018). EXPANSE: A novel narrative serious game for the behavioral assessment of cognitive abilities. PLOS ONE, 13(11), e0206925. doi:10.1371/journal.pone.0206925Grant, D. A., & Berg, E. (1948). A behavioral analysis of degree of reinforcement and ease of shifting to new responses in a Weigl-type card-sorting problem. Journal of Experimental Psychology, 38(4), 404-411. doi:10.1037/h0059831Henry, M., Joyal, C. C., & Nolin, P. (2012). Development and initial assessment of a new paradigm for assessing cognitive and motor inhibition: The bimodal virtual-reality Stroop. Journal of Neuroscience Methods, 210(2), 125-131. doi:10.1016/j.jneumeth.2012.07.025Hughes, C. (2013). Executive function: Development, individual differences, and clinical insights. In Neural Circuit Development and Function in the Brain, 429–445.Iriarte, Y., Diaz-Orueta, U., Cueto, E., Irazustabarrena, P., Banterla, F., & Climent, G. (2012). AULA—Advanced Virtual Reality Tool for the Assessment of Attention. Journal of Attention Disorders, 20(6), 542-568. doi:10.1177/1087054712465335Lang, P. J. (2005). International affective picture system (IAPS): Affective ratings of pictures and instruction manual. Technical report.Li, J., Theng, Y.-L., & Foo, S. (2016). Effect of Exergames on Depression: A Systematic Review and Meta-Analysis. Cyberpsychology, Behavior, and Social Networking, 19(1), 34-42. doi:10.1089/cyber.2015.0366Lo Priore, C., Castelnuovo, G., Liccione, D., & Liccione, D. (2003). Experience with V-STORE: Considerations on Presence in Virtual Environments for Effective Neuropsychological Rehabilitation of Executive Functions. CyberPsychology & Behavior, 6(3), 281-287. doi:10.1089/109493103322011579Martin, M. M., & Rubin, R. B. (1995). A New Measure of Cognitive Flexibility. Psychological Reports, 76(2), 623-626. doi:10.2466/pr0.1995.76.2.623Matheis, R. J., Schultheis, M. T., Tiersky, L. A., DeLuca, J., Millis, S. R., & Rizzo, A. (2007). Is Learning and Memory Different in a Virtual Environment? The Clinical Neuropsychologist, 21(1), 146-161. doi:10.1080/13854040601100668Miller, M. A., & Fillmore, M. T. (2010). The effect of image complexity on attentional bias towards alcohol-related images in adult drinkers. Addiction, 105(5), 883-890. doi:10.1111/j.1360-0443.2009.02860.xParsey, C. M., & Schmitter-Edgecombe, M. (2013). Applications of Technology in Neuropsychological Assessment. The Clinical Neuropsychologist, 27(8), 1328-1361. doi:10.1080/13854046.2013.834971Parsons, T. D., Bowerly, T., Buckwalter, J. G., & Rizzo, A. A. (2007). A Controlled Clinical Comparison of Attention Performance in Children with ADHD in a Virtual Reality Classroom Compared to Standard Neuropsychological Methods. Child Neuropsychology, 13(4), 363-381. doi:10.1080/13825580600943473PUGNETTI, L., MENDOZZI, L., ATTREE, E. A., BARBIERI, E., BROOKS, B. M., CAZZULLO, C. L., … Psychol, C. (1998). Probing Memory and Executive Functions with Virtual Reality: Past and Present Studies. CyberPsychology & Behavior, 1(2), 151-161. doi:10.1089/cpb.1998.1.151Pugnetti, L., Mendozzi, L., Motta, A., Cattaneo, A., Barbieri, E., & Brancotti, A. (1995). Evaluation and retraining of adults’ cognitive impairments: Which role for virtual reality technology? Computers in Biology and Medicine, 25(2), 213-227. doi:10.1016/0010-4825(94)00040-wRand, D., Katz, N., & (Tamar) Weiss, P. L. (2007). Evaluation of virtual shopping in the VMall: Comparison of post-stroke participants to healthy control groups. Disability and Rehabilitation, 29(22), 1710-1719. doi:10.1080/09638280601107450Rand, D., Rukan, S. B.-A., (Tamar) Weiss, P. L., & Katz, N. (2009). Validation of the Virtual MET as an assessment tool for executive functions. Neuropsychological Rehabilitation, 19(4), 583-602. doi:10.1080/09602010802469074Reitan, R. M. (1958). Validity of the Trail Making Test as an Indicator of Organic Brain Damage. Perceptual and Motor Skills, 8(3), 271-276. doi:10.2466/pms.1958.8.3.271Renison, B., Ponsford, J., Testa, R., Richardson, B., & Brownfield, K. (2012). The Ecological and Construct Validity of a Newly Developed Measure of Executive Function: The Virtual Library Task. Journal of the International Neuropsychological Society, 18(03), 440-450. doi:10.1017/s1355617711001883Slater, M. (2009). Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments. Philosophical Transactions of the Royal Society B: Biological Sciences, 364(1535), 3549-3557. doi:10.1098/rstb.2009.0138Stroop, J. R. (1935). Studies of interference in serial verbal reactions. Journal of Experimental Psychology, 18(6), 643-662. doi:10.1037/h0054651Stuss, D. T., & Alexander, M. P. (2000). Executive functions and the frontal lobes: a conceptual view. Psychological Research, 63(3-4), 289-298. doi:10.1007/s00426990000

Editorial: Psychology, technological Innovation, and entrepreneurship

The aim of this Research Topic is to offer an integrated view of three areas for implementing Psychology as a science and as a profession, for the benefit of both the academic and professional sphere. An initial article offers a global analysis of the R&D&I value chain (de la Fuente et al.). Complementarily, several articles then provide examples of research on the characteristics of Innovation and Entrepreneurship, whether as a review (Sánchez-García et al.), an analysis of a personal factor that is predictive of this activity (Arco-Tirado et al.), the role of psychological characteristics (Hu et al.), and even a tool for assessing this construct (Cuesta et al.)

Editorial: Psychology, technological Innovation, and entrepreneurship

The aim of this Research Topic is to offer an integrated view of three areas for implementing Psychology as a science and as a profession, for the benefit of both the academic and professional sphere. An initial article offers a global analysis of the R&D&I value chain (de la Fuente et al.). Complementarily, several articles then provide examples of research on the characteristics of Innovation and Entrepreneurship, whether as a review (Sánchez-García et al.), an analysis of a personal factor that is predictive of this activity (Arco-Tirado et al.), the role of psychological characteristics (Hu et al.), and even a tool for assessing this construct (Cuesta et al.)

Virtual reality-based assessment and rating scales in ADHD diagnosis

The diagnosis of Attention Deficit Hyperactivity Disorder (ADHD) is mainly based on structured scales, such as Conners’ ADHD Rating Scale (EDAH in the Spanish version) and DSM interviews. The use of technologies in neuropsychological assessment, such as the AULA virtual reality based test leads to more accurate diagnosis. The current study presents findings from analyzing the external validity of AULA and its contribution to the diagnosis of ADHD. Four hundred and seven children (272 girls and 135 boys) from 6 to 16 years old (213 with ADHD diagnosis, 105 inattentive children, 108 combined-type, and 194 controls) were evaluated. First, a factor analysis of AULA variables was conducted in order to reduce data to factor and 5 factors or components that account for 82.37% of the total variance were obtained from 407 subjects, namely, sustained attention, impulsivity control, processing speed, response variability, and control of motor activity. Second, a discriminant analysis was then performed on data obtained by participants from whom the five factors were obtained, showing that AULA presents moderate levels of both specificity and sensitivity. Finally, in order to study whether AULA adds relevant information in the diagnosis of ADHD, a cluster analysis was carried out, showing 4 clusters in the analysis of conglomerates with the control group and 6 groups of clusters in the ADHD group. In summary, AULA test shows adequate external validity, allows correct classification of children with and without attentional problems, and confirms and provides additional ADHD diagnostic information that it is essential for the design of interventions.El diagnóstico del trastorno por déficit de atención y/o hiperactividad (TDAH) se basa principalmente en escalas estructuradas, como la escala de Conners (validada en España con el nombre de EDAH), y entrevistas basadas en los criterios recogidos en el DSM. El uso de las nuevas tecnologías en el proceso de evaluación neuropsicológica, como el Test de Atención de Realidad Virtual AULA, proporciona información rigurosa que conduce a diagnósticos más precisos. En este contexto, el objetivo del presente estudio es proporcionar evidencias acerca de la validez externa del test AULA, un test que mejora la precisión diagnóstica del TDAH. La muestra estuvo formada por 407 niños (272 niños y 135 niñas) de entre 6 y 16 años del norte de España (213 niños tenían un diagnóstico de TDAH, 105 desatentos, 108 de tipo combinado y 194 fueron niños controles). En primer lugar se realizó un análisis factorial exploratorio, que puso de manifiesto una estructura formada por cinco factores (atención sostenida, control de la impulsividad, velocidad de procesamiento, variabilidad de respuesta y control de la actividad motora), que son capaces de explicar el 82.37% de la varianza. En segundo lugar, se realizó un análisis discriminante, de acuerdo con el rendimiento obtenido por los participantes en los cinco factores obtenidos en el test AULA, que mostró niveles moderados de especificidad y sensibilidad. Finalmente, se llevó a cabo un análisis de conglomerados con el grupo control y seis grupos de clúster dentro del grupo de niños con TDAH. Los resultados muestran una adecuada validez externa del instrumento AULA, que permite realizar clasificaciones correctas de sujetos sanos y patológicos, confirmándose que proporciona información adicional para el diagnóstico de TDAH, esencial para el posterior diseño de intervenciones clínicas eficaces

Adapting the Research Development and Innovation (RD & I) Value Chain in Psychology to Educational Psychology Area

Educational Psychology, as an area of Psychology that specializes in formative processes, faces several important challenges in the information and knowledge society of this twenty first century. One of these challenges is to facilitate a paradigm shift from a nearly exclusive focus on social science to the scientific-technological approach of a discipline that produces innovation and meaningful transfer of science and technology. The Research, Development, and Innovation (RD & I) value chain means pursuing these three endeavors in both the academic and professional lines of Educational Psychology. It is a strategy of innovation that leads us to integrate academic or research activity (R), research-related or professional scientific-technological development of innovation (D) and transfer and entrepreneurship activity (I). Generating innovation and transfer, applicable to educational contexts, can be an important stimulus of activity for new practicing psychologists in Educational Psychology. The RD & I value chain can become an academic, research-related or professional advantage in different activities, since it pertains to the processes, products and services found in the sphere of Educational Psychology. Several examples of how the RD & I chain can help improve psychoeducational activities are presented. First, we analyze competitive improvements that the RD & I chain can offer in competitive bids. Second, we give examples of the RD & I chain in the development of new processes, products and services in Projects of Innovation and Entrepreneurship in Educational Psychology, specifically illustrating the chain in each case. In order for this conception to take shape, a new cross-functional area must be created in professional and educational organizations. Specifically, this means creating an RD & I Department, or some area that branches across the other functions. The mission of this cross-functional unit is the actual implementation of the RD & I chain in the educational organization, as well as an incentive for innovative activities: use of ICT applications, organizational improvement, improved assessment, analysis of information produced by the organization itself, cost-benefit analysis, strategic decision-making processes, and so on