Joint Attention, Social-Cognition, and Recognition Memory in Adults

The early emerging capacity for Joint Attention (JA), or socially coordinated visual attention, is thought to be integral to the development of social-cognition in childhood. Recent studies have also begun to suggest that JA affects adult cognition as well, but methodological limitations hamper research on this topic. To address this issue we developed a novel virtual reality paradigm that integrates eye-tracking and virtual avatar technology to measure two types of JA in adults, Initiating Joint Attention (IJA) and Responding to Joint Attention (RJA). Distinguishing these types of JA in research is important because they are thought to reflect unique, as well as common constellations of processes involved in human social-cognition and social learning. We tested the validity of the differentiation of IJA and RJA in our paradigm in two studies of picture recognition memory in undergraduate students. Study 1 indicated that young adults correctly identified more pictures they had previously viewed in an IJA condition (67%) than in a RJA (58%) condition, η2 = 0.57. Study 2 controlled for IJA and RJA stimulus viewing time differences, and replicated the findings of Study 1. The implications of these results for the validity of the paradigm and research on the affects of JA on adult social-cognition are discussed

Feasibility of hemispatial neglect rehabilitation with virtual reality-based visual exploration therapy among patients with stroke: randomised controlled trial

BackgroundHemispatial neglect (HSN) was diagnosed using a virtual reality-based test (FOPR test) that explores the field of perception (FOP) and field of regard (FOR). Here, we developed virtual reality-visual exploration therapy (VR-VET) combining elements from the FOPR test and visual exploration therapy (VET) and examined its efficacy for HSN rehabilitation following stroke.MethodsEleven participants were randomly assigned to different groups, training with VR-VET first then waiting without VR-VET training (TW), or vice versa (WT). The TW group completed 20 sessions of a VR-VET program using a head-mounted display followed by 4 weeks of waiting, while the WT group completed the opposite regimen. Clinical HSN measurements [line bisection test (LBT), star cancellation test (SCT), Catherine Bergego Scale (CBS), CBS perceptual-attentional (CBS-PA), and CBS motor-explanatory (CBS-ME)] and FOPR tests [response time (RT), success rate (SR), and head movement (HM) for both FOP and FOR] were assessed by blinded face-to-face assessments.ResultsFive and six participants were allocated to the TW and WT groups, respectively, and no dropout occurred throughout the study. VR-VET considerably improved LBT scores, FOR variables (FOR-RT, FOR-SR), FOP-LEFT variables (FOP-LEFT-RT, FOP-LEFT-SR), and FOR-LEFT variables (FOR-LEFT-RT, FOR-LEFT-SR) compared to waiting without VR-VET. Additionally, VR-VET extensively improved FOP-SR, CBS, and CBS-PA, where waiting failed to make a significant change. The VR-VET made more improvements in the left hemispace than in the right hemispace in FOP-RT, FOP-SR, FOR-RT, and FOR-SR.ConclusionThe observed improvements in clinical assessments and FOPR tests represent the translatability of these improvements to real-world function and the multi-dimensional effects of VR-VET training.Clinical trial registrationhttps://clinicaltrials.gov/ct2/show/NCT03463122, identifier NCT03463122

Virtual Reality for Obsessive-Compulsive Disorder: Past and the Future

The use of computers, especially for virtual reality (VR), to understand, assess, and treat various mental health problems has been developed for the last decade, including application for phobia, post-traumatic stress disorder, attention deficits, and schizophrenia. However, the number of VR tools addressing obsessive-compulsive disorder (OCD) is still lacking due to the heterogeneous symptoms of OCD and poor understanding of the relationship between VR and OCD. This article reviews the empirical literatures for VR tools in the future, which involve applications for both clinical work and experimental research in this area, including examining symptoms using VR according to OCD patients' individual symptoms, extending OCD research in the VR setting to also study behavioral and physiological correlations of the symptoms, and expanding the use of VR for OCD to cognitive-behavioral intervention

Measuring recognition of body changes over time: A human-computer interaction tool using dynamic morphing and body ownership illusion.

Measuring body image is crucial at both personal and social levels. Previous studies have attempted to quantitatively measure body image but methods for measuring body change recognition over time have not yet been established. The present study proposes a novel human-computer interaction technique using dynamic morphing and body ownership illusion, and we conducted a user study to investigate how body ownership illusion and gender would affect to body change recognition. The results showed that a participant's body change recognition was weak when the body ownership illusion was strong. In addition, female participants were less sensitive than male participants. With our proposed technique, we demonstrated that we were able to quantitatively measure body change recognition and our empirical data indicated that body change recognition varied depending on body ownership illusion and gender, suggesting that our methodology could not only be used in future body image studies but also in eating disorder treatments

Impact of Personalized Avatars and Motion Synchrony on Embodiment and Users’ Subjective Experience: Empirical Study

BackgroundEmbodiment through a virtual avatar is a key element for people to feel that they are in the virtual world. ObjectiveThis study aimed to elucidate the interaction between 2 methods of eliciting embodiment through a virtual avatar: motion synchronization and appearance similarity between a human and avatar, to understand embodiment (agency, body ownership, and self-location) and subjective experience (presence, simulator sickness, and emotion) in virtual reality. MethodsUsing a full-body motion capture system, 24 participants experienced their virtual avatars with a 3D-scanned face and size-matched body from a first-person perspective. This study used a 2 (motion; sync and async) × 2 (appearance; personalized and generic) within-subject design. ResultsThe results indicated that agency and body ownership increased when motion and appearance were matched, whereas self-location, presence, and emotion were affected by motion only. Interestingly, if the avatar’s appearance was similar to the participants (personalized avatar), they formed an agency toward the avatar’s motion that was not performed by themselves. ConclusionsOur findings would be applicable in the field of behavioral therapy, rehabilitation, and entertainment applications, by eliciting higher agency with a personalized avatar

Joint Attention Virtual Classroom: A Preliminary Study.

ObjectivePrevious studies have suggested that a virtual classroom is immersive and ecologically valid neuropsychological assessment, but those studies have limited components for social attentions. Therefore, the objective in the current study is the development of a joint attention virtual reality (JA-VR) classroom to incorporate social attentions between a participant and a virtual avatar teacher.MethodsFifty-eight participants were recruited for current study (25 for pilot and 33 for main studies; 32.8% female, n=19; age: M=24.5, SD=4.0). We suggested a JA-VR classroom, and compared it with previous methods including a VR classroom without JA components. We conducted attention experiments with AX-version of continuous performance tasks.ResultsOur results suggest that the new JA-VR classroom had convergent validity with previous methods, and that the JA-VR classroom promoted attentional processing among participants better than both old VR and non-VR measures.ConclusionWe add an important social attention concept to the virtual classroom, and believe that this work is an methodological foundation for the study of social attention in school life. We hope it ultimately help people with mental handicaps in social attention

Data_Sheet_1_Feasibility of hemispatial neglect rehabilitation with virtual reality-based visual exploration therapy among patients with stroke: randomised controlled trial.docx

BackgroundHemispatial neglect (HSN) was diagnosed using a virtual reality-based test (FOPR test) that explores the field of perception (FOP) and field of regard (FOR). Here, we developed virtual reality-visual exploration therapy (VR-VET) combining elements from the FOPR test and visual exploration therapy (VET) and examined its efficacy for HSN rehabilitation following stroke.MethodsEleven participants were randomly assigned to different groups, training with VR-VET first then waiting without VR-VET training (TW), or vice versa (WT). The TW group completed 20 sessions of a VR-VET program using a head-mounted display followed by 4 weeks of waiting, while the WT group completed the opposite regimen. Clinical HSN measurements [line bisection test (LBT), star cancellation test (SCT), Catherine Bergego Scale (CBS), CBS perceptual-attentional (CBS-PA), and CBS motor-explanatory (CBS-ME)] and FOPR tests [response time (RT), success rate (SR), and head movement (HM) for both FOP and FOR] were assessed by blinded face-to-face assessments.ResultsFive and six participants were allocated to the TW and WT groups, respectively, and no dropout occurred throughout the study. VR-VET considerably improved LBT scores, FOR variables (FOR-RT, FOR-SR), FOP-LEFT variables (FOP-LEFT-RT, FOP-LEFT-SR), and FOR-LEFT variables (FOR-LEFT-RT, FOR-LEFT-SR) compared to waiting without VR-VET. Additionally, VR-VET extensively improved FOP-SR, CBS, and CBS-PA, where waiting failed to make a significant change. The VR-VET made more improvements in the left hemispace than in the right hemispace in FOP-RT, FOP-SR, FOR-RT, and FOR-SR.ConclusionThe observed improvements in clinical assessments and FOPR tests represent the translatability of these improvements to real-world function and the multi-dimensional effects of VR-VET training.Clinical trial registrationhttps://clinicaltrials.gov/ct2/show/NCT03463122, identifier NCT03463122.</p