空中ジェスチャ・インタラクションにおける触覚提示の高臨場感化および安定化に関する研究

Tohoku University昆陽雅司課

The Influence of Dopamine Replacement on Movement Impairments During Bimanual Coordination in Parkinson’s Disease (PD)

The purpose of the current thesis was to investigate the influence of dopamine replacement on performance during bimanual coordination in individuals with Parkinson’s disease (PD) There has been conflicting research on the cause of movement impairments such as coordination deficits, slowed switching and upper limb freezing that occur during coordinated movements It is unclear whether decreased function of the dopaminergic system after withdrawal from dopamine replacement is responsible for these deficits Healthy age-matched control participants were compared to PD participants in two experiments to determine the movement impairments that occurred during three-dimensional wrist flexion-extension bimanual coordination as a result of PD. In addition, individuals with PD were compared without (‘off’) and with (‘on’) dopamine replacement in both experiments to determine whether modulation of the dopaminergic system influenced coordinated movements. In Experiment 1, continuous bimanual coordination was performed in m-phase (simultaneous wrist flexion and extension) and anti-phase (flexion of one wrist while extending other wrist) with movements externally paced with increasing across seven cycle frequencies (0.75 to 2 Hz). Visual feedback was also manipulated in one of three sensory conditions no vision, normal vision or augmented vision. Visual feedback, phase and cycle frequency manipulation was performed to determine whether other deficits (e.g. sensory and/or attentional deficits) may influence coordinated movements Despite reduced amplitude of movements in both limbs of individuals with PD (PD ‘off’), coordination deficits were not observed in PD compared to healthy control participants. In addition, there was an increased occurrence of upper limb freezing (ULF) when cycle frequency demand was greater Dopamine replacement did increase the amplitude of movements in individuals with PD but did not influence coordination performance or the occurrence of ULF. In Experiment 2, coordinated movements were initiated in either m-phase or antiphase and participants were required to voluntarily switch to the other phase pattern when an auditory cue was presented Trials were performed at one of two cycle frequencies (1 or 2 Hz) and one of two sensory conditions (no vision or normal vision) to determine whether other deficits (e.g. sensory and/or attentional deficits) may influence coordinated movement. In addition, a separate block of trials were performed in anti-phase coordination with an auditory cue that did not require a switch Non-switching trials were included to investigate whether the presence of a distracting cue could evoke ULF comparable to when switching between movements was required PD ‘off’ participants demonstrated slower switching, more delayed responses and deficits in coordination performance when compared to healthy control participants. The increased demand of cycle frequency particularly when initiating anti-phase coordination, after voluntary switching and with the presence of the auditory cue without switching contributed to a large occurrence of ULF in individuals with PD. Dopamine replacement improved the ability to switch between phase patterns but had no overall influence on coordination performance or the occurrence of ULF. Overall, the results of the current thesis demonstrated that dopamine replacement can improve motor symptoms during coordinated movements (e g hypometna and bradykinesia) but does not contribute to coordination performance or ULF in individuals with PD. As a consequence, it was concluded that coordination deficits and ULF are not caused by the dysfunctional dopaminergic system but rather associated to secondary impairment caused by PD. The movement impairments caused by secondary dysfunction of PD were proposed to be associated with increased attentional demands and possible executive dysfunction related to fronto-stnatal pathways that cannot be modulated by dopamine replacement. Thus, treatment of complex movement impairments such as coordination deficits and ULF may benefit from rehabilitation or non-dopamine therapies that focus on the global dysfunction caused by PD

Understanding Visual Feedback in Large-Display Touchless Interactions: An Exploratory Study

Touchless interactions synthesize input and output from physically disconnected motor and display spaces without any haptic feedback. In the absence of any haptic feedback, touchless interactions primarily rely on visual cues, but properties of visual feedback remain unexplored. This paper systematically investigates how large-display touchless interactions are affected by (1) types of visual feedback—discrete, partial, and continuous; (2) alternative forms of touchless cursors; (3) approaches to visualize target-selection; and (4) persistent visual cues to support out-of-range and drag-and-drop gestures. Results suggest that continuous was more effective than partial visual feedback; users disliked opaque cursors, and efficiency did not increase when cursors were larger than display artifacts’ size. Semantic visual feedback located at the display border improved users’ efficiency to return within the display range; however, the path of movement echoed in drag-and-drop operations decreased efficiency. Our findings contribute key ingredients to design suitable visual feedback for large-display touchless environments.This work was partially supported by an IUPUI Research Support Funds Grant (RSFG)

Spatial representation and visual impairement - Developmental trends and new technological tools for assessment and rehabilitation

It is well known that perception is mediated by the five sensory modalities (sight, hearing, touch, smell and taste), which allows us to explore the world and build a coherent spatio-temporal representation of the surrounding environment. Typically, our brain collects and integrates coherent information from all the senses to build a reliable spatial representation of the world. In this sense, perception emerges from the individual activity of distinct sensory modalities, operating as separate modules, but rather from multisensory integration processes. The interaction occurs whenever inputs from the senses are coherent in time and space (Eimer, 2004). Therefore, spatial perception emerges from the contribution of unisensory and multisensory information, with a predominant role of visual information for space processing during the first years of life. Despite a growing body of research indicates that visual experience is essential to develop spatial abilities, to date very little is known about the mechanisms underpinning spatial development when the visual input is impoverished (low vision) or missing (blindness). The thesis's main aim is to increase knowledge about the impact of visual deprivation on spatial development and consolidation and to evaluate the effects of novel technological systems to quantitatively improve perceptual and cognitive spatial abilities in case of visual impairments. Chapter 1 summarizes the main research findings related to the role of vision and multisensory experience on spatial development. Overall, such findings indicate that visual experience facilitates the acquisition of allocentric spatial capabilities, namely perceiving space according to a perspective different from our body. Therefore, it might be stated that the sense of sight allows a more comprehensive representation of spatial information since it is based on environmental landmarks that are independent of body perspective. Chapter 2 presents original studies carried out by me as a Ph.D. student to investigate the developmental mechanisms underpinning spatial development and compare the spatial performance of individuals with affected and typical visual experience, respectively visually impaired and sighted. Overall, these studies suggest that vision facilitates the spatial representation of the environment by conveying the most reliable spatial reference, i.e., allocentric coordinates. However, when visual feedback is permanently or temporarily absent, as in the case of congenital blindness or blindfolded individuals, respectively, compensatory mechanisms might support the refinement of haptic and auditory spatial coding abilities. The studies presented in this chapter will validate novel experimental paradigms to assess the role of haptic and auditory experience on spatial representation based on external (i.e., allocentric) frames of reference. Chapter 3 describes the validation process of new technological systems based on unisensory and multisensory stimulation, designed to rehabilitate spatial capabilities in case of visual impairment. Overall, the technological validation of new devices will provide the opportunity to develop an interactive platform to rehabilitate spatial impairments following visual deprivation. Finally, Chapter 4 summarizes the findings reported in the previous Chapters, focusing the attention on the consequences of visual impairment on the developmental of unisensory and multisensory spatial experience in visually impaired children and adults compared to sighted peers. It also wants to highlight the potential role of novel experimental tools to validate the use to assess spatial competencies in response to unisensory and multisensory events and train residual sensory modalities under a multisensory rehabilitation

Cognitive and bodily selves: how do they interact following brain lesion?

Dualism has long distinguished between the mental and the body experiences. Probing the structure and organisation of the self traditionally calls for a distinction between these two sides of the self coin. It is far beyond the scope of this chapter to address these philosophical issues, and our starting point will be the simple distinction between reflective processes involved in the elaboration of body image, self awareness and self-recognition (i.e. ‘the self’) and the sensori-motor dialogues involved in action control, reactions and automatisms (i.e. ‘the body’ schema). This oversimplification does not take into account the complex interactions taking place between these two levels of description, but our initial aim will be to distinguish between them, before addressing the question of their interactions. Cognitive and sensori-motor processes have frequently been distinguished (review: Rossetti and Revonsuo 2000), and it may be proposed that a similar dissociation can be put forward, a priori, between a central representation of self and a bodily representation corresponding to body schema (Figure 1)

Effects of Embodied Learning and Digital Platform on the Retention of Physics Content: Centripetal Force

abstract: Embodiment theory proposes that knowledge is grounded in sensorimotor systems, and that learning can be facilitated to the extent that lessons can be mapped to these systems. This study with 109 college-age participants addresses two overarching questions: (a) how are immediate and delayed learning gains affected by the degree to which a lesson is embodied, and (b) how do the affordances of three different educational platforms affect immediate and delayed learning? Six 50 min-long lessons on centripetal force were created. The first factor was the degree of embodiment with two levels: (1) low and (2) high. The second factor was platform with three levels: (1) a large scale “mixed reality” immersive environment containing both digital and hands-on components called SMALLab, (2) an interactive whiteboard system, and (3) a mouse-driven desktop computer. Pre-tests, post-tests, and 1-week follow-up (retention or delayed learning gains) tests were administered resulting in a 2 × 3 × 3 design. Two knowledge subtests were analyzed, one that relied on more declarative knowledge and one that relied on more generative knowledge, e.g., hand-drawing vectors. Regardless of condition, participants made significant immediate learning gains from pre-test to post-test. There were no significant main effects or interactions due to platform or embodiment on immediate learning. However, from post-test to follow-up the level of embodiment interacted significantly with time, such that participants in the high embodiment conditions performed better on the subtest devoted to generative knowledge questions. We posit that better retention of certain types of knowledge can be seen over time when more embodiment is present during the encoding phase. This sort of retention may not appear on more traditional factual/declarative tests. Educational technology designers should consider using more sensorimotor feedback and gestural congruency when designing and opportunities for instructor professional development need to be provided as well.View the article as published at http://journal.frontiersin.org/article/10.3389/fpsyg.2016.01819/ful

Spatial-Temporal Characteristics of Multisensory Integration

abstract: We experience spatial separation and temporal asynchrony between visual and haptic information in many virtual-reality, augmented-reality, or teleoperation systems. Three studies were conducted to examine the spatial and temporal characteristic of multisensory integration. Participants interacted with virtual springs using both visual and haptic senses, and their perception of stiffness and ability to differentiate stiffness were measured. The results revealed that a constant visual delay increased the perceived stiffness, while a variable visual delay made participants depend more on the haptic sensations in stiffness perception. We also found that participants judged stiffness stiffer when they interact with virtual springs at faster speeds, and interaction speed was positively correlated with stiffness overestimation. In addition, it has been found that participants could learn an association between visual and haptic inputs despite the fact that they were spatially separated, resulting in the improvement of typing performance. These results show the limitations of Maximum-Likelihood Estimation model, suggesting that a Bayesian inference model should be used.Dissertation/ThesisDoctoral Dissertation Human Systems Engineering 201

Spatial and Timing Regulation of Upper-Limb Movements in Rhythmic Tasks

Rhythmic movement is vital to humans and a foundation of such activities as locomotion, handwriting, and repetitive tool use. The spatiotemporal regularity characterizing such movements reflects a level of automaticity and coordination that is believed to emerge from mutually inhibitory or other pattern generating neural networks in the central nervous system. Although many studies have provided descriptions of this regularity and have illuminated the types of sensory information that influence rhythmic behavior, an understanding of how the brain uses sensory feedback to regulate rhythmic behavior on a cycle-by-cycle basis has been elusive. This thesis utilizes the model task of paddle juggling, or vertical ball bouncing, to address how three types of feedback---visual, auditory, and haptic---contribute to spatial and temporal regulation of rhythmic upper-limb movements. We use a multi-level approach in accordance with the well-known dictum of Marr and Poggio. The crux of this thesis describes a method and suite of experiments to understand how the brain uses visual, audio, and haptic feedback to regulate spatial or timing regularity, and formulate acycle-by-cycle description of this control: to wit, the nature and algorithms of sensory-feedback guided regulation. Part I motivates our interest in this problem, by discussing the biological ``hardware'' that the nervous system putatively employs in these movements, and reviewing insights from previous studies of paddle juggling that suggest how the ``hardware'' may manifest itself in these behaviors. The central experimental approach of this thesis is to train participants to perform the paddle juggling task with spatiotemporal regularity (in other words, to achieve limit-cycle behavior), and then interrogate how the brain applies regulates closed-loop performance by perturbing task feedback. In Part II, we review the development of a novel hard-real-time virtual-reality juggling simulator that enabled precise spatial and temporal feedback perturbations. We then outline the central experimental approach, in which we perturb spatial feedback of the ball at apex phase (vision), and timing feedback of collision- (audio and haptic) and apex-phase events to understand spatial and timing regulation. Part III describes two experiments that yield the main research findings of this thesis. In Experiment 1, we use a sinusoidal-perturbation-based system identification approach to determine that spatial and timing feedback are used in two dissociable and complementary control processes: spatial error correction and temporal synchronization. In Experiment 2, a combination of sinusoidal and step perturbations is used to establish that these complementary processes obey different dynamics. Namely, spatial correction is a proportional-integral process based on a one-step memory of feedback, while temporal synchronization is a proportional process that is dependent only on the most recent feedback. We close in Part IV with a discussion of how insights and approaches from this thesis can lead to improved rehabilitation approaches and understanding of the physiological basis of rhythmic movement regulation