Sensory Communication

Contains table of contents for Section 2, an introduction and reports on fourteen research projects.National Institutes of Health Grant RO1 DC00117National Institutes of Health Grant RO1 DC02032National Institutes of Health/National Institute on Deafness and Other Communication Disorders Grant R01 DC00126National Institutes of Health Grant R01 DC00270National Institutes of Health Contract N01 DC52107U.S. Navy - Office of Naval Research/Naval Air Warfare Center Contract N61339-95-K-0014U.S. Navy - Office of Naval Research/Naval Air Warfare Center Contract N61339-96-K-0003U.S. Navy - Office of Naval Research Grant N00014-96-1-0379U.S. Air Force - Office of Scientific Research Grant F49620-95-1-0176U.S. Air Force - Office of Scientific Research Grant F49620-96-1-0202U.S. Navy - Office of Naval Research Subcontract 40167U.S. Navy - Office of Naval Research/Naval Air Warfare Center Contract N61339-96-K-0002National Institutes of Health Grant R01-NS33778U.S. Navy - Office of Naval Research Grant N00014-92-J-184

Plasticity in the sensorimotor system and innovative sensorimotor training in frailty

This dissertation presents two studies, in which the relationship of impairment in sensory and motor systems with frailty was investigated from a conceptual point of view (Study 1) and as a potential target for innovative treatment to reduce frailty (Study 2). The aim of Study 1 was to identify sensory and motor determinants of frailty as assessed by two common frailty instruments, the frailty phenotype (FP) and the frailty index (FI). Performance measures of sensory and motor function were assessed in 44 pre-frail and frail subjects. Separate multiple logistic regression analyses revealed that frailty as defined by the FP was associated with reduced upper extremity function, while frailty as defined by the FI was independently associated with higher hearing thresholds, reduced lower extremity performance and higher depression scores. This suggests that reduced sensory and motor function contributes to the syndrome of frailty, thereby offering a potential target for treatment, and that different frailty instruments may be differentially sensitive to capture functional impairment in frail populations. In Study 2, the effectiveness of a 90-day tablet-based sensorimotor training (n=24) targeting the reversal of age-related maladaptive neuroplasticity in the sensorimotor system to counteract frailty was evaluated, compared to a tablet-based relaxation control training (n=24). After 60 days of training, a reduction in frailty as determined by the FP was found for both groups, while the effect tended to be stronger for the sensorimotor training condition. A non-significant reduction in the FI was found irrespective of the group. No training effects were found for sensorimotor brain activity assessed by functional magnetic resonance imaging and corticomotor excitability assessed by transcranial magnetic stimulation. The results suggest that a neuroplasticity-based training may alter frailty, yet the significance of the postulated neuroplastic mechanisms and the specific training characteristics underlying the effect remain to be determined. Together, the two studies provide evidence that impairment in sensory and motor systems may represent a target mechanism to better understand pathophysiology of frailty and to develop novel, innovative treatment approaches. Longitudinal studies are needed to determine the influence of sensory and motor decline in the development of frailty. The present work may also inspire future large-scale interventional studies to validate the present preliminary, yet promising results and to examine the efficacy and mechanistic principles that approaches targeting the reversal of age-related maladaptive neuroplasticity may have in the treatment of frailty

Comparison of the Effects of Sensorimotor Rhythm and Slow Cortical Potential Neurofeedback in Epilepsy

Current conventional epilepsy treatments do not always aim to improve epilepsy comorbidities. For a treatment to be effective, is not necessary for it to keep the patient seizure-free; it is sufficient to show improvement in functions to help people who suffer from epilepsy to become more independent and productive in life. There is an urgent need to explore non- pharmaceutical/non-invasive interventions that can help in that regard. The earlier patients are treated with this condition, the more likely it is to prevent severe disabilities over time. Neurofeedback is a self-modulatory brain activity oscillatory intervention that previous researchers have found to reduce seizure frequency in patients with epilepsy. The aim of this work was to compare two Neurofeedback techniques that have shown some efficacy in improving symptoms in epilepsy. The novelty of this study is to explore further and included clinical, neurophysiological and cognitive outcomes in order to assess in more detail the effectiveness of epilepsy comorbidities. Forty-four patients, between the ages of 12 and 18 years, and diagnosed with focal epilepsy, divided randomly into three groups: sensorimotor rhythm (SMR) training, slow cortical potential (SCP) training, and control. The patients completed 25 sessions of intervention. The results showed that the SMR group training had an advantage in improving reaction time compared with SCP and control. Regression analysis revealed a significant correlation between the patients who learned to modify their brain activity in the SMR group and improving reaction time in two different tasks. In addition, the quality of life scale significantly improved in all three groups. The study supplies preliminary data to support that SMR neurofeedback training as an intervention should further be explored as a therapeutic option for children who suffer from focal epilepsy.CONACYT (Mexican Council of science and technology

Ageing Futures: Towards Cognitively Inclusive Digital Media Products

This thesis is situated in a moment when the theory and practice of inclusive design appears to be significantly implicated in the social and economic response to demographic changes in Western Europe by addressing the need to reconnect older people with technology. In light of claims that cognitive ageing results in an increasing disconnection from novel digital media in old age, inclusive design is apparently trapped in a discourse in which digital media products and interfaces are designed as a response to a deterministic decline in abilities. The thesis proceeds from this context to ask what intellectual moves are required within the discourses of inclusive design so that its community of theorists and practitioners can both comprehend and afford the enaction of cognitive experience in old age? Whilst influential design scholarship actively disregards reductionist cognitive explanations of human and technological relationships, it appears that inclusive design still requires an explanation of temporal changes to human cognition in later life. Whilst there is a burgeoning area of design related research dealing with this issue—an area this thesis defines as ‘cognitively inclusive design’—the underlying assumptions and claims supporting this body of research suggests its theorists and practitioners are struggling to move beyond conceptualising older people as passive consumers suffering a deterioration in key cognitive abilities. The thesis argues that, by revisiting the cognitive sciences for alternative explanations for the basis of human cognition, it is possible to relieve this problem by opening up new spaces for designers to critically reflect upon the manner in which older people interact with digital media. In taking a position that design is required to support human cognitive enactment, the thesis develops a new approach to conceptualising temporal changes in human cognition, defined as ‘senescent cognition’. From this new critical lens, the thesis provides an alternative ‘senescentechnic’ explanation of cognitive disconnections between older people and digital media that eschews reductionism and moves beyond a deterministic process of deterioration. In reassessing what ageing cognition means, new strategies for the future of inclusive design are proposed that emphasise the role of creating space for older people to actively explore, reflect upon and enact their own cognitive couplings with technology.Arts and Humanities Research Counci

MOVEMENT PLANNING AND POSTURAL ADJUSTMENT IN SINGLE AND MULTIPLE STEPS INITIATON

Background: This study was designed to identify possible neurological as well as the cognitive factors on how people program their step and stop. Specifically, we use a simple vs choice condition task, which contains 1 to 3 steps under both conditions, to examine the reaction time and anticipatory postural adjustment (APA) phase duration. Methods: Eight healthy young college students (four female, four male) were enrolled in this study. Each of them performed a simple reaction task and a choice reaction task in response to a visual cue. Each task contained situations to take one or several steps. During the test, ground reaction force and position data were collected to further analyze initiation phase latency. Reaction time, release phase, transition time, double support phase, and the total time will be calculated as our dependent variables. Two-way analysis of variance (ANOVA) with Tukey HSD post hoc testing was used to analyze data. Results: Between simple reaction task and choice reaction task, choice reaction task required significantly longer time to finish in reaction and release phase. However, simple reaction task required significantly longer time to finish in transition and double support phase. Number of steps did not affect reaction time, but release, transition and double support phase were significantly affected by number of steps. Specifically, multiple steps task required more time to perform on release and transition, but single step task required more time on double support phase. All four types of APAs were significantly different from each other with an ascending trend from Correct Trials to Multiple Error Trials in release phase. Transition phase had a descending trend with multiple error trials took the least time to finish. Conclusion: In choice reaction task, planning two or three steps ahead cost more time to initiate compared to planning one step. Single step stepping task evaluation period is an online process with program of “stop” actually occurred during double support phase. Error trials tended to have a compensation effect which means durations after release phase had a descending trend with multiple error trial took the least time to complete.Submitted to the faculty of the University Graduate School in partial fulfillment of the requirements for the degree Master of Science in Kinesiology in the Department of Kinesiology Indiana University November, 201

Design and semantics of form and movement (DeSForM 2006)

Design and Semantics of Form and Movement (DeSForM) grew from applied research exploring emerging design methods and practices to support new generation product and interface design. The products and interfaces are concerned with: the context of ubiquitous computing and ambient technologies and the need for greater empathy in the pre-programmed behaviour of the ‘machines’ that populate our lives. Such explorative research in the CfDR has been led by Young, supported by Kyffin, Visiting Professor from Philips Design and sponsored by Philips Design over a period of four years (research funding £87k). DeSForM1 was the first of a series of three conferences that enable the presentation and debate of international work within this field: • 1st European conference on Design and Semantics of Form and Movement (DeSForM1), Baltic, Gateshead, 2005, Feijs L., Kyffin S. & Young R.A. eds. • 2nd European conference on Design and Semantics of Form and Movement (DeSForM2), Evoluon, Eindhoven, 2006, Feijs L., Kyffin S. & Young R.A. eds. • 3rd European conference on Design and Semantics of Form and Movement (DeSForM3), New Design School Building, Newcastle, 2007, Feijs L., Kyffin S. & Young R.A. eds. Philips sponsorship of practice-based enquiry led to research by three teams of research students over three years and on-going sponsorship of research through the Northumbria University Design and Innovation Laboratory (nuDIL). Young has been invited on the steering panel of the UK Thinking Digital Conference concerning the latest developments in digital and media technologies. Informed by this research is the work of PhD student Yukie Nakano who examines new technologies in relation to eco-design textiles

Sensorimotor experience in virtual environments

The goal of rehabilitation is to reduce impairment and provide functional improvements resulting in quality participation in activities of life, Plasticity and motor learning principles provide inspiration for therapeutic interventions including movement repetition in a virtual reality environment, The objective of this research work was to investigate functional specific measurements (kinematic, behavioral) and neural correlates of motor experience of hand gesture activities in virtual environments stimulating sensory experience (VE) using a hand agent model. The fMRI compatible Virtual Environment Sign Language Instruction (VESLI) System was designed and developed to provide a number of rehabilitation and measurement features, to identify optimal learning conditions for individuals and to track changes in performance over time. Therapies and measurements incorporated into VESLI target and track specific impairments underlying dysfunction. The goal of improved measurement is to develop targeted interventions embedded in higher level tasks and to accurately track specific gains to understand the responses to treatment, and the impact the response may have upon higher level function such as participation in life. To further clarify the biological model of motor experiences and to understand the added value and role of virtual sensory stimulation and feedback which includes seeing one\u27s own hand movement, functional brain mapping was conducted with simultaneous kinematic analysis in healthy controls and in stroke subjects. It is believed that through the understanding of these neural activations, rehabilitation strategies advantaging the principles of plasticity and motor learning will become possible. The present research assessed successful practice conditions promoting gesture learning behavior in the individual. For the first time, functional imaging experiments mapped neural correlates of human interactions with complex virtual reality hands avatars moving synchronously with the subject\u27s own hands, Findings indicate that healthy control subjects learned intransitive gestures in virtual environments using the first and third person avatars, picture and text definitions, and while viewing visual feedback of their own hands, virtual hands avatars, and in the control condition, hidden hands. Moreover, exercise in a virtual environment with a first person avatar of hands recruited insular cortex activation over time, which might indicate that this activation has been associated with a sense of agency. Sensory augmentation in virtual environments modulated activations of important brain regions associated with action observation and action execution. Quality of the visual feedback was modulated and brain areas were identified where the amount of brain activation was positively or negatively correlated with the visual feedback, When subjects moved the right hand and saw unexpected response, the left virtual avatar hand moved, neural activation increased in the motor cortex ipsilateral to the moving hand This visual modulation might provide a helpful rehabilitation therapy for people with paralysis of the limb through visual augmentation of skills. A model was developed to study the effects of sensorimotor experience in virtual environments, and findings of the effect of sensorimotor experience in virtual environments upon brain activity and related behavioral measures. The research model represents a significant contribution to neuroscience research, and translational engineering practice, A model of neural activations correlated with kinematics and behavior can profoundly influence the delivery of rehabilitative services in the coming years by giving clinicians a framework for engaging patients in a sensorimotor environment that can optimally facilitate neural reorganization

Wearable Sensors Applied in Movement Analysis

Recent advances in electronics have led to sensors whose sizes and weights are such that they can be placed on living systems without impairing their natural motion and habits. They may be worn on the body as accessories or as part of the clothing and enable personalized mobile information processing. Wearable sensors open the way for a nonintrusive and continuous monitoring of body orientation, movements, and various physiological parameters during motor activities in real-life settings. Thus, they may become crucial tools not only for researchers, but also for clinicians, as they have the potential to improve diagnosis, better monitor disease development and thereby individualize treatment. Wearable sensors should obviously go unnoticed for the people wearing them and be intuitive in their installation. They should come with wireless connectivity and low-power consumption. Moreover, the electronics system should be self-calibrating and deliver correct information that is easy to interpret. Cross-platform interfaces that provide secure data storage and easy data analysis and visualization are needed.This book contains a selection of research papers presenting new results addressing the above challenges

Upper limb proprioceptive sensitivity in three-dimensional space: effects of direction, posture, and exogenous neuromodulation

abstract: Proprioception is the sense of body position, movement, force, and effort. Loss of proprioception can affect planning and control of limb and body movements, negatively impacting activities of daily living and quality of life. Assessments employing planar robots have shown that proprioceptive sensitivity is directionally dependent within the horizontal plane however, few studies have looked at proprioceptive sensitivity in 3d space. In addition, the extent to which proprioceptive sensitivity is modifiable by factors such as exogenous neuromodulation is unclear. To investigate proprioceptive sensitivity in 3d we developed a novel experimental paradigm employing a 7-DoF robot arm, which enables reliable testing of arm proprioception along arbitrary paths in 3d space, including vertical motion which has previously been neglected. A participant’s right arm was coupled to a trough held by the robot that stabilized the wrist and forearm, allowing for changes in configuration only at the elbow and shoulder. Sensitivity to imposed displacements of the endpoint of the arm were evaluated using a “same/different” task, where participant’s hands were moved 1-4 cm from a previously visited reference position. A measure of sensitivity (d’) was compared across 6 movement directions and between 2 postures. For all directions, sensitivity increased monotonically as the distance from the reference location increased. Sensitivity was also shown to be anisotropic (directionally dependent) which has implications for our understanding of the planning and control of reaching movements in 3d space. The effect of neuromodulation on proprioceptive sensitivity was assessed using transcutaneous electrical nerve stimulation (TENS), which has been shown to have beneficial effects on human cognitive and sensorimotor performance in other contexts. In this pilot study the effects of two frequencies (30hz and 300hz) and three electrode configurations were examined. No effect of electrode configuration was found, however sensitivity with 30hz stimulation was significantly lower than with 300hz stimulation (which was similar to sensitivity without stimulation). Although TENS was shown to modulate proprioceptive sensitivity, additional experiments are required to determine if TENS can produce enhancement rather than depression of sensitivity which would have positive implications for rehabilitation of proprioceptive deficits arising from stroke and other disorders.Dissertation/ThesisDoctoral Dissertation Neuroscience 201

Development of Cognitive Capabilities in Humanoid Robots

Merged with duplicate record 10026.1/645 on 03.04.2017 by CS (TIS)Building intelligent systems with human level of competence is the ultimate grand challenge for science and technology in general, and especially for the computational intelligence community. Recent theories in autonomous cognitive systems have focused on the close integration (grounding) of communication with perception, categorisation and action. Cognitive systems are essential for integrated multi-platform systems that are capable of sensing and communicating. This thesis presents a cognitive system for a humanoid robot that integrates abilities such as object detection and recognition, which are merged with natural language understanding and refined motor controls. The work includes three studies; (1) the use of generic manipulation of objects using the NMFT algorithm, by successfully testing the extension of the NMFT to control robot behaviour; (2) a study of the development of a robotic simulator; (3) robotic simulation experiments showing that a humanoid robot is able to acquire complex behavioural, cognitive, and linguistic skills through individual and social learning. The robot is able to learn to handle and manipulate objects autonomously, to cooperate with human users, and to adapt its abilities to changes in internal and environmental conditions. The model and the experimental results reported in this thesis, emphasise the importance of embodied cognition, i.e. the humanoid robot's physical interaction between its body and the environment