Using models of baseline gameplay to design for physical rehabilitation

Modified digital games manage to drive motivation in repetitive exercises needed for motor rehabilitation, however designing modifications that satisfy both rehabilitation and engagement goals is challenging. We present a method wherein a statistical model of baseline gameplay identifies design configurations that emulate behaviours compatible with unmodified play. We illustrate this approach through a case study involving upper limb rehabilitation with a custom controller for a Pac-Man game. A participatory design workshop with occupational therapists defined two interaction parameters for gameplay and rehabilitation adjustments. The parameters' effect on the interaction was measured experimentally with 12 participants. We show that a low-latency model, using both user input behaviour and internal game state, identifies values for interaction parameters that reproduce baseline gameplay under degraded control. We discuss how this method can be applied to systematically balance gamification problems involving trade-offs between physical requirements and subjectively engaging experiences.Comment: 19 pages, 10 figure

Effect of a mixed reality-based intervention on arm, hand, and finger function on chronic stroke

[EN] Background: Virtual and mixed reality systems have been suggested to promote motor recovery after stroke. Basing on the existing evidence on motor learning, we have developed a portable and low-cost mixed reality tabletop system that transforms a conventional table in a virtual environment for upper limb rehabilitation. The system allows intensive and customized training of a wide range of arm, hand, and finger movements and enables interaction with tangible objects, while providing audiovisual feedback of the participants' performance in gamified tasks. This study evaluates the clinical effectiveness and the acceptance of an experimental intervention with the system in chronic stroke survivors. Methods: Thirty individuals with stroke were included in a reversal (A-B-A) study. Phase A consisted of 30 sessions of conventional physical therapy. Phase B consisted of 30 training sessions with the experimental system. Both interventions involved flexion and extension of the elbow, wrist, and fingers, and grasping of different objects. Sessions were 45-min long and were administered three to five days a week. The body structures (Modified Ashworth Scale), functions (Motricity Index, Fugl-Meyer Assessment Scale), activities (Manual Function Test, Wolf Motor Function Test, Box and Blocks Test, Nine Hole Peg Test), and participation (Motor Activity Log) were assessed before and after each phase. Acceptance of the system was also assessed after phase B (System Usability Scale, Intrinsic Motivation Inventory). Results: Significant improvement was detected after the intervention with the system in the activity, both in arm function measured by the Wolf Motor Function Test (p < 0.01) and finger dexterity measured by the Box and Blocks Test (p < 0.01) and the Nine Hole Peg Test (p < 0.01); and participation (p < 0.01), which was maintained to the end of the study. The experimental system was reported as highly usable, enjoyable, and motivating. Conclusions: Our results support the clinical effectiveness of mixed reality interventions that satisfy the motor learning principles for upper limb rehabilitation in chronic stroke survivors. This characteristic, together with the low cost of the system, its portability, and its acceptance could promote the integration of these systems in the clinical practice as an alternative to more expensive systems, such as robotic instruments.The authors wish to thank the staff and patients of the Servicio de Neurorrehabilitación y Daño Cerebral de los Hospitales NISA for their involvement in the study. The authors also wish to thank the staff of LabHuman for their support in this project, especially Francisco Toledo and José Roda for their assistance. This study was funded in part by the Project TEREHA (IDI-20110844) and Project NeuroVR (TIN2013-44741-R) of the Ministerio de Economia y Competitividad of Spain, the Project Consolider-C (SEJ2006-14301/PSIC) of the Ministerio de Educacion y Ciencia of Spain, the "CIBER of Physiopathology of Obesity and Nutrition, an initiative of ISCIII", and the Excellence Research Program PROMETEO of the Conselleria de Educacion of Generalitat Valenciana (2008-157).Colomer Font, C.; Llorens Rodríguez, R.; Noé Sebastián, E.; Alcañiz Raya, ML. (2016). Effect of a mixed reality-based intervention on arm, hand, and finger function on chronic stroke. Journal of NeuroEngineering and Rehabilitation. 13:1-10. https://doi.org/10.1186/s12984-016-0153-6S11013Fregni F, Pascual-Leone A. Hand motor recovery after stroke: tuning the orchestra to improve hand motor function. Cogn Behav Neurol. 2006;19(1):21–33.Patten C, Condliffe EG, Dairaghi CA, Lum PS. Concurrent neuromechanical and functional gains following upper-extremity power training post-stroke. J Neuroeng Rehabil. 2013;10:1.Turolla A, Dam M, Ventura L, Tonin P, Agostini M, Zucconi C, et al. Virtual reality for the rehabilitation of the upper limb motor function after stroke: a prospective controlled trial. J Neuroeng Rehabil. 2013;10:85.Dancause N, Nudo RJ. Shaping plasticity to enhance recovery after injury. Prog Brain Res. 2011;192:273–95.Kwakkel G, Kollen B, Lindeman E. Understanding the pattern of functional recovery after stroke: facts and theories. Restor Neurol Neurosci. 2004;22(3–5):281–99.Nielsen JB, Willerslev-Olsen M, Christiansen L, Lundbye-Jensen J, Lorentzen J. Science-based neurorehabilitation: recommendations for neurorehabilitation from basic science. J Mot Behav. 2015;47(1):7–17.Shaughnessy M, Resnick BM. Using theory to develop an exercise intervention for patients post stroke. Top Stroke Rehabil. 2009;16(2):140–6.Subramanian SK, Massie CL, Malcolm MP, Levin MF. Does provision of extrinsic feedback result in improved motor learning in the upper limb poststroke? A systematic review of the evidence. Neurorehabil Neural Repair. 2010;24(2):113–24.Arya KN, Verma R, Garg RK, Sharma VP, Agarwal M, Aggarwal GG. Meaningful task-specific training (MTST) for stroke rehabilitation: a randomized controlled trial. Top Stroke Rehabil. 2012;19(3):193–211.Levin MF, Weiss PL, Keshner EA. Emergence of Virtual Reality as a Tool for Upper Limb Rehabilitation: Incorporation of Motor Control and Motor Learning Principles. Phys Ther. 2015;95(3):415–25.Laver K, George S, Thomas S, Deutsch JE, Crotty M. Cochrane review: virtual reality for stroke rehabilitation. Eur J Phys Rehabil Med. 2012;48(3):523–30.Cameirao MS, Badia SB, Duarte E, Frisoli A, Verschure PF. The combined impact of virtual reality neurorehabilitation and its interfaces on upper extremity functional recovery in patients with chronic stroke. Stroke. 2012;43(10):2720–8.Saposnik G, Levin M, G. Outcome Research Canada Working. Virtual reality in stroke rehabilitation: a meta-analysis and implications for clinicians. Stroke. 2011;42(5):1380–6.Viau A, Feldman AG, McFadyen BJ, Levin MF. Reaching in reality and virtual reality: a comparison of movement kinematics in healthy subjects and in adults with hemiparesis. J Neuroeng Rehabil. 2004;1(1):11.Thornton M, Marshall S, McComas J, Finestone H, McCormick A, Sveistrup H. Benefits of activity and virtual reality based balance exercise programmes for adults with traumatic brain injury: perceptions of participants and their caregivers. Brain Inj. 2005;19(12):989–1000.Mazzoleni S, Puzzolante L, Zollo L, Dario P, Posteraro F. Mechanisms of motor recovery in chronic and subacute stroke patients following a robot-aided training. IEEE Trans Haptics. 2014;7(2):175–80.Duff M, Chen Y, Cheng L, Liu SM, Blake P, Wolf SL, et al. Adaptive mixed reality rehabilitation improves quality of reaching movements more than traditional reaching therapy following stroke. Neurorehabil Neural Repair. 2013;27(4):306–15.Mousavi Hondori, H., M. Khademi, L. Dodakian, A. McKenzie, C.V. Lopes, and S.C. Cramer, Choice of Human-Computer Interaction Mode in Stroke Rehabilitation. Neurorehabil Neural Repair, 2015.Bohannon RW, Smith MB. Interrater reliability of a modified Ashworth scale of muscle spasticity. Phys Ther. 1987;67(2):206–7.Paternostro-Sluga T, Grim-Stieger M, Posch M, Schuhfried O, Vacariu G, Mittermaier C, et al. Reliability and validity of the Medical Research Council (MRC) scale and a modified scale for testing muscle strength in patients with radial palsy. J Rehabil Med. 2008;40(8):665–71.Kopp B, Kunkel A, Flor H, Platz T, Rose U, Mauritz KH, et al. The Arm Motor Ability Test: reliability, validity, and sensitivity to change of an instrument for assessing disabilities in activities of daily living. Arch Phys Med Rehabil. 1997;78(6):615–20.Folstein MF, Folstein SE, McHugh PR. “Mini-mental state”. A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975;12(3):189–98.Romero M, Sanchez A, Marin C, Navarro MD, Ferri J, Noe E. Clinical usefulness of the Spanish version of the Mississippi Aphasia Screening Test (MASTsp): validation in stroke patients. Neurologia. 2012;27(4):216–24.Llorens R, Marín C, Ortega M, Alcaniz M, Colomer C, Navarro MD, et al. Upper limb tracking using depth information for rehabilitative tangible tabletop systems, in 9th International Conference on Disability, Virtual Reality & Associated Technologies. Laval, France: The University of Reading; 2012. p. 463–466.Alt Murphy M, Resteghini C, Feys P, Lamers I. An overview of systematic reviews on upper extremity outcome measures after stroke. BMC Neurol. 2015;15:29.Sloan RL, Sinclair E, Thompson J, Taylor S, Pentland B. Inter-rater reliability of the modified Ashworth Scale for spasticity in hemiplegic patients. Int J Rehabil Res. 1992;15(2):158–61.van der Ploeg RJ, Fidler V, Oosterhuis HJ. Hand-held myometry: reference values. J Neurol Neurosurg Psychiatry. 1991;54(3):244–7.Duncan PW, Propst M, Nelson SG. Reliability of the Fugl-Meyer assessment of sensorimotor recovery following cerebrovascular accident. Phys Ther. 1983;63(10):1606–10.Miyamoto S, Kondo T, Suzukamo Y, Michimata A, Izumi S. Reliability and validity of the Manual Function Test in patients with stroke. Am J Phys Med Rehabil. 2009;88(3):247–55.Woodbury M, Velozo CA, Thompson PA, Light K, Uswatte G, Taub E, et al. Measurement structure of the Wolf Motor Function Test: implications for motor control theory. Neurorehabil Neural Repair. 2010;24(9):791–801.Mathiowetz V, Volland G, Kashman N, Weber K. Adult norms for the Box and Block Test of manual dexterity. Am J Occup Ther. 1985;39(6):386–91.Oxford Grice K, Vogel KA, Le V, Mitchell A, Muniz S, Vollmer MA. Adult norms for a commercially available Nine Hole Peg Test for finger dexterity. Am J Occup Ther. 2003;57(5):570–3.Hammer AM, Lindmark B. Responsiveness and validity of the Motor Activity Log in patients during the subacute phase after stroke. Disabil Rehabil. 2010;32(14):1184–93.Bullinger HJ, F.-I.f.A.u. Organisation, and U.S.I.f.A.u. Technologiemanagement. Human Aspects in Computing: Design and use of interactive systems and work with terminals. Elsevier; 1991.McAuley E, Duncan T, Tammen VV. Psychometric properties of the Intrinsic Motivation Inventory in a competitive sport setting: a confirmatory factor analysis. Res Q Exerc Sport. 1989;60(1):48–58.Mazzoleni S, Sale P, Tiboni M, Franceschini M, Carrozza MC, Posteraro F. Upper limb robot-assisted therapy in chronic and subacute stroke patients: a kinematic analysis. Am J Phys Med Rehabil. 2013;92(10 Suppl 2):e26–37.Lin KC, Hsieh YW, Wu CY, Chen CL, Jang Y, Liu JS. Minimal detectable change and clinically important difference of the Wolf Motor Function Test in stroke patients. Neurorehabil Neural Repair. 2009;23(5):429–34.Fu TS, Wu CY, Lin KC, Hsieh CJ, Liu JS, Wang TN, et al. Psychometric comparison of the shortened Fugl-Meyer Assessment and the streamlined Wolf Motor Function Test in stroke rehabilitation. Clin Rehabil. 2012;26(11):1043–7.Hsieh YW, Wu CY, Lin KC, Chang YF, Chen CL, Liu JS. Responsiveness and validity of three outcome measures of motor function after stroke rehabilitation. Stroke. 2009;40(4):1386–91.van der Lee JH, Beckerman H, Lankhorst GJ, Bouter LM. The responsiveness of the Action Research Arm test and the Fugl-Meyer Assessment scale in chronic stroke patients. J Rehabil Med. 2001;33(3):110–3.Wolf SL, Catlin PA, Ellis M, Archer AL, Morgan B, Piacentino A. Assessing Wolf Motor Function Test as Outcome Measure for Research in Patients After Stroke. Stroke. 2001;32(7):1635–9.Reinkensmeyer DJ, Wolbrecht ET, Chan V, Chou C, Cramer SC, Bobrow JE. Comparison of three-dimensional, assist-as-needed robotic arm/hand movement training provided with Pneu-WREX to conventional tabletop therapy after chronic stroke. Am J Phys Med Rehabil. 2012;91(11 Suppl 3):S232–41.Takahashi CD, Der-Yeghiaian L, Le V, Motiwala RR, Cramer SC. Robot-based hand motor therapy after stroke. Brain. 2008;131(Pt 2):425–37.Sale P, Mazzoleni S, Lombardi V, Galafate D, Massimiani MP, Posteraro F, et al. Recovery of hand function with robot-assisted therapy in acute stroke patients: a randomized-controlled trial. Int J Rehabil Res. 2014;37(3):236–42.Hwang CH, Seong JW, Son DS. Individual finger synchronized robot-assisted hand rehabilitation in subacute to chronic stroke: a prospective randomized clinical trial of efficacy. Clin Rehabil. 2012;26(8):696–704.Timmermans AA, Seelen HA, Willmann RD, Kingma H. Technology-assisted training of arm-hand skills in stroke: concepts on reacquisition of motor control and therapist guidelines for rehabilitation technology design. J Neuroeng Rehabil. 2009;6:1.Levin MF, Kleim JA, Wolf SL. What do motor “recovery” and “compensation” mean in patients following stroke? Neurorehabil Neural Repair. 2009;23(4):313–9.Rosati G, Oscari F, Spagnol S, Avanzini F, Masiero S. Effect of task-related continuous auditory feedback during learning of tracking motion exercises. J Neuroeng Rehabil. 2012;9:79.Imam B, Jarus T. Virtual reality rehabilitation from social cognitive and motor learning theoretical perspectives in stroke population. Rehabil Res Pract. 2014;2014:594540.Schuster-Amft C, Henneke A, Hartog-Keisker B, Holper L, Siekierka E, Chevrier E, et al. Intensive virtual reality-based training for upper limb motor function in chronic stroke: a feasibility study using a single case experimental design and fMRI. Disabil Rehabil Assist Technol. 2015;10(5):385–92.Llorens R, Noe E, Colomer C, Alcaniz M. Effectiveness, usability, and cost-benefit of a virtual reality-based telerehabilitation program for balance recovery after stroke: a randomized controlled trial. Arch Phys Med Rehabil. 2015;96(3):418–25. e2.Llorens R, Gil-Gomez JA, Alcaniz M, Colomer C, Noe E. Improvement in balance using a virtual reality-based stepping exercise: a randomized controlled trial involving individuals with chronic stroke. Clin Rehabil. 2015;29(3):7

ISAR: Ein Autorensystem für Interaktive Tische

Developing augmented reality systems involves several challenges, that prevent end users and experts from non-technical domains, such as education, to experiment with this technology. In this research we introduce ISAR, an authoring system for augmented reality tabletops targeting users from non-technical domains. ISAR allows non-technical users to create their own interactive tabletop applications and experiment with the use of this technology in domains such as educations, industrial training, and medical rehabilitation.Die Entwicklung von Augmented-Reality-Systemen ist mit mehreren Herausforderungen verbunden, die Endbenutzer und Experten aus nicht-technischen Bereichen, wie z.B. dem Bildungswesen, daran hindern, mit dieser Technologie zu experimentieren. In dieser Forschung stellen wir ISAR vor, ein Autorensystem für Augmented-Reality-Tabletops, das sich an Benutzer aus nicht-technischen Bereichen richtet. ISAR ermöglicht es nicht-technischen Anwendern, ihre eigenen interaktiven Tabletop-Anwendungen zu erstellen und mit dem Einsatz dieser Technologie in Bereichen wie Bildung, industrieller Ausbildung und medizinischer Rehabilitation zu experimentieren

A computational approach to gestural interactions of the upper limb on planar surfaces

There are many compelling reasons for proposing new gestural interactions: one might want to use a novel sensor that affords access to data that couldn’t be previously captured, or transpose a well-known task into a different unexplored scenario. After an initial design phase, the creation, optimisation or understanding of new interactions remains, however, a challenge. Models have been used to foresee interaction properties: Fitts’ law, for example, accurately predicts movement time in pointing and steering tasks. But what happens when no existing models apply? The core assertion to this work is that a computational approach provides frameworks and associated tools that are needed to model such interactions. This is supported through three research projects, in which discriminative models are used to enable interactions, optimisation is included as an integral part of their design and reinforcement learning is used to explore motions users produce in such interactions

Physical demand but not dexterity is associated with motor flexibility during rapid reaching in healthy young adults

Healthy humans are able to place light and heavy objects in small and large target locations with remarkable accuracy. Here we examine how dexterity demand and physical demand affect flexibility in joint coordination and end-effector kinematics when healthy young adults perform an upper extremity reaching task. We manipulated dexterity demand by changing target size and physical demand by increasing external resistance to reaching. Uncontrolled manifold analysis was used to decompose variability in joint coordination patterns into variability stabilizing the end-effector and variability de-stabilizing the end-effector during reaching. Our results demonstrate a proportional increase in stabilizing and de-stabilizing variability without a change in the ratio of the two variability components as physical demands increase. We interpret this finding in the context of previous studies showing that sensorimotor noise increases with increasing physical demands. We propose that the larger de-stabilizing variability as a function of physical demand originated from larger sensorimotor noise in the neuromuscular system. The larger stabilizing variability with larger physical demands is a strategy employed by the neuromuscular system to counter the de-stabilizing variability so that performance stability is maintained. Our findings have practical implications for improving the effectiveness of movement therapy in a wide range of patient groups, maintaining upper extremity function in old adults, and for maximizing athletic performance

Predicting Gains With Visuospatial Training After Stroke Using an EEG Measure of Frontoparietal Circuit Function

The heterogeneity of stroke prompts the need for predictors of individual treatment response to rehabilitation therapies. We previously studied healthy subjects with EEG and identified a frontoparietal circuit in which activity predicted training-related gains in visuomotor tracking. Here we asked whether activity in this same frontoparietal circuit also predicts training-related gains in visuomotor tracking in patients with chronic hemiparetic stroke. Subjects (n = 12) underwent dense-array EEG recording at rest, then received 8 sessions of visuomotor tracking training delivered via home-based telehealth methods. Subjects showed significant training-related gains in the primary behavioral endpoint, Success Rate score on a standardized test of visuomotor tracking, increasing an average of 24.2 ± 21.9% (p = 0.003). Activity in the circuit of interest, measured as coherence (20–30Hz) between leads overlying ipsilesional frontal (motor cortex) and parietal lobe, significantly predicted training-related gains in visuomotor tracking change, measured as change in Success Rate score (r = 0.61, p = 0.037), supporting the main study hypothesis. Results were specific to the hypothesized ipsilesional motor-parietal circuit, as coherence within other circuits did not predict training-related gains. Analyses were repeated after removing the four subjects with injury to motor or parietal areas; this increased the strength of the association between activity in the circuit of interest and training-related gains. The current study found that (1) Eight sessions of training can significantly improve performance on a visuomotor task in patients with chronic stroke, (2) this improvement can be realized using home-based telehealth methods, (3) an EEG-based measure of frontoparietal circuit function predicts training-related behavioral gains arising from that circuit, as hypothesized and with specificity, and (4) incorporating measures of both neural function and neural injury improves prediction of stroke rehabilitation therapy effects

Virtual reality with customized positive stimuli in a cognitive-motor rehabilitation task: a feasibility study with subacute stroke patients with mild cognitive impairment

Virtual Reality applications for integrated cognitive and motor stroke rehabilitation show promise for providing more comprehensive rehabilitation programs. However, we are still missing evidence on its impact in comparison with standard rehabilitation, particularly in patients with cognitive impairment. Additionally, little is known on how specific stimuli in the virtual environment affect task performance and its consequence on recovery. Here we investigate the impact in stroke recovery of a virtual cognitive-motor task customized with positive stimuli, in comparison to standard rehabilitation. The positive stimuli were images based on individual preferences, and self-selected music (half of the sessions). 13 participants in the subacute stage of stroke, with cognitive and motor deficits, were allocated to one of two groups (VR, Control). Motor and cognitive outcomes were assessed at end of treatment (4-6 weeks) and at a 4-week followup. Both groups showed significant improvements over time in functional ability during task performance, but without changes in motor impairment. Cognitive outcomes were modest in both groups. For participants in the VR group, the score in the task was significantly higher in sessions with music. There were no statistical differences between groups at end of treatment and follow-up. The impact of VR therapy was lower than in similar studies with stroke patients without cognitive deficits. This study is a first step towards understanding how VR could be shaped to address the particular needs of this population.info:eu-repo/semantics/publishedVersio

Age and Not the Preferred Limb Influences the Kinematic Structure of Pointing Movements

In goal-directed movements, effective open-loop control reduces the need for feedback-based corrective submovements. The purpose of this study was to determine the influence of hand preference and aging on submovements during single-and two-joint pointing movements. A total of 12 young and 12 older right-handed participants performed pointing movements that involved either elbow extension or a combination of elbow extension and horizontal shoulder flexion with their right and left arms to a target. Kinematics were used to separate the movements into their primary and secondary submovements. The older adults exhibited slower movements, used secondary submovements more often, and produced relatively shorter primary submovements. However, there were no interlimb differences for either age group or for the single-and two-joint movements. These findings indicate that open-loop control is similar between arms but compromised in older compared to younger adults