3-D Human Action Recognition by Shape Analysis of Motion Trajectories on Riemannian Manifold

International audienceRecognizing human actions in 3D video sequences is an important open problem that is currently at the heart of many research domains including surveillance, natural interfaces and rehabilitation. However, the design and development of models for action recognition that are both accurate and efficient is a challenging task due to the variability of the human pose, clothing and appearance. In this paper, we propose a new framework to extract a compact representation of a human action captured through a depth sensor, and enable accurate action recognition. The proposed solution develops on fitting a human skeleton model to acquired data so as to represent the 3D coordinates of the joints and their change over time as a trajectory in a suitable action space. Thanks to such a 3D joint-based framework, the proposed solution is capable to capture both the shape and the dynamics of the human body simultaneously. The action recognition problem is then formulated as the problem of computing the similarity between the shape of trajectories in a Riemannian manifold. Classification using kNN is finally performed on this manifold taking advantage of Riemannian geometry in the open curve shape space. Experiments are carried out on four representative benchmarks to demonstrate the potential of the proposed solution in terms of accuracy/latency for a low-latency action recognition. Comparative results with state-of-the-art methods are reported

Perceiving What Is Reachable Depends on Motor Representations: Evidence from a Transcranial Magnetic Stimulation Study

Background: Visually determining what is reachable in peripersonal space requires information about the egocentric location of objects but also information about the possibilities of action with the body, which are context dependent. The aim of the present study was to test the role of motor representations in the visual perception of peripersonal space. Methodology: Seven healthy participants underwent a TMS study while performing a right-left decision (control) task or perceptually judging whether a visual target was reachable or not with their right hand. An actual grasping movement task was also included. Single pulse TMS was delivered 80 % of the trials on the left motor and premotor cortex and on a control site (the temporo-occipital area), at 90 % of the resting motor threshold and at different SOA conditions (50ms, 100ms, 200ms or 300ms). Principal Findings: Results showed a facilitation effect of the TMS on reaction times in all tasks, whatever the site stimulated and until 200ms after stimulus presentation. However, the facilitation effect was on average 34ms lower when stimulating the motor cortex in the perceptual judgement task, especially for stimuli located at the boundary of peripersonal space. Conclusion: This study provides the first evidence that brain motor area participate in the visual determination of what is reachable. We discuss how motor representations may feed the perceptual system with information about possibl

Visualizing the Effects of rTMS in a Patient Sample: Small N vs. Group Level Analysis

The use of transcranial magnetic stimulation (TMS) to assess changes in cortical excitability is a tool used with increased prevalence in healthy and impaired populations. One factor of concern with this technique is how to achieve adequate statistical power given constraints of a small number of subjects and variability in responses. This paper compares a single pulse excitability measure using traditional group-level statistics vs single subject analyses in a patient population of subjects with focal hand dystonia, pre and post repetitive TMS (rTMS). Results show significant differences in cortical excitability for 4/5 subjects using a split middle line analysis on plots of individual subject data. Group level statistics (ANOVA), however, did not detect any significant findings. The consideration of single subject statistics for TMS excitability measures may assist researchers in describing the variably of rTMS outcome measures

The TMS Map Scales with Increased Stimulation Intensity and Muscle Activation

One way to study cortical organisation, or its reorganisation, is to use transcranial magnetic stimulation (TMS) to construct a map of corticospinal excitability. TMS maps are reported to be acquired with a wide variety of stimulation intensities and levels of muscle activation. Whilst MEPs are known to increase both with stimulation intensity and muscle activation, it remains to be established what the effect of these factors is on the map's centre of gravity (COG), area, volume and shape. Therefore, the objective of this study was to systematically examine the effect of stimulation intensity and muscle activation on these four key map outcome measures. In a first experiment, maps were acquired with a stimulation intensity of 110, 120 and 130% of resting threshold. In a second experiment, maps were acquired at rest and at 5, 10, 20 and 40% of maximum voluntary contraction. Map area and map volume increased with both stimulation intensity (P 0.09 in all cases). This result indicates the map simply scales with stimulation intensity and muscle activation

Systematic assessment of training-induced changes in corticospinal output to hand using frameless stereotaxic transcranial magnetic stimulation.

Measuring changes in the characteristics of corticospinal output has become a critical part of assessing the impact of motor experience on cortical organization in both the intact and injured human brain. In this protocol we describe a method for systematically assessing training-induced changes in corticospinal output that integrates volumetric anatomical MRI with transcranial magnetic stimulation (TMS). A TMS coil is sited to a target grid superimposed onto a 3D MRI of cortex using a stereotaxic neuronavigation system. Subjects are then required to exercise the first dorsal interosseus (FDI) muscle on two different tasks for a total of 30 min. The protocol allows for reliably and repeatedly detecting changes in corticospinal output to FDI muscle in response to brief periods of motor training

Repeatability of Corticospinal and Spinal Measures during Lengthening and Shortening Contractions in the Human Tibialis Anterior Muscle

Elements of the human central nervous system (CNS) constantly oscillate. In addition, there are also methodological factors and changes in muscle mechanics during dynamic muscle contractions that threaten the stability and consistency of transcranial magnetic stimulation (TMS) and perpherial nerve stimulation (PNS) measures