Gait recognition and understanding based on hierarchical temporal memory using 3D gait semantic folding

Gait recognition and understanding systems have shown a wide-ranging application prospect. However, their use of unstructured data from image and video has affected their performance, e.g., they are easily influenced by multi-views, occlusion, clothes, and object carrying conditions. This paper addresses these problems using a realistic 3-dimensional (3D) human structural data and sequential pattern learning framework with top-down attention modulating mechanism based on Hierarchical Temporal Memory (HTM). First, an accurate 2-dimensional (2D) to 3D human body pose and shape semantic parameters estimation method is proposed, which exploits the advantages of an instance-level body parsing model and a virtual dressing method. Second, by using gait semantic folding, the estimated body parameters are encoded using a sparse 2D matrix to construct the structural gait semantic image. In order to achieve time-based gait recognition, an HTM Network is constructed to obtain the sequence-level gait sparse distribution representations (SL-GSDRs). A top-down attention mechanism is introduced to deal with various conditions including multi-views by refining the SL-GSDRs, according to prior knowledge. The proposed gait learning model not only aids gait recognition tasks to overcome the difficulties in real application scenarios but also provides the structured gait semantic images for visual cognition. Experimental analyses on CMU MoBo, CASIA B, TUM-IITKGP, and KY4D datasets show a significant performance gain in terms of accuracy and robustness

Instrumenting gait with an accelerometer: A system and algorithm examination

Gait is an important clinical assessment tool since changes in gait may reflect changes in general health. Measurement of gait is a complex process which has been restricted to the laboratory until relatively recently. The application of an inexpensive body worn sensor with appropriate gait algorithms (BWM) is an attractive alternative and offers the potential to assess gait in any setting. In this study we investigated the use of a low-cost BWM, compared to laboratory reference using a robust testing protocol in both younger and older adults. We observed that the BWM is a valid tool for estimating total step count and mean spatio-temporal gait characteristics however agreement for variability and asymmetry results was poor. We conducted a detailed investigation to explain the poor agreement between systems and determined it was due to inherent differences between the systems rather than inability of the sensor to measure the gait characteristics. The results highlight caution in the choice of reference system for validation studies. The BWM used in this study has the potential to gather longitudinal (real-world) spatio-temporal gait data that could be readily used in large lifestyle-based intervention studies, but further refinement of the algorithm(s) is required

Reliable and robust detection of freezing of gait episodes with wearable electronic devices

A wearable wireless sensing system for assisting patients affected by Parkinson's disease is proposed. It uses integrated micro-electro-mechanical inertial sensors able to recognize the episodes of involuntary gait freezing. The system operates in real time and is designed for outdoor and indoor applications. Standard tests were performed on a noticeable number of patients and healthy persons and the algorithm demonstrated its reliability and robustness respect to individual specific gait and postural behaviors. The overall performances of the system are excellent with a specificity higher than 97%

In silico case studies of compliant robots: AMARSI deliverable 3.3

In the deliverable 3.2 we presented how the morphological computing ap- proach can significantly facilitate the control strategy in several scenarios, e.g. quadruped locomotion, bipedal locomotion and reaching. In particular, the Kitty experimental platform is an example of the use of morphological computation to allow quadruped locomotion. In this deliverable we continue with the simulation studies on the application of the different morphological computation strategies to control a robotic system