In-shoe plantar prressure measurement and analysis system based on fabric pressure sensing array

Author name used in this publication: David Dagan Feng2009-2010 > Academic research: refereed > Publication in refereed journalVersion of RecordPublishe

Deep Learning Based Abnormal Gait Classification System Study with Heterogeneous Sensor Network

Gait is one of the important biological characteristics of the human body. Abnormal gait is mostly related to the lesion site and has been demonstrated to play a guiding role in clinical research such as medical diagnosis and disease prevention. In order to promote the research of automatic gait pattern recognition, this paper introduces the research status of abnormal gait recognition and systems analysis of the common gait recognition technologies. Based on this, two gait information extraction methods, sensor-based and vision-based, are studied, including wearable system design and deep neural network-based algorithm design. In the sensor-based study, we proposed a lower limb data acquisition system. The experiment was designed to collect acceleration signals and sEMG signals under normal and pathological gaits. Specifically, wearable hardware-based on MSP430 and upper computer software based on Labview is designed. The hardware system consists of EMG foot ring, high-precision IMU and pressure-sensitive intelligent insole. Data of 15 healthy persons and 15 hemiplegic patients during walking were collected. The classification of gait was carried out based on sEMG and the average accuracy rate can reach 92.8% for CNN. For IMU signals five kinds of abnormal gait are trained based on three models: BPNN, LSTM, and CNN. The experimental results show that the system combined with the neural network can classify different pathological gaits well, and the average accuracy rate of the six-classifications task can reach 93%. In vision-based research, by using human keypoint detection technology, we obtain the precise location of the key points through the fusion of thermal mapping and offset, thus extracts the space-time information of the key points. However, the results show that even the state-of-the-art is not good enough for replacing IMU in gait analysis and classification. The good news is the rhythm wave can be observed within 2 m, which proves that the temporal and spatial information of the key points extracted is highly correlated with the acceleration information collected by IMU, which paved the way for the visual-based abnormal gait classification algorithm.步态指人走路时表现出来的姿态，是人体重要生物特征之一。异常步态多与病变部位有关，作为反映人体健康状况和行为能力的重要特征，其被论证在医疗诊断、疾病预防等临床研究中具有指导作用。为了促进步态模式自动识别的研究，本文介绍了异常步态识别的研究现状，系统地分析了常见步态识别技术以及算法，以此为基础研究了基于传感器与基于视觉两种步态信息提取方法，内容包括可穿戴系统设计与基于深度神经网络的算法设计。 在基于传感器的研究中，本工作开发了下肢步态信息采集系统，并利用该信息采集系统设计实验，采集正常与不同病理步态下的加速度信号与肌电信号，搭建深度神经网络完成分类任务。具体的，在系统搭建部分设计了基于MSP430的可穿戴硬件设备以及基于Labview的上位机软件，该硬件系统由肌电脚环，高精度IMU以及压感智能鞋垫组成，该上位机软件接收、解包蓝牙数据并计算出步频步长等常用步态参数。 在基于运动信号与基于表面肌电的研究中，采集了15名健康人与15名偏瘫病人的步态数据，并针对表面肌电信号训练卷积神经网络进行帕金森步态的识别与分类，平均准确率可达92.8%。针对运动信号训练了反向传播神经网络，LSTM以及卷积神经网络三种模型进行五种异常步态的分类任务。实验结果表明，本工作中步态信息采集系统结合神经网络模型，可以很好地对不同病理步态进行分类，六分类平均正确率可达93%。 在基于视觉的研究中，本文利用人体关键点检测技术，首先检测出图片中的一个或多个人，接着对边界框做图像分割，接着采用全卷积resnet对每一个边界框中的人物的主要关节点做热力图并分析偏移量，最后通过热力图与偏移的融合得到关键点的精确定位。通过该算法提取了不同步态下姿态关键点时空信息，为基于视觉的步态分析系统提供了基础条件。但实验结果表明目前最高准确率的人体关键点检测算法不足以替代IMU实现步态分析与分类。但在2m之内可以观察到节律信息，证明了所提取的关键点时空信息与IMU采集的加速度信息呈现较高相关度，为基于视觉的异常步态分类算法铺平了道路

Dynamic Mutual Capacitive Sensor for Human Interactions.

This dissertation introduces the novel concept of removing the ground conductive plate by utilizing body capacitance as the ground in the capacitive sensor, whereby circuit pressure sensing can occur with only one plate and one dielectric. Additionally, body capacitance sensing was limited to a binary touch-no-touch output, whereas the method presented here can sense various applied pressures. The resulting circuit acts as an antenna that receives local capacitance signals from a human interaction. The advantage of this design is that it allows for both proximity sensing and pressure sensing (once the body part is touching the dielectric material). This setup is ideal for a z-axis dimensional interface for touchscreen devices, as well as pressure sensing palpation or planter region interaction

Commercially available pressure sensors for sport and health applications: A comparative review

Pressure measurement systems have numerous applications in healthcare and sport. The purpose of this review is to: (a) describe the brief history of the development of pressure sensors for clinical and sport applications, (b) discuss the design requirements for pressure measurement systems for different applications, (c) critique the suitability, reliability, and validity of commercial pressure measurement systems, and (d) suggest future directions for the development of pressure measurements systems in this area. Commercial pressure measurement systems generally use capacitive or resistive sensors, and typically capacitive sensors have been reported to be more valid and reliable than resistive sensors for prolonged use. It is important to acknowledge, however, that the selection of sensors is contingent upon the specific application requirements. Recent improvements in sensor and wireless technology and computational power have resulted in systems that have higher sensor density and sampling frequency with improved usability – thinner, lighter platforms, some of which are wireless, and reduced the obtrusiveness of in-shoe systems due to wireless data transmission and smaller data-logger and control units. Future developments of pressure sensors should focus on the design of systems that can measure or accurately predict shear stresses in conjunction with pressure, as it is thought the combination of both contributes to the development of pressure ulcers and diabetic plantar ulcers. The focus for the development of in-shoe pressure measurement systems is to minimise any potential interference to the patient or athlete, and to reduce power consumption of the wireless systems to improve the battery life, so these systems can be used to monitor daily activity. A potential solution to reduce the obtrusiveness of in-shoe systems include thin flexible pressure sensors which can be incorporated into socks. Although some experimental systems are available further work is needed to improve their validity and reliability

Classification of forefoot plantar pressure distribution in persons with diabetes : a novel perspective for the mechanical management of diabetic foot?

Background: The aim of this study was to identify groups of subjects with similar patterns of forefoot loading and verify if specific groups of patients with diabetes could be isolated from non-diabetics. Methodology/Principal Findings: Ninety-seven patients with diabetes and 33 control participants between 45 and 70 years were prospectively recruited in two Belgian Diabetic Foot Clinics. Barefoot plantar pressure measurements were recorded and subsequently analysed using a semi-automatic total mapping technique. Kmeans cluster analysis was applied on relative regional impulses of six forefoot segments in order to pursue a classification for the control group separately, the diabetic group separately and both groups together. Cluster analysis led to identification of three distinct groups when considering only the control group. For the diabetic group, and the computation considering both groups together, four distinct groups were isolated. Compared to the cluster analysis of the control group an additional forefoot loading pattern was identified. This group comprised diabetic feet only. The relevance of the reported clusters was supported by ANOVA statistics indicating significant differences between different regions of interest and different clusters. Conclusion/s Significance: There seems to emerge a new era in diabetic foot medicine which embraces the classification of diabetic patients according to their biomechanical profile. Classification of the plantar pressure distribution has the potential to provide a means to determine mechanical interventions for the prevention and/or treatment of the diabetic foot