Analysis and recognition of human gait activity based on multimodal sensors

Remote health monitoring plays a significant role in research areas related to medicine, neurology, rehabilitation, and robotic systems. These applications include Human Activity Recognition (HAR) using wearable sensors, signal processing, mathematical methods, and machine learning to improve the accuracy of remote health monitoring systems. To improve the detection and accuracy of human activity recognition, we create a novel method to reduce the complexities of extracting features using the HuGaDB dataset. Our model extracts power spectra; due to the high dimensionality of features, sliding windows techniques are used to determine frequency bandwidth automatically, where an improved QRS algorithm selects the first dominant spectrum amplitude. In addition, the bandwidth algorithm has been used to reduce the dimensionality of data, remove redundant dimensions, and improve feature extraction. In this work, we have considered widely used machine learning classifiers. Our proposed method was evaluated using the accelerometer angles spectrum installed in six parts of the body and then reducing the bandwidth to know the evolution. Our approach attains an accuracy rate of 95.1% in the HuGaDB dataset with 70% of bandwidth, outperforming others in the human activity recognition accuracy.Partial funding for open access charge: Universidad de Málag

Comprehensive review of vision-based fall detection systems

Vision-based fall detection systems have experienced fast development over the last years. To determine the course of its evolution and help new researchers, the main audience of this paper, a comprehensive revision of all published articles in the main scientific databases regarding this area during the last five years has been made. After a selection process, detailed in the Materials and Methods Section, eighty-one systems were thoroughly reviewed. Their characterization and classification techniques were analyzed and categorized. Their performance data were also studied, and comparisons were made to determine which classifying methods best work in this field. The evolution of artificial vision technology, very positively influenced by the incorporation of artificial neural networks, has allowed fall characterization to become more resistant to noise resultant from illumination phenomena or occlusion. The classification has also taken advantage of these networks, and the field starts using robots to make these systems mobile. However, datasets used to train them lack real-world data, raising doubts about their performances facing real elderly falls. In addition, there is no evidence of strong connections between the elderly and the communities of researchers

Accelerometry based detection of epileptic seizures

Epilepsy is one of the most common neurological disorders. Epileptic seizures are the manifestation of abnormal hypersynchronous discharges of cortical neurons that impair brain function. Most of the people affected can be treated successfully with drug therapy or neurosurgical procedures. But there is still a large group of epilepsy patients that continues to have frequent seizures. For these patients automated detection of epileptic seizures can be of great clinical importance. Seizure detection can influence daily care or can be used to evaluate treatment effect. Furthermore automated detection can be used to trigger an alarm system during seizures that might be harmful to the patient. This thesis focusses on accelerometry (ACM) based seizure detection. A detailed overview is provided, on the perspectives for long-term epilepsy monitoring and automated seizure detection. The value of accelerometry for seizure detection is shown by means of a clinical evaluation and the first steps are made towards automatic detection of epileptic seizures based on ACM. With accelerometers movements are recorded. A large group of epileptic seizures manifest in specific movement patterns, so called motor seizures. Chapter 2 of this thesis presents an overview of the published literature on available methods for epileptic seizure detection in a long-term monitoring context. Based on this overview recommendations are formulated that should be used in seizure detection research and development. It is shown that for seizure detection in home environments, other sensor modalities besides EEG become more important. The use of alternative sensor modalities (such as ACM) is relatively new and so is the algorithm development for seizure detection based on these measures. It was also found that for both the adaptation of existing techniques and the development of new algorithms, clinical information should be taken more into account. The value of ACM for seizure detection is shown by means of a clinical evaluation in chapter 3. Here 3-D ACM- and EEG/video-recordings of 18 patients with severe epilepsy are visually analyzed. A striking outcome presented in this chapter is the large number of visually detected seizures versus the number of seizures that was expected on forehand and the number of seizures that was observed by the nurses. These results underscore the need for an automatic seizure detection device even more, since in the current situation many seizures are missed and therefore it is possible that patients do not get the right (medical) treatment. It was also observed that 95% of the ACM-patterns during motor seizures are sequences of three elementary patterns: myoclonic, tonic and clonic patterns. These characteristic patterns are a starting point for the development of methods for automated seizure detection based on ACM. It was decided to use a modular approach for the detection methodology and develop algorithms separately for motor activity in general, myoclonic seizures and tonic seizures. Furthermore, clinical information is incorporated in the detection methodology. Therefore in this thesis features were used that are either based on the shape of the patterns of interest as described in clinical practice (chapter 4 and 7), or the features were based on a physiological model with parameters that are related to seizure duration and intensity (chapter 5 and 6). In chapter 4 an algorithm is developed to distinguish periods with and without movement from ACM-data. Hence, when there is no movement there is no motor seizure. The amount of data that needs further analysis for seizure detection is thus reduced. From 15 ACM-signals (measured on five positions on the body), two features are computed, the variance and the jerk. In the resulting 2-D feature space a linear threshold function is used for classification. For training and testing the algorithm ACM data along with video data are used from nocturnal recordings in mentally retarded patients with severe epilepsy. Using this algorithm the amount of data that needs further analysis is reduced considerably. The results also indicate that the algorithm is robust for fluctuations across patients and thus there is no need for training the algorithm for each new patient. For the remaining data it needs to be established whether the detected movement is seizure related or not. To this purpose a model is developed for the accelerometer pattern measured on the arm during a myoclonic seizure (chapter 5). The model consists of a mechanical and an electrophysiological part. This model is used as a matched wavelet filter to detect myoclonic seizures. In chapter 6 the model based wavelet is compared to three other time frequency measures: the short time Fourier transform, the Wigner distribution and the continuous wavelet transform using a Daubechies wavelet. All four time-frequency methods are evaluated in a linear classification setup. Data from mentally retarded patients with severe epilepsy are used for training and evaluation. The results show that both wavelets are useful for detection of myoclonic seizures. On top of that, our model based wavelet has the advantage that it consists of parameters that are related to seizure duration and intensity that are physiological meaningful. Besides myoclonic seizures, the model is also useful for the detection of clonic seizures; physiologically these are repetitive myoclonic seizures. Finally for the detection of tonic seizures, in chapter 7 a set of features is studied that incorporate the mean characteristics of ACM-patterns associated with tonic seizures. Linear discriminant analysis is used for classification in the multi-dimensional feature space. For training and testing the algorithm, again data are used from recordings in mentally retarded patients with severe epilepsy. The results show that our approach is useful for the automated detection of tonic seizures based on 3-D ACM and that it is a promising contribution in a complete multi-sensor seizure detection setup

Mobile activity recognition and fall detection system for elderly people using Ameva algorithm

Currently, the lifestyle of elderly people is regularly monitored in order to establish guidelines for rehabilitation processes or ensure the welfare of this segment of the population. In this sense, activity recognition is essential to detect an objective set of behaviors throughout the day. This paper describes an accurate, comfortable and efficient system, which monitors the physical activity carried out by the user. An extension to an awarded activity recognition system that participated in the EvAAL 2012 and EvAAL 2013 competitions is presented. This approach uses data retrieved from accelerometer sensors to generate discrete variables and it is tested in a non-controlled environment. In order to achieve the goal, the core of the algorithm Ameva is used to develop an innovative selection, discretization and classification technique for activity recognition. Moreover, with the purpose of reducing the cost and increasing user acceptance and usability, the entire system uses only a smartphone to recover all the information requiredMinisterio de Economía y Competitividad HERMES TIN2013-46801-C4-1-rJunta de Andalucía Simon P11-TIC-8052Junta de Andalucía M-Learning P11-TIC-712

Inertial Sensing for Human Motion Analysis: Processing, Technologies, and Applications

Human motion has always attracted significant interest and curiosity. In particular, the last two centuries have seen a fast and great development of innovative techniques and technologies for the scientific analysis of human motion. If initially this was mainly due to the large interest in biomedical fields, a growing number of other leading applications has kept this interest alive until today. These applications emerge, for instance, in sport, entertainment, and industrial contexts. The first motion capture systems, appeared along the nineteenth century, were typically based on optical technologies and their development was profoundly interlaced with the contemporary development of photography and cinematography. Since then, many other different technologies have been employed to develop new motion capture systems, such as (but not limited to) inertial, mechanical, magnetic, and acoustic. In particular, inertial motion capture systems, based on the use of inertial sensors (such as the accelerometer, which measures the acceleration, and the gyroscope, which measures angular velocity), are likely to replace the previous ones and become a standard technology. This is mainly favored by the recent great improvement in the large-scale development of accurate inertial sensors ever cheaper. When referring to inertial human motion analysis, several application areas are driving current research and development efforts. A tentative list may include, for instance, the following: clinical and home monitoring and/or rehabilitation; ambient assisted living; computer graphics and computer animation; gaming and virtual reality; sport training; pedestrian navigation; and robotics. Furthermore, human motion analysis often implies a transversal investigation of many aspects of human motion, at different levels of abstraction and at different detail depths. For instance, one may just be interested in recognizing and estimating the pose of a person as well as in identifying the activities and/or the gestures that he/she is performing. Furthermore, one may be just interested in analyzing a restricted part of the body rather than focusing on the full body. Due to this heterogeneity of topics and intents, this thesis does not focus on a specific application or method, but aims at investigating different aspects of inertial human motion analysis, by specifically discussing the corresponding data processing approaches and the involved technologies. Four research areas have been taken into account which correspond to four types of applications: arm posture recognition; activity classification; evaluation of functional motor tasks; and motion reconstruction. In particular, these applications have been chosen in order to cover topics with different levels of abstraction and different detail depths

Machine Learning for Structural Monitoring and Anomaly Detection

Autonomous structural health monitoring (SHM) of a large number of structures became a topic of paramount importance for maintenance purposes and safety reasons in the last few decades. Civil infrastructures are the backbone of modern society, and the assessment of their conditions is of renowned importance. This aspect is even more exacerbated because of the existing system that are fast approaching their service life. Since the replacement of those structures is functionally and economically demanding, maintenance and retrofitting operations must be planned wisely. Moreover, the increasing amount and variety of data generated by users and sensors interconnected to the future 6G network requires new strategies to manage several types of data with highly different characteristics and also requires solutions to power the wireless network with renewable energies. In this scenario, the adoption of artificial intelligence and in particular machine learning (ML) strategies represents a flexible and potentially powerful solution that must be investigated. To manage the big and widespread amount of data generated by the extensive usage of multiple types of sensors, several ML techniques can be investigated, with the aim to perform data fusion and reduce the amount of data. Furthermore, the usage of anomaly detection techniques to identify potentially critical situations in infrastructures and buildings represents a topic of particular interest that still needs a significant investigation effort. In this research activity, we provide the fundamental guidelines to perform automatic damage detection, which combines SHM strategies and ML algorithms capable of performing anomaly detection on a wide set of structures. In particular, several algorithms and strategies capable of extracting relevant features from large amounts of data generated by different types of sensors are investigated. Finally, to effectively manage such an amount of data in communication constraints, we obtained some design rules for the acquisition system for bridge monitoring

Instrumentation of a cane to detect and prevent falls

Dissertação de mestrado integrado em Engenharia Biomédica (área de especialização em Eletrónica Médica)The number of falls is growing as the main cause of injuries and deaths in the geriatric community. As a result, the cost of treating the injuries associated with falls is also increasing. Thus, the development of fall-related strategies with the capability of real-time monitoring without user restriction is imperative. Due to their advantages, daily life accessories can be a solution to embed fall-related systems, and canes are no exception. Moreover, gait assessment might be capable of enhancing the capability of cane usage for older cane users. Therefore, reducing, even more, the possibility of possible falls amongst them. Summing up, it is crucial the development of strategies that recognize states of fall, the step before a fall (pre-fall step) and the different cane events continuously throughout a stride. This thesis aims to develop strategies capable of identifying these situations based on a cane system that collects both inertial and force information, the Assistive Smart Cane (ASCane). The strategy regarding the detection of falls consisted of testing the data acquired with the ASCane with three different fixed multi-threshold fall detection algorithms, one dynamic multi-threshold and machine learning methods from the literature. They were tested and modified to account the use of a cane. The best performance resulted in a sensitivity and specificity of 96.90% and 98.98%, respectively. For the detection of the different cane events in controlled and real-life situations, a state-of-the-art finite-state-machine gait event detector was modified to account the use of a cane and benchmarked against a ground truth system. Moreover, a machine learning study was completed involving eight feature selection methods and nine different machine learning classifiers. Results have shown that the accuracy of the classifiers was quite acceptable and presented the best results with 98.32% of overall accuracy for controlled situations and 94.82% in daily-life situations. Regarding pre-fall step detection, the same machine learning approach was accomplished. The models were very accurate (Accuracy = 98.15%) and with the implementation of an online post-processing filter, all the false positive detections were eliminated, and a fall was able to be detected 1.019s before the end of the corresponding pre-fall step and 2.009s before impact.O número de quedas tornou-se uma das principais causas de lesões e mortes na comunidade geriátrica. Como resultado, o custo do tratamento das lesões também aumenta. Portanto, é necessário o desenvolvimento de estratégias relacionadas com quedas e que exibam capacidade de monitorização em tempo real sem colocar restrições ao usuário. Devido às suas vantagens, os acessórios do dia-a-dia podem ser uma solução para incorporar sistemas relacionados com quedas, sendo que as bengalas não são exceção. Além disso, a avaliação da marcha pode ser capaz de aprimorar a capacidade de uso de uma bengala para usuários mais idosos. Desta forma, é crucial o desenvolvimento de estratégias que reconheçam estados de queda, do passo anterior a uma queda e dos diferentes eventos da marcha de uma bengala. Esta dissertação tem como objetivo desenvolver estratégias capazes de identificar as situações anteriormente descritas com base num sistema incorporado numa bengala que coleta informações inerciais e de força, a Assistive Smart Cane (ASCane). A estratégia referente à deteção de quedas consistiu em testar os dados adquiridos através da ASCane com três algoritmos de deteção de quedas (baseados em thresholds fixos), com um algoritmo de thresholds dinâmicos e diferentes classificadores de machine learning encontrados na literatura. Estes métodos foram testados e modificados para dar conta do uso de informação adquirida através de uma bengala. O melhor desempenho alcançado em termos de sensibilidade e especificidade foi de 96,90% e 98,98%, respetivamente. Relativamente à deteção dos diferentes eventos da ASCane em situações controladas e da vida real, um detetor de eventos da marcha foi e comparado com um sistema de ground truth. Além disso, foi também realizado um estudo de machine learning envolvendo oito métodos de seleção de features e nove classificadores diferentes de machine learning. Os resultados mostraram que a precisão dos classificadores foi bastante aceitável e apresentou, como melhores resultados, 98,32% de precisão para situações controladas e 94.82% para situações do dia-a-dia. No que concerne à deteção de passos pré-queda, a mesma abordagem de machine learning foi realizada. Os modelos foram precisos (precisão = 98,15%) e com a implementação de um filtro de pós-processamento, todas as deteções de falsos positivos foram eliminadas e uma queda foi passível de ser detetada 1,019s antes do final do respetivo passo de pré-queda e 2.009s antes do impacto

Speed Bump Detection Using Accelerometric Features: A Genetic Algorithm Approach

AmongthecurrentchallengesoftheSmartCity,trafficmanagementandmaintenanceareof utmostimportance. Roadsurfacemonitoringiscurrentlyperformedbyhumans,buttheroadsurface condition is one of the main indicators of road quality, and it may drastically affect fuel consumption and the safety of both drivers and pedestrians. Abnormalities in the road, such as manholes and potholes, can cause accidents when not identified by the drivers. Furthermore, human-induced abnormalities, such as speed bumps, could also cause accidents. In addition, while said obstacles ought to be signalized according to specific road regulation, they are not always correctly labeled. Therefore, we developed a novel method for the detection of road abnormalities (i.e., speed bumps). This method makes use of a gyro, an accelerometer, and a GPS sensor mounted in a car. After having the vehicle cruise through several streets, data is retrieved from the sensors. Then, using a cross-validation strategy, a genetic algorithm is used to find a logistic model that accurately detects road abnormalities. The proposed model had an accuracy of 0.9714 in a blind evaluation, with a false positive rate smaller than 0.018, and an area under the receiver operating characteristic curve of 0.9784. This methodology has the potential to detect speed bumps in quasi real-time conditions, and can be used to construct a real-time surface monitoring system.AmongthecurrentchallengesoftheSmartCity,trafficmanagementandmaintenanceareof utmostimportance. Roadsurfacemonitoringiscurrentlyperformedbyhumans,buttheroadsurface condition is one of the main indicators of road quality, and it may drastically affect fuel consumption and the safety of both drivers and pedestrians. Abnormalities in the road, such as manholes and potholes, can cause accidents when not identified by the drivers. Furthermore, human-induced abnormalities, such as speed bumps, could also cause accidents. In addition, while said obstacles ought to be signalized according to specific road regulation, they are not always correctly labeled. Therefore, we developed a novel method for the detection of road abnormalities (i.e., speed bumps). This method makes use of a gyro, an accelerometer, and a GPS sensor mounted in a car. After having the vehicle cruise through several streets, data is retrieved from the sensors. Then, using a cross-validation strategy, a genetic algorithm is used to find a logistic model that accurately detects road abnormalities. The proposed model had an accuracy of 0.9714 in a blind evaluation, with a false positive rate smaller than 0.018, and an area under the receiver operating characteristic curve of 0.9784. This methodology has the potential to detect speed bumps in quasi real-time conditions, and can be used to construct a real-time surface monitoring system

Quantitative classification of pediatric swallowing through accelerometry

Background: Dysphagia or swallowing disorder negatively impacts a child's health and development. The gold standard of dysphagia detection is videofluoroscopy which exposes the child to ionizing radiation, and requires specialized clinical expertise and expensive institutionally-based equipment, precluding day-to-day and repeated assessment of fluctuating swallowing function. Swallowing accelerometry is the non-invasive measurement of cervical vibrations during swallowing and may provide a portable and cost-effective bedside alternative. In particular, dual-axis swallowing accelerometry has demonstrated screening potential in older persons with neurogenic dysphagia, but the technique has not been evaluated in the pediatric population. Methods: In this study, dual-axis accelerometric signals were collected simultaneous to videofluoroscopic records from 29 pediatric participants (age 6.8 ± 4.8 years; 20 males) previously diagnosed with neurogenic dysphagia. Participants swallowed 3-5 sips of barium-coated boluses of different consistencies (normally, from thick puree to thin liquid) by spoon or bottle. Videofluoroscopic records were reviewed retrospectively by a clinical expert to extract swallow timings and ratings. The dual-axis acceleration signals corresponding to each identified swallow were pre-processed, segmented and trimmed prior to feature extraction from time, frequency, time-frequency and information theoretic domains. Feature space dimensionality was reduced via principal components. Results: Using 8-fold cross-validation, 16-17 dimensions and a support vector machine classifier with an RBF kernel, an adjusted accuracy of 89.6% ± 0.9 was achieved for the discrimination between swallows with and with out airway entry. Conclusions: Our results suggest that dual-axis accelerometry has merit in the non-invasive detection of unsafe swallows in children and deserves further consideration as a pediatric medical device. © 2012 Mérey et al; licensee BioMed Central Ltd