Spatio-temporal feature extraction in sensory electroneurographic signals

The recording and analysis of peripheral neural signal can provide insight for various prosthetic and bioelectronics medicine applications. However, there are few studies that investigate how informative features can be extracted from population activity electroneurographic (ENG) signals. In this study, five feature extraction frameworks were implemented on sensory ENG datasets and their classification performance was compared. The datasets were collected in acute rat experiments where multi-channel nerve cuffs recorded from the sciatic nerve in response to proprioceptive stimulation of the hindlimb. A novel feature extraction framework, which incorporates spatio-temporal focus and dynamic time warping, achieved classification accuracies above 90% while keeping a low computational cost. This framework outperformed the remaining frameworks tested in this study and has improved the discrimination accuracy of the sensory signals. Thus, this study has extended the tools available to extract features from sensory population activity ENG signals. This article is part of the theme issue ‘Advanced neurotechnologies: translating innovation for health and well-being’

A survey on bio-signal analysis for human-robot interaction

The use of bio-signals analysis in human-robot interaction is rapidly increasing. There is an urgent demand for it in various applications, including health care, rehabilitation, research, technology, and manufacturing. Despite several state-of-the-art bio-signals analyses in human-robot interaction (HRI) research, it is unclear which one is the best. In this paper, the following topics will be discussed: robotic systems should be given priority in the rehabilitation and aid of amputees and disabled people; second, domains of feature extraction approaches now in use, which are divided into three main sections (time, frequency, and time-frequency). The various domains will be discussed, then a discussion of each domain's benefits and drawbacks, and finally, a recommendation for a new strategy for robotic systems

Regulating Grip Forces through EMG-Controlled Protheses for Transradial Amputees

This study aims to evaluate different combinations of features and algorithms to be used in the control of a prosthetic hand wherein both the configuration of the fingers and the gripping forces can be controlled. This requires identifying machine learning algorithms and feature sets to detect both intended force variation and hand gestures in EMG signals recorded from upper-limb amputees. However, despite the decades of research into pattern recognition techniques, each new problem requires researchers to find a suitable classification algorithm, as there is no such thing as a universal ’best’ solution. Consideration of different techniques and data representation represents a fundamental practice in order to achieve maximally effective results. To this end, we employ a publicly-available database recorded from amputees to evaluate different combinations of features and classifiers. Analysis of data from 9 different individuals shows that both for classic features and for time-dependent power spectrum descriptors (TD-PSD) the proposed logarithmically scaled version of the current window plus previous window achieves the highest classification accuracy. Using linear discriminant analysis (LDA) as a classifier and applying a majority-voting strategy to stabilize the individual window classification, we obtain 88% accuracy with classic features and 89% with TD-PSD features.This paper is supported by European Union’s Horizon 2020 research and innovation programme under the Grant Agreement no 779967, project RobotUnion

PaWFE ::fast signal feature extraction using parallel time windows

Motivation: Hand amputations can dramatically affect the quality of life of a person. Researchers are developing surface electromyography and machine learning solutions to control dexterous and robotic prosthetic hands, however long computational times can slow down this process. Objective: This paper aims at creating a fast signal feature extraction algorithm that can extract widely used features and allow researchers to easily add new ones. Methods: PaWFE (Parallel Window Feature Extractor) extracts the signal features from several time windows in parallel. The MATLAB code is publicly available and supports several time domain and frequency features. The code was tested and benchmarked using 1,2,4,8,16,32, and 48 threads on a server with four Xeon E7- 4820 and 128 GB RAM using the first 5 datasets of the Ninapro database, that are recorded with different acquisition setups. Results: The parallel time window analysis approach allows to reduce the computational time up to 20 times when using 32 cores, showing a very good scalability. Signal features can be extracted in few seconds from an entire data acquisition and in <100ms from a single time window, easily reducing of up to over 15 times the feature extraction procedure in comparison to traditional approaches. The code allows users to easily add new signal feature extraction scripts, that can be added to the code and on the Ninapro website upon request. Significance: The code allows researchers in machine learning and biosignals data analysis to easily and quickly test modern machine learning approaches on big datasets and it can be used as a resource for real time data analysis too

Neuromuscular Control Modeling: from Physics to Data-Driven Approaches

Il controllo neurale della postura umana è stato investigato a partire da un punto di vista fisico. Il paradigma di controllo intermittente è stato usato allo scopo di capire il peso di quest'ultimo nella generazione delle traiettorie del centro di pressione. Un primo contributo di questo lavoro rigurda quindi l'analisi del centro di pressione generato dal suddetto modello biomeccanico attraverso l'extended detrended fluctuation analysis, recentemente proposta in letteratura. Le proprietà di correlazione a lungo termine e disomogeneità sono risultate strettamente legate al guadagno derivativo del modello di controllo intermittente e anche al grado di intermittenza. Il paradigma di controllo è stato poi esteso verso un sistema biomeccanico più complesso, cioè un pendolo inverso doppio link con controllo intermittente alla caviglia. I contributi più significativi hanno riguardato la modellazione matematica del centro di pressione per una struttura multi-link e la verifica della sua plausibilità fisiologica. Si è poi preso in considerazione il caso della postura perturbata, integrando aspetti cinematici, dinamici e relativi all'attività muscolare. A tal fine, si è utilizzato sia un approccio fisico che basato su dati per l'identificazione dei modelli a struttura variabile Si sono prese in considerazione differenti condizioni di sperimentali, e in tutti i casi l'approccio utilizzato ha garantito un adeguato grado di interpretabilità riguardo il ruolo del sistema nervoso centrale nella regolazione del postura eretta in condizioni perturbate. La seconda parte della tesi ha riguardato la caratterizzazione del controllo motorio attraverso il segnale elettromiografico di superfice. Il primo contributo ha riguardato l'identifcazione dell'onset muscolare in condizioni di basso rapporto segnale rumore, sfruttando operatori energetico di tipo Teager-Kaiser al fine del precondizionamento del segnale mioelettrico. La versioe estesa di questo tipo di operatori è risultata particolarmente utile al miglioramento delle performance di numerosi algoritmi di detection. Si è poi proseguito con l'utilizzo di tali segnali al fine della classificazione dei gesti dell'arto superiore. In particoalre si è prerso in considerazione il problema della motion intention detection dei principali movimenti della spalla , utilizzando sia descrittori del segnale elettromiografico nel dominio del tempo e della frequenza. Quest'ultimo aspetto risulta essere un elemento di novità nel contesto scientifico in quanto si sono considerati il riconoscimento l'intezioni di movimento di otto gesti della spalla con particolare attenzione al ruolo dei descrittori del segnale per la classificazione. Infine, con approcci simili, si è preso in considerazione il problema del riconoscimento della scrittura manuale a partire dal dato elettromiografico. Tale aspetto risulta poco investigato sotto la prospettiva della pattern recognition mioelettrica, ma la sua valenza è data dalla crescente richiesta di interfacce uomo-macchina per compiti riabilitativi che coinvolgono una componente cognitiva significativa, Inoltre, vista la tendenza ad investigare il ruolo del polso per il prelievo del segnale elettromiografico al fine della realizzazione delle suddette interfacce, si è analizzato l'utilizzo dei segnali elettromiografici del polso rispetto a quelli dell'avambraccio al fine di predirre le cifre scritte dall'utente, noto che l'avambraccio risulta essere la zona di prelievo più comunemente utilizzata.The biomechanics and the neural control of the human stance was investigated starting from a physical point of view. In particular the intermittent motor control paradigm was investigated with the aim of understanding how such paradigm mirrors in the center of pressure (COP) trajectories. A first contribution given in this work of thesis regards the analysis of COP generated from intermittent controlled inverted pendulum through the extended detrended fluctuation analysis, which was recently introduced in the literature. It has been found that the long-term correlation and inohmogeniety properties of the COP time series strictly depend on the derivative gain term of the intermittent controller and on the degree of intermittency of the control action. Thus, , another contribution provided in this work of thesis regards the use of a more complex biomechanical model of the stance, e.g. a double-link inverted pendulum intermittently controlled at the ankle. In terms of novelty, it deserves to be pointed out the results regarding the mechanical modeling of the COP for a multi-link structure, and the assessment of its physiological plausibility. . On the other hand, when the perturbed posture motor task was taken into account, there was the need to enlarge the perspective, integrating kinematic, dynamic and muscle activity data. The idea of employing different sources of information to develop models of the CNS represents an important element that was investigated using tools related to hybrid system identification theory. Subjects underwent to impulsive support base translations in three different conditions: considering eyes open, closed, and performing mental counting. Although such data were essentially analyzed through a data-driven approach, the identified models guaranteed physical interpretations of the role played by the CNS in the three different conditions. The second main core of this thesis regards the characterization of the motor control using the surface electromyographic (sEMG) signals. A first contribution given in this work regarded the muscle onset detection considering low SNR scenarios. In this framework, energy operators such as the Teager-Kaiser energy operator (TKEO) and its extended version (ETKEO) were investigated as signal preconditioning steps before the application of state of the art onset detection algorithms. The latter have been significantly boosted when ETKEO was used with respect to TKEO. The use of extended energy operators for the sEMG signal preprocessing constitutes a novel element in this field that can be also further investigated in future studies. From the sEMG muscle, one can also predict which movement the subject is going to perform. This aspect can be enclosed in the motion intention detection (MID) field. In this thesis a MID problem was investigated by taking into account two important aspects: as first the study was centered on the shoulder joint movements. Secondly, the MID problem was faced under a pattern recognition perspective. This allowed to verify whether methodologies encountered in the myoelectric hand gesture recognition can be transferred in the affine field of MID In contrast to what reported in the literature, where MID problems generally consider only few movements, in this work of thesis up to eight shoulder movements have been investigated. Myoelectric pattern recognition architectures were also used in the assessment of the ten hand-written digits. Despite the handwriting can be considered a hand movement that involves fine muscular control actions, it has not been consistently investigated in the field of sEMG based hand gesture recognition. Further, since the literature supports the change from forearm to wrist in order to acquire EMG data for hand gesture recognition, it was investigated whether such exchange can be performed when a challenging classification task, as the handwriting recognition has to be performed

a comparison of semg temporal and spatial information in the analysis of continuous movements

Abstract Much effort has recently been devoted to the analysis of continuous movements with the aim of promoting EMG signal acceptance in several fields of application. Moreover, several studies have been performed to optimize the temporal and spatial parameters in order to obtain a robust interpretation of EMG signals. Resulting from these perspectives, the investigation of the contribution of EMG temporal and spatial information has become a relevant aspect for signal interpretation. This paper aims to evaluate the effects of the two types of information on continuous motions analysis. In order to achieve this goal, the spatial and temporal information of EMG signals were separated and applied as input for an offline Template Making and Matching algorithm. Movement recognition was performed testing three different methods. In the first case (the Temporal approach) the RMS time series generated during movements was the only information employed. In the second case (the Spatial approach) the mean RMS amplitude measured on each channel was considered. Finally, in the third case (the Spatio-Temporal approach) a combination of the information from both the previous approaches was applied. The experimental protocol included 14 movements, which were different from each other in the muscular activation and the execution timing. Results show that the recognition of continuous movements cannot disregard the temporal information. Moreover, the temporal patterns seem to be relevant also for distinguishing movements which differ only in the muscular areas they activate