Towards human-level performance on automatic pose estimation of infant spontaneous movements

Assessment of spontaneous movements can predict the long-term developmental disorders in high-risk infants. In order to develop algorithms for automated prediction of later disorders, highly precise localization of segments and joints by infant pose estimation is required. Four types of convolutional neural networks were trained and evaluated on a novel infant pose dataset, covering the large variation in 1 424 videos from a clinical international community. The localization performance of the networks was evaluated as the deviation between the estimated keypoint positions and human expert annotations. The computational efficiency was also assessed to determine the feasibility of the neural networks in clinical practice. The best performing neural network had a similar localization error to the inter-rater spread of human expert annotations, while still operating efficiently. Overall, the results of our study show that pose estimation of infant spontaneous movements has a great potential to support research initiatives on early detection of developmental disorders in children with perinatal brain injuries by quantifying infant movements from video recordings with human-level performance.Comment: Published in Computerized Medical Imaging and Graphics (CMIG

Classical machine learning versus deep learning for the older adults free-living activity classification

Physical activity has a strong influence on mental and physical health and is essential in healthy ageing and wellbeing for the ever-growing elderly population. Wearable sensors can provide a reliable and economical measure of activities of daily living (ADLs) by capturing movements through, e.g., accelerometers and gyroscopes. This study explores the potential of using classical machine learning and deep learning approaches to classify the most common ADLs: walking, sitting, standing, and lying. We validate the results on the ADAPT dataset, the most detailed dataset to date of inertial sensor data, synchronised with high frame-rate video labelled data recorded in a free-living environment from older adults living independently. The findings suggest that both approaches can accurately classify ADLs, showing high potential in profiling ADL patterns of the elderly population in free-living conditions. In particular, both long short-term memory (LSTM) networks and Support Vector Machines combined with ReliefF feature selection performed equally well, achieving around 97% F-score in profiling ADLs

Introduction to Multifractal Detrended Fluctuation Analysis in Matlab

Physiological and behavioural phenomena are often complex, characterized by variations in time series. Variations in time series reflect how these phenomena organize into coherent structures by interactions that span multiple scales in both time and space. The present tutorial is an introduction to multifractal analyses that can identify these scale invariant interactions within time series by its multifractal spectrum. The multifractal spectrum can be estimated directly from scale-dependent measurements or from its q-order statistics. The tutorial emphasizes the most common scale-dependent measurements defined by the wavelet transforms and the detrended fluctuation analyses. The tutorial also emphasizes common features of all multifractal analyses, like the choice of linear regression method, scaling range and elimination of spurious singularities, which are important for a robust estimation of the multifractal spectrum. The tutorial ends with two brief examples where multifractal analyses are employed to time series from multifractal models and the complex phenomena of cognitive performance. References to available software for multifractal analyses are included at the end of the tutorial. The main aim of the tutorial is to give the reader an introduction to multifractal analyses without the extensive technicalities typically provided in mathematical journals

The Discriminant Value of Phase-Dependent Local Dynamic Stability of Daily Life Walking in Older Adult Community-Dwelling Fallers and Nonfallers

The present study compares phase-dependent measures of local dynamic stability of daily life walking with 35 conventional gait features in their ability to discriminate between community-dwelling older fallers and nonfallers. The study reanalyzes 3D-acceleration data of 3-day daily life activity from 39 older people who reported less than 2 falls during one year and 31 who reported two or more falls. Phase-dependent local dynamic stability was defined for initial perturbation at 0%, 20%, 40%, 60%, and 80% of the step cycle. A partial least square discriminant analysis (PLS-DA) was used to compare the discriminant abilities of phase-dependent local dynamic stability with the discriminant abilities of 35 conventional gait features. The phase-dependent local dynamic stability λ at 0% and 60% of the step cycle discriminated well between fallers and nonfallers (AUC = 0.83) and was significantly larger () for the nonfallers. Furthermore, phase-dependent λ discriminated as well between fallers and nonfallers as all other gait features combined. The present result suggests that phase-dependent measures of local dynamic stability of daily life walking might be of importance for further development in early fall risk screening tools

The Discriminant Value of Phase-Dependent Local Dynamic Stability of Daily Life Walking in Older Adult Community-Dwelling Fallers and Nonfallers

The present study compares phase-dependent measures of local dynamic stability of daily life walking with 35 conventional gait features in their ability to discriminate between community-dwelling older fallers and nonfallers. The study reanalyzes 3D-acceleration data of 3-day daily life activity from 39 older people who reported less than 2 falls during one year and 31 who reported two or more falls. Phase-dependent local dynamic stability was defined for initial perturbation at 0%, 20%, 40%, 60%, and 80% of the step cycle. A partial least square discriminant analysis (PLS-DA) was used to compare the discriminant abilities of phase-dependent local dynamic stability with the discriminant abilities of 35 conventional gait features. The phase-dependent local dynamic stability λ at 0% and 60% of the step cycle discriminated well between fallers and nonfallers (AUC = 0.83) and was significantly larger (p<0.01) for the nonfallers. Furthermore, phase-dependent λ discriminated as well between fallers and nonfallers as all other gait features combined. The present result suggests that phase-dependent measures of local dynamic stability of daily life walking might be of importance for further development in early fall risk screening tools

Fractional Stability of Trunk Acceleration Dynamics of Daily-Life Walking: Toward a Unified Concept of Gait Stability

Over the last decades, various measures have been introduced to assess stability during walking. All of these measures assume that gait stability may be equated with exponential stability, where dynamic stability is quantified by a Floquet multiplier or Lyapunov exponent. These specific constructs of dynamic stability assume that the gait dynamics are time independent and without phase transitions. In this case the temporal change in distance, d(t), between neighboring trajectories in state space is assumed to be an exponential function of time. However, results from walking models and empirical studies show that the assumptions of exponential stability break down in the vicinity of phase transitions that are present in each step cycle. Here we apply a general non-exponential construct of gait stability, called fractional stability, which can define dynamic stability in the presence of phase transitions. Fractional stability employs the fractional indices, α and β, of differential operator which allow modeling of singularities in d(t) that cannot be captured by exponential stability. The fractional stability provided an improved fit of d(t) compared to exponential stability when applied to trunk accelerations during daily-life walking in community-dwelling older adults. Moreover, using multivariate empirical mode decomposition surrogates, we found that the singularities in d(t), which were well modeled by fractional stability, are created by phase-dependent modulation of gait. The new construct of fractional stability may represent a physiologically more valid concept of stability in vicinity of phase transitions and may thus pave the way for a more unified concept of gait stability