13 research outputs found

    On-line Time Warping of Human Motion Sequences

    Get PDF
    Some application areas require motions to be time warped on-line as a motion is captured, aligning a partially captured motion to a complete prerecorded motion. For example movement training applications for dance and medical procedures, require on-line time warping for analysing and visually feeding back the accuracy of human motions as they are being performed. Additionally, real-time production techniques such as virtual production, in camera visual effects and the use of avatars in live stage performances, require on-line time warping to align virtual character performances to a live performer. The work in this thesis first addresses a research gap in the measurement of the alignment of two motions, proposing approaches based on rank correlation and evaluating them against existing distance based approaches to measuring motion similarity. The thesis then goes onto propose and evaluate novel methods for on-line time warping, which plot alignments in a forward direction and utilise forecasting and local continuity constraint techniques. Current studies into measuring the similarity of motions focus on distance based metrics for measuring the similarity of the motions to support motion recognition applications, leaving a research gap regarding the effectiveness of similarity metrics bases on correlation and the optimal metrics for measuring the alignment of two motions. This thesis addresses this research gap by comparing the performance of variety of similarity metrics based on distance and correlation, including novel combinations of joint parameterisation and correlation methods. The ability of each metric to measure both the similarity and alignment of two motions is independently assessed. This work provides a detailed evaluation of a variety of different approaches to using correlation within a similarity metric, testing their performance to determine which approach is optimal and comparing their performance against established distance based metrics. The results show that a correlation based metric, in which joints are parameterised using displacement vectors and correlation is measured using Kendall Tau rank correlation, is the optimal approach for measuring the alignment between two motions. The study also showed that similarity metrics based on correlation are better at measuring the alignment of two motions, which is important in motion blending and style transfer applications as well as evaluating the performance of time warping algorithms. It also showed that metrics based on distance are better at measuring the similarity of two motions, which is more relevant to motion recognition and classification applications. A number of approaches to on-line time warping have been proposed within existing research, that are based on plotting an alignment path backwards from a selected end-point within the complete motion. While these approaches work for discrete applications, such as recognising a motion, their lack of monotonic constraint between alignment of each frame, means these approaches do not support applications that require an alignment to be maintained continuously over a number of frames. For example applications involving continuous real-time visualisation, feedback or interaction. To solve this problem, a number of novel on-line time warping algorithms, based on forward plotting, motion forecasting and local continuity constraints are proposed and evaluated by applying them to human motions. Two benchmarks standards for evaluating the performance of on-line time warping algorithms are established, based on UTW time warping and compering the resulting alignment path with that produced by DTW. This work also proposes a novel approach to adapting existing local continuity constraints to a forward plotting approach. The studies within this thesis demonstrates that these time warping approaches are able to produce alignments of sufficient quality to support applications that require an alignment to be maintained continuously. The on-line time warping algorithms proposed in this study can align a previously recorded motion to a user in real-time, as they are performing the same action or an opposing action recorded at the same time as the motion being align. This solution has a variety of potential application areas including: visualisation applications, such as aligning a motion to a live performer to facilitate in camera visual effects or a live stage performance with a virtual avatar; motion feedback applications such as dance training or medical rehabilitation; and interaction applications such as working with Cobots

    Current Frontiers and Perspectives in Cell Biology

    Get PDF
    A numerous internationally renowned authors in the pages of this book present the views of the fields of cell biology and their own research results or review of current knowledge. Chapters are divided into five sections that are dedicated to cell structures and functions, genetic material, regulatory mechanisms, cellular biomedicine and new methods in cell biology. Multidisciplinary and often quite versatile approach by many authors have imposed restrictions of this classification, so it is certain that many chapters could belong to the other sections of this book. The current frontiers, on the manner in which they described in the book, can be a good inspiration to many readers for further improving, and perspectives which are highlighted can be seen in many areas of fundamental biology, biomedicine, biotechnology and other applications of knowledge of cell biology. The book will be very useful for beginners to gain insight into new area, as well as experts to find new facts and expanding horizons

    Wearable device-based gait recognition using angle embedded gait dynamic images and a convolutional neural network

    Get PDF
    The widespread installation of inertial sensors in smartphones and other wearable devices provides a valuable opportunity to identify people by analyzing their gait patterns, for either cooperative or non-cooperative circumstances. However, it is still a challenging task to reliably extract discriminative features for gait recognition with noisy and complex data sequences collected from casually worn wearable devices like smartphones. To cope with this problem, we propose a novel image-based gait recognition approach using the Convolutional Neural Network (CNN) without the need to manually extract discriminative features. The CNN’s input image, which is encoded straightforwardly from the inertial sensor data sequences, is called Angle Embedded Gait Dynamic Image (AE-GDI). AE-GDI is a new two-dimensional representation of gait dynamics, which is invariant to rotation and translation. The performance of the proposed approach in gait authentication and gait labeling is evaluated using two datasets: (1) the McGill University dataset, which is collected under realistic conditions; and (2) the Osaka University dataset with the largest number of subjects. Experimental results show that the proposed approach achieves competitive recognition accuracy over existing approaches and provides an effective parametric solution for identification among a large number of subjects by gait patterns

    Motion states inference through 3D shoulder gait analysis and Hierarchical Hidden Markov Models

    Full text link
    Automatically inferring human intention from walking movements is an important research concern in robotics and other fields of study. It is generally derived from temporal motion of limb position relative to the body. These changes can also be reected in the change of stance and gait. Conventional systems relying on gait are usually based on tracking the lower body motion (hip, foot) and are extracted from monocular camera data. However, such data can be inaccessible in crowded environments where occlusions of the lower body are prevalent. This paper proposes a novel approach to utilize upper body 3D-motion and Hierarchical Hidden Markov Models to estimate human ambulatory states, such as quietly standing, starting to walk (gait initiation), walking (gait cycle), or stopping (gait termination). Methods have been tested on real data acquired through a motion capture system where foot measurements (heels and toes) were used as ground truth data for labeling the states to train and test the models. Current results demonstrate the feasibility of using such a system to infer lower-body motion states and sub-states through observations of 3D shoulder motion online. Our results enable applications in situations where only upper body motion is readily observable

    Wearable device-based gait recognition using angle embedded gait dynamic images and a convolutional neural network

    Get PDF
    The widespread installation of inertial sensors in smartphones and other wearable devices provides a valuable opportunity to identify people by analyzing their gait patterns, for either cooperative or non-cooperative circumstances. However, it is still a challenging task to reliably extract discriminative features for gait recognition with noisy and complex data sequences collected from casually worn wearable devices like smartphones. To cope with this problem, we propose a novel image-based gait recognition approach using the Convolutional Neural Network (CNN) without the need to manually extract discriminative features. The CNN’s input image, which is encoded straightforwardly from the inertial sensor data sequences, is called Angle Embedded Gait Dynamic Image (AE-GDI). AE-GDI is a new two-dimensional representation of gait dynamics, which is invariant to rotation and translation. The performance of the proposed approach in gait authentication and gait labeling is evaluated using two datasets: (1) the McGill University dataset, which is collected under realistic conditions; and (2) the Osaka University dataset with the largest number of subjects. Experimental results show that the proposed approach achieves competitive recognition accuracy over existing approaches and provides an effective parametric solution for identification among a large number of subjects by gait patterns

    Identification de facteurs génétiques impliqués dans les troubles du spectre autistique et de la dyslexie

    Get PDF
    Les troubles du spectre autistique (TSA) touchent approximativement 1% de la population générale. Ces troubles se caractérisent par un déficit de la communication sociale, ainsi que des comportements stéréotypés et des intérêts restreints. Plusieurs gènes impliqués dans le déterminisme des TSA ont été identifiés, comme par exemple les gènes NLGN3-4X, NRXN1-3 et SHANK1-3. Au cours des années précédentes, les TSA ont été considérés comme un ensemble complexe de troubles monogéniques. Cependant, les études récentes du génome complet suggèrent la présence de gènes modificateurs ( multiple hits model ). La dyslexie est caractérisée par un trouble dans l apprentissage de la lecture et de l écriture qui touche 5- 15% de la population générale. Les facteurs génétiques impliqués restent pour l instant inconnus car seuls des gènes ou loci candidats ont été identifiés. Mon projet de thèse avait pour objectif de poursuivre l identification des facteurs génétiques impliqués dans les TSA et de découvrir un premier facteur génétique pour la dyslexie. Pour cela, deux types de populations ont été étudiés : d une part des patients atteints de TSA (N>600) provenant de France, de Suède et des Iles Faroe, d autre part des patients atteints de dyslexie (N>200) provenant de France, en particulier une famille de 11 personnes atteintes sur 3 générations. J ai utilisé à la fois la technologie des puces à ADN Illumina (600 K et 5M) et le séquençage complet du génome humain pour effectuer des analyses de liaison et d association. Pour les TSA, grâce aux analyses de CNVs, j ai pu identifier des gènes candidats pour l autisme et confirmer l association de plusieurs gènes synaptiques avec l autisme. En particulier, l étude d une population de 30 patients des îles Faroe a pu confirmer l implication des gènes NLGN1 et NRXN1 dans l autisme et identifier un nouveau gène candidat IQSEC3. En parallèle, j ai exploréPRRT2 localisé en 16p11.2. PRRT2 code pour un membre du complexe SNARE synaptique qui permet la libération des vésicules synaptiques. Je n ai pas pu mettre en évidence d association avec les TSA, mais j ai montré que ce gène important pour certaines maladies neurologiques était sous pression de sélection différente selon les populations. Pour la dyslexie, j ai effectué une analyse de liaison (méthode des lod-scores) pour une grande famille de 11 individus atteints sur trois générations. Cette étude a permis d identifier CNTNAP2 comme un gène de vulnérabilité à la dyslexie. Cette découverte est importante car ce même gène est aussi associé aux TSA. Par contre, aucune des 20 variations rares découvertes par le séquençage complet du génome n est localisée dans les parties codantes du gène. Plusieurs variations localisées dans des régions régulatrices sont candidates. En conclusion, les résultats de ma thèse ont permis d identifier des gènes candidats pour les TSA, de confirmer le rôle des gènes synaptiques dans ce trouble, de montrer pour la première fois grâce à une analyse de liaison le rôle de CNTNAP2 dans la dyslexie.Autism spectrum disorders (ASD) affect 1% of the general population. These disorders are characterized by deficits in social communication as well as stereotyped behaviors and restricted interests. Several genes involved in the determination of ASD have been identified, such as NLGN3-4, NRXN1-3 and SHANK1-3. In the previous years, ASD have been considered as a complex set of monogenic disorders. Recent studies on the complete genome nevertheless suggest the presence of modifier genes ("multiple hits model"). Dyslexia is characterized by difficulties in learning to read and write. It affects 5-15 % of the general population. Genetic factors involved remain unknown. Only candidate genes or loci have been identified. My thesis had two main objectives: pursuing the identification of genetic factors involved in ASD, and discovering a first genetic factor for dyslexia. I therefore studied two types of populations: on the one hand a group of patients with ASD (N > 600) from France, Sweden and the Faroe Islands, and on the other hand another group of patients with dyslexia (N > 200) from France, and more specifically a family of 11 people followed over 3 generations. I used both Illumina microarrays technology (600K and 5M) and the complete human genome sequencing to conduct linkage and association analyses. Regarding ASD, CNVs (copy number variants) analyses allowed me to confirm the association of several synaptic genes with autism and to identify new candidate genes. In particular, the study of a population of 30 patients from the Faroe Islands confirmed the involvement of NLGN1 and NRXN1 genes in autism and identified a new candidate gene, IQSEC3. At the same time, I explored PRRT2 located in 16p11.2. PRRT2 encodes a member of the synaptic SNARE complex that allows the release of synaptic vesicles. I have not been able to demonstrate any association with ASD, but I showed that this gene, which is important for some neurological diseases, was under different selection pressures according to the population considered. Regarding dyslexia, I realized a linkage analysis (lod-score method) for a large family of 11 individuals, with three generations affected. This study identified the CNTNAP2 gene as a vulnerability factor for dyslexia. This finding is important because this gene is also associated with ASD. Nevertheless, none of the 20 rare variations discovered by whole genome sequencing is localized in the coding parts of the gene. Only several variations localized in regulatory regions are robust candidates. To conclude, my findings enabled the identification of new candidate genes for ASD, the confirmation of the role of synaptic genes in this disorder, and the highlight for the first time of the role of CNTNAP2 in dyslexia through linkage analysis.PARIS5-Bibliotheque electronique (751069902) / SudocSudocFranceF

    Using shape information from natural tree landmarks for improving SLAM performance

    Get PDF
    Ankara : The Department of Computer Engineering and the Graduate School of Engineering and Science of Bilkent University, 2012.Thesis (Master's) -- Bilkent University, 2012.Includes bibliographical references leaves 52-56.Localization and mapping are crucial components for robotic autonomy. However, such robots must often function in remote, outdoor areas with no a-priori knowledge of the environment. Consequently, it becomes necessary for field robots to be able to construct their own maps based on exteroceptive sensor readings. To this end, visual sensing and mapping through naturally occurring landmarks have distinct advantages. With the availability of high bandwidth data provided by visual sensors, meaningful and uniquely identifiable objects can be detected. This improves the construction of maps consisting of natural landmarks that are meaningful for human readers as well. In this thesis, we focus on the use of trees in an outdoor environment as a suitable set of landmarks for Simultaneous Localization and Mapping (SLAM). Trees have a relatively simple, near vertical structure which makes them easily and consistently detectable. Furthermore, the thickness of a tree can be accurately determined from different viewpoints. Our primary contribution is the usage of the width of a tree trunk as an additional sensory reading, allowing us to include the radius of tree trunks on the map. To this end, we introduce a new sensor model that relates the width of a tree landmark on the image plane to the radius of its trunk. We provide a mathematical formulation of this model, derive associated Jacobians and incorporate our sensor model into a working EKF SLAM implementation. Through simulations we show that the use of this new sensory reading improves the accuracy of both the map and the trajectory estimates without additional sensor hardware other than a monocular camera.Turan, BilalM.S

    A complex systems approach to education in Switzerland

    Get PDF
    The insights gained from the study of complex systems in biological, social, and engineered systems enables us not only to observe and understand, but also to actively design systems which will be capable of successfully coping with complex and dynamically changing situations. The methods and mindset required for this approach have been applied to educational systems with their diverse levels of scale and complexity. Based on the general case made by Yaneer Bar-Yam, this paper applies the complex systems approach to the educational system in Switzerland. It confirms that the complex systems approach is valid. Indeed, many recommendations made for the general case have already been implemented in the Swiss education system. To address existing problems and difficulties, further steps are recommended. This paper contributes to the further establishment complex systems approach by shedding light on an area which concerns us all, which is a frequent topic of discussion and dispute among politicians and the public, where billions of dollars have been spent without achieving the desired results, and where it is difficult to directly derive consequences from actions taken. The analysis of the education system's different levels, their complexity and scale will clarify how such a dynamic system should be approached, and how it can be guided towards the desired performance
    corecore