Training of On-line Handwriting Text Recognizers with Synthetic Text Generated Using the Kinematic Theory of Rapid Human Movements

©2014 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.A method for automatic generation of synthetic handwritten words is presented which is based in the Kinematic Theory and its Sigma-lognormal model. To generate a new synthetic sample, first a real word is modelled using the Sigmalognormal model. Then the Sigma-lognormal parameters are randomly perturbed within a range, introducing human-like variations in the sample. Finally, the velocity function is recalculated taking into account the new parameters. The synthetic words are then used as training data for a Hidden Markov Model based on-line handwritten recognizer. The experimental results confirm the great potential of the Kinematic Theory of rapid human movements applied to writer adaptation.This work was partially supported by the Universitat Politècnica de València under the PMIA-2013 scholarship, the Spanish MEC under FPU scholarship AP2010-0575, the EU’s 7th Framework Programme (FP7/2007-2013) under grant agreement n. 600707 (tranScriptorium) and n. 287576 (CasMaCat) and the Natural Sciences and Engineering Research Council of Canada (NSERC) under grant RGPIN-915.Martín-Albo Simón, D.; Plamondon, R.; Vidal Ruiz, E. (2014). Training of On-line Handwriting Text Recognizers with Synthetic Text Generated Using the Kinematic Theory of Rapid Human Movements. IEEE. https://doi.org/10.1109/ICFHR.2014.97

Drawing, Handwriting Processing Analysis: New Advances and Challenges

International audienceDrawing and handwriting are communicational skills that are fundamental in geopolitical, ideological and technological evolutions of all time. drawingand handwriting are still useful in defining innovative applications in numerous fields. In this regard, researchers have to solve new problems like those related to the manner in which drawing and handwriting become an efficient way to command various connected objects; or to validate graphomotor skills as evident and objective sources of data useful in the study of human beings, their capabilities and their limits from birth to decline

A new algorithm and system for the extraction of delta-lognormal parameters

In this report, we present a new analytical method to estimate the parameters of Delta-lognormal functions. According to the Kinematic Theory of rapid human movements, these parameters contain information both on the motor commands and on the timing properties of a neuromuscular system. The new algorithm, called XZERO, exploits relationships between the zero crossings of the first and the second time-derivatives of a lognormal function and its four basic parameters. The methodology is described and evaluated in various testing conditions. Furthermore, for the first time, the extraction accuracy is quantified empirically, taking advantage of the exponential relationships that link the disperssion of the extraction errors with its signal to noise ratio. A new extraction system, which uses a benchmark of three estimation methods, is also proposed and evaluated in the mid-term perspective of developing machine intelligence applications that rely on lognormal functions

Recent developments in the study of rapid human movements with the kinematic theory: Applications to handwriting and signature synthesis

International audienceHuman movement modeling can be of great interest for the design of pattern recognition systems relying on the understanding of the fine motor control (such as on-line handwriting recognition or signature verification) as well as for the development of intelligent systems involving in a way or another the processing of human movements. In this paper, we briefly list the different models that have been proposed in order to characterize the handwriting process and focus on a representation involving a vectorial summation of lognormal functions: the Sigma-lognormal model. Then, from a practical perspective, we describe a new stroke extraction algorithm suitable for the reverse engineering of handwriting signals. In the following section it is shown how the resulting representation can be used to study the writer and signer variability. We then report on two joint projects dealing with the automatic generation of synthetic specimens for the creation of large databases. The first application concerns the automatic generation of totally synthetic signature specimens for the training and evaluation of verification performances of automatic signature recognition systems. The second application deals with the synthesis of handwritten gestures for speeding up the learning process in customizable on-line recognition systems to be integrated in electronic pen pads

The kinematic theory and minimum principles in motor control : a conceptual comparison

This paper presents a comparative study of two motor control theories that have put forward mathematical expressions to describe the stereotypical velocity profiles of rapid movements: the Kinematic Theory and the Minimization Theory. Among the various forms of the latter, the Minimum Square- Derivatives (MSD) principle and the Minimum-Time model are analyzed. It is shown that their concepts are linked and describe, with different arguments, a paradigm similar to the one used in the Kinematic Theory to model a velocity profile with a Delta-Lognormal equation. This unifying paradigm represents the functioning of a neuromuscular system by the convolution product of an infinite number of subsystem impulse responses. A second finding emerging from the present study is that the analytical models of velocity profiles, as described by the minimum principles under study correspond, with more or less accuracy, to an approximation of the Delta-Lognormal equation. Overall, the Kinematic Theory can be seen as relying on a general optimization principle and the use of the Minimization Theory in motor control gets new insights

Système de synthèse de l'écriture manuscrite par l'utilisation du modèle Sigma-lognormal : bilan de la conception et documentation de l'application SIMSCRIPT

An application was built to simulate complex movements with the use of the sigmalognormal model. The theory used to conduct simulation is shortly described, the built application interface and the applications functionalities are shown and discussed. Finally some simulations results are compared with typical handwritten data acquired from a subject with the use of a digitizer

AutoGraff: towards a computational understanding of graffiti writing and related art forms.

The aim of this thesis is to develop a system that generates letters and pictures with a style that is immediately recognizable as graffiti art or calligraphy. The proposed system can be used similarly to, and in tight integration with, conventional computer-aided geometric design tools and can be used to generate synthetic graffiti content for urban environments in games and in movies, and to guide robotic or fabrication systems that can materialise the output of the system with physical drawing media. The thesis is divided into two main parts. The first part describes a set of stroke primitives, building blocks that can be combined to generate different designs that resemble graffiti or calligraphy. These primitives mimic the process typically used to design graffiti letters and exploit well known principles of motor control to model the way in which an artist moves when incrementally tracing stylised letter forms. The second part demonstrates how these stroke primitives can be automatically recovered from input geometry defined in vector form, such as the digitised traces of writing made by a user, or the glyph outlines in a font. This procedure converts the input geometry into a seed that can be transformed into a variety of calligraphic and graffiti stylisations, which depend on parametric variations of the strokes

Synthèse de caractères manuscrits en-ligne pour la reconnaissance de l'écriture

National audienceDans de précédents travaux nous avons proposé une stratégie qui permet d'adapter automatiquement un système de reconnaissance de caractères isolés en-ligne au scripteur courant. La difficulté pour améliorer encore la vitesse d'adaptation du système est que très peu de données sont disponibles au début de l'utilisation. Nous explorons donc dans cet article les possibilités d'utiliser la synthèse de caractères en-ligne par déformation d'exemples pour augmenter la quantité disponible de caractères représentatifs du style d'écriture de l'utilisateur. Nous proposons pour cela l'utilisation de déformations dédiées au tracé en-ligne qui permettent des résultats meilleurs que les déformations classiquement utilisées dans le domaine hors-ligne

Généralisation du modèle delta-lognormal pour l'étude des mouvements en trois dimensions

Théorie cinématique en deux dimensions -- Théorie cinématique en trois dimensions -- Modèle delta-lognormal généralisé -- Méthode d'extraction de paramètres proposée -- Exemples de reconstruction -- Mouvements simples -- Mouvements complexes -- Résultats expérimentaux -- Matériel utilisé -- Résultats des mouvements simples -- Comparaison des profils de vitesse