The Line of Action: an Intuitive Interface for Expressive Character Posing

International audienceThe line of action is a conceptual tool often used by cartoonists and illustrators to help make their figures more consistent and more dramatic. We often see the expression of characters--may it be the dynamism of a super hero, or the elegance of a fashion model--well captured and amplified by a single aesthetic line. Usually this line is laid down in early stages of the drawing and used to describe the body's principal shape. By focusing on this simple abstraction, the person drawing can quickly adjust and refine the overall pose of his or her character from a given viewpoint. In this paper, we propose a mathematical definition of the line of action (LOA), which allows us to automatically align a 3D virtual character to a user specified LOA by solving an optimization problem. We generalize this framework to other types of lines found in the drawing literature, such as secondary lines used to place arms. Finally, we show a wide range of poses and animations that were rapidly created using our system

Adding dynamics to sketch-based character animations

International audienceCartoonists and animators often use lines of action to emphasize dynamics in character poses. In this paper, we propose a physically-based model to simulate the line of action's motion, leading to rich motion from simple drawings. Our proposed method is decomposed into three steps. Based on user-provided strokes, we forward simulate 2D elastic motion. To ensure continuity across keyframes, we re-target the forward simulations to the drawn strokes. Finally, we synthesize a 3D character motion matching the dynamic line. The fact that the line can move freely like an elastic band raises new questions about its relationship to the body over time. The line may move faster and leave body parts behind, or the line may slide slowly towards other body parts for support. We conjecture that the artist seeks to maximize the filling of the line (with the character's body)---while respecting basic realism constraints such as balance. Based on these insights, we provide a method that synthesizes 3D character motion, given discontinuously constrained body parts that are specified by the user at key moments

Tangent-space optimization for interactive animation control

Character animation tools are based on a keyframing metaphor where artists pose characters at selected keyframes and the software automatically interpolates the frames inbetween. Although the quality of the interpolation is critical for achieving a fluid and engaging animation, the tools available to adjust the result of the automatic inbetweening are rudimentary and typically require manual editing of spline parameters. As a result, artists spend a tremendous amount of time posing and setting more keyframes. In this pose-centric workflow, animators use combinations of forward and inverse kinematics. While forward kinematics leads to intuitive interpolations, it does not naturally support positional constraints such as fixed contact points. Inverse kinematics can be used to fix certain points in space at keyframes, but can lead to inferior interpolations, is slow to compute, and does not allow for positional contraints at non-keyframe frames. In this paper, we address these problems by formulating the control of interpolations with positional constraints over time as a space-time optimization problem in the tangent space of the animation curves driving the controls. Our method has the key properties that it (1) allows the manipulation of positions and orientations over time, extending inverse kinematics, (2) does not add new keyframes that might conflict with an artist's preferred keyframe style, and (3) works in the space of artist editable animation curves and hence integrates seamlessly with current pipelines. We demonstrate the utility of the technique in practice via various examples and use cases.</jats:p

Sketch2Pose : estimating a 3D character pose from a bitmap sketch

Artists frequently capture character poses via raster sketches, then use these drawings as a reference while posing a 3D character in a specialized 3D software --- a time-consuming process, requiring specialized 3D training and mental effort. We tackle this challenge by proposing the first system for automatically inferring a 3D character pose from a single bitmap sketch, producing poses consistent with viewer expectations. Algorithmically interpreting bitmap sketches is challenging, as they contain significantly distorted proportions and foreshortening. We address this by predicting three key elements of a drawing, necessary to disambiguate the drawn poses: 2D bone tangents, self-contacts, and bone foreshortening. These elements are then leveraged in an optimization inferring the 3D character pose consistent with the artist's intent. Our optimization balances cues derived from artistic literature and perception research to compensate for distorted character proportions. We demonstrate a gallery of results on sketches of numerous styles. We validate our method via numerical evaluations, user studies, and comparisons to manually posed characters and previous work

VR-CHEM Developing a virtual reality interface for molecular modelling

VR-CHEM is a prototype for a virtual reality molecular modelling program with a modern 3D user interface. In this thesis, the author discusses the research behind the development of the prototype, provides a detailed description of the program and its features, and reports on the user tests. The research includes reviewing previous programs of a similar category that have appeared in studies in the literature. Some of these are related to chemistry and molecular modelling while others focus on 3D input techniques. Consequently, the prototype contributes by exploring the design of the user interface and how it can affect productivity in this category of programs. The prototype is subjected to a pilot user test to evaluate what further developments are required. Based on this, the thesis proposes that 3D interfaces, while capable of several unique tasks, are yet to overcome some significant drawbacks such as limitations in accuracy and precision. It also suggests that virtual reality can aid in spatial understanding but virtual hands and controllers are far inferior to real hands for even basic tasks due to a lack of tactile feedback

Animation de personnages 3D par le sketching 2D

Free-form animation allows for exaggerated and artistic styles of motions such as stretching character limbs and animating imaginary creatures such as dragons. Creating these animations requires tools flexible enough to shape characters into arbitrary poses, and control motion at any instant in time. The current approach to free-form animation is keyframing: a manual task in which animators deform characters at individual instants in time by clicking-and-dragging individual body parts one at a time. While this approach is flexible, it is challenging to create quality animations that follow high-level artistic principles---as keyframing tools only provide localized control both spatially and temporally. When drawing poses and motions, artists rely on different sketch-based abstractions that help fulfill high-level aesthetic and artistic principles. For instance, animators will draw textit{lines of action} to create more readable and textit{expressive} poses. To coordinate movements, animators will sketch textit{motion abstractions} such as semi-circles and loops to coordinate a bouncing and rolling motions. Unfortunately, these drawing tools are not part of the free-form animation tool set today. The fact that we cannot use the same artistic tools for drawing when animating 3D characters has an important consequence: 3D animation tools are not involved in the creative process. Instead, animators create by first drawing on paper, and only later are 3D animation tools used to fulfill the pose or animation. The reason we do not have these artistic tools (the line of action, and motion abstractions) in the current animation tool set is because we lack a formal understanding relating the character's shape---possible over time---to the drawn abstraction's shape. Hence the main contribution of this thesis is a formal understanding of pose and motion abstractions (line of action and motion abstractions) together with a set of algorithms that allow using these tools in a free-form setting. As a result, the techniques described in this thesis allow exaggerated poses and movements that may include squash and stretch, and can be used with various character morphologies. These pose and animation drafting tools can be extended. For instance, an animator can sketch and compose different layers of motion on top of one another, add twist around strokes, or turning the strokes into elastic ribbons. The main contributions of this thesis are summarized as follows: -The line of action facilitating expressive posing by directly sketching the overall flow of the character's pose. -The space-time curve allowing to draft full coordinated movements with a single stroke---applicable to arbitrary characters. -A fast and robust skeletal line matching algorithm that supports squash-and-stretch. -Elastic lines of action with dynamically constrained bones for driving the motion of a multi-legged character with a single moving 2D line.L'animation expressive permet des styles de mouvements exagerés et artistiques comme l'étirement de parties du corps ou encore l'animation de créatures imaginaires comme un dragon. Créer ce genre d'animation nécessite des outils assez flexible afin de déformer les personnages en des poses quelconques, ainsi que de pouvoir contrôler l'animation à tout moment dans le temps. L'approche acutelle pour l'animation expressive est le keyframing: une approche manuelle avec laquelle les animateurs déforment leur personnage un moment spécifique dans le temps en cliquand et glissant la souris sur une partis spécifique du corps---un à la fois. Malgré le fait que cette approche soit flexible, il est difficile de créer des animations de qualité qui suivent les principes artistiques, puisque le keyframing permet seulement qu'un contrôle local spatiallement et temporellement. Lorsqu'ils dessinent des poses ou des mouvements, les artistes s'appuient sur différentes abstractions sous forme de croquis qui facillitent la réalisation de certain principes artistiques. Par example, certains animateurs dessinent des lignes d'action afin de créer une pose plus lisible et expressive. Afin de coordonner un mouvement, les animateurs vont souvent dessiner des abstractions de mouvement comme des demi-cercles pour des sauts, ou des boucles pour des pirouettes---leur permettant de pratiquer la coordination du mouvement. Malheureusement, ces outils artistiques ne font pas partis de l'ensemble d'outils de keyframing actuelle. Le fait que l'on ne puisse pas employer les même outils artistiques pour animater des personnages 3D a une forte conséquence: les outils d'animation 3D ne sont pas employés dans le processus créatif. Aujourd'hui, les animateurs créent sur du papier et utilisent le keyframing seulement à la fin pour réaliser leur animation. La raison pour laquelle nous n'avons pas ces outils artistiques (ligne d'action, abstractions de mouvement) en animation 3D, est parce qu'il manque une compréhension formelle de ceux-ci qui nous permettrais d'exprimer la forme du personnage---potentiellement au cours du temps---en fonction de la forme de ces croquis. Ainsi la contribution principale de cette thèse est une compréhension formelle et mathématique des abstractions de forme et de mouvement courrament employées par des artistes, ainsi qu'un ensemble d'algorithme qui permet l'utilisation de ces outils artistiques pour créer des animations expressives. C'est-à-dire que les outils développés dans cette thèse permettent d'étirer des parties du corps ainsi que d'animer des personnages de différentes morphologies. J'introduis aussi plusieurs extentions à ces outils. Par example, j'explore l'idée de sculpter du mouvement en permettant à l'artiste de dessigner plusieurs couches de mouvement une par dessus l'autre, de twister en 3D les croquis, ou encore d'animer un croquis ligne comme un élastique. Les contributions principales de cette thèse, aussi résumé ci-dessous: -La ligne d'action facilitant la création de poses expressives en dessinant directement le flow complet du personnage. -La courbe spatio-temporelle qui permet de spécifier un mouvement coordoné complet avec un seul geste (en dessinant une seule courbe), applicable à n'importe quel personnage 3D. -Un algorithme de matching rapide et robuste qui permet du ``squash and stretch''. -La ligne d'action élastique avec des attachements dynamiques à la ligne permettant d'animer un personnages à plusieurs jambes (bras) avec une seule ligne 2D animée

Animation de personnages 3D par le sketching 2D

Free-form animation allows for exaggerated and artistic styles of motions such as stretching character limbs and animating imaginary creatures such as dragons. Creating these animations requires tools flexible enough to shape characters into arbitrary poses, and control motion at any instant in time. The current approach to free-form animation is keyframing: a manual task in which animators deform characters at individual instants in time by clicking-and-dragging individual body parts one at a time. While this approach is flexible, it is challenging to create quality animations that follow high-level artistic principles---as keyframing tools only provide localized control both spatially and temporally. When drawing poses and motions, artists rely on different sketch-based abstractions that help fulfill high-level aesthetic and artistic principles. For instance, animators will draw textit{lines of action} to create more readable and textit{expressive} poses. To coordinate movements, animators will sketch textit{motion abstractions} such as semi-circles and loops to coordinate a bouncing and rolling motions. Unfortunately, these drawing tools are not part of the free-form animation tool set today. The fact that we cannot use the same artistic tools for drawing when animating 3D characters has an important consequence: 3D animation tools are not involved in the creative process. Instead, animators create by first drawing on paper, and only later are 3D animation tools used to fulfill the pose or animation. The reason we do not have these artistic tools (the line of action, and motion abstractions) in the current animation tool set is because we lack a formal understanding relating the character's shape---possible over time---to the drawn abstraction's shape. Hence the main contribution of this thesis is a formal understanding of pose and motion abstractions (line of action and motion abstractions) together with a set of algorithms that allow using these tools in a free-form setting. As a result, the techniques described in this thesis allow exaggerated poses and movements that may include squash and stretch, and can be used with various character morphologies. These pose and animation drafting tools can be extended. For instance, an animator can sketch and compose different layers of motion on top of one another, add twist around strokes, or turning the strokes into elastic ribbons. The main contributions of this thesis are summarized as follows: -The line of action facilitating expressive posing by directly sketching the overall flow of the character's pose. -The space-time curve allowing to draft full coordinated movements with a single stroke---applicable to arbitrary characters. -A fast and robust skeletal line matching algorithm that supports squash-and-stretch. -Elastic lines of action with dynamically constrained bones for driving the motion of a multi-legged character with a single moving 2D line.L'animation expressive permet des styles de mouvements exagerés et artistiques comme l'étirement de parties du corps ou encore l'animation de créatures imaginaires comme un dragon. Créer ce genre d'animation nécessite des outils assez flexible afin de déformer les personnages en des poses quelconques, ainsi que de pouvoir contrôler l'animation à tout moment dans le temps. L'approche acutelle pour l'animation expressive est le keyframing: une approche manuelle avec laquelle les animateurs déforment leur personnage un moment spécifique dans le temps en cliquand et glissant la souris sur une partis spécifique du corps---un à la fois. Malgré le fait que cette approche soit flexible, il est difficile de créer des animations de qualité qui suivent les principes artistiques, puisque le keyframing permet seulement qu'un contrôle local spatiallement et temporellement. Lorsqu'ils dessinent des poses ou des mouvements, les artistes s'appuient sur différentes abstractions sous forme de croquis qui facillitent la réalisation de certain principes artistiques. Par example, certains animateurs dessinent des lignes d'action afin de créer une pose plus lisible et expressive. Afin de coordonner un mouvement, les animateurs vont souvent dessiner des abstractions de mouvement comme des demi-cercles pour des sauts, ou des boucles pour des pirouettes---leur permettant de pratiquer la coordination du mouvement. Malheureusement, ces outils artistiques ne font pas partis de l'ensemble d'outils de keyframing actuelle. Le fait que l'on ne puisse pas employer les même outils artistiques pour animater des personnages 3D a une forte conséquence: les outils d'animation 3D ne sont pas employés dans le processus créatif. Aujourd'hui, les animateurs créent sur du papier et utilisent le keyframing seulement à la fin pour réaliser leur animation. La raison pour laquelle nous n'avons pas ces outils artistiques (ligne d'action, abstractions de mouvement) en animation 3D, est parce qu'il manque une compréhension formelle de ceux-ci qui nous permettrais d'exprimer la forme du personnage---potentiellement au cours du temps---en fonction de la forme de ces croquis. Ainsi la contribution principale de cette thèse est une compréhension formelle et mathématique des abstractions de forme et de mouvement courrament employées par des artistes, ainsi qu'un ensemble d'algorithme qui permet l'utilisation de ces outils artistiques pour créer des animations expressives. C'est-à-dire que les outils développés dans cette thèse permettent d'étirer des parties du corps ainsi que d'animer des personnages de différentes morphologies. J'introduis aussi plusieurs extentions à ces outils. Par example, j'explore l'idée de sculpter du mouvement en permettant à l'artiste de dessigner plusieurs couches de mouvement une par dessus l'autre, de twister en 3D les croquis, ou encore d'animer un croquis ligne comme un élastique. Les contributions principales de cette thèse, aussi résumé ci-dessous: -La ligne d'action facilitant la création de poses expressives en dessinant directement le flow complet du personnage. -La courbe spatio-temporelle qui permet de spécifier un mouvement coordoné complet avec un seul geste (en dessinant une seule courbe), applicable à n'importe quel personnage 3D. -Un algorithme de matching rapide et robuste qui permet du ``squash and stretch''. -La ligne d'action élastique avec des attachements dynamiques à la ligne permettant d'animer un personnages à plusieurs jambes (bras) avec une seule ligne 2D animée

Storyboard tools for university and education research projects

[EN] This paper is focused on the presentation of storyboard and storytelling open source online tools, for its application in the university context and in the education research projects. The main aim of this paper is to provide an open source tool to support (i) university teachers, using storyboard tools as a novel educational resource to include in their master and practice classes, allowing them to structure concepts or explain methodologies through images that have attached short descriptions; (ii) university students, as future industrial engineers, employing storyboard tools for structuring the decision-making process, by taking into account all the actors that are affected in the decision process; (iii) education research projects, adopting storyboard as a tool to aid the creative writing through matching creative images with keywords to capture the essence of the research project.The research leading to these results has received funding from European Community's H2020 Programme (H2020/2014-2020) under grant agreement no 636909, "Cloud Collaborative Manufacturing Networks (C2NET)".Andres, B.; Poler, R. (2017). Storyboard tools for university and education research projects. INTED proceedings (Online). 220-227. https://doi.org/10.21125/inted.2017.0173S22022