Visual Servoing and Robust Object Manipulation Using Symmetries and Conformal Geometric Algebra

Object tracking and manipulation is an important process for many applications in robotics and computer vision. A novel 3D pose estimation of objects using reflectionally symmetry formulated in Conformal Geometric Algebra (CGA) is proposed in this work. The synthesis of the kinematics model for robots and a sliding mode controller using the CGA approach is described. Real time implementation results are presented for the pose estimation of object using a stereo vision system.ITESO, A.C.CINVESTA

Model-Based Environmental Visual Perception for Humanoid Robots

The visual perception of a robot should answer two fundamental questions: What? and Where? In order to properly and efficiently reply to these questions, it is essential to establish a bidirectional coupling between the external stimuli and the internal representations. This coupling links the physical world with the inner abstraction models by sensor transformation, recognition, matching and optimization algorithms. The objective of this PhD is to establish this sensor-model coupling

Reconstruction and analysis of dynamic shapes

Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2010.Cataloged from PDF version of thesis.Includes bibliographical references (p. 122-141).Motion capture has revolutionized entertainment and influenced fields as diverse as the arts, sports, and medicine. This is despite the limitation that it tracks only a small set of surface points. On the other hand, 3D scanning techniques digitize complete surfaces of static objects, but are not applicable to moving shapes. I present methods that overcome both limitations, and can obtain the moving geometry of dynamic shapes (such as people and clothes in motion) and analyze it in order to advance computer animation. Further understanding of dynamic shapes will enable various industries to enhance virtual characters, advance robot locomotion, improve sports performance, and aid in medical rehabilitation, thus directly affecting our daily lives. My methods efficiently recover much of the expressiveness of dynamic shapes from the silhouettes alone. Furthermore, the reconstruction quality is greatly improved by including surface orientations (normals). In order to make reconstruction more practical, I strive to capture dynamic shapes in their natural environment, which I do by using hybrid inertial and acoustic sensors. After capture, the reconstructed dynamic shapes are analyzed in order to enhance their utility. My algorithms then allow animators to generate novel motions, such as transferring facial performances from one actor onto another using multi-linear models. The presented research provides some of the first and most accurate reconstructions of complex moving surfaces, and is among the few approaches that establish a relationship between different dynamic shapes.by Daniel Vlasic.Ph.D

Advances in Robot Kinematics : Proceedings of the 15th international conference on Advances in Robot Kinematics

International audienceThe motion of mechanisms, kinematics, is one of the most fundamental aspect of robot design, analysis and control but is also relevant to other scientific domains such as biome- chanics, molecular biology, . . . . The series of books on Advances in Robot Kinematics (ARK) report the latest achievement in this field. ARK has a long history as the first book was published in 1991 and since then new issues have been published every 2 years. Each book is the follow-up of a single-track symposium in which the participants exchange their results and opinions in a meeting that bring together the best of world’s researchers and scientists together with young students. Since 1992 the ARK symposia have come under the patronage of the International Federation for the Promotion of Machine Science-IFToMM.This book is the 13th in the series and is the result of peer-review process intended to select the newest and most original achievements in this field. For the first time the articles of this symposium will be published in a green open-access archive to favor free dissemination of the results. However the book will also be o↵ered as a on-demand printed book.The papers proposed in this book show that robot kinematics is an exciting domain with an immense number of research challenges that go well beyond the field of robotics.The last symposium related with this book was organized by the French National Re- search Institute in Computer Science and Control Theory (INRIA) in Grasse, France

Physics-based Reconstruction and Animation of Humans

Creating digital representations of humans is of utmost importance for applications ranging from entertainment (video games, movies) to human-computer interaction and even psychiatrical treatments. What makes building credible digital doubles difficult is the fact that the human vision system is very sensitive to perceiving the complex expressivity and potential anomalies in body structures and motion. This thesis will present several projects that tackle these problems from two different perspectives: lightweight acquisition and physics-based simulation. It starts by describing a complete pipeline that allows users to reconstruct fully rigged 3D facial avatars using video data coming from a handheld device (e.g., smartphone). The avatars use a novel two-scale representation composed of blendshapes and dynamic detail maps. They are constructed through an optimization that integrates feature tracking, optical flow, and shape from shading. Continuing along the lines of accessible acquisition systems, we discuss a framework for simultaneous tracking and modeling of articulated human bodies from RGB-D data. We show how semantic information can be extracted from the scanned body shapes. In the second half of the thesis, we will deviate from using standard linear reconstruction and animation models, and rather focus on exploiting physics-based techniques that are able to incorporate complex phenomena such as dynamics, collision response and incompressibility of the materials. The first approach we propose assumes that each 3D scan of an actor records his body in a physical steady state and uses a process called inverse physics to extract a volumetric physics-ready anatomical model of him. By using biologically-inspired growth models for the bones, muscles and fat, our method can obtain realistic anatomical reconstructions that can be later on animated using external tracking data such as the one resulting from tracking motion capture markers. This is then extended to a novel physics-based approach for facial reconstruction and animation. We propose a facial animation model which simulates biomechanical muscle contractions in a volumetric head model in order to create the facial expressions seen in the input scans. We then show how this approach allows for new avenues of dynamic artistic control, simulation of corrective facial surgery, and interaction with external forces and objects

Applied Mathematics to Mechanisms and Machines

This book brings together all 16 articles published in the Special Issue "Applied Mathematics to Mechanisms and Machines" of the MDPI Mathematics journal, in the section “Engineering Mathematics”. The subject matter covered by these works is varied, but they all have mechanisms as the object of study and mathematics as the basis of the methodology used. In fact, the synthesis, design and optimization of mechanisms, robotics, automotives, maintenance 4.0, machine vibrations, control, biomechanics and medical devices are among the topics covered in this book. This volume may be of interest to all who work in the field of mechanism and machine science and we hope that it will contribute to the development of both mechanical engineering and applied mathematics

Virtual articulation and kinematic abstraction in robotics

Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2009.Cataloged from PDF version of thesis.Includes bibliographical references (p. 279-292).This thesis presents the theory, implementation, novel applications, and experimental validation of a general-purpose framework for applying virtual modifications to an articulated robot, or virtual articulations. These can homogenize various aspects of a robot and its task environment into a single unified model which is both qualitatively high-level and quantitatively functional. This is the first framework designed specifically for the mixed real/virtual case. It supports arbitrary topology spatial kinematics, a broad catalog of joints, on-line structure changes, interactive kinostatic simulation, and novel kinematic abstractions, where complex subsystems are simplified with virtual replacements in both space and time. Decomposition algorithms, including a novel method of hierarchical subdivision, enable scaling to large closed-chain mechanisms with 100s of joints. Novel applications are presented in two areas of current interest: operating high- DoF kinematic manipulation and inspection tasks, and analyzing reliable kinostatic locomotion strategies based on compliance and proprioception. In both areas virtual articulations homogeneously model the robot and its task environment, and abstractions structure complex models. For high-DoF operations the operator attaches virtual joints as a novel interface metaphor to define task motion and to constrain coordinated motion (by virtually closing kinematic chains); virtual links can represent task frames or serve as intermediate connections for virtual joints. For compliant locomotion, virtual articulations model relevant compliances and uncertainties, and temporal abstractions model contact state evolution.(cont.) Results are presented for experiments with two separate robotic systems in each area. For high-DoF operations, NASA/JPL's 36 DoF ATHLETE performs previously challenging coordinated manipulation/inspection moves, and a novel large-scale (100s of joints) simulated modular robot is conveniently operated using spatial abstractions. For compliant locomotion, two experiments are analyzed that each achieve high reliability in uncertain tasks using only compliance and proprioception: a novel vertical structure climbing robot that is 99.8% reliable in over 1000 motions, and a mini-humanoid that steps up an uncertain height with 90% reliability in 80 trials. In both cases virtual articulation models capture the essence of compliant/proprioceptive strategies at a higher level than basic physics, and enable quantitative analyses of the limits of tolerable uncertainty that compare well to experiment.by Marsette Arthur Vona, III.Ph.D

Robotic Manipulation and Capture in Space: A Survey

Space exploration and exploitation depend on the development of on-orbit robotic capabilities for tasks such as servicing of satellites, removing of orbital debris, or construction and maintenance of orbital assets. Manipulation and capture of objects on-orbit are key enablers for these capabilities. This survey addresses fundamental aspects of manipulation and capture, such as the dynamics of space manipulator systems (SMS), i.e., satellites equipped with manipulators, the contact dynamics between manipulator grippers/payloads and targets, and the methods for identifying properties of SMSs and their targets. Also, it presents recent work of sensing pose and system states, of motion planning for capturing a target, and of feedback control methods for SMS during motion or interaction tasks. Finally, the paper reviews major ground testing testbeds for capture operations, and several notable missions and technologies developed for capture of targets on-orbit

Terza giornata di studio Ettore Funaioli: 16 luglio 2009

In questo volume sono raccolte le memorie presentate in occasione della “Terza giornata di studio Ettore Funaioli”, che si è tenuta il 16 luglio 2009 presso la Facoltà di Ingegneria dell’Alma Mater Studiorum – Università di Bologna. La giornata è stata organizzata dagli ex allievi del prof. Funaioli con la collaborazione del DIEM, Dipartimento di Ingegneria delle Costruzioni Meccaniche, Nucleari, Aeronautiche e di Metallurgia dell’Alma Mater Studiorum – Università di Bologna, con il patrocinio del GMA – Gruppo di Meccanica Applicata

Terza giornata di studio Ettore Funaioli: 16 luglio 2009

In questo volume sono raccolte le memorie presentate in occasione della “Terza giornata di studio Ettore Funaioli”, che si è tenuta il 16 luglio 2009 presso la Facoltà di Ingegneria dell’Alma Mater Studiorum – Università di Bologna. La giornata è stata organizzata dagli ex allievi del prof. Funaioli con la collaborazione del DIEM, Dipartimento di Ingegneria delle Costruzioni Meccaniche, Nucleari, Aeronautiche e di Metallurgia dell’Alma Mater Studiorum – Università di Bologna, con il patrocinio del GMA – Gruppo di Meccanica Applicata