Modélisation dynamique inverse de tissus - Apprentissage profond à l'aide de simulations basées sur la physique

Inverse problems arise in various physical domains and solving them from real-world visual observations poses a significant challenge due to the high dimensional nature of the data. Furthermore gathering enough observations that a data driven model can accurately capture the complete distribution of a physical phenomenon is often intractable. In this work we use deep learning to solve inverse problems by applying two basic principles. Deep learning models can be trained using synthetic data generated from physics based simulations. And the employed simulator itself needs to be verified for physical accuracy thus allowing the model to learn the exact physical phenomenon that is desired.To validate the simulator, we introduce rich and compact physical protocols, originally proposed in soft matter physics literature to measure physical parameters. These protocols can be easily replicated in a simulator to test the physical correctness of the model, and the validity of the simulator.We solve the inverse measurement problem of estimating contact friction in soft-bodies which otherwise requires a specialized physics bench and entails tedious acquisition protocols. This makes the prospect of a purely non-invasive, video-based measurement technique particularly attractive. Previous works have shown that such a video-based estimation is feasible for material parameters using deep learning, but this has never been applied to the friction estimation problem which results in even more subtle visual variations. Since acquiring a large dataset for this problem is impractical, we generate it using a frictional contact simulator. As the simulator has been calibrated and verified using controlled experiments, the results are not only visually plausible, but physically-correct enough to match observations made at the macroscopic scale. We propose to our knowledge the first non-invasive measurement network and adjoining synthetic training dataset for estimating cloth friction at contact, for both cloth-hard body and cloth-cloth contacts. We also acquire an extensive dataset of real world experiments for testing. Both the training and test datasets have been made freely available to the community.We also utilize the same protocol for solving the inverse measurement problem of estimating the deformed curvature of a suspended Kirchhoff rod. In order to do such estimation on physical rods, we utilize a deep learning model to visually predict a curvature field from a suspended rod. As creating a dataset from physical rods (even if synthetically constructed), that faithfully covers a representative manifold of deformed curvatures is intractable, we rely on generating such a dataset from a verified simulator. Our work shows a promising way forward for utilizing deep learning models as part of an inversion measurement pipeline.Des problèmes inverses surviennent dans divers domaines physiques et les résoudre à partir d'observations visuelles du monde réel pose un défi important en raison de la nature hautement dimensionnelle des données. De plus, rassembler suffisamment d'observations pour qu'un modèle basé sur les données puisse capturer avec précision la distribution complète d'un phénomène physique est souvent insoluble. Dans ce travail, nous utilisons l'apprentissage profond pour résoudre des problèmes inverses en appliquant deux principes de base. Les modèles d'apprentissage profond peuvent être entraînés à l'aide de données synthétiques générées à partir de simulations basées sur la physique. Et la précision physique du simulateur employé, lui-même, doit être vérifiée, permettant ainsi au modèle d'apprendre le phénomène physique exact souhaité.Afin de valider le simulateur, nous introduisons des protocoles physiques riches et compacts, proposés à l'origine dans la littérature de physique de la matière molle pour mesurer des paramètres physiques. Ces protocoles peuvent être facilement répliqués dans un simulateur pour tester l'exactitude physique du modèle et la validité du simulateur.Nous résolvons le problème de mesure inverse de l'estimation du frottement de contact dans les corps mous qui nécessite sinon un banc de physique spécialisé et un protocole d'acquisition fastidieux. Cela rend la perspective d'une technique de mesure purement non invasive basée sur la vidéo particulièrement attrayante. Des travaux antérieurs ont montré qu'une telle estimation basée sur la vidéo est réalisable pour les paramètres de matériaux en utilisant l'apprentissage profond, mais cela n'a jamais été appliqué au problème d'estimation de la friction qui entraîne des variations visuelles encore plus subtiles. Étant donné qu'il n'est pas pratique d'acquérir un grand ensemble de données pour ce problème, nous le générons à l'aide d'un simulateur de contact frictionnel. Comme le simulateur a été calibré et vérifié à l'aide d'expériences contrôlées, les résultats sont non seulement visuellement plausibles, mais suffisamment corrects physiquement pour correspondre aux observations faites à l'échelle macroscopique. Nous proposons à notre connaissance le premier réseau de mesure non invasif et un jeu de données d'entraînement synthétique adjacent pour estimer le frottement du tissu au contact, à la fois pour les contacts tissu-corps dur et tissu-tissu. Nous acquérons également un vaste ensemble de données d'expériences du monde réel pour les tests. Les ensembles de données de formation et de test ont été mis gratuitement à la disposition de la communauté.Nous utilisons également le même protocole pour résoudre le problème de mesure inverse de l'estimation de la courbure déformée d'une tige de Kirchhoff suspendue. Afin de faire une telle estimation sur des tiges physiques, nous utilisons un modèle d'apprentissage profond pour prédire visuellement un champ de courbure à partir d'une tige suspendue. Comme la création d'un ensemble de données à partir de tiges physiques (même si elles sont synthétiquement construites), qui couvre fidèlement une variété représentative de courbures déformées est insoluble, nous comptons sur la génération d'un tel ensemble de données à partir d'un simulateur vérifié. Notre travail montre une voie prometteuse pour l'utilisation de modèles d'apprentissage profond dans le cadre d'un pipeline de mesure d'inversion

Space Exploration Robotic Systems - Orbital Manipulation Mechanisms

In the future, orbital space robots will assist humans in space by constructing and maintaining space modules and structures. Robotic manipulators will play essential roles in orbital operations. This work is devoted to the implemented designs of two different orbital manipulation mechanical grippers developed in collaboration with Thales Alenia Space Italy and NASA Jet Propulsion Laboratory – California Institute of Technology. The consensus to a study phase for an IXV (Intermediate eXperimental Vehicle) successor, a preoperational vehicle called SPACE RIDER (Space Rider Reusable Integrated Demonstrator for European Return), has been recently enlarged, as approved during last EU Ministerial Council. One of the main project task consists in developing SPACE RIDER to conduct on orbit servicing activity with no docking. SPACE RIDER would be provided with a robotic manipulator system (arm and gripper) able to transfer cargos, such as scientific payloads, from low Earth orbiting platforms to SPACE RIDER cargo bay. The platform is a part of a space tug designed to move small satellites and other payloads from Low Earth Orbit (LEO) to Geosynchronous Equatorial Orbit (GEO) and viceversa. The assumed housing cargo bay requirements in terms of volume (<100l) and mass (<50kg) combined with the required overall arm dimensions (4m length), and mass of the cargo (5-30kg) force to developing an innovative robotic manipulator with the task-oriented end effector. It results in a seven degree-of-freedom arm to ensure a high degree of dexterity and a dedicate end-effector designed to grasp the cargo interface. The gripper concept developed consists in a multi-finger hand able to lock both translational and rotational cargo degrees of freedom through an innovative underactuation strategy to limit its mass and volume. A configuration study on the cargo handle interface was performed together with some computer aided design models and multibody analysis of the whole system to prove its feasibility. Finally, the concept of system control architecture, the test report and the gripper structural analysis were defined. In order to be able to accurately analyze a sample of Martian soil and to determine if life was present on the red planet, a lot of mission concepts have been formulating to reach Mars and to bring back a terrain sample. NASA JPL has been studying such mission concepts for many years. This concept is made up of three intermediate mission accomplishments. Mars 2020 is the first mission envisioned to collect the terrain sample and to seal it in sample tubes. These sealed sample tubes could be inserted in a spherical envelope named Orbiting Sample (OS). A Mars Ascent Vehicle (MAV) is the notional rocket designed to bring this sample off Mars, and a Rendezvous Orbiting Capture System (ROCS) is the mission conceived to bring this sample back to Earth through the Earth Entry Vehicle (EEV). MOSTT is the technical work study to create new concepts able to capture and reorient an OS. This maneuver is particularly important because we do not know an OS incoming orientation and we need to be able to capture, to reorient it (2 rotational degrees of freedom), and to retain an OS (3 translational degrees of freedom and 2 rotational ones). Planetary protection requirements generate a need to enclose an OS in two shells and to seal it through a process called Break-The-Chain (BTC). Considering the EEV would return back to Earth, the tubes orientation and position have to be known in detail to prevent any possible damage during the Earth hard landing (acceleration of ∼1300g). Tests and analysis report that in order for the hermetic seals of the sample tubes to survive the impact, they should be located above an OS equator. Due to other system uncertainties an OS presents the potential requirement to be properly reoriented before being inserted inside the EEV. Planetary protection issues and landing safety are critical mission points and provide potential strict requirements to MOSTT system configuration. This task deals with the concept, design, and testbed realization of an innovative electro-mechanical system to reorient an OS consistent with all the necessary potential requirements. One of these electro-mechanical systems consists of a controlled-motorized wiper that explores all an OS surface until it engages with a pin on an OS surface and brings it to the final home location reorienting an OS. This mechanism is expected to be robust to the incoming OS orientation and to reorient it to the desired position using only one degree of freedom rotational actuator

Modeling, simulation and control of microrobots for the microfactory.

Future assembly technologies will involve higher levels of automation in order to satisfy increased microscale or nanoscale precision requirements. Traditionally, assembly using a top-down robotic approach has been well-studied and applied to the microelectronics and MEMS industries, but less so in nanotechnology. With the boom of nanotechnology since the 1990s, newly designed products with new materials, coatings, and nanoparticles are gradually entering everyone’s lives, while the industry has grown into a billion-dollar volume worldwide. Traditionally, nanotechnology products are assembled using bottom-up methods, such as self-assembly, rather than top-down robotic assembly. This is due to considerations of volume handling of large quantities of components, and the high cost associated with top-down manipulation requiring precision. However, bottom-up manufacturing methods have certain limitations, such as components needing to have predefined shapes and surface coatings, and the number of assembly components being limited to very few. For example, in the case of self-assembly of nano-cubes with an origami design, post-assembly manipulation of cubes in large quantities and cost-efficiency is still challenging. In this thesis, we envision a new paradigm for nanoscale assembly, realized with the help of a wafer-scale microfactory containing large numbers of MEMS microrobots. These robots will work together to enhance the throughput of the factory, while their cost will be reduced when compared to conventional nanopositioners. To fulfill the microfactory vision, numerous challenges related to design, power, control, and nanoscale task completion by these microrobots must be overcome. In this work, we study two classes of microrobots for the microfactory: stationary microrobots and mobile microrobots. For the stationary microrobots in our microfactory application, we have designed and modeled two different types of microrobots, the AFAM (Articulated Four Axes Microrobot) and the SolarPede. The AFAM is a millimeter-size robotic arm working as a nanomanipulator for nanoparticles with four degrees of freedom, while the SolarPede is a light-powered centimeter-size robotic conveyor in the microfactory. For mobile microrobots, we have introduced the world’s first laser-driven micrometer-size locomotor in dry environments, called ChevBot to prove the concept of the motion mechanism. The ChevBot is fabricated using MEMS technology in the cleanroom, following a microassembly step. We showed that it can perform locomotion with pulsed laser energy on a dry surface. Based on the knowledge gained with the ChevBot, we refined tits fabrication process to remove the assembly step and increase its reliability. We designed and fabricated a steerable microrobot, the SerpenBot, in order to achieve controllable behavior with the guidance of a laser beam. Through modeling and experimental study of the characteristics of this type of microrobot, we proposed and validated a new type of deep learning controller, the PID-Bayes neural network controller. The experiments showed that the SerpenBot can achieve closed-loop autonomous operation on a dry substrate

Modeling of ground excavation with the particle finite element method

The present work introduces a new application of the Particle Finite Element Method (PFEM) for the modeling of excavation problems. PFEM is presented as a very suitable tool for the treatment of excavation problem. The method gives solution for the analysis of all processes that derive from it. The method has a high versatility and a reasonable computational cost. The obtained results are really promising.Postprint (published version

Physical validation of simulators in Computer Graphics: A new framework dedicated to slender elastic structures and frictional contact

International audienceWe introduce a selected set of protocols inspired from the Soft Matter Physics community in order to validate Computer Graphics simulators of slender elastic structures possibly subject to dry frictional contact. Although these simulators were primarily intended for feature film animation and visual effects, they are more and more used as virtual design tools for predicting the shape and deformation of real objects; hence the need for a careful, quantitative validation. Our tests, experimentally verified, are designed to evaluate carefully the predictability of these simulators on various aspects, such as bending elasticity, bend-twist coupling, and frictional contact. We have passed a number of popular codes of Computer Graphics through our benchmarks by defining a rigorous, consistent, and as fair as possible methodology. Our results show that while some popular simulators for plates/shells and frictional contact fail even on the simplest scenarios, more recent ones, as well as well-known codes for rods, generally perform well and sometimes even better than some reference commercial tools of Mechanical Engineering. To make our validation protocols easily applicable to any simulator, we provide an extensive description of our methodology, and we shall distribute all the necessary model data to be compared against

Coupling, Conservation, and Performance in Numerical Simulations

This thesis considers three aspects of the numerical simulations, which arecoupling, conservation, and performance. We conduct a project and addressone challenge from each of these aspects.We propose a novel penalty force to enforce contacts with accurate Coulombfriction. The force is compatible with fully-implicit time integration and theuse of optimization-based integration. In addition to processing collisionsbetween deformable objects, the force can be used to couple rigid bodies todeformable objects or the material point method. The force naturally leads tostable stacking without drift over time, even when solvers are not run toconvergence. The force leads to an asymmetrical system, and we provide apractical solution for handling these.Next we present a new technique for transferring momentum and velocity betweenparticles and MAC grids based on the Affine-Particle-In-Cell (APIC) frameworkpreviously developed for co-locatedgrids. We extend the original APIC paper and show thatthe proposed transfers preserve linear and angular momentum and also satisfyall of the original APIC properties.Early indications in the original APIC paper suggested that APIC might besuitable for simulating high Reynolds fluids due to favorable retention ofvortices, but these properties were not studied further. We use twodimensional Fourier analysis to investigate dissipation in the limit \dt=0.We investigate dissipation and vortex retention numerically to quantify theeffectiveness of APIC compared with other transfer algorithms.Finally we present an efficient solver for problems typically seen inmicrofluidic applications.Microfluidic ``lab on a chip'' devices are small devices that operate on smalllength scales on small volumes of fluid. Designs for microfluidic chips aregenerally composed of standardized and often repeated components connected bylong, thin, straight fluid channels. We propose a novel discretizationalgorithm for simulating the Stokes equations on geometry with these features,which produces sparse linear systems with many repeated matrix blocks. Thediscretization is formally third order accurate for velocity and second orderaccurate for pressure in the $L^\infty$ norm. We also propose a novel linearsystem solver based on cyclic reduction, reordered sparse Gaussian elimination,and operation caching that is designed to efficiently solve systems withrepeated matrix blocks