Model of tactile sensors using soft contacts and its application in robot grasping simulation

In the context of robot grasping and manipulation, realistic dynamic simulation requires accurate modeling of contacts between bodies and, in a practical level, accurate simulation of touch sensors. This paper addresses the problem of creating a simulation of a tactile sensor as well as its implementation in a simulation environment. The simulated tactile sensor model utilizes collision detection and response methods using soft contacts as well as a full friction description. The tactile element is created based on a geometry enabling the creation of a variety of different shape tactile sensors. The tactile sensor element can be used to detect touch against triangularized geometries. This independence in shape enables the use of the sensor model for various applications, ranging from regular tactile sensors to more complex geometries as the human hand which makes it possible to explore human-like touch. The developed tactile sensor model is implemented within OpenGRASP and is available in the open-source plugin. The model has been validated through several experiments ranging from physical properties verification to testing on robot grasping applications. This simulated sensor can provide researchers with a valuable tool for robotic grasping research, especially in cases where the real sensors are not accurate enough yet

Studio dell'interazione tra Sistema Muscoloscheletrico Umano e Dispositivi di Assistenza Robotici

In the latest years, robotic technologies have been increasingly introduced in rehabilitation with the main purpose of reducing the costs and speeding up the recovery process of patients. However, most of the commercial devices impose a pre-programmed trajectory to the limbs of the patients, who therefore behave in a passive way. Another current major limitation is the inability to accurately evaluate the dynamics of the interaction between the patient and the robotic device. This interaction plays a central role in the mutual modulation of human and robot system behavior with respect of their standalone behavior. In particular, the prediction of the interaction can provide useful information to better design the exoskeleton as well as the rehabilitation treatment. This thesis presents my proposed solution for the development of a simulator able to dynamically simulate at the same time the actuated robot device, the human body, and their emerging physical interaction during the movement cooperation. The main idea behind this solution is to decompose the main system in different levels. I called the proposed solution Multi-Level modeling approach, which is the main topic of this thesis. I proposed the following decomposition: Human, Robot, and Boundary Level. The levels are integrated into a whole system in which each of them addresses specific challenges. The Human Level represents the subject who is wearing, for example, an exoskeleton for the lower limbs. To reach a symbiotic collaboration between the subject and the exoskeleton, the proposed approach has to include the subject's intentions and efforts. Moreover, user's internal transformations provide important information about the internal dynamic parameters modulation due to the external device. The Robot Level consists of the wearable robot system which supports the movements. Our proposed approach includes models of both device mechanics and control strategies. This allows to test different control strategies and find the one that better fits each specific patient's needs and characteristics. The last level is the Boundary Level, which has the main objective to model the human-robot mechanical power transfer, including also the non-idealities (such as dissipative forces), in order to accurately estimate interactions. Challenges emerged during the development of the simulator system were faced, investigating different solutions, and selecting and validating the most promising one. First, I selected a common software platform, able to simultaneously reproduce the dynamic behavior of the three levels. The common software platform allows to build a quite flexible system where different solution could be evaluated simply modifying model parameters. Among different available software, OpenSim was selected because it is well known and used for the dynamic study of human movement. Although OpenSim was well tested in biomechanics, it required a further evaluation as simulator for Robot and Boudary Levels. Performed tests and their motivations are reported in this work. Human internal dynamics parameters are modulated by the influence of the external device. I proposed to monitor this variation, taking into consideration the neural drive sent to the muscles. This can be done by measuring the muscles' electromyographic (EMG) signals, which are the electrical potential generated by muscle cells when they are activated, prior to muscle contraction. These signals can be used as input for a physiologically accurate human musculoskeletal model, to calculate the subject contribution to the movement. As the relation between EMGs and the generated muscle forces and joint moments is not linear, the neuromusculoskeletal model is indeed needed to replicate step-by-step all the internal transformations which occur from the excitation of the muscle to the joint movement. Estimation of the emerging interaction, during the human-robot cooperation, can be performed through an interaction model which is basically a set of contact models. Due to the specific rehabilitation purpose of our work, this contact model needs special attention. I introduced and validated a procedure to calibrate the contact models to improve the accuracy of the estimated interaction forces. One of the problems of using EMG signals is that, in order to acquire them in a non-invasive way, surface electrodes must be used; however, this means that the collected data quality is quite susceptible to the electrodes placements and decay, and to electric and magnetic interferences. In many contexts, such as home rehabilitation, this could be a limitation. An alternative solution to avoid the direct EMG measurement is presented in this work. The idea is that for some repetitive tasks, which are most interesting for rehabilitation, it is possible to substitute the direct data collection with a subject specific model of EMGs. The objective of this work is to provide an effective approach to estimate the emerging interaction during the human-robot movement cooperation. The Multi-Level Modeling approach, presented in this thesis, decomposes this complex problem allowing to find all the required components to realize a whole system able to reach this objective

Proceedings of the ECCOMAS Thematic Conference on Multibody Dynamics 2015

This volume contains the full papers accepted for presentation at the ECCOMAS Thematic Conference on Multibody Dynamics 2015 held in the Barcelona School of Industrial Engineering, Universitat Politècnica de Catalunya, on June 29 - July 2, 2015. The ECCOMAS Thematic Conference on Multibody Dynamics is an international meeting held once every two years in a European country. Continuing the very successful series of past conferences that have been organized in Lisbon (2003), Madrid (2005), Milan (2007), Warsaw (2009), Brussels (2011) and Zagreb (2013); this edition will once again serve as a meeting point for the international researchers, scientists and experts from academia, research laboratories and industry working in the area of multibody dynamics. Applications are related to many fields of contemporary engineering, such as vehicle and railway systems, aeronautical and space vehicles, robotic manipulators, mechatronic and autonomous systems, smart structures, biomechanical systems and nanotechnologies. The topics of the conference include, but are not restricted to: ● Formulations and Numerical Methods ● Efficient Methods and Real-Time Applications ● Flexible Multibody Dynamics ● Contact Dynamics and Constraints ● Multiphysics and Coupled Problems ● Control and Optimization ● Software Development and Computer Technology ● Aerospace and Maritime Applications ● Biomechanics ● Railroad Vehicle Dynamics ● Road Vehicle Dynamics ● Robotics ● Benchmark ProblemsPostprint (published version

Advances in Mechanical Systems Dynamics 2020

The fundamentals of mechanical system dynamics were established before the beginning of the industrial era. The 18th century was a very important time for science and was characterized by the development of classical mechanics. This development progressed in the 19th century, and new, important applications related to industrialization were found and studied. The development of computers in the 20th century revolutionized mechanical system dynamics owing to the development of numerical simulation. We are now in the presence of the fourth industrial revolution. Mechanical systems are increasingly integrated with electrical, fluidic, and electronic systems, and the industrial environment has become characterized by the cyber-physical systems of industry 4.0. Within this framework, the status-of-the-art has become represented by integrated mechanical systems and supported by accurate dynamic models able to predict their dynamic behavior. Therefore, mechanical systems dynamics will play a central role in forthcoming years. This Special Issue aims to disseminate the latest research findings and ideas in the field of mechanical systems dynamics, with particular emphasis on novel trends and applications

A continuum robotic platform for endoscopic non-contact laser surgery: design, control, and preclinical evaluation

The application of laser technologies in surgical interventions has been accepted in the clinical domain due to their atraumatic properties. In addition to manual application of fibre-guided lasers with tissue contact, non-contact transoral laser microsurgery (TLM) of laryngeal tumours has been prevailed in ENT surgery. However, TLM requires many years of surgical training for tumour resection in order to preserve the function of adjacent organs and thus preserve the patient’s quality of life. The positioning of the microscopic laser applicator outside the patient can also impede a direct line-of-sight to the target area due to anatomical variability and limit the working space. Further clinical challenges include positioning the laser focus on the tissue surface, imaging, planning and performing laser ablation, and motion of the target area during surgery. This dissertation aims to address the limitations of TLM through robotic approaches and intraoperative assistance. Although a trend towards minimally invasive surgery is apparent, no highly integrated platform for endoscopic delivery of focused laser radiation is available to date. Likewise, there are no known devices that incorporate scene information from endoscopic imaging into ablation planning and execution. For focusing of the laser beam close to the target tissue, this work first presents miniaturised focusing optics that can be integrated into endoscopic systems. Experimental trials characterise the optical properties and the ablation performance. A robotic platform is realised for manipulation of the focusing optics. This is based on a variable-length continuum manipulator. The latter enables movements of the endoscopic end effector in five degrees of freedom with a mechatronic actuation unit. The kinematic modelling and control of the robot are integrated into a modular framework that is evaluated experimentally. The manipulation of focused laser radiation also requires precise adjustment of the focal position on the tissue. For this purpose, visual, haptic and visual-haptic assistance functions are presented. These support the operator during teleoperation to set an optimal working distance. Advantages of visual-haptic assistance are demonstrated in a user study. The system performance and usability of the overall robotic system are assessed in an additional user study. Analogous to a clinical scenario, the subjects follow predefined target patterns with a laser spot. The mean positioning accuracy of the spot is 0.5 mm. Finally, methods of image-guided robot control are introduced to automate laser ablation. Experiments confirm a positive effect of proposed automation concepts on non-contact laser surgery.Die Anwendung von Lasertechnologien in chirurgischen Interventionen hat sich aufgrund der atraumatischen Eigenschaften in der Klinik etabliert. Neben manueller Applikation von fasergeführten Lasern mit Gewebekontakt hat sich die kontaktfreie transorale Lasermikrochirurgie (TLM) von Tumoren des Larynx in der HNO-Chirurgie durchgesetzt. Die TLM erfordert zur Tumorresektion jedoch ein langjähriges chirurgisches Training, um die Funktion der angrenzenden Organe zu sichern und damit die Lebensqualität der Patienten zu erhalten. Die Positionierung des mikroskopis chen Laserapplikators außerhalb des Patienten kann zudem die direkte Sicht auf das Zielgebiet durch anatomische Variabilität erschweren und den Arbeitsraum einschränken. Weitere klinische Herausforderungen betreffen die Positionierung des Laserfokus auf der Gewebeoberfläche, die Bildgebung, die Planung und Ausführung der Laserablation sowie intraoperative Bewegungen des Zielgebietes. Die vorliegende Dissertation zielt darauf ab, die Limitierungen der TLM durch robotische Ansätze und intraoperative Assistenz zu adressieren. Obwohl ein Trend zur minimal invasiven Chirurgie besteht, sind bislang keine hochintegrierten Plattformen für die endoskopische Applikation fokussierter Laserstrahlung verfügbar. Ebenfalls sind keine Systeme bekannt, die Szeneninformationen aus der endoskopischen Bildgebung in die Ablationsplanung und -ausführung einbeziehen. Für eine situsnahe Fokussierung des Laserstrahls wird in dieser Arbeit zunächst eine miniaturisierte Fokussieroptik zur Integration in endoskopische Systeme vorgestellt. Experimentelle Versuche charakterisieren die optischen Eigenschaften und das Ablationsverhalten. Zur Manipulation der Fokussieroptik wird eine robotische Plattform realisiert. Diese basiert auf einem längenveränderlichen Kontinuumsmanipulator. Letzterer ermöglicht in Kombination mit einer mechatronischen Aktuierungseinheit Bewegungen des Endoskopkopfes in fünf Freiheitsgraden. Die kinematische Modellierung und Regelung des Systems werden in ein modulares Framework eingebunden und evaluiert. Die Manipulation fokussierter Laserstrahlung erfordert zudem eine präzise Anpassung der Fokuslage auf das Gewebe. Dafür werden visuelle, haptische und visuell haptische Assistenzfunktionen eingeführt. Diese unterstützen den Anwender bei Teleoperation zur Einstellung eines optimalen Arbeitsabstandes. In einer Anwenderstudie werden Vorteile der visuell-haptischen Assistenz nachgewiesen. Die Systemperformanz und Gebrauchstauglichkeit des robotischen Gesamtsystems werden in einer weiteren Anwenderstudie untersucht. Analog zu einem klinischen Einsatz verfolgen die Probanden mit einem Laserspot vorgegebene Sollpfade. Die mittlere Positioniergenauigkeit des Spots beträgt dabei 0,5 mm. Zur Automatisierung der Ablation werden abschließend Methoden der bildgestützten Regelung vorgestellt. Experimente bestätigen einen positiven Effekt der Automationskonzepte für die kontaktfreie Laserchirurgie

Multibody dynamics 2015

This volume contains the full papers accepted for presentation at the ECCOMAS Thematic Conference on Multibody Dynamics 2015 held in the Barcelona School of Industrial Engineering, Universitat Politècnica de Catalunya, on June 29 - July 2, 2015. The ECCOMAS Thematic Conference on Multibody Dynamics is an international meeting held once every two years in a European country. Continuing the very successful series of past conferences that have been organized in Lisbon (2003), Madrid (2005), Milan (2007), Warsaw (2009), Brussels (2011) and Zagreb (2013); this edition will once again serve as a meeting point for the international researchers, scientists and experts from academia, research laboratories and industry working in the area of multibody dynamics. Applications are related to many fields of contemporary engineering, such as vehicle and railway systems, aeronautical and space vehicles, robotic manipulators, mechatronic and autonomous systems, smart structures, biomechanical systems and nanotechnologies. The topics of the conference include, but are not restricted to: Formulations and Numerical Methods, Efficient Methods and Real-Time Applications, Flexible Multibody Dynamics, Contact Dynamics and Constraints, Multiphysics and Coupled Problems, Control and Optimization, Software Development and Computer Technology, Aerospace and Maritime Applications, Biomechanics, Railroad Vehicle Dynamics, Road Vehicle Dynamics, Robotics, Benchmark Problems. The conference is organized by the Department of Mechanical Engineering of the Universitat Politècnica de Catalunya (UPC) in Barcelona. The organizers would like to thank the authors for submitting their contributions, the keynote lecturers for accepting the invitation and for the quality of their talks, the awards and scientific committees for their support to the organization of the conference, and finally the topic organizers for reviewing all extended abstracts and selecting the awards nominees.Postprint (published version

Technology for large space systems: A bibliography with indexes (supplement 19)

This bibliography lists 526 reports, articles, and other documents introduced into the NASA scientific and technical information system between January 1, 1988 and June 30, 1988. Its purpose is to provide helpful information to the researcher, manager, and designer in technology development and mission design according to system, interactive analysis and design, structural and thermal analysis and design, structural concepts and control systems, electronics, advanced materials, assembly concepts, propulsion, and solar power satellite systems

Robot Learning for Manipulation of Deformable Linear Objects

Deformable Object Manipulation (DOM) is a challenging problem in robotics. Until recently there has been limited research on the subject, with most robotic manipulation methods being developed for rigid objects. Part of the challenge in DOM is that non-rigid objects require solutions capable of generalizing to changes in shape and mechanical properties. Recently, Machine Learning (ML) has been proven successful in other fields where generalization is important such as computer vision, thus encouraging the application of ML to robotics as well. Notably, Reinforcement Learning (RL) has shown promise in finding control policies for manipulation of rigid objects. However, RL requires large amounts of data that are better satisfied in simulation while deformable objects are inherently more difficult to model and simulate. This thesis presents ReForm, a simulation sandbox for robotic manipulation of Deformable Linear Objects (DLOs) such as cables, ropes, and wires. DLO manipulation is an interesting problem for a variety of applications throughout manufacturing, agriculture, and medicine. Currently, this sandbox includes six shape control tasks, which are classified as explicit when a precise shape is to be achieved, or implicit when the deformation is just a consequence of a more abstract goal, e.g. wrapping a DLO around another object. The proposed simulation environments aim to facilitate comparison and reproducibility of robot learning research. To that end, an RL algorithm is tested on each simulated task providing initial benchmarking results. ReForm is one of three concurrent frameworks to first support DOM problems. This thesis also addresses the problem of DLO state representation for an explicit shape control problem. Moreover, the effects of elastoplastic properties on the RL reward definition are investigated. From a control perspective, DLOs with these properties are particularly challenging to manipulate due to their nonlinear behavior, acting elastic up to a yield point after which they become permanently deformed. A low-dimensional representation from discrete differential geometry is proposed, offering more descriptive shape information than a simple point-cloud while avoiding the need for curve fitting. Empirical results show that this representation leads to a better goal description in the presence of elastoplasticity, preventing the RL algorithm from converging to local minima which correspond to incorrect shapes of the DLO