Robotic Perception-motion Synergy for Novel Rope Wrapping Tasks

This paper introduces a novel and general method to address the problem of using a general-purpose robot manipulator with a parallel gripper to wrap a deformable linear object (DLO), called a rope, around a rigid object, called a rod, autonomously. Such a robotic wrapping task has broad potential applications in automotive, electromechanical industries construction manufacturing, etc., but has hardly been studied. Our method does not require prior knowledge of the physical and geometrical properties of the objects but enables the robot to use real-time RGB-D perception to determine the wrapping state and feedback control to achieve high-quality results. As such, it provides the robot manipulator with the general capabilities to handle wrapping tasks of different rods or ropes. We tested our method on 6 combinations of 3 different ropes and 2 rods. The result shows that the wrapping quality improved and converged within 5 wraps for all test cases

Synchronized computational architecture for generalized bilateral control of robot arms

A master six degree of freedom Force Reflecting Hand Controller (FRHC) is available at a master site where a received image displays, in essentially real time, a remote robotic manipulator which is being controlled in the corresponding six degree freedom by command signals which are transmitted to the remote site in accordance with the movement of the FRHC at the master site. Software is user-initiated at the master site in order to establish the basic system conditions, and then a physical movement of the FRHC in Cartesean space is reflected at the master site by six absolute numbers that are sensed, translated and computed as a difference signal relative to the earlier position. The change in position is then transmitted in that differential signal form over a high speed synchronized bilateral communication channel which simultaneously returns robot-sensed response information to the master site as forces applied to the FRHC so that the FRHC reflects the feel of what is taking place at the remote site. A system wide clock rate is selected at a sufficiently high rate that the operator at the master site experiences the Force Reflecting operation in real time

Toward Dynamic Manipulation of Flexible Objects by High-Speed Robot System: From Static to Dynamic

This chapter explains dynamic manipulation of flexible objects, where the target objects to be manipulated include rope, ribbon, cloth, pizza dough, and so on. Previously, flexible object manipulation has been performed in a static or quasi-static state. Therefore, the manipulation time becomes long, and the efficiency of the manipulation is not considered to be sufficient. In order to solve these problems, we propose a novel control strategy and motion planning for achieving flexible object manipulation at high speed. The proposed strategy simplifies the flexible object dynamics. Moreover, we implemented a high-speed vision system and high-speed image processing to improve the success rate by manipulating the robot trajectory. By using this strategy, motion planning, and high-speed visual feedback, we demonstrated several tasks, including dynamic manipulation and knotting of a rope, generating a ribbon shape, dynamic folding of cloth, rope insertion, and pizza dough rotation, and we show experimental results obtained by using the high-speed robot system

Recent Advances in Robust Control

Robust control has been a topic of active research in the last three decades culminating in H_2/H_\infty and \mu design methods followed by research on parametric robustness, initially motivated by Kharitonov's theorem, the extension to non-linear time delay systems, and other more recent methods. The two volumes of Recent Advances in Robust Control give a selective overview of recent theoretical developments and present selected application examples. The volumes comprise 39 contributions covering various theoretical aspects as well as different application areas. The first volume covers selected problems in the theory of robust control and its application to robotic and electromechanical systems. The second volume is dedicated to special topics in robust control and problem specific solutions. Recent Advances in Robust Control will be a valuable reference for those interested in the recent theoretical advances and for researchers working in the broad field of robotics and mechatronics

Nonlinear Modeling and Control of Driving Interfaces and Continuum Robots for System Performance Gains

With the rise of (semi)autonomous vehicles and continuum robotics technology and applications, there has been an increasing interest in controller and haptic interface designs. The presence of nonlinearities in the vehicle dynamics is the main challenge in the selection of control algorithms for real-time regulation and tracking of (semi)autonomous vehicles. Moreover, control of continuum structures with infinite dimensions proves to be difficult due to their complex dynamics plus the soft and flexible nature of the manipulator body. The trajectory tracking and control of automobile and robotic systems requires control algorithms that can effectively deal with the nonlinearities of the system without the need for approximation, modeling uncertainties, and input disturbances. Control strategies based on a linearized model are often inadequate in meeting precise performance requirements. To cope with these challenges, one must consider nonlinear techniques. Nonlinear control systems provide tools and methodologies for enabling the design and realization of (semi)autonomous vehicle and continuum robots with extended specifications based on the operational mission profiles. This dissertation provides an insight into various nonlinear controllers developed for (semi)autonomous vehicles and continuum robots as a guideline for future applications in the automobile and soft robotics field. A comprehensive assessment of the approaches and control strategies, as well as insight into the future areas of research in this field, are presented.First, two vehicle haptic interfaces, including a robotic grip and a joystick, both of which are accompanied by nonlinear sliding mode control, have been developed and studied on a steer-by-wire platform integrated with a virtual reality driving environment. An operator-in-the-loop evaluation that included 30 human test subjects was used to investigate these haptic steering interfaces over a prescribed series of driving maneuvers through real time data logging and post-test questionnaires. A conventional steering wheel with a robust sliding mode controller was used for all the driving events for comparison. Test subjects operated these interfaces for a given track comprised of a double lane-change maneuver and a country road driving event. Subjective and objective results demonstrate that the driver’s experience can be enhanced up to 75.3% with a robotic steering input when compared to the traditional steering wheel during extreme maneuvers such as high-speed driving and sharp turn (e.g., hairpin turn) passing. Second, a cellphone-inspired portable human-machine-interface (HMI) that incorporated the directional control of the vehicle as well as the brake and throttle functionality into a single holistic device will be presented. A nonlinear adaptive control technique and an optimal control approach based on driver intent were also proposed to accompany the mechatronic system for combined longitudinal and lateral vehicle guidance. Assisting the disabled drivers by excluding extensive arm and leg movements ergonomically, the device has been tested in a driving simulator platform. Human test subjects evaluated the mechatronic system with various control configurations through obstacle avoidance and city road driving test, and a conventional set of steering wheel and pedals were also utilized for comparison. Subjective and objective results from the tests demonstrate that the mobile driving interface with the proposed control scheme can enhance the driver’s performance by up to 55.8% when compared to the traditional driving system during aggressive maneuvers. The system’s superior performance during certain vehicle maneuvers and approval received from the participants demonstrated its potential as an alternative driving adaptation for disabled drivers. Third, a novel strategy is designed for trajectory control of a multi-section continuum robot in three-dimensional space to achieve accurate orientation, curvature, and section length tracking. The formulation connects the continuum manipulator dynamic behavior to a virtual discrete-jointed robot whose degrees of freedom are directly mapped to those of a continuum robot section under the hypothesis of constant curvature. Based on this connection, a computed torque control architecture is developed for the virtual robot, for which inverse kinematics and dynamic equations are constructed and exploited, with appropriate transformations developed for implementation on the continuum robot. The control algorithm is validated in a realistic simulation and implemented on a six degree-of-freedom two-section OctArm continuum manipulator. Both simulation and experimental results show that the proposed method could manage simultaneous extension/contraction, bending, and torsion actions on multi-section continuum robots with decent tracking performance (e.g. steady state arc length and curvature tracking error of 3.3mm and 130mm-1, respectively). Last, semi-autonomous vehicles equipped with assistive control systems may experience degraded lateral behaviors when aggressive driver steering commands compete with high levels of autonomy. This challenge can be mitigated with effective operator intent recognition, which can configure automated systems in context-specific situations where the driver intends to perform a steering maneuver. In this article, an ensemble learning-based driver intent recognition strategy has been developed. A nonlinear model predictive control algorithm has been designed and implemented to generate haptic feedback for lateral vehicle guidance, assisting the drivers in accomplishing their intended action. To validate the framework, operator-in-the-loop testing with 30 human subjects was conducted on a steer-by-wire platform with a virtual reality driving environment. The roadway scenarios included lane change, obstacle avoidance, intersection turns, and highway exit. The automated system with learning-based driver intent recognition was compared to both the automated system with a finite state machine-based driver intent estimator and the automated system without any driver intent prediction for all driving events. Test results demonstrate that semi-autonomous vehicle performance can be enhanced by up to 74.1% with a learning-based intent predictor. The proposed holistic framework that integrates human intelligence, machine learning algorithms, and vehicle control can help solve the driver-system conflict problem leading to safer vehicle operations

Remote robot manipulator coupled with remote-controlled guide vehicle for soil sampling in hazardous waste sites

The important initial step for remediation of hazardous waste is contaminant analysis since the cleanup operation can not begin until the contaminants in hazardous waste sites have been clearly identified. Ames Laboratory, one of the U.S. Department of Energy sites, has developed a robotic sampling system for automation of real-time contaminant analysis in situ which will provide the advantage of lowering the cost per sample, eliminating personnel exposure to hazardous environments, and allowing quicker results. Successful accomplishment of real-time contaminant analysis will require a remote manipulator to perform the sampling tasks in remote and unstructured surroundings, and a remote-controlled guide vehicle to move a remote manipulator into the desired sampling location;This thesis focuses on the design and construction of a remote-controlled guide vehicle to move the robotic sampling system into the contaminated field to obtain soil samples at the desired locations, the development of an integrated dynamic model of a remote manipulator, the identification of dynamic parameters in the integrated dynamic model, and the design of a mobile robotic sampling system. A four-wheeled vehicle prototype has been constructed and its performance tested manually in the field to verify the design requirements. To remotely control the vehicle, mechanical requirements to activate the brake, throttle, transmission, and steering linkages were determined based on experimental results. A teleoperated control utilizing hundred feet long umbilical cords was first employed to remotely control the vehicle. Next, the vehicle was modified to remotely operate in the field by radio control without the aid of long umbilical cords, satisfying all the design specifications;To reduce modeling error in the robotic system, the integrated dynamic system comprised of a remote manipulator (located on a trailer pulled by the remote-controlled guide vehicle) and its drive system has been modeled. The friction model as a function of velocity is included. The dynamic parameters such as velocity-dependent friction and gravity torque in the integrated dynamic model have been determined based on experimental results;Finally, a robotic arm, a sampling tool, and a soil recovery fixture for a mobile robotic sampling system to be mounted on the remote-controlled guide vehicle have been designed and analyzed. The integrated dynamic model for the robotic arm (mounted on the remote-controlled guide vehicle) and its drive system has also been developed

Tactile sensors for robot handling

First and second generation robots have been used cost effectively in high‐volume ‘fixed’ or ‘hard’ automated manufacturing/assembly systems. They are ‘limited‐ability’ devices using simple logic elements or primitive sensory feedback. However, in the unstructured environment of most manufacturing plants it is often necessary to locate, identify, orientate and position randomly presented components. Visual systems have been researched and developed to provide a coarse resolution outline of objects. More detailed and precise definition of parts is usually obtained by high resolution tactile sensing arrays. This paper reviews and discusses the current state of the art in tactile sensing

Mechatronics of systems with undetermined configurations

This work is submitted for the award of a PhD by published works. It deals with some of the efforts of the author over the last ten years in the field of Mechatronics. Mechatronics is a new area invented by the Japanese in the late 1970's, it consists of a synthesis of computers and electronics to improve mechanical systems. To control any mechanical event three fundamental features must be brought together: the sensors used to observe the process, the control software, including the control algorithm used and thirdly the actuator that provides the stimulus to achieve the end result. Simulation, which plays such an important part in the Mechatronics process, is used in both in continuous and discrete forms. The author has spent some considerable time developing skills in all these areas. The author was certainly the first at Middlesex to appreciate the new developments in Mechatronics and their significance for manufacturing. The author was one of the first mechanical engineers to recognise the significance of the new transputer chip. This was applied to the LQG optimal control of a cinefilm copying process. A 300% improvement in operating speed was achieved, together with tension control. To make more efficient use of robots they have to be made both faster and cheaper. The author found extremely low natural frequencies of vibration, ranging from 3 to 25 Hz. This limits the speed of response of existing robots. The vibration data was some of the earliest available in this field, certainly in the UK. Several schemes have been devised to control the flexible robot and maintain the required precision. Actuator technology is one area where mechatronic systems have been the subject of intense development. At Middlesex we have improved on the Aexator pneumatic muscle actuator, enabling it to be used with a precision of about 2 mm. New control challenges have been undertaken now in the field of machine tool chatter and the prevention of slip. A variety of novel and traditional control algorithms have been investigated in order to find out the best approach to solve this problem

Estimating Exerted Hand Force via Force Myography to Interact with a Biaxial Stage in Real-Time by Learning Human Intentions: A Preliminary Investigation

Force myography (FMG) signals can read volumetric changes of muscle movements, while a human participant interacts with the environment. For collaborative activities, FMG signals could potentially provide a viable solution to controlling manipulators. In this paper, a novel method to interact with a two-degree-of-freedom (DoF) system consisting of two perpendicular linear stages using FMG is investigated. The method consists in estimating exerted hand forces in dynamic arm motions of a participant using FMG signals to provide velocity commands to the biaxial stage during interactions. Five different arm motion patterns with increasing complexities, i.e., “x-direction”, “y-direction”, “diagonal”, “square”, and “diamond”, were considered as human intentions to manipulate the stage within its planar workspace. FMG-based force estimation was implemented and evaluated with a support vector regressor (SVR) and a kernel ridge regressor (KRR). Real-time assessments, where 10 healthy participants were asked to interact with the biaxial stage by exerted hand forces in the five intended arm motions mentioned above, were conducted. Both the SVR and the KRR obtained higher estimation accuracies of 90–94% during interactions with simple arm motions (x-direction and y-direction), while for complex arm motions (diagonal, square, and diamond) the notable accuracies of 82–89% supported the viability of the FMG-based interactive control

NASA patent abstracts bibliography: A continuing bibliography. Section 1: Abstracts (supplement 29)

Abstracts are provided for 115 patents and patent applications entered into the NASA scientific and technical information system during the period January 1986 through June 1986. Each entry consists of a citation, an abstract, and in most cases, a key illustration selected from the patent application