Research on Visual Servo Grasping of Household Objects for Nonholonomic Mobile Manipulator

This paper focuses on the problem of visual servo grasping of household objects for nonholonomic mobile manipulator. Firstly, a new kind of artificial object mark based on QR (Quick Response) Code is designed, which can be affixed to the surface of household objects. Secondly, after summarizing the vision-based autonomous mobile manipulation system as a generalized manipulator, the generalized manipulator’s kinematic model is established, the analytical inverse kinematic solutions of the generalized manipulator are acquired, and a novel active vision based camera calibration method is proposed to determine the hand-eye relationship. Finally, a visual servo switching control law is designed to control the service robot to finish object grasping operation. Experimental results show that QR Code-based artificial object mark can overcome the difficulties brought by household objects’ variety and operation complexity, and the proposed visual servo scheme makes it possible for service robot to grasp and deliver objects efficiently

Redundant Hybrid Cable-Driven Robots: Modeling, Control, and Analysis

Serial and Cable-Driven Parallel Robots (CDPRs) are two types of robots that are widely used in industrial applications. Usually, the former offers high position accuracy at the cost of high motion inertia and small workspace envelope. The latter has a large workspace, low motion inertia, and high motion accelerations, but low accuracy. In this thesis, redundant Hybrid Cable-Driven Robots (HCDRs) are proposed to harness the strengths and benefits of serial and CDPRs. Although the study has been directed at warehousing applications, the developed techniques are general and can be applied to other applications. The main goal of this research is to develop integrated control systems to reduce vibrations and improve the position accuracy of HCDRs. For the proposed HCDRs, the research includes system modeling, redundancy resolution, optimization problem formulation, integrated control system development, and simulation and experimental validation. In this thesis, first, a generalized HCDR is proposed for the step-by-step derivation of a generic model, and it can be easily extended to any HCDRs. Then, based on an in-plane configuration, three types of control architecture are proposed to reduce vibrations and improve the position accuracy of HCDR. Their performance is evaluated using several well-designed case studies. Furthermore, a stiffness optimization algorithm is developed to overcome the limitations of existing approaches. Decoupled system modeling is studied to reduce the complexity of HCDRs. Control design, simulations, and experiments are developed to validate the models and control strategies. Additionally, state estimation algorithms are proposed to overcome the inaccurate limitation of Inertial Measurement Unit (IMU). Based on these state observers, experiments are conducted in different cases to evaluate the control performance. An Underactuated Mobile Manipulator (UMM) is proposed to address the tracking and vibration- and balance-control problems. Out-of-plane system modeling, disturbance analysis, and model validation are also investigated. Besides, a simple but effective strategy is developed to solve the equilibrium point and balancing problem. Based on the dynamic model, two control architectures are proposed. Compared to other Model Predictive Control (MPC)-based control strategies, the proposed controllers require less effort to implement in practice. Simulations and experiments are also conducted to evaluate the model and control performance. Finally, redundancy resolution and disturbance rejection via torque optimization in HCDRs are proposed: joint-space Torque Optimization for Actuated Joints (TOAJ) and joint-space Torque Optimization for Actuated and Unactuated Joints (TOAUJ). Compared to TOAJ, TOAUJ can solve the redundancy resolution problem as well as disturbance rejection. The algorithms are evaluated using a Three-Dimensional (3D) coupled HCDR and can also be extended to other HCDRs

Stability and robustness of adaptive controllers for underactuated Lagrangian systems and robotic networks

This dissertation studies the stability and robustness of an adaptive control framework for underactuated Lagrangian systems and robotic networks. In particular, an adaptive control framework is designed for a manipulator, which operates on an underactuated dynamic platform. The framework promotes the use of a filter in the control input to improve the system robustness. The characteristics of the controller are represented by two decoupled indicators. First, the adaptation gain determines the rate of adaptation, as well as the deviation between the adaptive control system and a nonadaptive reference system governing the ideal response. Second, the filter bandwidth determines the tracking performance, as well as the system robustness. The ability of the control scheme to tolerate time delay in the control loop, which is an indicator of robustness, is explored using numerical simulations, estimation of the time-delay margin of an equivalent linear, time-invariant system, and parameter continuation for Hopf bifurcation analysis. This dissertation also performs theoretical study of the delay robustness of the control framework. The analysis shows that the controller has a positive lower bound for the time-delay margin by exploring a number of properties of delay systems, especially the continuity of their solutions in the delay, uniformly in time. In particular, if the input delay is below the lower bound, then the state and control input of the closed-loop system follow those of a nonadaptive, robust reference system closely. A method for computing the lower bound for the delay robustness using a Pad\'{e} approximant is proposed. The results show that the minimum delay that destabilizes the system, which may also be estimated by forward simulation, is always larger than the value computed by the proposed method. The control framework is extended to the synchronization and consensus of networked manipulators operating on an underactuated dynamic platform in the presence of communication delays. The theoretical analysis based on input-output maps of functional differential equations shows that the adaptive control system's behavior matches closely that of a nonadaptive reference system. The tracking-synchronization objective is achieved despite the effects of communication delays and unknown dynamics of the platform. When there is no desired trajectory common to the networked manipulators, a modified controller drives all robots to a consensus configuration. A further modification is proposed that allows for the control of the constant and time-varying consensus values using a leader-follower scheme. Simulation results illustrate the performance of the proposed control algorithms