Kinematic Visual Servo Control of a Quadrotor aerial vehicle

Visual systems are key sensors for control of small scale unmanned aerial vehicles. In this paper we investigate a range of image based visual servo control algorithms for positioning of flying vehicles capable of hover. The image based outer control loop for translation kinematics is coupled to a high-gain inner control loop that regulates translational velocities and full attitude dynamics. Zero and first order image moments are used as visual features for the control design. Perspective projection moments with suitable scaling along with a classical image based visual servo control design lead to satisfactory transients and asymptotic stability of the closed-loop system when the image plane remains parallel to the target. However, the system response may lack robustness for aggressive manoeuvres. In order to overcome this problem, several control schemes, based on spherical image moments, are designed and their performance is analysed. All designed control laws have been tested on a kinematic robotic manipulator to demonstrate the relative strengths and weaknesses of thedifferent image based visual servo control designs. The three most promising control algorithms have been successfully implemented on an autonomous aerial vehicle showing excellent performances in all three cases

Image-based visual servo control of the translation kinematics of a quadrotor aerial vehicle

International audienceIn this paper, we investigate a range of image-based visual servo control algorithms for regulation of the position of a quadrotor aerial vehicle. The most promising control algorithms have been successfully implemented on an autonomous aerial vehicle and demonstrate excellent performance

Asymptotic Vision-Based Tracking Control of the Quadrotor Aerial Vehicle

This paper proposes an image-based visual servo (IBVS) controller for the 3D translational motion of the quadrotor unmanned aerial vehicle (UAV). The main purpose of this paper is to provide asymptotic stability for vision-based tracking control of the quadrotor in the presence of uncertainty in the dynamic model of the system. The aim of the paper also includes the use of ow of image features as the velocity information to compensate for the unreliable linear velocity data measured by accelerometers. For this purpose, the mathematical model of the quadrotor is presented based on the optic ow of image features which provides the possibility of designing a velocity-free IBVS controller with considering the dynamics of the robot. The image features are de ned from a suitable combination of perspective image moments without using the model of the object. This property allows the application of the proposed controller in unknown places. The controller is robust with respect to the uncertainties in the transla- tional dynamics of the system associated with the target motion, image depth and external disturbances. Simulation results and a comparison study are presented which demonstrate the e ectiveness of the proposed approach

A hybrid switched reactive-based visual servo control of 5-DOF robot manipulators for pick-and-place tasks

[[notice]]補正完

Visual Servoing

International audienceThis chapter introduces visual servo control, using computer vision data in the servo loop to control the motion of a robot. We first describe the basic techniques that are by now well established in the field. We give a general overview of the formulation of the visual servo control problem, and describe the two archetypal visual servo control schemes: image-based and pose-based visual servo control. We then discuss performance and stability issues that pertain to these two schemes, motivating advanced techniques. Of the many advanced techniques that have been developed , we discuss 2.5-D, hybrid, partitioned, and switched approaches. Having covered a variety of control schemes, we deal with target tracking and controlling motion directly in the joint space and extensions to under-actuated ground and aerial robots. We conclude by describing applications of visual ser-voing in robotics

Asymptotic Vision-Based Tracking Control of the Quadrotor Aerial Vehicle

This paper proposes an image-based visual servo (IBVS) controller for the 3D translational motion of the quadrotor unmanned aerial vehicle (UAV). The main purpose of this paper is to provide asymptotic stability for vision-based tracking control of the quadrotor in the presence of uncertainty in the dynamic model of the system. The aim of the paper also includes the use of ow of image features as the velocity information to compensate for the unreliable linear velocity data measured by accelerometers. For this purpose, the mathematical model of the quadrotor is presented based on the optic ow of image features which provides the possibility of designing a velocity-free IBVS controller with considering the dynamics of the robot. The image features are de ned from a suitable combination of perspective image moments without using the model of the object. This property allows the application of the proposed controller in unknown places. The controller is robust with respect to the uncertainties in the transla- tional dynamics of the system associated with the target motion, image depth and external disturbances. Simulation results and a comparison study are presented which demonstrate the e ectiveness of the proposed approach

Output Feedback Image-Based Visual Servoing of Rotorcrafts

© 2018, Springer Nature B.V. This paper presents an improved output feedback based image-based visual servoing (IBVS) law for rotorcraft unmanned aerial vehicles (RUAVs). The control law enables a RUAV with a minimal set of sensors, i.e. an inertial measurement unit (IMU) and a single downward facing camera, to regulate its position and heading relative to a planar visual target consisting of multiple points. As compared to our previous work, twofold improvement is made. First, the desired value of the image feature of controlling the vertical motion of the RUAV is a function of other image features instead of a constant. This modification helps to keep the visual target stay in the camera’s field of view by indirectly adjusting the height of the vehicle. Second, the proposed approach simplifies our previous output feedback law by reducing the dimension of the observer filter state space while the same asymptotic stability result is kept. Both simulation and experimental results are presented to demonstrate the performance of the proposed controller

Grasping, Perching, And Visual Servoing For Micro Aerial Vehicles

Micro Aerial Vehicles (MAVs) have seen a dramatic growth in the consumer market because of their ability to provide new vantage points for aerial photography and videography. However, there is little consideration for physical interaction with the environment surrounding them. Onboard manipulators are absent, and onboard perception, if existent, is used to avoid obstacles and maintain a minimum distance from them. There are many applications, however, which would benefit greatly from aerial manipulation or flight in close proximity to structures. This work is focused on facilitating these types of close interactions between quadrotors and surrounding objects. We first explore high-speed grasping, enabling a quadrotor to quickly grasp an object while moving at a high relative velocity. Next, we discuss planning and control strategies, empowering a quadrotor to perch on vertical surfaces using a downward-facing gripper. Then, we demonstrate that such interactions can be achieved using only onboard sensors by incorporating vision-based control and vision-based planning. In particular, we show how a quadrotor can use a single camera and an Inertial Measurement Unit (IMU) to perch on a cylinder. Finally, we generalize our approach to consider objects in motion, and we present relative pose estimation and planning, enabling tracking of a moving sphere using only an onboard camera and IMU