A sliding mode approach to visual motion estimation

The problem of estimating motion from a sequence of images has been a major research theme in machine vision for many years and remains one of the most challenging ones. In this work, we use sliding mode observers to estimate the motion of a moving body with the aid of a CCD camera. We consider a variety of dynamical systems which arise in machine vision applications and develop a novel identication procedure for the estimation of both constant and time varying parameters. The basic procedure introduced for parameter estimation is to recast image feature dynamics linearly in terms of unknown parameters and construct a sliding mode observer to produce asymptotically correct estimates of the observed image features, and then use “equivalent control” to explicitly compute parameters. Much of our analysis has been substantiated by computer simulations and real experiments

Three-dimensional structure from motion recovery of a moving object with noisy measurement

In this paper, a Nonlinear Unknown Input Observer (NLUIO) based approach is proposed for three-dimensional (3-D) structure from motion identification. Unlike the previous studies that require prior knowledge of either the motion parameters or scene geometry, the proposed approach assumes that the object motion is imperfectly known and considered as an unknown input to the perspective dynamical system. The reconstruction of the 3-D structure of the moving objects can be achieved using just two-dimensional (2-D) images of a monocular vision system. The proposed scheme is illustrated with a numerical example in the presence of measurement noise for both static and dynamic scenes. Those results are used to clearly demonstrate the advantages of the proposed NLUIO

Vision-based Autonomous Tracking of a Non-cooperative Mobile Robot by a Low-cost Quadrotor Vehicle

The goal of this thesis is the detection and tracking of a ground vehicle, in particular a car-like robot, by a quadrotor. The first challenge to address in any pursuit or tracking scenario is the detection and unique identification of the target. From this first challenge, comes the need to precisely localize the target in a coordinate system that is common to the tracking and tracked vehicles. In most real-life scenarios, the tracked vehicle does not directly communicate information such as its position to the tracking one. From this fact, arises a non-cooperative constraint problem. The autonomous tracking aspect of the mission requires, for both the aerial and ground vehicles, robust pose estimation during the mission. The primary and crucial functions to achieve autonomous behaviors are control and navigation. The principal-agent being the quadrotor, this thesis explains in detail the derivation and analysis of the equations of motion that govern its natural behavior along with the control methods that permit to achieve desired performances. The analysis of these equations reveals a naturally unstable system, subject to non-linearities. Therefore, we explored three different control methods capable of guaranteeing stability while mitigating non-linearities. The first two control methods operate in the linear region and consist of the intuitive Proportional Integrate Derivative controller (PID). The second linear control strategy is represented by an optimal controller that is the Linear Quadratic Regulator controller (LQR). The last and final control method is a nonlinear controller designed from the Sliding Mode Control Theory. In addition to the in-depth analysis, we provide assets and limitations of each control method. In order to achieve the tracking mission, we address the detection and localization problems using respectively visual servoing and frame transform techniques. The pose estimation challenge for the aerial robot is cleared up using Kalman Filtering estimation methods that are also explored in depth. The same estimation method is used to mitigate the ground vehicle’s real-time pose estimation and tracking problem. Analysis results are illustrated using Matlab. A simulation and a real implementation using the Robot Operating System are used to support the obtained results

Vision-based control of multi-agent systems

Scope and Methodology of Study: Creating systems with multiple autonomous vehicles places severe demands on the design of decision-making supervisors, cooperative control schemes, and communication strategies. In last years, several approaches have been developed in the literature. Most of them solve the vehicle coordination problem assuming some kind of communications between team members. However, communications make the group sensitive to failure and restrict the applicability of the controllers to teams of friendly robots. This dissertation deals with the problem of designing decentralized controllers that use just local sensor information to achieve some group goals.Findings and Conclusions: This dissertation presents a decentralized architecture for vision-based stabilization of unmanned vehicles moving in formation. The architecture consists of two main components: (i) a vision system, and (ii) vision-based control algorithms. The vision system is capable of recognizing and localizing robots. It is a model-based scheme composed of three main components: image acquisition and processing, robot identification, and pose estimation.Using vision information, we address the problem of stabilizing groups of mobile robots in leader- or two leader-follower formations. The strategies use relative pose between a robot and its designated leader or leaders to achieve formation objectives. Several leader-follower formation control algorithms, which ensure asymptotic coordinated motion, are described and compared. Lyapunov's stability theory-based analysis and numerical simulations in a realistic tridimensional environment show the stability properties of the control approaches

A comparative study of the extended Kalman filter and sliding mode observer for orbital determination for formation flying about the L(2) Lagrange point

Two nonlinear state estimation techniques, the Sliding Mode Observer and the Extended Kalman Filter, are compared in terms of their ability to provide accurate relative position and velocity estimates for a formation flying mission about the Earth/Moon - Sun L2 libration point. The observers are individually tested on the NASA Constellation X simulation model. Constellation X is a proposed x-ray telescope mission, where formation flying spacecraft was considered as a possible mission scenario. A follower spacecraft is controlled to maintain a fixed distance (50 meters) from a leader spacecraft to with 1 millimeter accuracy. The state estimates propagated by each observer were of sufficient accuracy to maintain the required separation distance to within mission design requirements. For these particular formations of the Extended Kalman Filter and the Sliding Mode Observer, the Extended Kalman Filter is shown to be less sensitive to measurement noise levels, and the Sliding Mode Observer is shown to be less sensitive to input disturbances. There is no overall significant difference in sensitivity to parametric uncertainties between observers

Spatial frequency tuning of the Ouchi illusion and its dependence on stimulus size

AbstractThis study investigated the effects of the stimulus size on the spatial frequency tuning of the Ouchi illusion, which is an illusory sliding motion perceived in a checkerboard pattern of rectangular elements that is surrounded by a checkerboard pattern of orthogonally oriented elements. Two experiments were conducted to measure the perceived strength of illusion. The optimal size of the inner pattern increased proportionally with check size. In contrast, the optimal check size increased with the size of the inner pattern but not proportionally, and the range of increase was relatively small. The optimal fundamental spatial frequency was lower for a larger stimulus both for checkerboard patterns and simpler sinusoidal grating patterns, but there were differences in the tuning curves for the two types of stimuli. These results support the idea that two processes underlie the Ouchi illusion; one computes the local motion direction, and the other integrates motion signals across space for surface segmentation. For the checkerboard and grating stimuli, the former process may be different while the latter can be shared

Robust motion control of nonlinear quadrotor model with wind disturbance observer

This paper focuses on robust wind disturbance rejection for nonlinear quadrotor models. By leveraging on nonlinear unknown observer theory, it proposes a nonlinear dynamic filter that, using sensors already on-board the aircraft, can estimate in real-time wind gust signals in the three dimensions. The wind disturbance is then treated as input to the PD controller for a quick and robust flight pathway in presence of disturbances. With this scheme, the wind disturbance can be precisely estimated online and compensated in real-time. Hence, the quadrotor can successfully reach its desired attitude and position. To show the effective and desired performance of the method, simulation results are presented in Matlab/Simulink and ROS-enabled Gazebo platform

Decentralized sliding mode control and estimation for large-scale systems

This thesis concerns the development of an approach of decentralised robust control and estimation for large scale systems (LSSs) using robust sliding mode control (SMC) and sliding mode observers (SMO) theory based on a linear matrix inequality (LMI) approach. A complete theory of decentralized first order sliding mode theory is developed. The main developments proposed in this thesis are: The novel development of an LMI approach to decentralized state feedback SMC. The proposed strategy has good ability in combination with other robust methods to fulfill specific performance and robustness requirements. The development of output based SMC for large scale systems (LSSs). Three types of novel decentralized output feedback SMC methods have been developed using LMI design tools. In contrast to more conventional approaches to SMC design the use of some complicated transformations have been obviated. A decentralized approach to SMO theory has been developed focused on the Walcott-Żak SMO combined with LMI tools. A derivation for bounds applicable to the estimation error for decentralized systems has been given that involves unknown subsystem interactions and modeling uncertainty. Strategies for both actuator and sensor fault estimation using decentralized SMO are discussed.The thesis also provides a case study of the SMC and SMO concepts applied to a non-linear annealing furnace system modelderived from a distributed parameter (partial differential equation) thermal system. The study commences with a lumped system decentralised representation of the furnace derived from the partial differential equations. The SMO and SMC methods derived in the thesis are applied to this lumped parameter furnace model. Results are given demonstrating the validity of the methods proposed and showing a good potential for a valuable practical implementation of fault tolerant control based on furnace temperature sensor faults