Accurate 3D maps from depth images and motion sensors via nonlinear Kalman filtering

This paper investigates the use of depth images as localisation sensors for 3D map building. The localisation information is derived from the 3D data thanks to the ICP (Iterative Closest Point) algorithm. The covariance of the ICP, and thus of the localization error, is analysed, and described by a Fisher Information Matrix. It is advocated this error can be much reduced if the data is fused with measurements from other motion sensors, or even with prior knowledge on the motion. The data fusion is performed by a recently introduced specific extended Kalman filter, the so-called Invariant EKF, and is directly based on the estimated covariance of the ICP. The resulting filter is very natural, and is proved to possess strong properties. Experiments with a Kinect sensor and a three-axis gyroscope prove clear improvement in the accuracy of the localization, and thus in the accuracy of the built 3D map.Comment: Submitted to IROS 2012. 8 page

Invariant EKF Design for Scan Matching-aided Localization

Localization in indoor environments is a technique which estimates the robot's pose by fusing data from onboard motion sensors with readings of the environment, in our case obtained by scan matching point clouds captured by a low-cost Kinect depth camera. We develop both an Invariant Extended Kalman Filter (IEKF)-based and a Multiplicative Extended Kalman Filter (MEKF)-based solution to this problem. The two designs are successfully validated in experiments and demonstrate the advantage of the IEKF design

A nonlinear observer for 6 DOF pose estimation from inertial and bearing measurements

Abstract — This paper considers the problem of estimating pose from inertial and bearing-only vision measurements. We present a non-linear observer that evolves directly on the special Euclidean group SE(3) from inertial measurements and bearing measurements, such as provided by a visual system tracking known landmarks. Local asymptotic convergence of the observer is proved. The observer is computationally simple and its gains are easy to tune. Simulation results demonstrate robustness to measurement noise and initial conditions

FREQUENCY DOMAIN CHARACTERIZATION OF OPTIC FLOW AND VISION-BASED OCELLAR SENSING FOR ROTATIONAL MOTION

The structure of an animal’s eye is determined by the tasks it must perform. While vertebrates rely on their two eyes for all visual functions, insects have evolved a wide range of specialized visual organs to support behaviors such as prey capture, predator evasion, mate pursuit, flight stabilization, and navigation. Compound eyes and ocelli constitute the vision forming and sensing mechanisms of some flying insects. They provide signals useful for flight stabilization and navigation. In contrast to the well-studied compound eye, the ocelli, seen as the second visual system, sense fast luminance changes and allows for fast visual processing. Using a luminance-based sensor that mimics the insect ocelli and a camera-based motion detection system, a frequency-domain characterization of an ocellar sensor and optic flow (due to rotational motion) are analyzed. Inspired by the insect neurons that make use of signals from both vision sensing mechanisms, advantages, disadvantages and complementary properties of ocellar and optic flow estimates are discussed

Robust Nonlinear Fusion of Inertial and Visual Data for position, velocity and attitude estimation of UAV

This paper presents a coupled observer that uses accelerometer, gyrometer and vision sensors to provide estimates of pose and linear velocity for an aerial robotic vehicle. The observer is based on a non-linear complimentary filter framework and incorporates adaptive estimates of measurement bias in gyrometers and accelerometers commonly encountered in low-cost inertial measurement systems. Asymptotic stability of the observer estimates is proved as well as bounded energy of the observer error signals. Experimental data is provided for the proposed filter run on data obtained from an experiment involving a remotely controlled helicopter

Recent Progress in Some Aircraft Technologies

The book describes the recent progress in some engine technologies and active flow control and morphing technologies and in topics related to aeroacoustics and aircraft controllers. Both the researchers and students should find the material useful in their work

Vision-based guidance and control of a hovering vehicle in unknown environments

Thesis (S.M.)--Massachusetts Institute of Technology, Dept. of Mechanical Engineering, 2008.Includes bibliographical references (leaves 115-122).This thesis presents a methodology, architecture, hardware implementation, and results of a system capable of controlling and guiding a hovering vehicle in unknown environments, emphasizing cluttered indoor spaces. Six-axis inertial data and a low-resolution onboard camera yield sufficient information for image processing, Kalman filtering, and novel mapping algorithms to generate a, high-performance estimate of vehicle motion, as well as an accurate three-dimensional map of the environment. This combination of mapping and localization enables a quadrotor vehicle to autonomously navigate cluttered, unknown environments safely. Communication limitations are considered, and a hybrid control architecture is presented to demonstrate the feasibility of combining separated proactive offboard and reactive onboard planners simultaneously, including a detailed presentation of a novel reactive obstacle avoidance algorithm and preliminary results integrating the MIT Darpa Urban Challenge planner for high-level control. The RAVEN testbed is successfully employed as a prototyping facility for rapid development of these algorithms using emulated inertial data and offboard processing as a precursor to embedded development. An analysis of computational demand and a comparison of the emulated inertial system to an embedded sensor package demonstrates the feasibility of porting the onboard algorithms to an embedded autopilot. Finally, flight results using only the single camera and emulated inertial data for closed-loop trajectory following, environment mapping, and obstacle avoidance are presented and discussed.by Spencer Greg Ahrens.S.M

Sensor-based formation control using a generalised rigidity framework and passivity techniques

The research in this thesis addresses the subject of sensor-based formation control for a network of autonomous agents. The task of formation control involves the stabilisation of the agents to a desired set of relative states, with the possible additional objective of manoeuvring the agents while maintaining this formation. Although the formation control challenge has been widely studied in the literature, many existing control strategies are based on full state information, and give little consideration to the sensor modalities available for the task. The focus of this thesis lies in the use of a generic arrangement of partial state measurements as can commonly be acquired by onboard sensors; for example, time-of-flight sensors can be used to measure the distances between vehicles, and onboard cameras can provide the bearing from one vehicle to each of the others. Particular aspects of the problem that are addressed in this thesis include (i) ways of modelling the formation control task, (ii) methods of analysing the system's behaviour, and (iii) the design of a formation control scheme based on generic arrangements of sensors that provide only partial position information. A key contribution in this thesis is a generalisation of the classical notion of rigidity, which considers the use of distance constraints between agents in R^2 or R^3 to specify a rigid body (or formation). This enables the concept of rigidity to be applied to agent networks involving a variety of (possibly non-Euclidean) state-spaces, with a generic set of state constraints that may, for example, include bearings between agents as well as distances. I demonstrate that this framework is very well-suited for modelling a wide variety of formation control problems (addressing goal (i) above), and I extend several fundamental results from classical rigidity theory in order to provide significant insight for system analysis (addressing goal (ii) above). To design a formation control scheme that uses generic partial position measurements (addressing goal (iii) above), I employ a modular passivity-based approach that is developed using the bondgraph modelling formalism. I illustrate how adaptive compensation can be incorporated into this design approach in order to account for the unknown position information that is not available from the onboard sensors. Although formation control is the subject of this thesis, it should be noted that the rigidity-based and passivity-based frameworks developed here are quite general and may be applied to a wide range of other problems