Event-based Vision: A Survey

Event cameras are bio-inspired sensors that differ from conventional frame cameras: Instead of capturing images at a fixed rate, they asynchronously measure per-pixel brightness changes, and output a stream of events that encode the time, location and sign of the brightness changes. Event cameras offer attractive properties compared to traditional cameras: high temporal resolution (in the order of microseconds), very high dynamic range (140 dB vs. 60 dB), low power consumption, and high pixel bandwidth (on the order of kHz) resulting in reduced motion blur. Hence, event cameras have a large potential for robotics and computer vision in challenging scenarios for traditional cameras, such as low-latency, high speed, and high dynamic range. However, novel methods are required to process the unconventional output of these sensors in order to unlock their potential. This paper provides a comprehensive overview of the emerging field of event-based vision, with a focus on the applications and the algorithms developed to unlock the outstanding properties of event cameras. We present event cameras from their working principle, the actual sensors that are available and the tasks that they have been used for, from low-level vision (feature detection and tracking, optic flow, etc.) to high-level vision (reconstruction, segmentation, recognition). We also discuss the techniques developed to process events, including learning-based techniques, as well as specialized processors for these novel sensors, such as spiking neural networks. Additionally, we highlight the challenges that remain to be tackled and the opportunities that lie ahead in the search for a more efficient, bio-inspired way for machines to perceive and interact with the world

Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Age

Simultaneous Localization and Mapping (SLAM)consists in the concurrent construction of a model of the environment (the map), and the estimation of the state of the robot moving within it. The SLAM community has made astonishing progress over the last 30 years, enabling large-scale real-world applications, and witnessing a steady transition of this technology to industry. We survey the current state of SLAM. We start by presenting what is now the de-facto standard formulation for SLAM. We then review related work, covering a broad set of topics including robustness and scalability in long-term mapping, metric and semantic representations for mapping, theoretical performance guarantees, active SLAM and exploration, and other new frontiers. This paper simultaneously serves as a position paper and tutorial to those who are users of SLAM. By looking at the published research with a critical eye, we delineate open challenges and new research issues, that still deserve careful scientific investigation. The paper also contains the authors' take on two questions that often animate discussions during robotics conferences: Do robots need SLAM? and Is SLAM solved

A survey of design methods for failure detection in dynamic systems

A number of methods for the detection of abrupt changes (such as failures) in stochastic dynamical systems were surveyed. The class of linear systems were emphasized, but the basic concepts, if not the detailed analyses, carry over to other classes of systems. The methods surveyed range from the design of specific failure-sensitive filters, to the use of statistical tests on filter innovations, to the development of jump process formulations. Tradeoffs in complexity versus performance are discussed

Multi-mode Tracking of a Group of Mobile Agents

We consider the problem of tracking a group of mobile nodes with limited available computational and energy resources given noisy RSSI measurements and position estimates from group members. The multilateration solutions are known for energy efficiency. However, these solutions are not directly applicable to dynamic grouping scenarios where neighbourhoods and resource availability may frequently change. Existing algorithms such as cluster-based GPS duty-cycling, individual-based tracking, and multilateration-based tracking can only partially deal with the challenges of dynamic grouping scenarios. To cope with these challenges in an effective manner, we propose a new group-based multi-mode tracking algorithm. The proposed algorithm takes the topological structure of the group as well as the availability of the resources into consideration and decides the best solution at any particular time instance. We consider a clustering approach where a cluster head coordinates the usage of resources among the cluster members. We evaluate the energy-accuracy trade-off of the proposed algorithm for various fixed sampling intervals. The evaluation is based on the 2D position tracks of 40 nodes generated using Reynolds' flocking model. For a given energy budget, the proposed algorithm reduces the mean tracking error by up to $20\%$ in comparison to the existing energy-efficient cooperative algorithms. Moreover, the proposed algorithm is as accurate as the individual-based tracking while using almost half the energy.Comment: Accepted for publication in the 20th international symposium on wireless personal multimedia communications (WPMC-2017

Real-time human ambulation, activity, and physiological monitoring:taxonomy of issues, techniques, applications, challenges and limitations

Automated methods of real-time, unobtrusive, human ambulation, activity, and wellness monitoring and data analysis using various algorithmic techniques have been subjects of intense research. The general aim is to devise effective means of addressing the demands of assisted living, rehabilitation, and clinical observation and assessment through sensor-based monitoring. The research studies have resulted in a large amount of literature. This paper presents a holistic articulation of the research studies and offers comprehensive insights along four main axes: distribution of existing studies; monitoring device framework and sensor types; data collection, processing and analysis; and applications, limitations and challenges. The aim is to present a systematic and most complete study of literature in the area in order to identify research gaps and prioritize future research directions

Development and evaluation of a Kalman-filter algorithm for terminal area navigation using sensors of moderate accuracy

Translational state estimation in terminal area operations, using a set of commonly available position, air data, and acceleration sensors, is described. Kalman filtering is applied to obtain maximum estimation accuracy from the sensors but feasibility in real-time computations requires a variety of approximations and devices aimed at minimizing the required computation time with only negligible loss of accuracy. Accuracy behavior throughout the terminal area, its relation to sensor accuracy, its effect on trajectory tracking errors and control activity in an automatic flight control system, and its adequacy in terms of existing criteria for various terminal area operations are examined. The principal investigative tool is a simulation of the system

Modeling of Inertial Rate Sensor Errors Using Autoregressive and Moving Average (ARMA) Models

In this chapter, a low-cost micro electro mechanical systems (MEMS) gyroscope drift is modeled by time series model, namely, autoregressive-moving-average (ARMA). The optimality of ARMA (2, 1) model is identified by using minimum values of the Akaike information criteria (AIC). In addition, the ARMA model based Sage-Husa adaptive fading Kalman filter algorithm (SHAFKF) is proposed for minimizing the drift and random noise of MEMS gyroscope signal. The suggested algorithm is explained in two stages: (i) an adaptive transitive factor (a1) is introduced into a predicted state error covariance for adaption. (ii) The measurement noise covariance matrix is updated by another transitive factor (a2). The proposed algorithm is applied to MEMS gyroscope signals for reducing the drift and random noise in a static condition at room temperature. The Allan variance (AV) analysis is used to identify and quantify the random noise sources of MEMS gyro signal. The performance of the suggested algorithm is analyzed using AV for static signal. The experimental results demonstrate that the proposed algorithm performs better than CKF and a single transitive factor based adaptive SHFKF algorithm for reducing the drift and random noise in the static condition

Validation and Experimental Testing of Observers for Robust GNSS-Aided Inertial Navigation

This chapter is the study of state estimators for robust navigation. Navigation of vehicles is a vast field with multiple decades of research. The main aim is to estimate position, linear velocity, and attitude (PVA) under all dynamics, motions, and conditions via data fusion. The state estimation problem will be considered from two different perspectives using the same kinematic model. First, the extended Kalman filter (EKF) will be reviewed, as an example of a stochastic approach; second, a recent nonlinear observer will be considered as a deterministic case. A comparative study of strapdown inertial navigation methods for estimating PVA of aerial vehicles fusing inertial sensors with global navigation satellite system (GNSS)-based positioning will be presented. The focus will be on the loosely coupled integration methods and performance analysis to compare these methods in terms of their stability, robustness to vibrations, and disturbances in measurements

A tripartite filter design for seamless pedestrian navigation using recursive 2-means clustering and Tukey update

Mobile devices are desired to guide users seamlessly to diverse destinations indoors and outdoors. The positioning fixing subsystems often provide poor quality measurements with gaps in an urban environment. No single position fixing technology works continuously. Many sensor fusion variations have been previously trialed to overcome this challenge, including the particle filter that is robust and the Kalman filter which is fast. However, a lack exists, of context aware, seamless systems that are able to use the most fit sensors and methods in the correct context. A novel adaptive and modular tripartite navigation filter design is presented to enable seamless navigation. It consists of a sensor subsystem, a context inference and a navigation filter blocks. A foot-mounted inertial measurement unit (IMU), a Global Navigation Satellite System (GNSS) receiver, Bluetooth Low Energy (BLE) and Ultrawideband (UWB) positioning systems were used in the evaluation implementation of this design. A novel recursive 2-means clustering method was developed to track multiple hypotheses when there are gaps in position fixes. The closest hypothesis to a new position fix is selected when the gap ends. Moreover, when the position fix quality measure is not reliable, a fusion approach using a Tukey-style particle filter measurement update is introduced. Results show the successful operation of the design implementation. The Tukey update improves accuracy by 5% and together with the clustering method the system robustness is enhanced