IONet: Learning to Cure the Curse of Drift in Inertial Odometry

Inertial sensors play a pivotal role in indoor localization, which in turn lays the foundation for pervasive personal applications. However, low-cost inertial sensors, as commonly found in smartphones, are plagued by bias and noise, which leads to unbounded growth in error when accelerations are double integrated to obtain displacement. Small errors in state estimation propagate to make odometry virtually unusable in a matter of seconds. We propose to break the cycle of continuous integration, and instead segment inertial data into independent windows. The challenge becomes estimating the latent states of each window, such as velocity and orientation, as these are not directly observable from sensor data. We demonstrate how to formulate this as an optimization problem, and show how deep recurrent neural networks can yield highly accurate trajectories, outperforming state-of-the-art shallow techniques, on a wide range of tests and attachments. In particular, we demonstrate that IONet can generalize to estimate odometry for non-periodic motion, such as a shopping trolley or baby-stroller, an extremely challenging task for existing techniques.Comment: To appear in AAAI18 (Oral

An Adaptive Human Activity-Aided Hand-Held Smartphone-Based Pedestrian Dead Reckoning Positioning System

Pedestrian dead reckoning (PDR), enabled by smartphones’ embedded inertial sensors, is widely applied as a type of indoor positioning system (IPS). However, traditional PDR faces two challenges to improve its accuracy: lack of robustness for different PDR-related human activities and positioning error accumulation over elapsed time. To cope with these issues, we propose a novel adaptive human activity-aided PDR (HAA-PDR) IPS that consists of two main parts, human activity recognition (HAR) and PDR optimization. (1) For HAR, eight different locomotion-related activities are divided into two classes: steady-heading activities (ascending/descending stairs, stationary, normal walking, stationary stepping, and lateral walking) and non-steady-heading activities (door opening and turning). A hierarchical combination of a support vector machine (SVM) and decision tree (DT) is used to recognize steady-heading activities. An autoencoder-based deep neural network (DNN) and a heading range-based method to recognize door opening and turning, respectively. The overall HAR accuracy is over 98.44%. (2) For optimization methods, a process automatically sets the parameters of the PDR differently for different activities to enhance step counting and step length estimation. Furthermore, a method of trajectory optimization mitigates PDR error accumulation utilizing the non-steady-heading activities. We divided the trajectory into small segments and reconstructed it after targeted optimization of each segment. Our method does not use any a priori knowledge of the building layout, plan, or map. Finally, the mean positioning error of our HAA-PDR in a multilevel building is 1.79 m, which is a significant improvement in accuracy compared with a baseline state-of-the-art PDR system

MULTI-SENSOR LOCALIZATION AND TRACKING IN DISASTER MANAGEMENT AND INDOOR WAYFINDING FOR VISUALLY IMPAIRED USERS

This dissertation proposes a series of multi-sensor localization and tracking algorithms particularly developed for two important application domains, which are disaster management and indoor wayfinding for blind and visually impaired (BVI) users. For disaster management, we developed two different localization algorithms, one each for Radio Frequency Identification (RFID) and Bluetooth Low Energy (BLE) technology, which enable the disaster management system to track patients in real-time. Both algorithms work in the absence of any pre-deployed infrastructure along with smartphones and wearable devices. Regarding indoor wayfinding for BVI users, we have explored several types of indoor positioning techniques including BLE-based, inertial, visual and hybrid approaches to offer accurate and reliable location and orientation in complex navigation spaces. In this dissertation, significant contributions have been made in the design and implementation of various localization and tracking algorithms under different requirements of certain applications

Entwicklung und Implementierung eines Peer-to-Peer Kalman Filters für Fußgänger- und Indoor-Navigation

Smartphones are an integral part of our society by now. They are used for messaging, searching the Internet, working on documents, and of course for navigation. Although smartphones are also used for car navigation their main area of application is pedestrian navigation. Almost all smartphones sold today comprise a GPS L1 receiver which provides position computation with accuracy between 1 and 10 m as long as the environment in beneficial, i.e. the line-of-sight to satellites is not obstructed by trees or high buildings. But this is often the case in areas where smartphones are used primarily for navigation. Users walk in narrow streets with high density, in city centers, enter, and leave buildings and the smartphone is not able to follow their movement because it loses satellite signals. The approach presented in this thesis addresses the problem to enable seamless navigation for the user independently of the current environment and based on cooperative positioning and inertial navigation. It is intended to realize location-based services in areas and buildings with limited or no access to satellite data and a large amount of users like e.g. shopping malls, city centers, airports, railway stations and similar environments. The idea of this concept was for a start based on cooperative positioning between users’ devices denoted here as peers moving within an area with only limited access to satellite signals at certain places (windows, doors) or no access at all. The devices are therefore not able to provide a position by means of satellite signals. Instead of deploying solutions based on infrastructure, surveying, and centralized computations like range measurements, individual signal strength, and similar approaches a decentralized concept was developed. This concept suggests that the smartphone automatically detects if no satellite signals are available and uses its already integrated inertial sensors like magnetic field sensor, accelerometer, and gyroscope for seamless navigation. Since the quality of those sensors is very low the accuracy of the position estimation decreases with each step of the user. To avoid a continuously growing bias between real position and estimated position an update has to be performed to stabilize the position estimate. This update is either provided by the computation of a position based on satellite signals or if signals are not available by the exchange of position data with another peer in the near vicinity using peer-to-peer ad-hoc networks. The received and the own position are processed in a Kalman Filter algorithm and the result is then used as new position estimate and new start position for further navigation based on inertial sensors. The here presented concept is therefore denoted as Peer-to-Peer Kalman Filter (P2PKF)

Context Detection, Categorization and Connectivity for Advanced Adaptive Integrated Navigation

Context is the environment that a navigation system operates in and the behaviour of its host vehicle or user. The type and quality of signals and environmental features available for positioning varies with the environment. For example, GNSS provides high-quality positioning in open environments, low-quality positioning in dense urban environments and no solution at all deep indoors. The behaviour of the host vehicle (or pedestrian) is also important. For example, pedestrian, car and train navigation all require different map-matching techniques, different motion constraints to limit inertial navigation error growth, and different dynamic models in a navigation filter [1]. A navigation system design should therefore be matched to its context. However, the context can change, particularly for devices, such as smartphones, which move between indoor and outdoor environments and can be stationary, on a pedestrian, or in a vehicle. For best performance, a navigation system should therefore be able to detect its operating context and adapt accordingly; this is context-adaptive positioning [1]. Previous work on context-adaptive navigation and positioning has focused on individual subsystems. For example, there has been substantial research into determining the motion type and sensor location for pedestrian dead reckoning using step detection [2-4]. Researchers have also begun to investigate context-adaptive (or cognitive) GNSS [5-7]. However, this paper considers context adaptation across an integrated navigation system as a whole. The paper addresses three aspects of context-adaptive integrated navigation: context detection, context categorization and context connectivity. It presents experimental results showing how GNSS C/N0 measurements, frequency-domain MEMS inertial sensor measurements and Wi-Fi signal availability could be used to detect both the environmental and behavioural contexts. It then looks at how context information could be shared across the different components of an integrated navigation system. Finally, the concept of context connectivity is introduced to improve the reliability of context detection. GNSS C/N0 measurement distributions, obtained using a smartphone, and Wi-Fi reception data collected over a range of indoor, urban and open environments will be compared to identify suitable features from which the environmental context may be derived. In an open environment, strong GNSS signals will be received from all directions. In an urban environment, fewer strong signals will be received and only from certain directions. Inside a building, nearly all GNSS signals will be much weaker than outside. Wi-Fi signals essentially vary with the environment in the opposite way to GNSS. Indoors, more access points (APs) can be received at higher signal strengths and there is greater variation in RSS. In urban environments, large numbers of APs can still be received, but at lower signal strengths [6]. Finally, in open environments, few APs, if any, will be received. Behavioural context is studied using an IMU. Although an Xsens MEMS IMU is used in this study, smartphone inertial sensors are also suitable. Pedestrian, car and train data has been collected under a range of different motion types and will be compared to identify context-dependent features. Early indications are that, as well as detecting motion, it is also possible to distinguish nominally-stationary IMUs that are placed in a car, on a person or on a table from the frequency spectra of the sensor measurements. The exchange of context information between subsystems in an integrated navigation system requires agreement on the definitions of those contexts. As different subsystems are often supplied by different organisations, it is desirable to standardize the context definitions across the whole navigation and positioning community. This paper therefore proposes a framework upon which a “context dictionary” could be constructed. Environmental and behavioural contexts are categorized separately and a hierarchy of attributes is proposed to enable some subsystems to work with highly specific context categories and others to work with broader categories. Finally, the concept of context connectivity is introduced. This is analogous to the road link connectivity used in map matching [8]. As context detection involves the matching of measurement data to stored context profiles, there will always be occurrences of false or ambiguous context identification. However, these may be minimized by using the fact that it is only practical to transition directly between certain pairs of contexts. For example, it is not normally possible to move directly from an airborne to an indoor environment as an aircraft must land first. Thus, the air and land contexts are connected, as are the land and indoor contexts, but the air and indoor contexts are not. Thus, by only permitting contexts that are connected to the previous context, false and ambiguous context detection is reduced. Robustness may be further enhanced by considering location-dependent connectivity. For example, people normally board and leave trains at stations and fixed-wing aircraft typically require an airstrip to take off and land. / References [1] Groves, P. D., Principles of GNSS, inertial, and multi-sensor integrated navigation systems, Second Edition, Artech House, 2013. [2] Park, C. G., et al., “Adaptive Step Length Estimation with Awareness of Sensor Equipped Location for PNS,” Proc. ION GNSS 2007. [3] Frank, K., et al., “Reliable Real-Time Recognition of Motion Related Human Activities Using MEMS Inertial Sensors,” Proc. ION GNSS 2010. [4] Pei, L., et al., “Using Motion-Awareness for the 3D Indoor Personal Navigation on a Smartphone,” Proc. ION GNSS 2011. [5] Lin, T., C. O’Driscoll, and G. Lachapelle, “Development of a Context-Aware Vector-Based High-Sensitivity GNSS Software Receiver,” Proc. ION ITM 2011. [6] Shafiee, M., K., O’Keefe, and G. Lachapelle, “Context-aware Adaptive Extended Kalman Filtering Using Wi-Fi Signals for GPS Navigation,” Proc. ION GNSS 2011. [7] Shivaramaiah, N. C., and A. G. Dempster, “Cognitive GNSS Receiver Design: Concept and Challenges,” Proc. ION GNSS 2011. [8] Quddus, M. A., High Integrity Map Matching Algorithms for Advanced Transport Telematics Applications, PhD Thesis, Imperial College London, 2006

Algorithms for Autonomous Personal Navigation Systems

Personal positioning is a challenging topic in the area of navigation mainly because of the cost, size and power consumption constraints imposed on the hardware. Satellite based positioning techniques can meet the requirements for many applications, but cover well only outdoor environment. Problems like weak satellite signals make the positioning impossible indoors. Urban canyons are also difficult areas for GNSS based navigation because of large multipath errors and satellite signal outages. Many applications require seamless positioning in all environments. However, there is no overall solution for navigation in GNSS denied environment, which is reliable, accurate, cost effective and quickly installed. Recently developed systems for indoor positioning often require pre-installed infrastructure. Another approach is to use fully autonomous navigation systems based on self-contained sensors and street or indoor maps. This thesis is concerned with autonomous personal navigation devices, which do not rely on the reception of external information, like satellite or terrestrial signals. The three proposed algorithms can be integrated into personal navigation systems. The first algorithm computes positioning for a map aided navigation system designed for land vehicles traveling on road network. The novelty is in application of particle filtering to vehicle navigation using road network database. The second algorithm is aimed at map aided vehicle navigation indoors. The novelty is in the method for correction of position and heading. The third algorithm computes solution for pedestrian navigation system, which is based on body mounted inertial measurement unit and models of human gait