Step Detection Algorithm For Accurate Distance Estimation Using Dynamic Step Length

In this paper, a new Smartphone sensor based algorithm is proposed to detect accurate distance estimation. The algorithm consists of two phases, the first phase is for detecting the peaks from the Smartphone accelerometer sensor. The other one is for detecting the step length which varies from step to step. The proposed algorithm is tested and implemented in real environment and it showed promising results. Unlike the conventional approaches, the error of the proposed algorithm is fixed and is not affected by the long distance. Keywords distance estimation, peaks, step length, accelerometer.Comment: this paper contains of 5 pages and 6 figure

사용자 상황인지 딥러닝을 사용한 GPS 반송파 / 관성 센서 결합 스마트폰 보행자 항법

학위논문 (석사)-- 서울대학교 대학원 : 공과대학 기계항공공학부, 2019. 2. 여재익.본 논문에서는 스마트폰 Galaxy S8 환경에서 GPS / INS 결합 보행자 항법을 수행하였으며, 스마트폰 센서의 특성을 자세히 분석하였다. 이에 최근 공개된 Android GNSS API 를 사용하여 GPS 원시데이터를 항법에 이용하면서, Cycle slip 을 보정한 Carrier phase 를 이용한 속도 결정법을 사용하였다. 이로 인해 기존의 NMEA GPS 를 사용한 방식의 스마트폰 보행자 항법보다 정밀한 위치, 속도 항법이 가능하였고, 성능을 향상 시켰다. 또한 사용자 상황 분석이 가능한 분류 딥러닝 기법을 사용하여 각 보행 상황에 따른 분류감지가 가능하였음 보였으며, LSTM 의 입력부분을 변화한 몇가지 딥러닝 모델의 성능을 비교하였다. 이를 통해서 사용자의 보행 상황에 따른 적응적 보행자 항법 파라메터 결정이 가능함의 가능성을 보였다.In this research, the overall construction of the smartphone GPS / INS pedestrian dead reckoning system is detaily described with considering the smartphone sensor measurement properties. Also, the recent android GNSS API which can provide the raw GPS measurement is used. With carrier phase, the cycleslip compensated velocity determination is considered. As a result, the carrier phase /INS integrated pedestrian dead reckoning shows the more precise navigation accuracy than NMEA. Moreover, The deep learning approach is applied in the user context classification to change the parameters in the pedestrian dead reckoning system. The author compares the effect of several transformed inputs for the LSTM model and validate each classification performances.Abstract i Contents ii List of Figures iv List of Tables vii Chapter 1. Introduction 1 1.1 Motivation and Backgrounds 1 1.2 Research Purpose and Contribution 3 1.3 Contents and Methods of Research 3 Chapter 2. Smartphone GPS / INS measurements analysis 4 2.1 Smartphone GNSS measurements 4 2.1.1 Android Raw GNSS Measurements API 4 2.1.2 Raw GPS Measurements Properties 7 2.1.3 Smartphone NMEA Location Provider 8 2.1.4 Pseudorange Based Position Estimation 10 2.1.5 Position Determination Experiment 11 2.2 Smartphone INS Measurements 12 2.2.1 Android Sensor Manager API 12 2.2.2 INS Measurements Properties 13 2.2.3 Noise level, Constant bias, Scale factor, Calibration 14 2.2.4. Accelerometer, Gyroscope Calibration Experiment 17 2.2.5 Magnetometer Ellipse Fitting Calibration 22 2.2.6 Random Bias, Allan Variance Exiperiment 25 2.3 Developed Android Smartphone App 30 Chapter 3. Pedestrian Dead Reckoning 31 3.1 Pedestrian Dead-Reckoning System 31 3.1.1 Attitude Determination Quaternion Kalman Filter 32 3.1.2 Attitude Determination Simulation , Experiment 35 3.1.3 Walking Detection 39 3.1.4 Step Counting, Stride Length 41 3.1.5 Pedestrian Dead Reckoning Experiment 45 Chapter 4. Carrier phase / INS integrated Pedestrian Dead Reckoning 50 4.1 Carrier phase Cycleslip Compensation & Velocity Determination 50 4.1.1 Carrier phase Cycleslip Compensation 50 4.1.2 Android Environment Cycle slip Detection 51 4.1.3 False Alarm & Miss Detection Analysis 55 4.1.4 Doppler, Carrier Based Velocity Estimation 56 4.1.5 Cycle slip Compensation & Velocity Determination Experiment 58 4.2 Raw GPS / INS Integrated Pedestrian Dead Reckoning 63 4.2.1 GPS / INS Integration 63 4.2.2 Position Determination Extended Kalman Filter 65 4.2.3 Raw GPS / INS Integrated Pedestrian Dead Reckoning Experiment 66 Chapter 5. User Context Classification Deep learning for Adaptive PDR 69 5.1 Smartphone Location / Walking Context Classification 69 5.1.1 Smartphone Location / Walking Context Dataset 69 5.1.2 Deep Learning Models 71 5.1.3 Comparison of Input Transformations 72 Chapter 6. Conclusion & Future work 76 Chapter 7. Bibliography 77Maste

Finding Your Way Back: Comparing Path Odometry Algorithms for Assisted Return.

We present a comparative analysis of inertial-based odometry algorithms for the purpose of assisted return. An assisted return system facilitates backtracking of a path previously taken, and can be particularly useful for blind pedestrians. We present a new algorithm for path matching, and test it in simulated assisted return tasks with data from WeAllWalk, the only existing data set with inertial data recorded from blind walkers. We consider two odometry systems, one based on deep learning (RoNIN), and the second based on robust turn detection and step counting. Our results show that the best path matching results are obtained using the turns/steps odometry system

적분 및 매개변수 기법 융합을 이용한 스마트폰 다중 동작에서 보행 항법

학위논문 (박사) -- 서울대학교 대학원 : 공과대학 기계항공공학부, 2020. 8. 박찬국.In this dissertation, an IA-PA fusion-based PDR (Pedestrian Dead Reckoning) using low-cost inertial sensors is proposed to improve the indoor position estimation. Specifically, an IA (Integration Approach)-based PDR algorithm combined with measurements from PA (Parametric Approach) is constructed so that the algorithm is operated even in various poses that occur when a pedestrian moves with a smartphone indoors. In addition, I propose an algorithm that estimates the device attitude robustly in a disturbing situation by an ellipsoidal method. In addition, by using the machine learning-based pose recognition, it is possible to improve the position estimation performance by varying the measurement update according to the poses. First, I propose an adaptive attitude estimation based on ellipsoid technique to accurately estimate the direction of movement of a smartphone device. The AHRS (Attitude and Heading Reference System) uses an accelerometer and a magnetometer as measurements to calculate the attitude based on the gyro and to compensate for drift caused by gyro sensor errors. In general, the attitude estimation performance is poor in acceleration and geomagnetic disturbance situations, but in order to effectively improve the estimation performance, this dissertation proposes an ellipsoid-based adaptive attitude estimation technique. When a measurement disturbance comes in, it is possible to update the measurement more accurately than the adaptive estimation technique without considering the direction by adjusting the measurement covariance with the ellipsoid method considering the direction of the disturbance. In particular, when the disturbance only comes in one axis, the proposed algorithm can use the measurement partly by updating the other two axes considering the direction. The proposed algorithm shows its effectiveness in attitude estimation under disturbances through the rate table and motion capture equipment. Next, I propose a PDR algorithm that integrates IA and PA that can be operated in various poses. When moving indoors using a smartphone, there are many degrees of freedom, so various poses such as making a phone call, texting, and putting a pants pocket are possible. In the existing smartphone-based positioning algorithms, the position is estimated based on the PA, which can be used only when the pedestrian's walking direction and the device's direction coincide, and if it does not, the position error due to the mismatch in angle is large. In order to solve this problem, this dissertation proposes an algorithm that constructs state variables based on the IA and uses the position vector from the PA as a measurement. If the walking direction and the device heading do not match based on the pose recognized through machine learning technique, the position is updated in consideration of the direction calculated using PCA (Principal Component Analysis) and the step length obtained through the PA. It can be operated robustly even in various poses that occur. Through experiments considering various operating conditions and paths, it is confirmed that the proposed method stably estimates the position and improves performance even in various indoor environments.본 논문에서는 저가형 관성센서를 이용한 보행항법시스템 (PDR: Pedestrian Dead Reckoning)의 성능 향상 알고리즘을 제안한다. 구체적으로 보행자가 실내에서 스마트폰을 들고 이동할 때 발생하는 다양한 동작 상황에서도 운용될 수 있도록, 매개변수 기반 측정치를 사용하는 적분 기반의 보행자 항법 알고리즘을 구성한다. 또한 타원체 기반 자세 추정 알고리즘을 구성하여 외란 상황에서도 강인하게 자세를 추정하는 알고리즘을 제안한다. 추가적으로 기계학습 기반의 동작 인식 정보를 이용, 동작에 따른 측정치 업데이트를 달리함으로써 위치 추정 성능을 향상시킨다. 먼저 스마트폰 기기의 이동 방향을 정확하게 추정하기 위해 타원체 기법 기반 적응 자세 추정을 제안한다. 자세 추정 기법 (AHRS: Attitude and Heading Reference System)은 자이로를 기반으로 자세를 계산하고 자이로 센서오차에 의해 발생하는 드리프트를 보정하기 위해 측정치로 가속도계와 지자계를 사용한다. 일반적으로 가속 및 지자계 외란 상황에서는 자세 추정 성능이 떨어지는데, 추정 성능을 효과적으로 향상시키기 위해 본 논문에서는 타원체 기반 적응 자세 추정 기법을 제안한다. 측정치 외란이 들어오는 경우, 외란의 방향을 고려하여 타원체 기법으로 측정치 공분산을 조정해줌으로써 방향을 고려하지 않은 적응 추정 기법보다 정확하게 측정치 업데이트를 할 수 있다. 특히 외란이 한 축으로만 들어오는 경우, 제안한 알고리즘은 방향을 고려해 나머지 두 축에 대해서는 업데이트 해줌으로써 측정치를 부분적으로 사용할 수 있다. 레이트 테이블, 모션 캡쳐 장비를 통해 제안한 알고리즘의 자세 성능이 향상됨을 확인하였다. 다음으로 다양한 동작에서도 운용 가능한 적분 및 매개변수 기법을 융합하는 보행항법 알고리즘을 제안한다. 스마트폰을 이용해 실내를 이동할 때에는 자유도가 크기 때문에 전화 걸기, 문자, 바지 주머니 넣기 등 다양한 동작이 발생 가능하다. 기존의 스마트폰 기반 보행 항법에서는 매개변수 기법을 기반으로 위치를 추정하는데, 이는 보행자의 진행 방향과 기기의 방향이 일치하는 경우에만 사용 가능하며 일치하지 않는 경우 자세 오차로 인한 위치 오차가 크게 발생한다. 이러한 문제를 해결하기 위해 본 논문에서는 적분 기반 기법을 기반으로 상태변수를 구성하고 매개변수 기법을 통해 나오는 위치 벡터를 측정치로 사용하는 알고리즘을 제안한다. 만약 기계학습을 통해 인식한 동작을 바탕으로 진행 방향과 기기 방향이 일치하지 않는 경우, 주성분 분석을 통해 계산한 진행방향을 이용해 진행 방향을, 매개변수 기법을 통해 얻은 보폭으로 거리를 업데이트해 줌으로써 보행 중 발생하는 여러 동작에서도 강인하게 운용할 수 있다. 다양한 동작 상황 및 경로를 고려한 실험을 통해 위에서 제안한 방법이 다양한 실내 환경에서도 안정적으로 위치를 추정하고 성능이 향상됨을 확인하였다.Chapter 1 Introduction 1 1.1 Motivation and Background 1 1.2 Objectives and Contribution 5 1.3 Organization of the Dissertation 6 Chapter 2 Pedestrian Dead Reckoning System 8 2.1 Overview of Pedestrian Dead Reckoning 8 2.2 Parametric Approach 9 2.2.1 Step detection algorithm 11 2.2.2 Step length estimation algorithm 13 2.2.3 Heading estimation 14 2.3 Integration Approach 15 2.3.1 Extended Kalman filter 16 2.3.2 INS-EKF-ZUPT 19 2.4 Activity Recognition using Machine Learning 21 2.4.1 Challenges in HAR 21 2.4.2 Activity recognition chain 22 Chapter 3 Attitude Estimation in Smartphone 26 3.1 Adaptive Attitude Estimation in Smartphone 26 3.1.1 Indirect Kalman filter-based attitude estimation 26 3.1.2 Conventional attitude estimation algorithms 29 3.1.3 Adaptive attitude estimation using ellipsoidal methods 30 3.2 Experimental Results 36 3.2.1 Simulation 36 3.2.2 Rate table experiment 44 3.2.3 Handheld rotation experiment 46 3.2.4 Magnetic disturbance experiment 49 3.3 Summary 53 Chapter 4 Pedestrian Dead Reckoning in Multiple Poses of a Smartphone 54 4.1 System Overview 55 4.2 Machine Learning-based Pose Classification 56 4.2.1 Training dataset 57 4.2.2 Feature extraction and selection 58 4.2.3 Pose classification result using supervised learning in PDR 62 4.3 Fusion of the Integration and Parametric Approaches in PDR 65 4.3.1 System model 67 4.3.2 Measurement model 67 4.3.3 Mode selection 74 4.3.4 Observability analysis 76 4.4 Experimental Results 82 4.4.1 AHRS results 82 4.4.2 PCA results 84 4.4.3 IA-PA results 88 4.5 Summary 100 Chapter 5 Conclusions 103 5.1 Summary of the Contributions 103 5.2 Future Works 105 국문초록 125 Acknowledgements 127Docto

Entwicklung und Implementierung eines Peer-to-Peer Kalman Filters für Fußgänger- und Indoor-Navigation

Smartphones are an integral part of our society by now. They are used for messaging, searching the Internet, working on documents, and of course for navigation. Although smartphones are also used for car navigation their main area of application is pedestrian navigation. Almost all smartphones sold today comprise a GPS L1 receiver which provides position computation with accuracy between 1 and 10 m as long as the environment in beneficial, i.e. the line-of-sight to satellites is not obstructed by trees or high buildings. But this is often the case in areas where smartphones are used primarily for navigation. Users walk in narrow streets with high density, in city centers, enter, and leave buildings and the smartphone is not able to follow their movement because it loses satellite signals. The approach presented in this thesis addresses the problem to enable seamless navigation for the user independently of the current environment and based on cooperative positioning and inertial navigation. It is intended to realize location-based services in areas and buildings with limited or no access to satellite data and a large amount of users like e.g. shopping malls, city centers, airports, railway stations and similar environments. The idea of this concept was for a start based on cooperative positioning between users’ devices denoted here as peers moving within an area with only limited access to satellite signals at certain places (windows, doors) or no access at all. The devices are therefore not able to provide a position by means of satellite signals. Instead of deploying solutions based on infrastructure, surveying, and centralized computations like range measurements, individual signal strength, and similar approaches a decentralized concept was developed. This concept suggests that the smartphone automatically detects if no satellite signals are available and uses its already integrated inertial sensors like magnetic field sensor, accelerometer, and gyroscope for seamless navigation. Since the quality of those sensors is very low the accuracy of the position estimation decreases with each step of the user. To avoid a continuously growing bias between real position and estimated position an update has to be performed to stabilize the position estimate. This update is either provided by the computation of a position based on satellite signals or if signals are not available by the exchange of position data with another peer in the near vicinity using peer-to-peer ad-hoc networks. The received and the own position are processed in a Kalman Filter algorithm and the result is then used as new position estimate and new start position for further navigation based on inertial sensors. The here presented concept is therefore denoted as Peer-to-Peer Kalman Filter (P2PKF)

RuDaCoP: The Dataset for Smartphone-based Intellectual Pedestrian Navigation

This paper presents the large and diverse dataset for development of smartphone-based pedestrian navigation algorithms. This dataset consists of about 1200 sets of inertial measurements from sensors of several smartphones. The measurements are collected while walking through different trajectories up to 10 minutes long. The data are accompanied by the high accuracy ground truth collected with two foot-mounted inertial measurement units and post-processed by the presented algorithms. The dataset suits both for training of intellectual pedestrian navigation algorithms based on learning techniques and for development of pedestrian navigation algorithms based on classical approaches. The dataset is accessible at http://gartseev.ru/projects/ipin2019

Fusion of non-visual and visual sensors for human tracking

Human tracking is an extensively researched yet still challenging area in the Computer Vision field, with a wide range of applications such as surveillance and healthcare. People may not be successfully tracked with merely the visual information in challenging cases such as long-term occlusion. Thus, we propose to combine information from other sensors with the surveillance cameras to persistently localize and track humans, which is becoming more promising with the pervasiveness of mobile devices such as cellphones, smart watches and smart glasses embedded with all kinds of sensors including accelerometers, gyroscopes, magnetometers, GPS, WiFi modules and so on. In this thesis, we firstly investigate the application of Inertial Measurement Unit (IMU) from mobile devices to human activity recognition and human tracking, we then develop novel persistent human tracking and indoor localization algorithms by the fusion of non-visual sensors and visual sensors, which not only overcomes the occlusion challenge in visual tracking, but also alleviates the calibration and drift problems in IMU tracking --Abstract, page iii

Inertial sensors for smartphones navigation

The advent of smartphones and tablets, means that we can constantly get informa- tion on our current geographical location. These devices include not only GPS/GNSS chipsets but also mass-market inertial platforms that can be used to plan activities, share locations on social networks, and also to perform positioning in indoor and outdoor scenarios. This paper shows the performance of smartphones and their inertial sensors in terms of gaining information about the user’s current geographical loca- tion considering an indoor navigation scenario. Tests were carried out to determine the accuracy and precision obtainable with internal and external sensors. In terms of the attitude and drift estimation with an updating interval equal to 1 s, 2D accuracies of about 15 cm were obtained with the images. Residual benefits were also obtained, however, for large intervals, e.g. 2 and 5 s, where the accuracies decreased to 50 cm and 2.2 m, respectively