Multi sensor system for pedestrian tracking and activity recognition in indoor environments

The widespread use of mobile devices and the rise of Global Navigation Satellite Systems (GNSS) have allowed mobile tracking applications to become very popular and valuable in outdoor environments. However, tracking pedestrians in indoor environments with Global Positioning System (GPS)-based schemes is still very challenging. Along with indoor tracking, the ability to recognize pedestrian behavior and activities can lead to considerable growth in location-based applications including pervasive healthcare, leisure and guide services (such as, hospitals, museums, airports, etc.), and emergency services, among the most important ones. This paper presents a system for pedestrian tracking and activity recognition in indoor environments using exclusively common off-the-shelf sensors embedded in smartphones (accelerometer, gyroscope, magnetometer and barometer). The proposed system combines the knowledge found in biomechanical patterns of the human body while accomplishing basic activities, such as walking or climbing stairs up and down, along with identifiable signatures that certain indoor locations (such as turns or elevators) introduce on sensing data. The system was implemented and tested on Android-based mobile phones. The system detects and counts steps with an accuracy of 97% and 96:67% in flat floor and stairs, respectively; detects user changes of direction and altitude with 98:88% and 96:66% accuracy, respectively; and recognizes the proposed human activities with a 95% accuracy. All modules combined lead to a total tracking accuracy of 91:06% in common human motion indoor displacement

Adaptive Indoor Pedestrian Tracking Using Foot-Mounted Miniature Inertial Sensor

This dissertation introduces a positioning system for measuring and tracking the momentary location of a pedestrian, regardless of the environmental variations. This report proposed a 6-DOF (degrees of freedom) foot-mounted miniature inertial sensor for indoor localization which has been tested with simulated and real-world data. To estimate the orientation, velocity and position of a pedestrian we describe and implement a Kalman filter (KF) based framework, a zero-velocity updates (ZUPTs) methodology, as well as, a zero-velocity (ZV) detection algorithm. The novel approach presented in this dissertation uses the interactive multiple model (IMM) filter in order to determine the exact state of pedestrian with changing dynamics. This work evaluates the performance of the proposed method in two different ways: At first a vehicle traveling in a straight line is simulated using commonly used kinematic motion models in the area of tracking (constant velocity (CV), constant acceleration (CA) and coordinated turn (CT) models) which demonstrates accurate state estimation of targets with changing dynamics is achieved through the use of multiple model filter models. We conclude by proposing an interactive multiple model estimator based adaptive indoor pedestrian tracking system for handling dynamic motion which can incorporate different motion types (walking, running, sprinting and ladder climbing) whose threshold is determined individually and IMM adjusts itself adaptively to correct the change in motion models. Results indicate that the overall IMM performance will at all times be similar to the best individual filter model within the IMM

Evaluating indoor positioning systems in a shopping mall : the lessons learned from the IPIN 2018 competition

The Indoor Positioning and Indoor Navigation (IPIN) conference holds an annual competition in which indoor localization systems from different research groups worldwide are evaluated empirically. The objective of this competition is to establish a systematic evaluation methodology with rigorous metrics both for real-time (on-site) and post-processing (off-site) situations, in a realistic environment unfamiliar to the prototype developers. For the IPIN 2018 conference, this competition was held on September 22nd, 2018, in Atlantis, a large shopping mall in Nantes (France). Four competition tracks (two on-site and two off-site) were designed. They consisted of several 1 km routes traversing several floors of the mall. Along these paths, 180 points were topographically surveyed with a 10 cm accuracy, to serve as ground truth landmarks, combining theodolite measurements, differential global navigation satellite system (GNSS) and 3D scanner systems. 34 teams effectively competed. The accuracy score corresponds to the third quartile (75th percentile) of an error metric that combines the horizontal positioning error and the floor detection. The best results for the on-site tracks showed an accuracy score of 11.70 m (Track 1) and 5.50 m (Track 2), while the best results for the off-site tracks showed an accuracy score of 0.90 m (Track 3) and 1.30 m (Track 4). These results showed that it is possible to obtain high accuracy indoor positioning solutions in large, realistic environments using wearable light-weight sensors without deploying any beacon. This paper describes the organization work of the tracks, analyzes the methodology used to quantify the results, reviews the lessons learned from the competition and discusses its future

Indoor location based services challenges, requirements and usability of current solutions

Indoor Location Based Services (LBS), such as indoor navigation and tracking, still have to deal with both technical and non-technical challenges. For this reason, they have not yet found a prominent position in people’s everyday lives. Reliability and availability of indoor positioning technologies, the availability of up-to-date indoor maps, and privacy concerns associated with location data are some of the biggest challenges to their development. If these challenges were solved, or at least minimized, there would be more penetration into the user market. This paper studies the requirements of LBS applications, through a survey conducted by the authors, identifies the current challenges of indoor LBS, and reviews the available solutions that address the most important challenge, that of providing seamless indoor/outdoor positioning. The paper also looks at the potential of emerging solutions and the technologies that may help to handle this challenge

Visual-Inertial first responder localisation in large-scale indoor training environments.

Accurately and reliably determining the position and heading of first responders undertaking training exercises can provide valuable insights into their situational awareness and give a larger context to the decisions made. Measuring first responder movement, however, requires an accurate and portable localisation system. Training exercises of- ten take place in large-scale indoor environments with limited power infrastructure to support localisation. Indoor positioning technologies that use radio or sound waves for localisation require an extensive network of transmitters or receivers to be installed within the environment to ensure reliable coverage. These technologies also need power sources to operate, making their use impractical for this application. Inertial sensors are infrastructure independent, low cost, and low power positioning devices which are attached to the person or object being tracked, but their localisation accuracy deteriorates over long-term tracking due to intrinsic biases and sensor noise. This thesis investigates how inertial sensor tracking can be improved by providing correction from a visual sensor that uses passive infrastructure (fiducial markers) to calculate accurate position and heading values. Even though using a visual sensor increase the accuracy of the localisation system, combining them with inertial sensors is not trivial, especially when mounted on different parts of the human body and going through different motion dynamics. Additionally, visual sensors have higher energy consumption, requiring more batteries to be carried by the first responder. This thesis presents a novel sensor fusion approach by loosely coupling visual and inertial sensors to create a positioning system that accurately localises walking humans in largescale indoor environments. Experimental evaluation of the devised localisation system indicates sub-metre accuracy for a 250m long indoor trajectory. The thesis also proposes two methods to improve the energy efficiency of the localisation system. The first is a distance-based error correction approach which uses distance estimation from the foot-mounted inertial sensor to reduce the number of corrections required from the visual sensor. Results indicate a 70% decrease in energy consumption while maintaining submetre localisation accuracy. The second method is a motion type adaptive error correction approach, which uses the human walking motion type (forward, backward, or sideways) as an input to further optimise the energy efficiency of the localisation system by modulating the operation of the visual sensor. Results of this approach indicate a 25% reduction in the number of corrections required to keep submetre localisation accuracy. Overall, this thesis advances the state of the art by providing a sensor fusion solution for long-term submetre accurate localisation and methods to reduce the energy consumption, making it more practical for use in first responder training exercises

Pozicioniranje i praćenje pješaka u zatvorenom prostoru koristeći senzore pametnih telefona, otkrivanje koraka i algoritam za geokodiranje

The paper deals with indoor navigation using inertial sensors (accelerometers, gyroscopes, etc.) built in a smartphone. The main disadvantage of the use of inertial sensors is the accuracy, which rapidly decreases with the increasing time of the measurement. The reason of the deteriorating accuracy is the presence of errors in inertial measurements, which are accumulated in the integration process. The paper describes the determination of a pedestrian trajectory using step detection method, which is improved with utilization of the adaptive step length estimation algorithm. This algorithm reflects the change of the step length with different types of movement. The proposal of the data processing uses information from floormap, what allows the verification of the pedestrian position and detects the collision of the trajectory with the floormap. The proposed algorithm significantly increases the accuracy of the resulting trajectory. Another extension of the proposed algorithm is the implementation of the barometer measurements for determination of the height differences. This fact allows change the floor in a multi-storey buildings. The experimental measurement was realized with a smartphone Samsung Galaxy S4.Rad se bavi navigacijom u zatvorenom prostoru koristeći inercijalne senzore (akcelerometre, žiroskope, itd.) ugrađene u pametne telefone. Najveći nedostatak korištenja inercijalnih senzora je netočnost koja se ubrzano povećava produljenjem vremena mjerenja. Razlog smanjenja točnosti je prisutnost pogrešaka inercijalnih mjerenja koje se akumuliraju kroz proces integracije. Rad opisuje određivanje putanje pješaka koristeći metodu praćenja koraka koja je poboljšana korištenjem algoritma za procjenu prilagodljive duljine koraka. Ovaj algoritam odražava promjene u duljini koraka s različitim vrstama kretanja. Prijedlog obrade podataka koristi informacije iz tlocrta katova što omogućava potvrdu položaja pješaka i otkriva koliziju putanje s tlocrtom. Predloženi algoritam znatno povećava točnost dobivene putanje. Drugi dodatak predloženog algoritma se odnosi na upotrebu barometarskih mjerenja pri određivanju visinskih razlika. Ova činjenica omogućava promjenu kata u višekatnoj zgradi. Eksperimentalno mjerenje je izvršeno uz pomoć pametnog telefona Samsung Galaxy S4

Off-line evaluation of indoor positioning systems in different scenarios: the experiences from IPIN 2020 competition

Every year, for ten years now, the IPIN competition has aimed at evaluating real-world indoor localisation systems by testing them in a realistic environment, with realistic movement, using the EvAAL framework. The competition provided a unique overview of the state-of-the-art of systems, technologies, and methods for indoor positioning and navigation purposes. Through fair comparison of the performance achieved by each system, the competition was able to identify the most promising approaches and to pinpoint the most critical working conditions. In 2020, the competition included 5 diverse off-site off-site Tracks, each resembling real use cases and challenges for indoor positioning. The results in terms of participation and accuracy of the proposed systems have been encouraging. The best performing competitors obtained a third quartile of error of 1 m for the Smartphone Track and 0.5 m for the Foot-mounted IMU Track. While not running on physical systems, but only as algorithms, these results represent impressive achievements.Track 3 organizers were supported by the European Union’s Horizon 2020 Research and Innovation programme under the Marie Skłodowska Curie Grant 813278 (A-WEAR: A network for dynamic WEarable Applications with pRivacy constraints), MICROCEBUS (MICINN, ref. RTI2018-095168-B-C55, MCIU/AEI/FEDER UE), INSIGNIA (MICINN ref. PTQ2018-009981), and REPNIN+ (MICINN, ref. TEC2017-90808-REDT). We would like to thanks the UJI’s Library managers and employees for their support while collecting the required datasets for Track 3. Track 5 organizers were supported by JST-OPERA Program, Japan, under Grant JPMJOP1612. Track 7 organizers were supported by the Bavarian Ministry for Economic Affairs, Infrastructure, Transport and Technology through the Center for Analytics-Data-Applications (ADA-Center) within the framework of “BAYERN DIGITAL II. ” Team UMinho (Track 3) was supported by FCT—Fundação para a Ciência e Tecnologia within the R&D Units Project Scope under Grant UIDB/00319/2020, and the Ph.D. Fellowship under Grant PD/BD/137401/2018. Team YAI (Track 3) was supported by the Ministry of Science and Technology (MOST) of Taiwan under Grant MOST 109-2221-E-197-026. Team Indora (Track 3) was supported in part by the Slovak Grant Agency, Ministry of Education and Academy of Science, Slovakia, under Grant 1/0177/21, and in part by the Slovak Research and Development Agency under Contract APVV-15-0091. Team TJU (Track 3) was supported in part by the National Natural Science Foundation of China under Grant 61771338 and in part by the Tianjin Research Funding under Grant 18ZXRHSY00190. Team Next-Newbie Reckoners (Track 3) were supported by the Singapore Government through the Industry Alignment Fund—Industry Collaboration Projects Grant. This research was conducted at Singtel Cognitive and Artificial Intelligence Lab for Enterprises (SCALE@NTU), which is a collaboration between Singapore Telecommunications Limited (Singtel) and Nanyang Technological University (NTU). Team KawaguchiLab (Track 5) was supported by JSPS KAKENHI under Grant JP17H01762. Team WHU&AutoNavi (Track 6) was supported by the National Key Research and Development Program of China under Grant 2016YFB0502202. Team YAI (Tracks 6 and 7) was supported by the Ministry of Science and Technology (MOST) of Taiwan under Grant MOST 110-2634-F-155-001

Heading drift mitigation for low-cost inertial pedestrian navigation

The concept of autonomous pedestrian navigation is often adopted for indoor pedestrian navigation. For outdoors, a Global Positioning System (GPS) is often used for navigation by utilizing GPS signals for position computation but indoors, its signals are often unavailable. Therefore, autonomous pedestrian navigation for indoors can be realized with the use of independent sensors, such as low-cost inertial sensors, and these sensors are often known as Inertial Measurement Unit (IMU) where they do not rely on the reception of external information such as GPS signals. Using these sensors, a relative positioning concept from initialized position and attitude is used for navigation. The sensors sense the change in velocity and after integration, it is added to the previous position to obtain the current position. Such low-cost systems, however, are prone to errors that can result in a large position drift. This problem can be minimized by mounting the sensors on the pedestrian’s foot. During walking, the foot is briefly stationary while it is on the ground, sometimes called the zero-velocity period. If a non-zero velocity is then measured by the inertial sensors during this period, it is considered as an error and thus can be corrected. These repeated corrections to the inertial sensor’s velocity measurements can, therefore, be used to control the error growth and minimize the position drift. Nonetheless, it is still inadequate, mainly due to the remaining errors on the inertial sensor’s heading when the velocity corrections are used alone. Apart from the initialization issue, therefore, the heading drift problem still remains in such low-cost systems. In this research, two novel methods are developed and investigated to mitigate the heading drift problem when used with the velocity updates. The first method is termed Cardinal Heading Aided Inertial Navigation (CHAIN), where an algorithm is developed to use building ‘heading’ to aid the heading measurement in the Kalman Filter. The second method is termed the Rotated IMU (RIMU), where the foot-mounted inertial sensor is rotated about a single axis to increase the observability of the sensor’s heading. For the CHAIN, the method proposed has been investigated with real field trials using the low-cost Microstrain 3DM-GX3-25 inertial sensor. It shows a clear improvement in mitigating the heading drift error. It offers significant improvement in navigation accuracy for a long period, allowing autonomous pedestrian navigation for as long as 40 minutes with below 5 meters position error between start and end position. It does not require any extra heading sensors, such as a magnetometer or visual sensors such as a camera nor an extensive position or map database, and thus offers a cost-effective solution. Furthermore, its simplicity makes it feasible for it to be implemented in real-time, as very little computing capability is needed. For the RIMU, the method was tested with Nottingham Geospatial Institute (NGI) inertial data simulation software. Field trials were also undertaken using the same low-cost inertial sensor, mounted on a rotated platform prototype. This method improves the observability of the inertial sensor’s errors, resulting also in a decrease in the heading drift error at the expense of requiring extra components

Off-Line Evaluation of Indoor Positioning Systems in Different Scenarios: The Experiences From IPIN 2020 Competition

Every year, for ten years now, the IPIN competition has aimed at evaluating real-world indoor localisation systems by testing them in a realistic environment, with realistic movement, using the EvAAL framework. The competition provided a unique overview of the state-of-the-art of systems, technologies, and methods for indoor positioning and navigation purposes. Through fair comparison of the performance achieved by each system, the competition was able to identify the most promising approaches and to pinpoint the most critical working conditions. In 2020, the competition included 5 diverse off-site off-site Tracks, each resembling real use cases and challenges for indoor positioning. The results in terms of participation and accuracy of the proposed systems have been encouraging. The best performing competitors obtained a third quartile of error of 1 m for the Smartphone Track and 0.5 m for the Foot-mounted IMU Track. While not running on physical systems, but only as algorithms, these results represent impressive achievements