User Experience Enhancement on Smartphones using Wireless Communication Technologies

학위논문 (박사) -- 서울대학교 대학원 : 공과대학 전기·정보공학부, 2020. 8. 박세웅.Recently, various sensors as well as wireless communication technologies such as Wi-Fi and Bluetooth Low Energy (BLE) have been equipped with smartphones. In addition, in many cases, users use a smartphone while on the move, so if a wireless communication technologies and various sensors are used for a mobile user, a better user experience can be provided. For example, when a user moves while using Wi-Fi, the user experience can be improved by providing a seamless Wi-Fi service. In addition, it is possible to provide a special service such as indoor positioning or navigation by estimating the users mobility in an indoor environment, and additional services such as location-based advertising and payment systems can also be provided. Therefore, improving the user experience by using wireless communication technology and smartphones sensors is considered to be an important research field in the future. In this dissertation, we propose three systems that can improve the user experience or convenience by usingWi-Fi, BLE, and smartphones sensors: (i) BLEND: BLE beacon-aided fast Wi-Fi handoff for smartphones, (ii) PYLON: Smartphone based Indoor Path Estimation and Localization without Human Intervention, (iii) FINISH: Fully-automated Indoor Navigation using Smartphones with Zero Human Assistance. First, we propose fast handoff scheme called BLEND exploiting BLE as secondary radio. We conduct detailed analysis of the sticky client problem on commercial smartphones with experiment and close examination of Android source code. We propose BLEND, which exploits BLE modules to provide smartphones with prior knowledge of the presence and information of APs operating at 2.4 and 5 GHz Wi-Fi channels. BLEND operating with only application requires no hardware and Android source code modification of smartphones.We prototype BLEND with commercial smartphones and evaluate the performance in real environment. Our measurement results demonstrate that BLEND significantly improves throughput and video bitrate by up to 61% and 111%, compared to a commercial Android application, respectively, with negligible energy overhead. Second, we design a path estimation and localization system, termed PYLON, which is plug-and-play on Android smartphones. PYLON includes a novel landmark correction scheme that leverages real doors of indoor environments consisting of floor plan mapping, door passing time detection and correction. It operates without any user intervention. PYLON relaxes some requirements for localization systems. It does not require any modifications to hardware or software of smartphones, and the initial location of WiFi APs, BLE beacons, and users. We implement PYLON on five Android smartphones and evaluate it on two office buildings with the help of three participants to prove applicability and scalability. PYLON achieves very high floor plan mapping accuracy with a low localization error. Finally, We design a fully-automated navigation system, termed FINISH, which addresses the problems of existing previous indoor navigation systems. FINISH generates the radio map of an indoor building based on the localization system to determine the initial location of the user. FINISH relaxes some requirements for current indoor navigation systems. It does not require any human assistance to provide navigation instructions. In addition, it is plug-and-play on Android smartphones. We implement FINISH on five Android smartphones and evaluate it on five floors of an office building with the help of multiple users to prove applicability and scalability. FINISH determines the location of the user with extremely high accuracy with in one step. In summary, we propose systems that enhance the users convenience and experience by utilizing wireless infrastructures such as Wi-Fi and BLE and various smartphones sensors such as accelerometer, gyroscope, and barometer equipped in smartphones. Systems are implemented on commercial smartphones to verify the performance through experiments. As a result, systems show the excellent performance that can enhance the users experience.1 Introduction 1 1.1 Motivation 1 1.2 Overview of Existing Approaches 3 1.2.1 Wi-Fi handoff for smartphones 3 1.2.2 Indoor path estimation and localization 4 1.2.3 Indoor navigation 5 1.3 Main Contributions 7 1.3.1 BLEND: BLE Beacon-aided Fast Handoff for Smartphones 7 1.3.2 PYLON: Smartphone Based Indoor Path Estimation and Localization with Human Intervention 8 1.3.3 FINISH: Fully-automated Indoor Navigation using Smartphones with Zero Human Assistance 9 1.4 Organization of Dissertation 10 2 BLEND: BLE Beacon-Aided FastWi-Fi Handoff for Smartphones 11 2.1 Introduction 11 2.2 Related Work 14 2.2.1 Wi-Fi-based Handoff 14 2.2.2 WPAN-aided AP Discovery 15 2.3 Background 16 2.3.1 Handoff Procedure in IEEE 802.11 16 2.3.2 BSS Load Element in IEEE 802.11 16 2.3.3 Bluetooth Low Energy 17 2.4 Sticky Client Problem 17 2.4.1 Sticky Client Problem of Commercial Smartphone 17 2.4.2 Cause of Sticky Client Problem 20 2.5 BLEND: Proposed Scheme 21 2.5.1 Advantages and Necessities of BLE as Secondary Low-Power Radio 21 2.5.2 Overall Architecture 22 2.5.3 AP Operation 23 2.5.4 Smartphone Operation 24 2.5.5 Verification of aTH estimation 28 2.6 Performance Evaluation 30 2.6.1 Implementation and Measurement Setup 30 2.6.2 Saturated Traffic Scenario 31 2.6.3 Video Streaming Scenario 35 2.7 Summary 38 3 PYLON: Smartphone based Indoor Path Estimation and Localization without Human Intervention 41 3.1 Introduction 41 3.2 Background and Related Work 44 3.2.1 Infrastructure-Based Localization 44 3.2.2 Fingerprint-Based Localization 45 3.2.3 Model-Based Localization 45 3.2.4 Dead Reckoning 46 3.2.5 Landmark-Based Localization 47 3.2.6 Simultaneous Localization and Mapping (SLAM) 47 3.3 System Overview 48 3.3.1 Notable RSSI Signature 49 3.3.2 Smartphone Operation 50 3.3.3 Server Operation 51 3.4 Path Estimation 52 3.4.1 Step Detection 52 3.4.2 Step Length Estimation 54 3.4.3 Walking Direction 54 3.4.4 Location Update 55 3.5 Landmark Correction Part 1: Virtual Room Generation 56 3.5.1 RSSI Stacking Difference 56 3.5.2 Virtual Room Generation 57 3.5.3 Virtual Graph Generation 59 3.5.4 Physical Graph Generation 60 3.6 Landmark Correction Part 2: From Floor Plan Mapping to Path Correction 60 3.6.1 Candidate Graph Generation 60 3.6.2 Backbone Node Mapping 62 3.6.3 Dead-end Node Mapping 65 3.6.4 Final Candidate Graph Selection 66 3.6.5 Door Passing Time Detection 68 3.6.6 Path Correction 70 3.7 Particle Filter 71 3.8 Performance Evaluation 73 3.8.1 Implementation and Measurement Setup 73 3.8.2 Step Detection Accuracy 77 3.8.3 Floor Plan Mapping Accuracy 77 3.8.4 Door Passing Time 78 3.8.5 Walking Direction and Localization Performance 81 3.8.6 Impact of WiFi AP and BLE Beacon Number 84 3.8.7 Impact of Walking Distance and Speed 84 3.8.8 Performance on Different Areas 87 3.9 Summary 87 4 FINISH: Fully-automated Indoor Navigation using Smartphones with Zero Human Assistance 91 4.1 Introduction 91 4.2 Related Work 92 4.2.1 Localization-based Navigation System 92 4.2.2 Peer-to-peer Navigation System 93 4.3 System Overview 93 4.3.1 System Architecture 93 4.3.2 An Example for Navigation 95 4.4 Level Change Detection and Floor Decision 96 4.4.1 Level Change Detection 96 4.5 Real-time navigation 97 4.5.1 Initial Floor and Location Decision 97 4.5.2 Orientation Adjustment 98 4.5.3 Shortest Path Estimation 99 4.6 Performance Evaluation 99 4.6.1 Initial Location Accuracy 99 4.6.2 Real-Time Navigation Accuracy 100 4.7 Summary 101 5 Conclusion 102 5.1 Research Contributions 102 5.2 Future Work 103 Abstract (In Korean) 118 감사의 글Docto

An improved approach for RSSI-based only calibration-free real-time indoor localization on IEEE 802.11 and 802.15.4 wireless networks

Assuming a reliable and responsive spatial contextualization service is a must-have in IEEE 802.11 and 802.15.4 wireless networks, a suitable approach consists of the implementation of localization capabilities, as an additional application layer to the communication protocol stack. Considering the applicative scenario where satellite-based positioning applications are denied, such as indoor environments, and excluding data packet arrivals time measurements due to lack of time resolution, received signal strength indicator (RSSI) measurements, obtained according to IEEE 802.11 and 802.15.4 data access technologies, are the unique data sources suitable for indoor geo-referencing using COTS devices. In the existing literature, many RSSI based localization systems are introduced and experimentally validated, nevertheless they require periodic calibrations and significant information fusion from different sensors that dramatically decrease overall systems reliability and their effective availability. This motivates the work presented in this paper, which introduces an approach for an RSSI-based calibration-free and real-time indoor localization. While switched-beam array-based hardware (compliant with IEEE 802.15.4 router functionality) has already been presented by the author, the focus of this paper is the creation of an algorithmic layer for use with the pre-existing hardware capable to enable full localization and data contextualization over a standard 802.15.4 wireless sensor network using only RSSI information without the need of lengthy offline calibration phase. System validation reports the localization results in a typical indoor site, where the system has shown high accuracy, leading to a sub-metrical overall mean error and an almost 100% site coverage within 1 m localization error

Guaranteeing Spoof-Resilient Multi-Robot Networks

Multi-robot networks use wireless communication to provide wide-ranging services such as aerial surveillance and unmanned delivery. However, effective coordination between multiple robots requires trust, making them particularly vulnerable to cyber-attacks. Specifically, such networks can be gravely disrupted by the Sybil attack, where even a single malicious robot can spoof a large number of fake clients. This paper proposes a new solution to defend against the Sybil attack, without requiring expensive cryptographic key-distribution. Our core contribution is a novel algorithm implemented on commercial Wi-Fi radios that can "sense" spoofers using the physics of wireless signals. We derive theoretical guarantees on how this algorithm bounds the impact of the Sybil Attack on a broad class of robotic coverage problems. We experimentally validate our claims using a team of AscTec quadrotor servers and iRobot Create ground clients, and demonstrate spoofer detection rates over 96%

ReLoc-PDR: Visual Relocalization Enhanced Pedestrian Dead Reckoning via Graph Optimization

Accurately and reliably positioning pedestrians in satellite-denied conditions remains a significant challenge. Pedestrian dead reckoning (PDR) is commonly employed to estimate pedestrian location using low-cost inertial sensor. However, PDR is susceptible to drift due to sensor noise, incorrect step detection, and inaccurate stride length estimation. This work proposes ReLoc-PDR, a fusion framework combining PDR and visual relocalization using graph optimization. ReLoc-PDR leverages time-correlated visual observations and learned descriptors to achieve robust positioning in visually-degraded environments. A graph optimization-based fusion mechanism with the Tukey kernel effectively corrects cumulative errors and mitigates the impact of abnormal visual observations. Real-world experiments demonstrate that our ReLoc-PDR surpasses representative methods in accuracy and robustness, achieving accurte and robust pedestrian positioning results using only a smartphone in challenging environments such as less-textured corridors and dark nighttime scenarios.Comment: 11 pages, 14 figure

A Framework for UWB-Based Communication and Location Tracking Systems for Wireless Sensor Networks

Ultra wideband (UWB) radio technology is nowadays one of the most promising technologies for medium-short range communications. It has a wide range of applications including Wireless Sensor Networks (WSN) with simultaneous data transmission and location tracking. The combination of location and data transmission is important in order to increase flexibility and reduce the cost and complexity of the system deployment. In this scenario, accuracy is not the only evaluation criteria, but also the amount of resources associated to the location service, as it has an impact not only on the location capacity of the system but also on the sensor data transmission capacity. Although several studies can be found in the literature addressing UWB-based localization, these studies mainly focus on distance estimation and position calculation algorithms. Practical aspects such as the design of the functional architecture, the procedure for the transmission of the associated information between the different elements of the system, and the need of tracking multiple terminals simultaneously in various application scenarios, are generally omitted. This paper provides a complete system level evaluation of a UWB-based communication and location system for Wireless Sensor Networks, including aspects such as UWB-based ranging, tracking algorithms, latency, target mobility and MAC layer design. With this purpose, a custom simulator has been developed, and results with real UWB equipment are presented too

BLE Beacons for Indoor Positioning at an Interactive IoT-Based Smart Museum

The Internet of Things (IoT) can enable smart infrastructures to provide advanced services to the users. New technological advancement can improve our everyday life, even simple tasks as a visit to the museum. In this paper, an indoor localization system is presented, to enhance the user experience in a museum. In particular, the proposed system relies on Bluetooth Low Energy (BLE) beacons proximity and localization capabilities to automatically provide the users with cultural contents related to the observed artworks. At the same time, an RSS-based technique is used to estimate the location of the visitor in the museum. An Android application is developed to estimate the distance from the exhibits and collect useful analytics regarding each visit and provide a recommendation to the users. Moreover, the application implements a simple Kalman filter in the smartphone, without the need of the Cloud, to improve localization precision and accuracy. Experimental results on distance estimation, location, and detection accuracy show that BLE beacon is a promising solution for an interactive smart museum. The proposed system has been designed to be easily extensible to the IoT technologies and its effectiveness has been evaluated through experimentation

Laitteiden välisen yhteistyön soveltuvuus älypuhelimilla toteutettavaan sisätilapaikannukseen

A reliable indoor positioning service for smartphones is a service that is often requested. There are several competing technologies already available but a lot of basic research is still done on the subject. This thesis studies the applicability and technological possibilities of improving the performance of a positioning service using peer to peer collaboration. The Bluetooth low energy technology (BLE) offers a possibility to use peer to peer radio signal measurements with smartphones. This could be used to improve the performance of existing positioning algorithms if enough service users are in close proximity to each other. In this thesis a pedestrian simulation system was implemented to study the probability that two positioning service users are in close enough proximity to each other for BLE usage. The suitability of BLE as the collaboration technology was studied by implementing a particle filter based positioning system that uses BLE measurements to track a smartphone. Finally the collaborative BLE system was integrated on top of an existing geomagnetic tracking algorithm and the effect on the positioning performance was studied. It was concluded that the BLE as a technology is suitable for positioning use despite the large measurement uncertainty. BLE based collaboration is feasible in improving the positioning results provided that the basic positioning technology is reliable enough. The pedestrian simulations concluded that with realistic expected number of users in one building most sessions would not benefit from collaboration but it would still likely happen frequently.Luotettava sisätilapaikannuspalvelu on haluttu ominaisuus mobiilipalveluiden kehityksessä. Useita kilpailevia ratkaisuja on jo markkinoilla, mutta ongelman parissa tehdään vielä huomattavan paljon perustutkimusta. Tässä diplomityössä tutkitaan mahdollisuutta parantaa paikannusjärjestelmän toimintaa käyttäen vertaisyhteistyötä. Bluetooth low energy -teknologia (BLE) tarjoaa mahdollisuuden käyttää laitteiden välisiä radiosignaalimittauksia älypuhelimilla. Tätä voidaan mahdollisesti hyödyntää parantamaan olemassa olevien paikannusalgoritmien toimintaa, jos riittävästi käyttäjiä on riittävän lähellä toisiaan. Tässä diplomityössä toteutettiin ihmisjoukkojen liikettä sisätiloissa mallintava järjestelmä, jolla tutkittiin todennäköisyyttä, että kaksi paikannusjärjestelmän käyttäjää olisi riittävän lähellä toisiaan käyttääkseen BLE-radiomittauksia. BLE:n soveltuvuutta paikannusteknologiana tutkittiin toteuttamalla partikkelisuotimeen perustuva paikannusjärjestelmä, joka käyttää BLE-mittauksia älypuhelimen seuraamiseen. Lopuksi BLE mittausjärjestelmä integroitiin olemassa olevaan magneettikenttään perustuvaan paikannusalgoritmiin ja BLE-yhteistyön vaikutusta algoritmin toimintaan tutkittiin. Työ osoitti, että BLE on paikannuskäyttöön soveltuva teknologia suuresta mittausepävarmuudesta huolimatta. BLE-perusteinen yhteistyö paikannustuloksen parantamisessa on toimiva ratkaisu, mikäli varsinainen paikannusteknologia on riittävän luotettava. Realistisesti odotettavissa olevilla paikannuspalvelun käyttäjämäärillä BLE-yhteistyötä todennäköisesti tapahtuisi suhteellisen usein, vaikka suurin osa paikannussessioista ei pääsisikään hyötymään siitä