Enhancing the museum experience with a sustainable solution based on contextual information obtained from an on-line analysis of users’ behaviour

Human computer interaction has evolved in the last years in order to enhance users’ experiences and provide more intuitive and usable systems. A major leap through in this scenario is obtained by embedding, in the physical environment, sensors capable of detecting and processing users’ context (position, pose, gaze, ...). Feeded by the so collected information flows, user interface paradigms may shift from stereotyped gestures on physical devices, to more direct and intuitive ones that reduce the semantic gap between the action and the corresponding system reaction or even anticipate the user’s needs, thus limiting the overall learning effort and increasing user satisfaction. In order to make this process effective, the context of the user (i.e. where s/he is, what is s/he doing, who s/he is, what are her/his preferences and also actual perception and needs) must be properly understood. While collecting data on some aspects can be easy, interpreting them all in a meaningful way in order to improve the overall user experience is much harder. This is more evident when we consider informal learning environments like museums, i.e. places that are designed to elicit visitor response towards the artifacts on display and the cultural themes proposed. In such a situation, in fact, the system should adapt to the attention paid by the user choosing the appropriate content for the user’s purposes, presenting an intuitive interface to navigate it. My research goal is focused on collecting, in a simple,unobtrusive, and sustainable way, contextual information about the visitors with the purpose of creating more engaging and personalized experiences

Evaluating indoor positioning systems in a shopping mall : the lessons learned from the IPIN 2018 competition

The Indoor Positioning and Indoor Navigation (IPIN) conference holds an annual competition in which indoor localization systems from different research groups worldwide are evaluated empirically. The objective of this competition is to establish a systematic evaluation methodology with rigorous metrics both for real-time (on-site) and post-processing (off-site) situations, in a realistic environment unfamiliar to the prototype developers. For the IPIN 2018 conference, this competition was held on September 22nd, 2018, in Atlantis, a large shopping mall in Nantes (France). Four competition tracks (two on-site and two off-site) were designed. They consisted of several 1 km routes traversing several floors of the mall. Along these paths, 180 points were topographically surveyed with a 10 cm accuracy, to serve as ground truth landmarks, combining theodolite measurements, differential global navigation satellite system (GNSS) and 3D scanner systems. 34 teams effectively competed. The accuracy score corresponds to the third quartile (75th percentile) of an error metric that combines the horizontal positioning error and the floor detection. The best results for the on-site tracks showed an accuracy score of 11.70 m (Track 1) and 5.50 m (Track 2), while the best results for the off-site tracks showed an accuracy score of 0.90 m (Track 3) and 1.30 m (Track 4). These results showed that it is possible to obtain high accuracy indoor positioning solutions in large, realistic environments using wearable light-weight sensors without deploying any beacon. This paper describes the organization work of the tracks, analyzes the methodology used to quantify the results, reviews the lessons learned from the competition and discusses its future

A Non-Line-of-Sight Mitigation Method For Indoor Ultra-Wideband Localization With Multiple Walls

Ultra-wideband (UWB) ranging techniques can provide accurate distance measurement under line-of-sight (LOS) conditions. However, various walls and obstacles in indoor non-LOS (NLOS) environments, which obstruct the direct propagation of UWB signals, can generate significant ranging errors. Due to the complex through-wall UWB signal propagation, most conventional studies simplify the ranging error model by assuming that the incidence angle is zero or the relative permittivity\u27s for different walls are the same to improve the through-wall UWB localization performance. Considering walls are different in realistic settings, this article presents a through-multiple-wall NLOS mitigation method for UWB indoor positioning. First, spatial geometric equilibrium equations of UWB through-wall propagation and a numerical method are developed for the precise modeling of UWB through-wall ranging errors. Then, calculated error maps are determined numerically without field measurements. Finally, the determined error maps are combined with a gray wolf optimization algorithm for localization. The proposed method is evaluated via field experiments with four rooms, three walls, and six penetration cases. The results demonstrate that the method can strongly mitigate the multi-wall. NLOS effects on the performance of UWB positioning systems. This solution can reduce project costs and number of power supplies for UWB indoor positioning applications

MULTI-SENSOR LOCALIZATION AND TRACKING IN DISASTER MANAGEMENT AND INDOOR WAYFINDING FOR VISUALLY IMPAIRED USERS

This dissertation proposes a series of multi-sensor localization and tracking algorithms particularly developed for two important application domains, which are disaster management and indoor wayfinding for blind and visually impaired (BVI) users. For disaster management, we developed two different localization algorithms, one each for Radio Frequency Identification (RFID) and Bluetooth Low Energy (BLE) technology, which enable the disaster management system to track patients in real-time. Both algorithms work in the absence of any pre-deployed infrastructure along with smartphones and wearable devices. Regarding indoor wayfinding for BVI users, we have explored several types of indoor positioning techniques including BLE-based, inertial, visual and hybrid approaches to offer accurate and reliable location and orientation in complex navigation spaces. In this dissertation, significant contributions have been made in the design and implementation of various localization and tracking algorithms under different requirements of certain applications

Adaptive indoor positioning system based on locating globally deployed WiFi signal sources

Recent trends in data driven applications have encouraged expanding location awareness to indoors. Various attributes driven by location data indoors require large scale deployment that could expand beyond specific venue to a city, country or even global coverage. Social media, assets or personnel tracking, marketing or advertising are examples of applications that heavily utilise location attributes. Various solutions suggest triangulation between WiFi access points to obtain location attribution indoors imitating the GPS accurate estimation through satellites constellations. However, locating signal sources deep indoors introduces various challenges that cannot be addressed via the traditional war-driving or war-walking methods. This research sets out to address the problem of locating WiFi signal sources deep indoors in unsupervised deployment, without previous training or calibration. To achieve this, we developed a grid approach to mitigate for none line of site (NLoS) conditions by clustering signal readings into multi-hypothesis Gaussians distributions. We have also employed hypothesis testing classification to estimate signal attenuation through unknown layouts to remove dependencies on indoor maps availability. Furthermore, we introduced novel methods for locating signal sources deep indoors and presented the concept of WiFi access point (WAP) temporal profiles as an adaptive radio-map with global coverage. Nevertheless, the primary contribution of this research appears in utilisation of data streaming, creation and maintenance of self-organising networks of WAPs through an adaptive deployment of mass-spring relaxation algorithm. In addition, complementary database utilisation components such as error estimation, position estimation and expanding to 3D have been discussed. To justify the outcome of this research, we present results for testing the proposed system on large scale dataset covering various indoor environments in different parts of the world. Finally, we propose scalable indoor positioning system based on received signal strength (RSSI) measurements of WiFi access points to resolve the indoor positioning challenge. To enable the adoption of the proposed solution to global scale, we deployed a piece of software on multitude of smartphone devices to collect data occasionally without the context of venue, environment or custom hardware. To conclude, this thesis provides learning for novel adaptive crowd-sourcing system that automatically deals with tolerance of imprecise data when locating signal sources

On the Trade-Off Between Accuracy and Delay in Cooperative UWB Localization: Performance Bounds and Scaling Laws

Ultra-wide bandwidth (UWB) systems allow for accurate positioning in environments where global navigation satellite systems may fail, especially when complemented with cooperative processing. While cooperative UWB has led to centimeter-level accuracies, the communication overhead is often neglected. We quantify how accuracy and delay trade off in a wide variety of operation conditions. We also derive the asymptotic scaling of accuracy and delay, indicating that, in some conditions, standard cooperation offers the worst possible tradeoff. Both avenues lead to the same conclusion: indiscriminately targeting increased accuracy incurs a significant delay penalty. Simple countermeasures can be taken to reduce this penalty and obtain a meaningful accuracy/delay trade-off

Robotic Wireless Sensor Networks

In this chapter, we present a literature survey of an emerging, cutting-edge, and multi-disciplinary field of research at the intersection of Robotics and Wireless Sensor Networks (WSN) which we refer to as Robotic Wireless Sensor Networks (RWSN). We define a RWSN as an autonomous networked multi-robot system that aims to achieve certain sensing goals while meeting and maintaining certain communication performance requirements, through cooperative control, learning and adaptation. While both of the component areas, i.e., Robotics and WSN, are very well-known and well-explored, there exist a whole set of new opportunities and research directions at the intersection of these two fields which are relatively or even completely unexplored. One such example would be the use of a set of robotic routers to set up a temporary communication path between a sender and a receiver that uses the controlled mobility to the advantage of packet routing. We find that there exist only a limited number of articles to be directly categorized as RWSN related works whereas there exist a range of articles in the robotics and the WSN literature that are also relevant to this new field of research. To connect the dots, we first identify the core problems and research trends related to RWSN such as connectivity, localization, routing, and robust flow of information. Next, we classify the existing research on RWSN as well as the relevant state-of-the-arts from robotics and WSN community according to the problems and trends identified in the first step. Lastly, we analyze what is missing in the existing literature, and identify topics that require more research attention in the future

Scalable positioning of commodity mobile devices using audio signals

This thesis explores the problem of computing a position map for co-located mobile devices. The positioning should happen in a scalable manner without requiring specialized hardware and without requiring specialized infrastructure (except basic Wi-Fi or cellular access). At events like meetings, talks, or conferences, a position map can aid spontaneous communication among users based on their relative position in two ways. First, it enables users to choose message recipients based on their relative position, which also enables the position-based distribution of documents. Second, it enables senders to attach their position to messages, which can facilitate interaction between speaker and audience in a lecture hall and enables the collection of feedback based on users’ location. In this thesis, we present Sonoloc, a mobile app and system that, by relying on acoustic signals, allows a set of commodity smart devices to determine their relative positions. Sonoloc can position any number of devices within acoustic range with a constant number of acoustic signals emitted by a subset of devices. Our experimental evaluation with up to 115 devices in real rooms shows that – despite substantial background noise – the system can locate devices with an accuracy of tens of centimeters using no more than 15 acoustic signals.Diese Dissertation befasst sich mit dem Problem, eine Positionskarte von sich am gleichen Ort befindenden mobilen Geräten zu berechnen. Dies soll skalierbar, ohne Verwendung von spezialisierter Hardware oder Infrastruktur (ausgenommen einfache WLAN- oder Mobilfunkzugang) erfolgen. Bei Veranstaltungen wie Meetings, Diskussionen oder Konferenzen kann eine Positionskarte die Benutzer bei spontaner Kommunikation mithilfe der relativen Positionen in zweierlei Hinsicht unterstützen. Erstens ermöglicht sie den Benutzern, die Empfänger von Nachrichten aufgrund deren Position zu wählen, was auch eine positionsabhängige Verteilung von Unterlagen erlaubt. Zweitens ermöglicht sie den Sendern, ihre Position in die Nachrichten zu integrieren, was eine Interaktion zwischen Referent und Zuhörer in einem Hörsaal und die Sammlung von positionsabhängigen Rückmeldungen erlaubt. In dieser Dissertation stellen wir die Mobile-App und das System Sonoloc vor, das mithilfe von Tonsignalen erlaubt, die relative Position handelsüblicher, intelligenter Geräte zu bestimmen. Sonoloc kann eine beliebige Zahl von Geräten innerhalb des Hörbereichs durch eine gleichbleibende Zahl von Tonsignalen, die von einer Teilmenge der Geräte gesendet werden, lokalisieren. Unsere experimentelle Analyse mit bis zu 115 Geräten in echten Räumen zeigt, dass das System trotz signifikanter Hintergrundgeräusche unter Verwendung von bis zu 15 Tonsignalen mit einer Genauigkeit von wenigen Dezimetern Geräte lokalisieren kann.This work was supported in part by the European Research Council (ERC Synergy imPACT 610150), the German Science Foundation (DFG CRC 1223), the Japan Society for the Promotion of Science (Grant-in-Aid for Scientific Research (A), KAKENHI Grant Number 16H01735), and the National Science Foundation (NSF Awards CNS 1526635 and CNS 1314857)