Position Estimation of Robotic Mobile Nodes in Wireless Testbed using GENI

We present a low complexity experimental RF-based indoor localization system based on the collection and processing of WiFi RSSI signals and processing using a RSS-based multi-lateration algorithm to determine a robotic mobile node's location. We use a real indoor wireless testbed called w-iLab.t that is deployed in Zwijnaarde, Ghent, Belgium. One of the unique attributes of this testbed is that it provides tools and interfaces using Global Environment for Network Innovations (GENI) project to easily create reproducible wireless network experiments in a controlled environment. We provide a low complexity algorithm to estimate the location of the mobile robots in the indoor environment. In addition, we provide a comparison between some of our collected measurements with their corresponding location estimation and the actual robot location. The comparison shows an accuracy between 0.65 and 5 meters.Comment: (c) 2016 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other work

Benchmarking of localization solutions : guidelines for the selection of evaluation points

Indoor localization solutions are key enablers for next-generation indoor navigation and track and tracing solutions. As a result, an increasing number of different localization algorithms have been proposed and evaluated in scientific literature. However, many of these publications do not accurately substantiate the used evaluation methods. In particular, many authors utilize a different number of evaluation points, but they do not (i) analyze if the number of used evaluation points is sufficient to accurately evaluate the performance of their solutions and (ii) report on the uncertainty of the published results. To remedy this, this paper evaluates the influence of the selection of evaluation points. Based on statistical parameters such as the standard error of the mean value, an estimator is defined that can be used to quantitatively analyze the impact of the number of used evaluation points on the confidence interval of the mean value of the obtained results. This estimator is used to estimate the uncertainty of the presented accuracy results, and can be used to identify if more evaluations are required. To validate the proposed estimator, two different localization algorithms are evaluated in different testbeds and using different types of technology, showing that the number of required evaluation points does indeed vary significantly depending on the evaluated solution. (C) 2017 Elsevier B.V. All rights reserved

Toward Standardized Performance Evaluation of Flow-guided Nanoscale Localization

Nanoscale devices featuring Terahertz (THz)-based wireless communication capabilities are envisioned to be deployed within human bloodstreams. Such devices are envisaged to enable fine-grained sensing-based applications for detecting events for early indications of various health conditions, as well as actuation-based ones such as the targeted drug delivery. Intuitively, associating the locations of such events with the events themselves would provide an additional utility for precision diagnostics and treatment. This vision recently yielded a new class of in-body localization coined under the term "flow-guided nanoscale localization". Such localization can be piggybacked on THz-based communication for detecting body regions in which events were observed based on the duration of one circulation of a nanodevice in the bloodstream. From a decades-long research on objective benchmarking of "traditional" indoor localization, as well as its eventual standardization (e.g., ISO/IEC 18305:2016), we know that in early stages the reported performance results were often incomplete (e.g., targeting a subset of relevant metrics), carrying out benchmarking experiments in different evaluation environments and scenarios, and utilizing inconsistent performance indicators. To avoid such a "lock-in" in flow-guided localization, in this paper we discuss a workflow for standardized evaluation of such localization. The workflow is implemented in the form of an open-source framework that is able to jointly account for the mobility of the nanodevices in the bloodstream, in-body THz communication between the nanodevices and on-body anchors, and energy-related and other technological constraints at the nanodevice level. Accounting for these constraints, the framework is able to generate the raw data that can be streamlined into different flow-guided solutions for generating standardized performance benchmarks.Comment: 8 pages, 6 figures, 15 references, available at: https://bitbucket.org/filip_lemic/flow-guided-localization-in-ns3/src/master

A realistic evaluation of indoor robot position tracking systems: The IPIN 2016 competition experience

We report a novel open competition aimed at evaluating accurate robot position tracking in indoor environments. The competition was organized within the IPIN 2016 (Indoor Positioning and Indoor Navigation international Conference). Here, we describe the competition, the competitors and their final results. The challenges of this new competition included: tracking an industrial robot following an unknown path but with a defined ground-truth, and open positioning system to be deployed on-site, with no restrictions apart from those related to safety issues. Our aim here is to provide sufficient detail to serve as a solid basis for future competition initiatives with a similar scope, using common metrics and objective evaluation procedures. In addition, the real systems evaluated represent state-of-the-art performance, and thus offer interesting solutions to the problem posed in the competition.Agencia Estatal de InvestigaciónUniversidad de Alcal

Off-line evaluation of mobile-centric indoor positioning systems: the experiences from the 2017 IPIN competition

The development of indoor positioning solutions using smartphones is a growing activity with an enormous potential for everyday life and professional applications. The research activities on this topic concentrate on the development of new positioning solutions that are tested in specific environments under their own evaluation metrics. To explore the real positioning quality of smartphone-based solutions and their capabilities for seamlessly adapting to different scenarios, it is needed to find fair evaluation frameworks. The design of competitions using extensive pre-recorded datasets is a valid way to generate open data for comparing the different solutions created by research teams. In this paper, we discuss the details of the 2017 IPIN indoor localization competition, the different datasets created, the teams participating in the event, and the results they obtained. We compare these results with other competition-based approaches (Microsoft and Perf-loc) and on-line evaluation web sites. The lessons learned by organising these competitions and the benefits for the community are addressed along the paper. Our analysis paves the way for future developments on the standardization of evaluations and for creating a widely-adopted benchmark strategy for researchers and companies in the field.We would like to thank Topcon Corporation for sponsoring the competition track with an award for the winning team. We are also grateful to Francesco Potorti, Sangjoon Park, Hideo Makino, Nobuo Kawaguchi, Takeshi Kurata and Jesus Urena for their invaluable help in organizing and promoting the IPIN competition and conference. Many thanks to Raul Montoliu, Emilio Sansano, Marina Granel and Luis Alisandra for collecting the databases in the UJITI building. Parts of this work were carried out with the financial support received from projects and grants: REPNIN network (TEC2015-71426-REDT), LORIS (TIN2012-38080-C04-04), TARSIUS (TIN2015-71564-C4-2-R (MINECO/FEDER)), SmartLoc (CSIC-PIE Ref. 201450E011), "Metodologias avanzadas para el diseno, desarrollo, evaluacion e integracion de algoritmos de localizacion en interiores" (TIN2015-70202-P), GEO-C (Project ID: 642332, H2020-MSCA-ITN-2014-Marie Sklodowska-Curie Action: Innovative Training Networks), and financial support from the Ministry of Science and Technology, Taiwan (106-3114-E-007-005 and 105-2221-E-155-013-MY3). The HFTS team has been supported in the frame of the German Federal Ministry of Education and Research programme "FHprofUnt2013" under contract 03FH035PB3 (Project SPIRIT). The UMinho team has been supported by COMPETE: POCI-01-0145-FEDER-007043 and FCT-Fundacao para a Ciencia e Tecnologia within the Project Scope: UID/CEC/00319/2013. G.M. Mendoza-Silva gratefully acknowledges funding from grant PREDOC/2016/55 by Universitat Jaume I.info:eu-repo/semantics/publishedVersio

The smartphone-based offline indoor location competition at IPIN 2016: analysis and future work

This paper presents the analysis and discussion of the off-site localization competition track, which took place during the Seventh International Conference on Indoor Positioning and Indoor Navigation (IPIN 2016). Five international teams proposed different strategies for smartphone-based indoor positioning using the same reference data. The competitors were provided with several smartphone-collected signal datasets, some of which were used for training (known trajectories), and others for evaluating (unknown trajectories). The competition permits a coherent evaluation method of the competitors' estimations, where inside information to fine-tune their systems is not offered, and thus provides, in our opinion, a good starting point to introduce a fair comparison between the smartphone-based systems found in the literature. The methodology, experience, feedback from competitors and future working lines are described.We would like to thank Tecnalia Research & Innovation Foundation for sponsoring the competition track with an award for the winning team. We are also grateful to Francesco Potortì, Sangjoon Park, Jesús Ureña and Kyle O’Keefe for their invaluable help in promoting the IPIN competition and conference. Parts of this work was carried out with the financial support received from projects and grants: LORIS (TIN2012-38080-C04-04), TARSIUS (TIN2015-71564-C4-2-R (MINECO/FEDER)), SmartLoc (CSIC-PIE Ref.201450E011), “Metodologías avanzadas para el diseño, desarrollo, evaluación e integración de algoritmos de localización en interiores” (TIN2015-70202-P), REPNIN network (TEC2015-71426-REDT) and the José Castillejo mobility grant (CAS16/00072). The HFTS team has been supported in the frame of the German Federal Ministry of Education and Research programme “FHprofUnt2013” under contract 03FH035PB3 (Project SPIRIT). The UMinho team has been supported by COMPETE: POCI-01-0145-FEDER-007043 and FCT — Fundação para a Ciência e Tecnologia within the Project Scope: UID/CEC/00319/2013.info:eu-repo/semantics/publishedVersio