RFID-based indoor positioning of autonomous aid for disable people

Nowadays, global positioning system (GPS) is widely used in localization area because it's very capable and reliable. However, in indoor positioning, GPS capabilities are very limited since the satellite signals are typically strongly attenuated by walls and ceiling. Thus, this project introduced the concept which presents a self-localization of a mobile robot by fusing radio frequency identification (RFID) system and wireless communication using XBee module to be used in indoor environment. Two Xbee devices will be used to transfer data from the remote control unit to mobile robot. Aims of this project are to create a mobile robot that reacts to the remote control to go to the desired position as command. To meet the desired aim of this project, practical and compact design technique are emphasized in order to create a mobile robot and the remote control. Sixteen RFID cards are arranged in a fixed pattern on the floor. A unique code of each RFID card provides the position data to the mobile robot. An RFID reader act as antenna will be installed to read the card data on the below of the mobile robot. The user can make it come by easily pressing the remote control by informing the user location

A Novel Approach To Intelligent Navigation Of A Mobile Robot In A Dynamic And Cluttered Indoor Environment

The need and rationale for improved solutions to indoor robot navigation is increasingly driven by the influx of domestic and industrial mobile robots into the market. This research has developed and implemented a novel navigation technique for a mobile robot operating in a cluttered and dynamic indoor environment. It divides the indoor navigation problem into three distinct but interrelated parts, namely, localization, mapping and path planning. The localization part has been addressed using dead-reckoning (odometry). A least squares numerical approach has been used to calibrate the odometer parameters to minimize the effect of systematic errors on the performance, and an intermittent resetting technique, which employs RFID tags placed at known locations in the indoor environment in conjunction with door-markers, has been developed and implemented to mitigate the errors remaining after the calibration. A mapping technique that employs a laser measurement sensor as the main exteroceptive sensor has been developed and implemented for building a binary occupancy grid map of the environment. A-r-Star pathfinder, a new path planning algorithm that is capable of high performance both in cluttered and sparse environments, has been developed and implemented. Its properties, challenges, and solutions to those challenges have also been highlighted in this research. An incremental version of the A-r-Star has been developed to handle dynamic environments. Simulation experiments highlighting properties and performance of the individual components have been developed and executed using MATLAB. A prototype world has been built using the WebotsTM robotic prototyping and 3-D simulation software. An integrated version of the system comprising the localization, mapping and path planning techniques has been executed in this prototype workspace to produce validation results

Accurate pedestrian indoor navigation by tightly coupling foot-mounted IMU and RFID measurements

We present a new method to accurately locate persons indoors by fusing inertial navigation system (INS) techniques with active RFID technology. A foot-mounted inertial measuring units (IMUs)-based position estimation method, is aided by the received signal strengths (RSSs) obtained from several active RFID tags placed at known locations in a building. In contrast to other authors that integrate IMUs and RSS with a loose Kalman filter (KF)-based coupling (by using the residuals of inertial- and RSS-calculated positions), we present a tight KF-based INS/RFID integration, using the residuals between the INS-predicted reader-to-tag ranges and the ranges derived from a generic RSS path-loss model. Our approach also includes other drift reduction methods such as zero velocity updates (ZUPTs) at foot stance detections, zero angular-rate updates (ZARUs) when the user is motionless, and heading corrections using magnetometers. A complementary extended Kalman filter (EKF), throughout its 15-element error state vector, compensates the position, velocity and attitude errors of the INS solution, as well as IMU biases. This methodology is valid for any kind of motion (forward, lateral or backward walk, at different speeds), and does not require an offline calibration for the user gait. The integrated INS+RFID methodology eliminates the typical drift of IMU-alone solutions (approximately 1% of the total traveled distance), resulting in typical positioning errors along the walking path (no matter its length) of approximately 1.5 m

Ultra high frequency (UHF) radio-frequency identification (RFID) for robot perception and mobile manipulation

Personal robots with autonomy, mobility, and manipulation capabilities have the potential to dramatically improve quality of life for various user populations, such as older adults and individuals with motor impairments. Unfortunately, unstructured environments present many challenges that hinder robot deployment in ordinary homes. This thesis seeks to address some of these challenges through a new robotic sensing modality that leverages a small amount of environmental augmentation in the form of Ultra High Frequency (UHF) Radio-Frequency Identification (RFID) tags. Previous research has demonstrated the utility of infrastructure tags (affixed to walls) for robot localization; in this thesis, we specifically focus on tagging objects. Owing to their low-cost and passive (battery-free) operation, users can apply UHF RFID tags to hundreds of objects throughout their homes. The tags provide two valuable properties for robots: a unique identifier and receive signal strength indicator (RSSI, the strength of a tag's response). This thesis explores robot behaviors and radio frequency perception techniques using robot-mounted UHF RFID readers that enable a robot to efficiently discover, locate, and interact with UHF RFID tags applied to objects and people of interest. The behaviors and algorithms explicitly rely on the robot's mobility and manipulation capabilities to provide multiple opportunistic views of the complex electromagnetic landscape inside a home environment. The electromagnetic properties of RFID tags change when applied to common household objects. Objects can have varied material properties, can be placed in diverse orientations, and be relocated to completely new environments. We present a new class of optimization-based techniques for RFID sensing that are robust to the variation in tag performance caused by these complexities. We discuss a hybrid global-local search algorithm where a robot employing long-range directional antennas searches for tagged objects by maximizing expected RSSI measurements; that is, the robot attempts to position itself (1) near a desired tagged object and (2) oriented towards it. The robot first performs a sparse, global RFID search to locate a pose in the neighborhood of the tagged object, followed by a series of local search behaviors (bearing estimation and RFID servoing) to refine the robot's state within the local basin of attraction. We report on RFID search experiments performed in Georgia Tech's Aware Home (a real home). Our optimization-based approach yields superior performance compared to state of the art tag localization algorithms, does not require RF sensor models, is easy to implement, and generalizes to other short-range RFID sensor systems embedded in a robot's end effector. We demonstrate proof of concept applications, such as medication delivery and multi-sensor fusion, using these techniques. Through our experimental results, we show that UHF RFID is a complementary sensing modality that can assist robots in unstructured human environments.PhDCommittee Chair: Kemp, Charles C.; Committee Member: Abowd, Gregory; Committee Member: Howard, Ayanna; Committee Member: Ingram, Mary Ann; Committee Member: Reynolds, Matt; Committee Member: Tentzeris, Emmanoui

Mapping, Path Following, and Perception with Long Range Passive UHF RFID for Mobile Robots

Service robots have shown an impressive potential in providing assistance and guidance in various environments, such as supermarkets, shopping malls, homes, airports, and libraries. Due to the low-cost and contactless way of communication, radio-frequency identification (RFID) technology provides a solution to overcome the difficulties (e.g. occlusions) that the traditional line of sight sensors (e.g. cameras and laser range finders) face. In this thesis, we address the applications of using passive ultra high frequency (UHF) RFID as a sensing technology for mobile robots in three fundamental tasks, namely mapping, path following, and tracking. An important task in the field of RFID is mapping, which aims at inferring the positions of RFID tags based on the measurements (i.e. the detections as well as the received signal strength) received by the RFID reader. The robot, which serves as an intelligent mobile carrier, is able to localize itself in a known environment based on the existing positioning techniques, such as laser-based Monte Carlo localization. The mapping process requires a probabilistic sensor model, which characterizes the likelihood of receiving a measurement, given the relative pose of the antenna and the tag. In this thesis, we address the problem of recovering from mapping failures of static RFID tags and localizing non-static RFID tags which do not move frequently using a particle filter. The usefulness of negative information (e.g. non-detections) is also examined in the context of mapping RFID tags. Moreover, we present a novel three dimensional (3D) sensor model to improve the mapping accuracy of RFID tags. In particular, using this new sensor model, we are able to localize the 3D position of an RFID tag by mounting two antennas at different heights on the robot. We additionally utilize negative information to improve the mapping accuracy, especially for the height estimation in our stereo antenna configuration. The model-based localization approach, which works as a dual to the mapping process, estimates the pose of the robot based on the sensor model as well as the given positions of RFID tags. The fingerprinting-based approach was shown to be superior to the model-based approach, since it is able to better capture the unpredictable radio frequency characteristics in the existing infrastructure. Here, we present a novel approach that combines RFID fingerprints and odometry information as an input of the motion control of a mobile robot for the purpose of path following in unknown environments. More precisely, we apply the teaching and playback scheme to perform this task. During the teaching stage, the robot is manually steered to move along a desired path. RFID measurements and the associated motion information are recorded in an online-fashion as reference data. In the second stage (i.e. playback stage), the robot follows this path autonomously by adjusting its pose according to the difference between the current RFIDmeasurements and the previously recorded reference measurements. Particularly, our approach needs no prior information about the distribution and positions of the tags, nor does it require a map of the environment. The proposed approach features a cost-effective alternative for mobile robot navigation if the robot is equipped with an RFID reader for inventory in RFID-tagged environments. The capability of a mobile robot to track dynamic objects is vital for efficiently interacting with its environment. Although a large number of researchers focus on the mapping of RFID tags, most of them only assume a static configuration of RFID tags and too little attention has been paid to dynamic ones. Therefore, we address the problem of tracking dynamic objects for mobile robots using RFID tags. In contrast to mapping of RFID tags, which aims at achieving a minimum mapping error, tracking does not only need a robust tracking performance, but also requires a fast reaction to the movement of the objects. To achieve this, we combine a two stage dynamic motion model with the dual particle filter, to capture the dynamic motion of the object and to quickly recover from failures in tracking. The state estimation from the particle filter is used in a combination with the VFH+ (Vector Field Histogram), which serves as a local path planner for obstacle avoidance, to guide the robot towards the target. This is then integrated into a framework, which allows the robot to search for both static and dynamic tags, follow it, and maintain the distance between them. [untranslated]Service-Roboter bergen ein großes Potential bei der Unterstützung, Beratung und Führung von Kunden oder Personal in verschiedenen Umgebungen wie zum Beispiel Supermärkten, Einkaufszentren, Wohnungen, Flughäfen und Bibliotheken. Durch die geringen Kosten und die kontaktlose Kommunikation ist die RFID Technologie in der Lage vorhandene Herausforderungen traditioneller sichtlinienbasierter Sensoren (z.B. Verdeckung beim Einsatz von Kameras oder Laser-Entfernungsmessern) zu lösen. In dieser Arbeit beschäftigen wir uns mit dem Einsatz von passivem Ultrahochfrequenz (UHF) RFID als Sensortechnologie für mobile Roboter hinsichtlich drei grundlegender Aufgabenstellungen Kartierung, Pfadverfolgung und Tracking. Kartierung nimmt eine wesentliche Rolle im Bereich der Robotik als auch beim Einsatz von RFID Sensoren ein. Hierbei ist das Ziel die Positionen von RFID-Tags anhand von Messungen (die Erfassung der Tags als solche und die Signalstärke) zu schätzen. Der Roboter, der als intelligenter mobiler Träger dient, ist in der Lage, sich selbst in einer bekannten Umgebung auf Grundlage der bestehenden Positionierungsverfahren, wie Laser-basierter Monte-Carlo Lokalisierung zurechtzufinden. Der Kartierungsprozess erfordert ein probabilistisches Sensormodell, das die Wahrscheinlichkeit beschreibt, ein Tag an einer gegebenen Position relativ zur RFID-Antenne (ggf. mit einer bestimmten Signalstärke) zu erkennen. Zentrale Aspekte dieser Arbeit sind die Regeneration bei fehlerhafter Kartierung statischer RFID-Tags und die Lokalisierung von nicht-statischen RFID-Tags. Auch wird die Verwendbarkeit negativer Informationen, wie z.B. das Nichterkennen von Transpondern, im Rahmen der RFID Kartierung untersucht. Darüber hinaus schlagen wir ein neues 3D-Sensormodell vor, welches die Genauigkeit der Kartierung von RFID-Tags verbessert. Durch die Montage von zwei Antennen auf verschiedenen Höhen des eingesetzten Roboters, erlaubt es dieses Modell im Besonderen, die 3D Positionen von Tags zu bestimmen. Dabei nutzen wir zusätzlich negative Informationen um die Genauigkeit der Kartierung zu erhöhen. Dank der Eindeutigkeit von RFID-Tags, ist es möglich die Lokalisierung eines mobilen Roboters ohne Mehrdeutigkeit zu bestimmen. Der modellbasierte Ansatz zur Lokalisierung schätzt die Pose des Roboters auf Basis des Sensormodells und den angegebenen Positionen der RFID-Tags. Es wurde gezeigt, dass der Fingerprinting-Ansatz dem modellbasierten Ansatz überlegen ist, da ersterer in der Lage ist, die unvorhersehbaren Funkfrequenzeigenschaften in der vorhandenen Infrastruktur zu erfassen. Hierfür präsentieren wir einen neuen Ansatz, der RFID Fingerprints und Odometrieinformationen für die Zwecke der Pfadverfolgung in unbekannten Umgebungen kombiniert. Dieser basiert auf dem Teaching-and-Playback-Schema. Während der Teaching-Phase wird der Roboter manuell gelenkt, um ihn entlang eines gewünschten Pfades zu bewegen. RFID-Messungen und die damit verbundenen Bewegungsinformationen werden als Referenzdaten aufgezeichnet. In der zweiten Phase, der Playback-Phase, folgt der Roboter diesem Pfad autonom. Der vorgeschlagene Ansatz bietet eine kostengünstige Alternative für die mobile Roboternavigation bei der Bestandsaufnahme in RFID-gekennzeichneten Umgebungen, wenn der Roboter mit einem RFID-Lesegerät ausgestattet ist. Die Fähigkeit eines mobilen Roboters dynamische Objekte zu verfolgen ist entscheidend für eine effiziente Interaktion mit der Umgebung. Obwohl sich viele Forscher mit der Kartierung von RFID-Tags befassen, nehmen die meisten eine statische Konfiguration der RFID-Tags an, nur wenige berücksichtigen dabei dynamische RFID-Tags. Wir wenden uns daher dem Problem der RFID basierten Verfolgung dynamischer Objekte mit mobilen Robotern zu. Im Gegensatz zur Kartierung von RFID-Tags, ist für die Verfolgung nicht nur eine stabile Erkennung notwendig, es ist zudem erforderlich schnell auf die Bewegung der Objekte reagieren zu können. Um dies zu erreichen, kombinieren wir ein zweistufiges dynamisches Bewegungsmodell mit einem dual-Partikelfilter. Die Zustandsschätzung des Partikelfilters wird in Kombination mit dem VFH+ (Vektorfeld Histogramm) verwendet, um den Roboter in Richtung des Ziels zu leiten. Hierdurch ist es dem Roboter möglich nach statischen und dynamischen Tags zu suchen, ihnen zu folgen und dabei einen gewissen Abstand zu halten

Improving Indoor Security Surveillance by Fusing Data from BIM, UWB and Video

Indoor physical security, as a perpetual and multi-layered phenomenon, is a time-intensive and labor-consuming task. Various technologies have been leveraged to develop automatic access control, intrusion detection, or video monitoring systems. Video surveillance has been significantly enhanced by the advent of Pan-Tilt-Zoom (PTZ) cameras and advanced video processing, which together enable effective monitoring and recording. The development of ubiquitous object identification and tracking technologies provides the opportunity to accomplish automatic access control and tracking. Intrusion detection has also become possible through deploying networks of motion sensors for alerting about abnormal behaviors. However, each of the above-mentioned technologies has its own limitations. This thesis presents a fully automated indoor security solution that leverages an Ultra-wideband (UWB) Real-Time Locating System (RTLS), PTZ surveillance cameras and a Building Information Model (BIM) as three sources of environmental data. Providing authorized persons with UWB tags, unauthorized intruders are distinguished as the mismatch observed between the detected tag owners and the persons detected in the video, and intrusion alert is generated. PTZ cameras allow for wide-area monitoring and motion-based recording. Furthermore, the BIM is used for space modeling and mapping the locations of intruders in the building. Fusing UWB tracking, video and spatial data can automate the entire security procedure from access control to intrusion alerting and behavior monitoring. Other benefits of the proposed method include more complex query processing and interoperability with other BIM-based solutions. A prototype system is implemented that demonstrates the feasibility of the proposed method

MULTI-SENSOR LOCALIZATION AND TRACKING IN DISASTER MANAGEMENT AND INDOOR WAYFINDING FOR VISUALLY IMPAIRED USERS

This dissertation proposes a series of multi-sensor localization and tracking algorithms particularly developed for two important application domains, which are disaster management and indoor wayfinding for blind and visually impaired (BVI) users. For disaster management, we developed two different localization algorithms, one each for Radio Frequency Identification (RFID) and Bluetooth Low Energy (BLE) technology, which enable the disaster management system to track patients in real-time. Both algorithms work in the absence of any pre-deployed infrastructure along with smartphones and wearable devices. Regarding indoor wayfinding for BVI users, we have explored several types of indoor positioning techniques including BLE-based, inertial, visual and hybrid approaches to offer accurate and reliable location and orientation in complex navigation spaces. In this dissertation, significant contributions have been made in the design and implementation of various localization and tracking algorithms under different requirements of certain applications

Review of computer vision in intelligent environment design

This paper discusses and compares the use of vision based and non-vision based technologies in developing intelligent environments. By reviewing the related projects that use vision based techniques in intelligent environment design, the achieved functions, technical issues and drawbacks of those projects are discussed and summarized, and the potential solutions for future improvement are proposed, which leads to the prospective direction of my PhD research

RFID-Guided Robots for Pervasive Automation

©2010 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works.DOI: 10.1109/MPRV.2010.17Passive UHF RFID tags are well matched to robots' needs. Unlike lowfrequency (LF) and high-frequency (HF) RFID tags, passive UHF RFID tags are readable from across a room, enabling a mobile robot to efficiently discover and locate them. Using tags' unique IDs, a semantic database, and RF perception via actuated antennas, this paper shows how a robot can reliably interact with people and manipulate labeled objects