MScMS-II: an innovative IR-based indoor coordinate measuring system for large-scale metrology applications

According to the current great interest concerning large-scale metrology applications in many different fields of manufacturing industry, technologies and techniques for dimensional measurement have recently shown a substantial improvement. Ease-of-use, logistic and economic issues, as well as metrological performance are assuming a more and more important role among system requirements. This paper describes the architecture and the working principles of a novel infrared (IR) optical-based system, designed to perform low-cost and easy indoor coordinate measurements of large-size objects. The system consists of a distributed network-based layout, whose modularity allows fitting differently sized and shaped working volumes by adequately increasing the number of sensing units. Differently from existing spatially distributed metrological instruments, the remote sensor devices are intended to provide embedded data elaboration capabilities, in order to share the overall computational load. The overall system functionalities, including distributed layout configuration, network self-calibration, 3D point localization, and measurement data elaboration, are discussed. A preliminary metrological characterization of system performance, based on experimental testing, is also presente

Cooperative Localization in Mobile Underwater Acoustic Sensor Networks

Die großflächige Erkundung und Überwachung von Tiefseegebieten gewinnt mehr und mehr an Bedeutung für Industrie und Wissenschaft. Diese schwer zugänglichen Areale in der Tiefsee können nur mittels Teams unbemannter Tauchbote effizient erkundet werden. Aufgrund der hohen Kosten, war bisher ein Einsatz von mehreren autonomen Unterwasserfahrzeugen (AUV) wirtschaftlich undenkbar, wodurch AUV-Teams nur in Simulationen erforscht werden konnten. In den letzten Jahren konnte jedoch eine Entwicklung hin zu günstigeren und robusteren AUVs beobachtet werden. Somit wird der Einsatz von AUV-Teams in Zukunft zu einer realen Option. Die wachsende Nachfrage nach Technologien zur Unterwasseraufklärung und Überwachung konnte diese Entwicklung noch zusätzlich beschleunigen. Eine der größten technischen Hürden für tief tauchende AUVs ist die Unterwasserlokalisierug. Satelitengestützte Navigation ist in der Tiefe nicht möglich, da Radiowellen bereits nach wenigen Metern im Wasser stark an Intensität verlieren. Daher müssen neue Ansätze für die Unterwasserlokalisierung entwickelt werden die sich auch für Fahrzeugenverbände skalieren lassen. Der Einsatz von AUV-Teams ermöglicht nicht nur völlig neue Möglichkeiten der Kooperation, sondern erlaubt auch jedem einzelnen AUV von den Navigationsdaten der anderen Fahrzeuge im Verband zu profitieren, um die eigene Lokalisierung zu verbessern. In dieser Arbeit wird ein kooperativer Lokalisierungsansatz vorgestellt, welcher auf dem Nachrichtenaustausch durch akustische Ultra-Short Base-Line (USBL) Modems basiert. Ein akustisches Modem ermöglicht die Übertragung von Datenpaketen im Wasser, wärend ein USBL-Sensor die Richtung einer akustischen Quelle bestimmen kann. Durch die Kombination von Modem und Sensor entsteht ein wichtiges Messinstrument für die Unterwasserlokalisierung. Wenn ein Fahrzeug ein Datenpaket mit seiner eignen Position aussendet, können andere Fahrzeuge mit einem USBL-Modem diese Nachricht empfangen. In Verbindung mit der Richtungsmessung zur Quelle, können diese Daten von einem Empfangenden AUV verwendet werden, um seine eigene Positionsschatzung zu verbessern. Diese Arbeit schlägt einen Ansatz zur Fusionierung der empfangenen Nachricht mit der Richtungsmessung vor, welcher auch die jeweiligen Messungenauigkeiten berücksichtigt. Um die Messungenauigkeit des komplexen USBL-Sensors bestimmen zu können, wurde zudem ein detailliertes Sensormodell entwickelt. Zunächst wurden existierende Ansätze zur kooperativen Lokalisierung (CL) untersucht, um daraus eine Liste von erwünschten Eigenschaften für eine CL abzuleiten. Darauf aufbauend wurde der Deep-Sea Network Lokalisation (DNL) Ansatz entwickelt. Bei DNL handelt es sich um eine CL Methode, bei der die Skalierbarkeit sowie die praktische Anwendbarkeit im Fokus stehen. DNL ist als eine Zwischenschicht konzipiert, welche USBL-Modem und Navigationssystem miteinander verbindet. Es werden dabei Messwerte und Kommunikationsdaten des USBL zu einer Standortbestimmung inklusive Richtungsschätzung fusioniert und an das Navigationssystem weiter geleitet, ähnlich einem GPS-Sensor. Die Funktionalität von USBL-Modell und DNL konnten evaluiert werden anhand von Messdaten aus Seeerprobungen in der Ostsee sowie im Mittelatlantik. Die Qualität einer CL hangt häufig von vielen unterschiedlichen Faktoren ab. Die Netzwerktopologie muss genauso berücksichtig werden wie die Lokalisierungsfähigkeiten jedes einzelnen Teilnehmers. Auch das Kommunikationsverhalten der einzelnen Teilnehmer bestimmt, welche Informationen im Netzwerk vorhanden sind und hat somit einen starken Einfluss auf die CL. Um diese Einflussfaktoren zu untersuchen, wurden eine Reihe von Szenarien simuliert, in denen Kommunikationsverhalten und Netzwerktopologie für eine Gruppe von AUVs variiert wurden. In diesen Experimenten wurden die AUVs durch ein Oberflächenfahrzeug unterstützt, welches seine geo-referenzierte Position über DNL an die getauchten Fahrzeuge weiter leitete. Anhand der untersuchten Topologie können die Experimente eingeteilt werden in Single-Hop und Multi-Hop. Single-Hop bedeutet, dass jedes AUV sich in der Sendereichweite des Oberflächenfahrzeugs befindet und dessen Positionsdaten auf direktem Wege erhält. Wie die Ergebnisse der Single-Hop Experimente zeigen, kann der Lokalisierungsfehler der AUVs eingegrenzt werden, wenn man DNL verwendet. Dabei korreliert der Lokalisierungsfehler mit der kombinierten Ungenauigkeit von USBL-Messung und Oberflächenfahrzeugposition. Bei den Multi-Hop Experimenten wurde die Topologie so geändert, dass sich nur eines der AUVs in direkter Sendereichweite des Oberflächenfahrzeugs befindet. Dieses AUV verbessert seine Position mit den empfangen Daten des Oberflächenfahrzeugs und sendet wiederum seine verbesserte Position an die anderen AUVs. Auch hier konnte gezeigt werden, dass sich der Lokalisierungfehler der Gruppe mit DNL einschränken lässt. Ändert man nun das Schema der Kommunikation so, dass alle AUVs zyklisch ihre Position senden, zeigte sich eine Verschlechterung der Lokalisierungsqualität der Gruppe. Dieses unerwartet Ergebnis konnte auf einen Teil des DNL-Algorithmus zurück geführt werden. Da die verwendete USBL-Klasse nur die Richtung eines Signals misst, nicht jedoch die Entfernung zum Sender, wird in der DNL-Schicht eine Entfernungsschatzung vorgenommen. Wenn die Kommunikation nicht streng unidirektional ist, entsteht eine Ruckkopplungsschleife, was zu fehlerhaften Entfernungsschatzungen führt. Im letzten Experiment wird gezeigt wie sich dieses Problem vermeiden lasst, mithilfe einer relativ neue USBL-Klasse, die sowohl Richtung als auch Entfernung zum Sender misst. Die zwei wesentlichen Beiträge dieser Arbeit sind das USBL-Model zum einen und zum Anderen, der neue kooperative Lokalisierungsansatz DNL. Mithilfe des Sensormodels lassen sich nicht nur Messabweichungen einer USBL-Messung bestimmen, es kann auch dazu genutzt werden, einige Fehlereinflüsse zu korrigieren. Mit DNL wurde eine skalierbare CL-Methode entwickelt, die sich gut für den den Einsatz bei mobilen Unterwassersensornetzwerken eignet. Durch das Konzept als Zwischenschicht, lasst sich DNL einfach in bestehende Navigationslösungen integrieren, um die Langzeitstabilität der Navigation für große Verbände von tiefgetauchten Fahrzeugen zu gewährleisten. Sowohl USBL-Model als auch DNL sind dabei so ressourcenschonend, dass sie auf dem Computer eines Standard USBL laufen können, ohne die ursprüngliche Funktionalität einzuschränken, was den praktischen Einsatz zusätzlich vereinfacht

Magnetic-Visual Sensor Fusion-based Dense 3D Reconstruction and Localization for Endoscopic Capsule Robots

Reliable and real-time 3D reconstruction and localization functionality is a crucial prerequisite for the navigation of actively controlled capsule endoscopic robots as an emerging, minimally invasive diagnostic and therapeutic technology for use in the gastrointestinal (GI) tract. In this study, we propose a fully dense, non-rigidly deformable, strictly real-time, intraoperative map fusion approach for actively controlled endoscopic capsule robot applications which combines magnetic and vision-based localization, with non-rigid deformations based frame-to-model map fusion. The performance of the proposed method is demonstrated using four different ex-vivo porcine stomach models. Across different trajectories of varying speed and complexity, and four different endoscopic cameras, the root mean square surface reconstruction errors 1.58 to 2.17 cm.Comment: submitted to IROS 201

Sistemas de posicionamento baseados em comunicação por luz para ambientes interiores

The demand for highly precise indoor positioning systems (IPSs) is growing rapidly due to its potential in the increasingly popular techniques of the Internet of Things, smart mobile devices, and artificial intelligence. IPS becomes a promising research domain that is getting wide attention due to its benefits in several working scenarios, such as, industries, indoor public locations, and autonomous navigation. Moreover, IPS has a prominent contribution in day-to-day activities in organizations such as health care centers, airports, shopping malls, manufacturing, underground locations, etc., for safe operating environments. In indoor environments, both radio frequency (RF) and optical wireless communication (OWC) based technologies could be adopted for localization. Although the RF-based global positioning system, such as, Global positioning system offers higher penetration rates with reduced accuracy (i.e., in the range of a few meters), it does not work well in indoor environments (and not at all in certain cases such as tunnels, mines, etc.) due to the very weak signal and no direct access to the satellites. On the other hand, the light-based system known as a visible light positioning (VLP) system, as part of the OWC systems, uses the pre-existing light-emitting diodes (LEDs)-based lighting infrastructure, could be used at low cost and high accuracy compared with the RF-based systems. VLP is an emerging technology promising high accuracy, high security, low deployment cost, shorter time response, and low relative complexity when compared with RFbased positioning. However, in indoor VLP systems, there are some concerns such as, multipath reflection, transmitter tilting, transmitter’s position, and orientation uncertainty, human shadowing/blocking, and noise causing the increase in the positioning error, thereby reducing the positioning accuracy of the system. Therefore, it is imperative to capture the characteristics of different VLP channel and properly model them for the dual purpose of illumination and localization. In this thesis, firstly, the impact of transmitter tilting angles and multipath reflections are studied and for the first time, it is demonstrated that tilting the transmitter can be beneficial in VLP systems considering both line of sight (LOS) and non-line of sight transmission paths. With the transmitters oriented towards the center of the receiving plane, the received power level is maximized due to the LOS components. It is also shown that the proposed scheme offers a significant accuracy improvement of up to ~66% compared with a typical non-tilted transmitter VLP. The effect of tilting the transmitter on the lighting uniformity is also investigated and results proved that the uniformity achieved complies with the European Standard EN 12464-1. After that, the impact of transmitter position and orientation uncertainty on the accuracy of the VLP system based on the received signal strength (RSS) is investigated. Simulation results show that the transmitter uncertainties have a severe impact on the positioning error, which can be leveraged through the usage of more transmitters. Concerning a smaller transmitter’s position epochs, and the size of the training set. It is shown that, the ANN with Bayesian regularization outperforms the traditional RSS technique using the non-linear least square estimation for all values of signal to noise ratio. Furthermore, a novel indoor VLP system is proposed based on support vector machines and polynomial regression considering two different multipath environments of an empty room and a furnished room. The results show that, in an empty room, the positioning accuracy improvement for the positioning error of 2.5 cm are 36.1, 58.3, and 72.2 % for three different scenarios according to the regions’ distribution in the room. For the furnished room, a positioning relative accuracy improvement of 214, 170, and 100 % is observed for positioning error of 0.1, 0.2, and 0.3 m, respectively. Ultimately, an indoor VLP system based on convolutional neural networks (CNN) is proposed and demonstrated experimentally in which LEDs are used as transmitters and a rolling shutter camera is used as receiver. A detection algorithm named single shot detector (SSD) is used which relies on CNN (i.e., MobileNet or ResNet) for classification as well as position estimation of each LED in the image. The system is validated using a real-world size test setup containing eight LED luminaries. The obtained results show that the maximum average root mean square positioning error achieved is 4.67 and 5.27 cm with SSD MobileNet and SSD ResNet models, respectively. The validation results show that the system can process 67 images per second, allowing real-time positioning.A procura por sistemas de posicionamento interior (IPSs) de alta precisão tem crescido rapidamente devido ao seu interesse nas técnicas cada vez mais populares da Internet das Coisas, dispositivos móveis inteligentes e inteligência artificial. O IPS tornou-se um domínio de pesquisa promissor que tem atraído grande atenção devido aos seus benefícios em vários cenários de trabalho, como indústrias, locais públicos e navegação autónoma. Além disso, o IPS tem uma contribuição destacada no dia a dia de organizações, como, centros de saúde, aeroportos, supermercados, fábricas, locais subterrâneos, etc. As tecnologias baseadas em radiofrequência (RF) e comunicação óptica sem fio (OWC) podem ser adotadas para localização em ambientes interiores. Embora o sistema de posicionamento global (GPS) baseado em RF ofereça taxas de penetração mais altas com precisão reduzida (ou seja, na faixa de alguns metros), não funciona bem em ambientes interiores (e não funciona bem em certos casos como túneis, minas, etc.) devido ao sinal muito fraco e falta de acesso direto aos satélites. Por outro lado, o sistema baseado em luz conhecido como sistema de posicionamento de luz visível (VLP), como parte dos sistemas OWC, usa a infraestrutura de iluminação baseada em díodos emissores de luz (LEDs) pré-existentes, é um sistemas de baixo custo e alta precisão quando comprado com os sistemas baseados em RF. O VLP é uma tecnologia emergente que promete alta precisão, alta segurança, baixo custo de implantação, menor tempo de resposta e baixa complexidade relativa quando comparado ao posicionamento baseado em RF. No entanto, os sistemas VLP interiores, exibem algumas limitações, como, a reflexão multicaminho, inclinação do transmissor, posição do transmissor e incerteza de orientação, sombra/bloqueio humano e ruído, que têm como consequência o aumento do erro de posicionamento, e consequente redução da precisão do sistema. Portanto, é imperativo estudar as características dos diferentes canais VLP e modelá-los adequadamente para o duplo propósito de iluminação e localização. Esta tesa aborda, primeiramente, o impacto dos ângulos de inclinação do transmissor e reflexões multipercurso no desempenho do sistema de posicionamento. Demonstra-se que a inclinação do transmissor pode ser benéfica em sistemas VLP considerando tanto a linha de vista (LOS) como as reflexões. Com os transmissores orientados para o centro do plano recetor, o nível de potência recebido é maximizado devido aos componentes LOS. Também é mostrado que o esquema proposto oferece uma melhoria significativa de precisão de até ~66% em comparação com um sistema VLP de transmissor não inclinado típico. O efeito da inclinação do transmissor na uniformidade da iluminação também é investigado e os resultados comprovam que a uniformidade alcançada está de acordo com a Norma Europeia EN 12464-1. O impacto da posição do transmissor e incerteza de orientação na precisão do sistema VLP com base na intensidade do sinal recebido (RSS) foi também investigado. Os resultados da simulação mostram que as incertezas do transmissor têm um impacto severo no erro de posicionamento, que pode ser atenuado com o uso de mais transmissores. Para incertezas de posicionamento dos transmissores menores que 5 cm, os erros médios de posicionamento são 23.3, 15.1 e 13.2 cm para conjuntos de 4, 9 e 16 transmissores, respetivamente. Enquanto que, para a incerteza de orientação de um transmissor menor de 5°, os erros médios de posicionamento são 31.9, 20.6 e 17 cm para conjuntos de 4, 9 e 16 transmissores, respetivamente. O trabalho da tese abordou a investigação dos aspetos de projeto de um sistema VLP indoor no qual uma rede neuronal artificial (ANN) é utilizada para estimativa de posicionamento considerando um canal multipercurso. O estudo considerou a influência do ruído como indicador de desempenho para a comparação entre diferentes abordagens de projeto. Três algoritmos de treino de ANNs diferentes foram considerados, a saber, Levenberg-Marquardt, regularização Bayesiana e algoritmos de gradiente conjugado escalonado, para minimizar o erro de posicionamento no sistema VLP. O projeto da ANN foi otimizado com base no número de neurónios nas camadas ocultas, no número de épocas de treino e no tamanho do conjunto de treino. Mostrou-se que, a ANN com regularização Bayesiana superou a técnica RSS tradicional usando a estimação não linear dos mínimos quadrados para todos os valores da relação sinal-ruído. Foi proposto um novo sistema VLP indoor baseado em máquinas de vetores de suporte (SVM) e regressão polinomial considerando dois ambientes interiores diferentes: uma sala vazia e uma sala mobiliada. Os resultados mostraram que, numa sala vazia, a melhoria da precisão de posicionamento para o erro de posicionamento de 2.5 cm são 36.1, 58.3 e 72.2% para três cenários diferentes de acordo com a distribuição das regiões na sala. Para a sala mobiliada, uma melhoria de precisão relativa de posicionamento de 214, 170 e 100% é observada para erro de posicionamento de 0.1, 0.2 e 0.3 m, respetivamente. Finalmente, foi proposto um sistema VLP indoor baseado em redes neurais convolucionais (CNN). O sistema foi demonstrado experimentalmente usando luminárias LED como transmissores e uma camara com obturador rotativo como recetor. O algoritmo de detecção usou um detector de disparo único (SSD) baseado numa CNN pré configurada (ou seja, MobileNet ou ResNet) para classificação. O sistema foi validado usando uma configuração de teste de tamanho real contendo oito luminárias LED. Os resultados obtidos mostraram que o erro de posicionamento quadrático médio alcançado é de 4.67 e 5.27 cm com os modelos SSD MobileNet e SSD ResNet, respetivamente. Os resultados da validação mostram que o sistema pode processar 67 imagens por segundo, permitindo o posicionamento em tempo real.Programa Doutoral em Engenharia Eletrotécnic

Exploiting Sparse Structures in Source Localization and Tracking

This thesis deals with the modeling of structured signals under different sparsity constraints. Many phenomena exhibit an inherent structure that may be exploited when setting up models, examples include audio waves, radar, sonar, and image objects. These structures allow us to model, identify, and classify the processes, enabling parameter estimation for, e.g., identification, localisation, and tracking.In this work, such structures are exploited, with the goal to achieve efficient localisation and tracking of a structured source signal. Specifically, two scenarios are considered. In papers A and B, the aim is to find a sparse subset of a structured signal such that the signal parameters and source locations maybe estimated in an optimal way. For the sparse subset selection, a combinatorial optimization problem is approximately solved by means of convex relaxation, with the results of allowing for different types of a priori information to be incorporated in the optimization. In paper C, a sparse subset of data is provided, and a generative model is used to find the location of an unknown number of jammers in a wireless network, with the jammers’ movement in the network being tracked as additional observations become available

Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Age

Simultaneous Localization and Mapping (SLAM)consists in the concurrent construction of a model of the environment (the map), and the estimation of the state of the robot moving within it. The SLAM community has made astonishing progress over the last 30 years, enabling large-scale real-world applications, and witnessing a steady transition of this technology to industry. We survey the current state of SLAM. We start by presenting what is now the de-facto standard formulation for SLAM. We then review related work, covering a broad set of topics including robustness and scalability in long-term mapping, metric and semantic representations for mapping, theoretical performance guarantees, active SLAM and exploration, and other new frontiers. This paper simultaneously serves as a position paper and tutorial to those who are users of SLAM. By looking at the published research with a critical eye, we delineate open challenges and new research issues, that still deserve careful scientific investigation. The paper also contains the authors' take on two questions that often animate discussions during robotics conferences: Do robots need SLAM? and Is SLAM solved

Location-Enabled IoT (LE-IoT): A Survey of Positioning Techniques, Error Sources, and Mitigation

The Internet of Things (IoT) has started to empower the future of many industrial and mass-market applications. Localization techniques are becoming key to add location context to IoT data without human perception and intervention. Meanwhile, the newly-emerged Low-Power Wide-Area Network (LPWAN) technologies have advantages such as long-range, low power consumption, low cost, massive connections, and the capability for communication in both indoor and outdoor areas. These features make LPWAN signals strong candidates for mass-market localization applications. However, there are various error sources that have limited localization performance by using such IoT signals. This paper reviews the IoT localization system through the following sequence: IoT localization system review -- localization data sources -- localization algorithms -- localization error sources and mitigation -- localization performance evaluation. Compared to the related surveys, this paper has a more comprehensive and state-of-the-art review on IoT localization methods, an original review on IoT localization error sources and mitigation, an original review on IoT localization performance evaluation, and a more comprehensive review of IoT localization applications, opportunities, and challenges. Thus, this survey provides comprehensive guidance for peers who are interested in enabling localization ability in the existing IoT systems, using IoT systems for localization, or integrating IoT signals with the existing localization sensors

Distributed Algorithms for Stochastic Source Seeking With Mobile Robot Networks

Autonomous robot networks are an effective tool for monitoring large-scale environmental fields. This paper proposes distributed control strategies for localizing the source of a noisy signal, which could represent a physical quantity of interest such as magnetic force, heat, radio signal, or chemical concentration. We develop algorithms specific to two scenarios: one in which the sensors have a precise model of the signal formation process and one in which a signal model is not available. In the model-free scenario, a team of sensors is used to follow a stochastic gradient of the signal field. Our approach is distributed, robust to deformations in the group geometry, does not necessitate global localization, and is guaranteed to lead the sensors to a neighborhood of a local maximum of the field. In the model-based scenario, the sensors follow a stochastic gradient of the mutual information (MI) between their expected measurements and the expected source location in a distributed manner. The performance is demonstrated in simulation using a robot sensor network to localize the source of a wireless radio signal