Spatio-temporal coverage optimization of sensor networks

Les réseaux de capteurs sont formés d’un ensemble de dispositifs capables de prendre individuellement des mesures d’un environnement particulier et d’échanger de l’information afin d’obtenir une représentation de haut niveau sur les activités en cours dans la zone d’intérêt. Une telle détection distribuée, avec de nombreux appareils situés à proximité des phénomènes d’intérêt, est pertinente dans des domaines tels que la surveillance, l’agriculture, l’observation environnementale, la surveillance industrielle, etc. Nous proposons dans cette thèse plusieurs approches pour effectuer l’optimisation des opérations spatio-temporelles de ces dispositifs, en déterminant où les placer dans l’environnement et comment les contrôler au fil du temps afin de détecter les cibles mobiles d’intérêt. La première nouveauté consiste en un modèle de détection réaliste représentant la couverture d’un réseau de capteurs dans son environnement. Nous proposons pour cela un modèle 3D probabiliste de la capacité de détection d’un capteur sur ses abords. Ce modèle inègre également de l’information sur l’environnement grâce à l’évaluation de la visibilité selon le champ de vision. À partir de ce modèle de détection, l’optimisation spatiale est effectuée par la recherche du meilleur emplacement et l’orientation de chaque capteur du réseau. Pour ce faire, nous proposons un nouvel algorithme basé sur la descente du gradient qui a été favorablement comparée avec d’autres méthodes génériques d’optimisation «boites noires» sous l’aspect de la couverture du terrain, tout en étant plus efficace en terme de calculs. Une fois que les capteurs placés dans l’environnement, l’optimisation temporelle consiste à bien couvrir un groupe de cibles mobiles dans l’environnement. D’abord, on effectue la prédiction de la position future des cibles mobiles détectées par les capteurs. La prédiction se fait soit à l’aide de l’historique des autres cibles qui ont traversé le même environnement (prédiction à long terme), ou seulement en utilisant les déplacements précédents de la même cible (prédiction à court terme). Nous proposons de nouveaux algorithmes dans chaque catégorie qui performent mieux ou produits des résultats comparables par rapport aux méthodes existantes. Une fois que les futurs emplacements de cibles sont prédits, les paramètres des capteurs sont optimisés afin que les cibles soient correctement couvertes pendant un certain temps, selon les prédictions. À cet effet, nous proposons une méthode heuristique pour faire un contrôle de capteurs, qui se base sur les prévisions probabilistes de trajectoire des cibles et également sur la couverture probabiliste des capteurs des cibles. Et pour terminer, les méthodes d’optimisation spatiales et temporelles proposées ont été intégrées et appliquées avec succès, ce qui démontre une approche complète et efficace pour l’optimisation spatio-temporelle des réseaux de capteurs.Sensor networks consist in a set of devices able to individually capture information on a given environment and to exchange information in order to obtain a higher level representation on the activities going on in the area of interest. Such a distributed sensing with many devices close to the phenomena of interest is of great interest in domains such as surveillance, agriculture, environmental monitoring, industrial monitoring, etc. We are proposing in this thesis several approaches to achieve spatiotemporal optimization of the operations of these devices, by determining where to place them in the environment and how to control them over time in order to sense the moving targets of interest. The first novelty consists in a realistic sensing model representing the coverage of a sensor network in its environment. We are proposing for that a probabilistic 3D model of sensing capacity of a sensor over its surrounding area. This model also includes information on the environment through the evaluation of line-of-sight visibility. From this sensing model, spatial optimization is conducted by searching for the best location and direction of each sensor making a network. For that purpose, we are proposing a new algorithm based on gradient descent, which has been favourably compared to other generic black box optimization methods in term of performance, while being more effective when considering processing requirements. Once the sensors are placed in the environment, the temporal optimization consists in covering well a group of moving targets in the environment. That starts by predicting the future location of the mobile targets detected by the sensors. The prediction is done either by using the history of other targets who traversed the same environment (long term prediction), or only by using the previous displacements of the same target (short term prediction). We are proposing new algorithms under each category which outperformed or produced comparable results when compared to existing methods. Once future locations of targets are predicted, the parameters of the sensors are optimized so that targets are properly covered in some future time according to the predictions. For that purpose, we are proposing a heuristics for making such sensor control, which deals with both the probabilistic targets trajectory predictions and probabilistic coverage of sensors over the targets. In the final stage, both spatial and temporal optimization method have been successfully integrated and applied, demonstrating a complete and effective pipeline for spatiotemporal optimization of sensor networks

Motion Planning

Motion planning is a fundamental function in robotics and numerous intelligent machines. The global concept of planning involves multiple capabilities, such as path generation, dynamic planning, optimization, tracking, and control. This book has organized different planning topics into three general perspectives that are classified by the type of robotic applications. The chapters are a selection of recent developments in a) planning and tracking methods for unmanned aerial vehicles, b) heuristically based methods for navigation planning and routes optimization, and c) control techniques developed for path planning of autonomous wheeled platforms

Sample efficiency, transfer learning and interpretability for deep reinforcement learning

Deep learning has revolutionised artificial intelligence, where the application of increased compute to train neural networks on large datasets has resulted in improvements in real-world applications such as object detection, text-to-speech synthesis and machine translation. Deep reinforcement learning (DRL) has similarly shown impressive results in board and video games, but less so in real-world applications such as robotic control. To address this, I have investigated three factors prohibiting further deployment of DRL: sample efficiency, transfer learning, and interpretability. To decrease the amount of data needed to train DRL systems, I have explored various storage strategies and exploration policies for episodic control (EC) algorithms, resulting in the application of online clustering to improve the memory efficiency of EC algorithms, and the maximum entropy mellowmax policy for improving the sample efficiency and final performance of the same EC algorithms. To improve performance during transfer learning, I have shown that a multi-headed neural network architecture trained using hierarchical reinforcement learning can retain the benefits of positive transfer between tasks while mitigating the interference effects of negative transfer. I additionally investigated the use of multi-headed architectures to reduce catastrophic forgetting under the continual learning setting. While the use of multiple heads worked well within a simple environment, it was of limited use within a more complex domain, indicating that this strategy does not scale well. Finally, I applied a wide range of quantitative and qualitative techniques to better interpret trained DRL agents. In particular, I compared the effects of training DRL agents both with and without visual domain randomisation (DR), a popular technique to achieve simulation-to-real transfer, providing a series of tests that can be applied before real-world deployment. One of the major findings is that DR produces more entangled representations within trained DRL agents, indicating quantitatively that they are invariant to nuisance factors associated with the DR process. Additionally, while my environment allowed agents trained without DR to succeed without requiring complex recurrent processing, all agents trained with DR appear to integrate information over time, as evidenced through ablations on the recurrent state.Open Acces

Déploiement optimal de réseaux de capteurs dans des environnements intérieurs en support à la navigation des personnes à mobilité réduite

La participation sociale des personnes ayant une incapacité (PAI) est l'un des enjeux majeurs de notre société. La participation sociale des PAI est influencée par les résultats des interactions entre les facteurs personnels et les facteurs environnementaux (physiques et sociaux). L'une des activités quotidiennes les plus importantes en milieu urbain est la mobilité, ce qui est fondamental pour la participation sociale des PAI. L'environnement urbain est composé des infrastructures et des services principalement conçus pour les personnes sans incapacités et ne prend pas en compte les besoins spécifiques des PAI. Dans ce contexte, la conception et le développement des environnements intelligents peuvent contribuer à une meilleure mobilité et participation sociale des PAI grâce à l'avancement récent de technologie de l'information et de télécommunication ainsi que de réseaux de capteurs. Cependant, le déploiement de réseaux de capteurs en tant que technologie d'assistance pour améliorer la mobilité des personnes n'est conçu que sur la base des modèles trop simplistes de l'environnement physique. Bien que des approches de déploiement de réseaux de capteurs aient été développées ces dernières années, la plupart d'entre elles ont considéré le modèle simple des capteurs (cercle ou sphérique dans le meilleur des cas) et l'environnement 2D, (sans obstacle), indépendamment des besoins des PAI lors de leur mobilité. À cet égard, l'objectif global de cette thèse est le déploiement optimal de réseau de capteurs dans un environnement intérieur pour améliorer l'efficacité de la mobilité des personnes à mobilité réduite (PMR). Plus spécifiquement, nous sommes intéressés à la mobilité des personnes utilisatrices de fauteuil roulant manuel. Pour atteindre cet objectif global, trois objectifs spécifiques sont identifiés. Premièrement, nous proposons un cadre conceptuel pour l'évaluation de la lisibilité de l'environnement intérieur pour les PMR, afin de déterminer la méthode appropriée pour évaluer les interactions entre les facteurs personnels et les facteurs environnementaux (par exemple, pentes, rampes, marches, etc.). Deuxièmement, nous développons un algorithme d'optimisation locale basé sur la structure Voronoi 3D pour le déploiement de capteurs dans l'environnement intérieur 3D pour s'attaquer à la complexité de la structure de l'environnement intérieur (par exemple, différentes hauteurs de plafonds) afin de maximiser la couverture du réseau. Troisièmement, pour aider la mobilité des PMR, nous développons un algorithme d'optimisation ciblé pour le déploiement de capteurs multi-types dans l'environnement intérieur en tenant compte du cadre d'évaluation de la lisibilité pour les PMR. La question la plus importante de cette recherche est la suivante : quels sont les emplacements optimaux pour un ensemble des capteurs pour le positionnement et le guidage des PMR dans l'environnement intérieur complexe 3D. Pour répondre à cette question, les informations sur les caractéristiques des capteurs, les éléments environnementaux et la lisibilité des PMR ont été intégrés dans les algorithmes d'optimisation locale pour le déploiement de réseaux de capteurs multi-types, afin d'améliorer la couverture du réseau et d'aider efficacement les PMR lors de leur mobilité. Dans ce processus, le diagramme de Voronoi 3D, en tant que structure géométrique, est utilisé pour optimiser l'emplacement des capteurs en fonction des caractéristiques des capteurs, des éléments environnementaux et de la lisibilité des PMR. L'optimisation locale proposée a été mise en œuvre et testée avec plusieurs scénarios au Centre des congrès de Québec. La comparaison des résultats obtenus avec ceux des autres algorithmes démontre une plus grande efficacité de l'approche proposée dans cette recherche.Social participation of people with disabilities (PWD) is one of the challenging problems in our society. Social participation of PWD is influenced by results from the interactions between personal characteristics and the physical and social environments. One of the most significant daily activities in the urban environment is mobility which impacts on the social participation of PWD. The urban environment includes infrastructure and services are mostly designed for people without any disability and does not consider the specific needs of PWD. In this context, the design and development of intelligent environments can contribute to better mobility and social participation of PWD by leveraging the recent advancement in information and telecommunications technologies as well as sensor networks. Sensor networks, as an assistive technology for improving the mobility of people are generally designed based on the simplistic models of physical environment. Although sensor networks deployment approaches have been developed in recent years, the majority of them have considered the simple model of sensors (circle or spherical in the best case) and the environment (2D, without obstacles) regardless of the PWD needs during their mobility. In this regard, the global objective of this thesis is the determination of the position and type of sensors to enhance the efficiency of the people with motor disabilities (PWMD) mobility. We are more specifically interested in the mobility of people using manual wheelchair. To achieve this global objective, three specific objectives are demarcated. First, a framework is developed for legibility assessment of the indoor environment for PWMD to determine the appropriate method to evaluate the interactions between personal factors with environmental factors (e.g. slops, ramps, steps, etc.). Then, a local optimization algorithm based on 3D Voronoi structure for sensor deployment in the 3D indoor environment is developed to tackle the complexity of structure of indoor environment (e.g., various ceilings' height) to maximize the network coverage. Next, a purpose-oriented optimization algorithm for multi-type sensor deployment in the indoor environment to help the PWMD mobility is developed with consideration of the legibility assessment framework for PWMD. In this thesis, the most important question of this research is where the optimal places of sensors are for efficient guidance of the PWMD in their mobility in 3D complex indoor environments. To answer this question, the information of sensors characteristics, environmental elements and legibility of PWMD have been integrated into the local optimization algorithms for multi-type sensor networks deployment to enhance the network coverage as well as efficiently help the PWMD during their mobility. In this process, Voronoi diagram as a geometrical structure is used to change the sensors' location based on the sensor characteristics, environmental elements and legibility of PWMD. The proposed local optimization is implemented and tested for several scenarios in Quebec City Convention Centre. The obtained results show that these integration in our approach enhance its effectiveness compared to the existing methods

Outdoor operations of multiple quadrotors in windy environment

Coordinated multiple small unmanned aerial vehicles (sUAVs) offer several advantages over a single sUAV platform. These advantages include improved task efficiency, reduced task completion time, improved fault tolerance, and higher task flexibility. However, their deployment in an outdoor environment is challenging due to the presence of wind gusts. The coordinated motion of a multi-sUAV system in the presence of wind disturbances is a challenging problem when considering collision avoidance (safety), scalability, and communication connectivity. Performing wind-agnostic motion planning for sUAVs may produce a sizeable cross-track error if the wind on the planned route leads to actuator saturation. In a multi-sUAV system, each sUAV has to locally counter the wind disturbance while maintaining the safety of the system. Such continuous manipulation of the control effort for multiple sUAVs under uncertain environmental conditions is computationally taxing and can lead to reduced efficiency and safety concerns. Additionally, modern day sUAV systems are susceptible to cyberattacks due to their use of commercial wireless communication infrastructure. This dissertation aims to address these multi-faceted challenges related to the operation of outdoor rotor-based multi-sUAV systems. A comprehensive review of four representative techniques to measure and estimate wind speed and direction using rotor-based sUAVs is discussed. After developing a clear understanding of the role wind gusts play in quadrotor motion, two decentralized motion planners for a multi-quadrotor system are implemented and experimentally evaluated in the presence of wind disturbances. The first planner is rooted in the reinforcement learning (RL) technique of state-action-reward-state-action (SARSA) to provide generalized path plans in the presence of wind disturbances. While this planner provides feasible trajectories for the quadrotors, it does not provide guarantees of collision avoidance. The second planner implements a receding horizon (RH) mixed-integer nonlinear programming (MINLP) model that is integrated with control barrier functions (CBFs) to guarantee collision-free transit of the multiple quadrotors in the presence of wind disturbances. Finally, a novel communication protocol using Ethereum blockchain-based smart contracts is presented to address the challenge of secure wireless communication. The U.S. sUAV market is expected to be worth $92 Billion by 2030. The Association for Unmanned Vehicle Systems International (AUVSI) noted in its seminal economic report that UAVs would be responsible for creating 100,000 jobs by 2025 in the U.S. The rapid proliferation of drone technology in various applications has led to an increasing need for professionals skilled in sUAV piloting, designing, fabricating, repairing, and programming. Engineering educators have recognized this demand for certified sUAV professionals. This dissertation aims to address this growing sUAV-market need by evaluating two active learning-based instructional approaches designed for undergraduate sUAV education. The two approaches leverages the interactive-constructive-active-passive (ICAP) framework of engagement and explores the use of Competition based Learning (CBL) and Project based Learning (PBL). The CBL approach is implemented through a drone building and piloting competition that featured 97 students from undergraduate and graduate programs at NJIT. The competition focused on 1) drone assembly, testing, and validation using commercial off-the-shelf (COTS) parts, 2) simulation of drone flight missions, and 3) manual and semi-autonomous drone piloting were implemented. The effective student learning experience from this competition served as the basis of a new undergraduate course on drone science fundamentals at NJIT. This undergraduate course focused on the three foundational pillars of drone careers: 1) drone programming using Python, 2) designing and fabricating drones using Computer-Aided Design (CAD) and rapid prototyping, and 3) the US Federal Aviation Administration (FAA) Part 107 Commercial small Unmanned Aerial Vehicles (sUAVs) pilot test. Multiple assessment methods are applied to examine the students’ gains in sUAV skills and knowledge and student attitudes towards an active learning-based approach for sUAV education. The use of active learning techniques to address these challenges lead to meaningful student engagement and positive gains in the learning outcomes as indicated by quantitative and qualitative assessments

Internationales Kolloquium über Anwendungen der Informatik und Mathematik in Architektur und Bauwesen : 20. bis 22.7. 2015, Bauhaus-Universität Weimar

The 20th International Conference on the Applications of Computer Science and Mathematics in Architecture and Civil Engineering will be held at the Bauhaus University Weimar from 20th till 22nd July 2015. Architects, computer scientists, mathematicians, and engineers from all over the world will meet in Weimar for an interdisciplinary exchange of experiences, to report on their results in research, development and practice and to discuss. The conference covers a broad range of research areas: numerical analysis, function theoretic methods, partial differential equations, continuum mechanics, engineering applications, coupled problems, computer sciences, and related topics. Several plenary lectures in aforementioned areas will take place during the conference. We invite architects, engineers, designers, computer scientists, mathematicians, planners, project managers, and software developers from business, science and research to participate in the conference

Intelligent Sensor Networks

In the last decade, wireless or wired sensor networks have attracted much attention. However, most designs target general sensor network issues including protocol stack (routing, MAC, etc.) and security issues. This book focuses on the close integration of sensing, networking, and smart signal processing via machine learning. Based on their world-class research, the authors present the fundamentals of intelligent sensor networks. They cover sensing and sampling, distributed signal processing, and intelligent signal learning. In addition, they present cutting-edge research results from leading experts

Deep Reinforcement Learning Models for Real-Time Traffic Signal Optimization with Big Traffic Data

One of the most significant changes that the globe has faced in recent years is the changes brought about by the COVID19 pandemic. While this research was started before the pandemic began, the pandemic has exposed the value that data and information can have in modern society. During the pandemic traffic volumes changed substantially, leaving the inefficiencies of existing methods exposed. This research has focussed on exploring two key ideas that will become increasingly relevant as societies adapt to these changes: Big Data and Artificial Intelligence. For many municipalities, traffic signals are still re-timed using traditional approaches and there is still significant reliance on static timing plans designed with data collected from static field studies. This research explored the possibility of using travel-time data obtained from Bluetooth and WiFi sniffing. Bluetooth and WiFi sniffing is an emerging Big Data approach that takes advantage of the ability to track and monitor unique devices as they move from location to location. An approach to re-time signals using an adaptive system was developed, analysed, and tested under varying conditions. The results of this work showed that this data could be used to improve delays by as much as 10\% when compared to traditional approaches. More importantly, this approach demonstrated that it is possible to re-time signals using a readily available and dynamic data source without the need for field volume studies. In addition to Big Data technologies, Artificial Intelligence (AI) is increasingly playing an important role in modern technologies. AI is already being used to make complex decisions, categorise images, and can best humans in complex strategy games. While AI shows promise, applications to Traffic Engineering have been limtied. This research has advanced the state-of-the art by conducting a systematic sensitivity study on an AI technique, Deep Reinforcement Learning. This thesis investigated and identified optimal settings for key parameters such as the discount factor, learning rate, and reward functions. This thesis also developed and tested a complete framework that could potentially be applied to evaluate AI techniques in field settings. This includes applications of AI techniques such as transfer learning to reduce training times. Finally, this thesis also examined framings for multi-intersection control, including comparisons to existing state-of-the art approaches such as SCOOT