Dynamic Reconfiguration in Camera Networks: A Short Survey

There is a clear trend in camera networks towards enhanced functionality and flexibility, and a fixed static deployment is typically not sufficient to fulfill these increased requirements. Dynamic network reconfiguration helps to optimize the network performance to the currently required specific tasks while considering the available resources. Although several reconfiguration methods have been recently proposed, e.g., for maximizing the global scene coverage or maximizing the image quality of specific targets, there is a lack of a general framework highlighting the key components shared by all these systems. In this paper we propose a reference framework for network reconfiguration and present a short survey of some of the most relevant state-of-the-art works in this field, showing how they can be reformulated in our framework. Finally we discuss the main open research challenges in camera network reconfiguration

Centralised, Decentralised, and Self-Organised Coverage Maximisation in Smart Camera Networks

When maximising the coverage of a camera network, current approaches rely on a central approach and rarely consider the decentralised or even self-organised potential. In this paper, we study the performance of decentralised and self-organised approaches in comparison to centralised ones in terms of geometric coverage maximisation. We present a decentralised and self-organised algorithm to maximise coverage in a camera network using a Particle Swarm Optimiser (PSO) and compare them to a centralised version of PSO. Additionally, we present a decentralised and self-organised version of ARES, a centralised approximation algorithm for optimal plans combining PSO, Importance Splitting, and an adaptive receding horizons at its core. We first show the benefits of ARES over using PSO as a single, centralised optimisation algorithm when used before deployment time. Second, since cameras are not able to change instantaneously, we investigate gradual adaptation of individual cameras during runtime. Third, we compare achieved geometrical coverage of our decentralised approximation algorithm against the centralised version of ARES. Finally, we study the benefits of a self-organised version of PSO and ARES, allowing the system to improve its coverage over time. This allows the system to deal with quickly unfolding situations

Attentive monitoring of multiple video streams driven by a Bayesian foraging strategy

In this paper we shall consider the problem of deploying attention to subsets of the video streams for collating the most relevant data and information of interest related to a given task. We formalize this monitoring problem as a foraging problem. We propose a probabilistic framework to model observer's attentive behavior as the behavior of a forager. The forager, moment to moment, focuses its attention on the most informative stream/camera, detects interesting objects or activities, or switches to a more profitable stream. The approach proposed here is suitable to be exploited for multi-stream video summarization. Meanwhile, it can serve as a preliminary step for more sophisticated video surveillance, e.g. activity and behavior analysis. Experimental results achieved on the UCR Videoweb Activities Dataset, a publicly available dataset, are presented to illustrate the utility of the proposed technique.Comment: Accepted to IEEE Transactions on Image Processin

Long Range Automated Persistent Surveillance

This dissertation addresses long range automated persistent surveillance with focus on three topics: sensor planning, size preserving tracking, and high magnification imaging. field of view should be reserved so that camera handoff can be executed successfully before the object of interest becomes unidentifiable or untraceable. We design a sensor planning algorithm that not only maximizes coverage but also ensures uniform and sufficient overlapped camera’s field of view for an optimal handoff success rate. This algorithm works for environments with multiple dynamic targets using different types of cameras. Significantly improved handoff success rates are illustrated via experiments using floor plans of various scales. Size preserving tracking automatically adjusts the camera’s zoom for a consistent view of the object of interest. Target scale estimation is carried out based on the paraperspective projection model which compensates for the center offset and considers system latency and tracking errors. A computationally efficient foreground segmentation strategy, 3D affine shapes, is proposed. The 3D affine shapes feature direct and real-time implementation and improved flexibility in accommodating the target’s 3D motion, including off-plane rotations. The effectiveness of the scale estimation and foreground segmentation algorithms is validated via both offline and real-time tracking of pedestrians at various resolution levels. Face image quality assessment and enhancement compensate for the performance degradations in face recognition rates caused by high system magnifications and long observation distances. A class of adaptive sharpness measures is proposed to evaluate and predict this degradation. A wavelet based enhancement algorithm with automated frame selection is developed and proves efficient by a considerably elevated face recognition rate for severely blurred long range face images

QoI-Aware Unified Framework for Node Classification and Self-Reconfiguration Within Heterogeneous Visual Sensor Networks

Due to energy and throughput constraints of visual sensing nodes, in-node energy conservation is one of the prime concerns in visual sensor networks (VSNs) with wireless transceiving capability. To cope with these constraints, the energy efficiency of a VSN for a given level of reliability can be enhanced by reconfiguring its nodes dynamically to achieve optimal configurations. In this paper, a unified framework for node classification and dynamic self-reconfiguration in VSNs is proposed. The proposed framework incorporates quality-of-information (QoI) awareness using peak signal-to-noise ratio-based representative metric to support a diverse range of applications. First, for a given application, the proposed framework provides a feasible solution for the classification of visual sensing nodes based on their field-of-view by exploiting the heterogeneity of the targeted QoI within the sensing region. Second, with the dynamic realization of QoI, a strategy is devised for selecting suitable configurations of visual sensing nodes to reduce redundant visual content prior to transmission without sacrificing the expected information retrieval reliability. The robustness of the proposed framework is evaluated under various scenarios by considering: 1) target QoI thresholds; 2) degree of heterogeneity; and 3) compression schemes. From the simulation results, it is observed that for the second degree of heterogeneity in targeted QoI, the unified framework outperforms its existing counterparts and results in up to 72% energy savings with as low as 94% reliability

Quality-of-Information Aware Sensing Node Characterisation for Optimised Energy Consumption in Visual Sensor Networks

Energy consumption is one of the primary concerns in a resource constrained visual sensor network (VSN) with wireless transceiving capability. The existing VSN design solutions under particular resource constrained scenarios are application-specific, whereas the degree of sensitivity of the resource constraints varies from one application to another. This limits the implementation of the existing energy efficient solutions within a VSN node, which may be considered to be a part of a heterogeneous network. This thesis aims to resolve the energy consumption issues faced within VSNs because of their resource constrained nature by proposing energy efficient solutions for sensing nodes characterisation. The heterogeneity of image capture and processing within a VSN can be adaptively reflected with a dynamic field-of-view (FoV) realisation. This is expected to allow the implementation of a generalised energy efficient solution that will adapt with the heterogeneity of the network. In this thesis, a FoV characterisation framework is proposed, which can assist design engineers during the pre-deployment phase in developing energy efficient VSNs. The proposed FoV characterisation framework provides efficient solutions for: 1) selecting suitable sensing range; 2) maximising spatial coverage; 3) minimising the number of required nodes; and 4) adaptive task classification. The task classification scheme proposed in this thesis exploits heterogeneity of the network and leads to an optimal distribution of tasks between visual sensing nodes. Soft decision criteria is exploited, and it is observed that for a given detection reliability, the proposed FoV characterisation framework provides energy efficient solutions which can be implemented within heterogeneous networks. In the post-deployment phase, the energy efficiency of a VSN for a given level of reliability can be enhanced by reconfiguring its nodes dynamically to achieve optimal configurations. Considering the dynamic realisation of quality-of-information (QoI), a strategy is devised for selecting suitable configurations of visual sensing nodes to reduce redundant visual content prior to transmission without sacrificing the expected information retrieval reliability. By incorporating QoI awareness using peak signal-to-noise ratio-based representative metric, the distributed nature of the proposed self-reconfiguration scheme accelerates the decision making process. This thesis also proposes a unified framework for node classification and dynamic self-reconfiguration in VSNs. For a given application, the unified framework provides a feasible solution to classify and reconfigure visual sensing nodes based on their FoV by exploiting the heterogeneity of targeted QoI within the sensing region. From the results, it is observed that for the second degree of heterogeneity in targeted QoI, the unified framework outperforms its existing counterparts and results in up to 72% energy savings with as low as 94% reliability. Within the context of resource constrained VSNs, the substantial energy savings achieved by the proposed unified framework can lead to network lifetime enhancement. Moreover, the reliability analysis demonstrates suitability of the unified framework for applications that need a desired level of QoI

Déploiement optimal de réseaux de capteurs dans des environnements intérieurs en support à la navigation des personnes à mobilité réduite

La participation sociale des personnes ayant une incapacité (PAI) est l'un des enjeux majeurs de notre société. La participation sociale des PAI est influencée par les résultats des interactions entre les facteurs personnels et les facteurs environnementaux (physiques et sociaux). L'une des activités quotidiennes les plus importantes en milieu urbain est la mobilité, ce qui est fondamental pour la participation sociale des PAI. L'environnement urbain est composé des infrastructures et des services principalement conçus pour les personnes sans incapacités et ne prend pas en compte les besoins spécifiques des PAI. Dans ce contexte, la conception et le développement des environnements intelligents peuvent contribuer à une meilleure mobilité et participation sociale des PAI grâce à l'avancement récent de technologie de l'information et de télécommunication ainsi que de réseaux de capteurs. Cependant, le déploiement de réseaux de capteurs en tant que technologie d'assistance pour améliorer la mobilité des personnes n'est conçu que sur la base des modèles trop simplistes de l'environnement physique. Bien que des approches de déploiement de réseaux de capteurs aient été développées ces dernières années, la plupart d'entre elles ont considéré le modèle simple des capteurs (cercle ou sphérique dans le meilleur des cas) et l'environnement 2D, (sans obstacle), indépendamment des besoins des PAI lors de leur mobilité. À cet égard, l'objectif global de cette thèse est le déploiement optimal de réseau de capteurs dans un environnement intérieur pour améliorer l'efficacité de la mobilité des personnes à mobilité réduite (PMR). Plus spécifiquement, nous sommes intéressés à la mobilité des personnes utilisatrices de fauteuil roulant manuel. Pour atteindre cet objectif global, trois objectifs spécifiques sont identifiés. Premièrement, nous proposons un cadre conceptuel pour l'évaluation de la lisibilité de l'environnement intérieur pour les PMR, afin de déterminer la méthode appropriée pour évaluer les interactions entre les facteurs personnels et les facteurs environnementaux (par exemple, pentes, rampes, marches, etc.). Deuxièmement, nous développons un algorithme d'optimisation locale basé sur la structure Voronoi 3D pour le déploiement de capteurs dans l'environnement intérieur 3D pour s'attaquer à la complexité de la structure de l'environnement intérieur (par exemple, différentes hauteurs de plafonds) afin de maximiser la couverture du réseau. Troisièmement, pour aider la mobilité des PMR, nous développons un algorithme d'optimisation ciblé pour le déploiement de capteurs multi-types dans l'environnement intérieur en tenant compte du cadre d'évaluation de la lisibilité pour les PMR. La question la plus importante de cette recherche est la suivante : quels sont les emplacements optimaux pour un ensemble des capteurs pour le positionnement et le guidage des PMR dans l'environnement intérieur complexe 3D. Pour répondre à cette question, les informations sur les caractéristiques des capteurs, les éléments environnementaux et la lisibilité des PMR ont été intégrés dans les algorithmes d'optimisation locale pour le déploiement de réseaux de capteurs multi-types, afin d'améliorer la couverture du réseau et d'aider efficacement les PMR lors de leur mobilité. Dans ce processus, le diagramme de Voronoi 3D, en tant que structure géométrique, est utilisé pour optimiser l'emplacement des capteurs en fonction des caractéristiques des capteurs, des éléments environnementaux et de la lisibilité des PMR. L'optimisation locale proposée a été mise en œuvre et testée avec plusieurs scénarios au Centre des congrès de Québec. La comparaison des résultats obtenus avec ceux des autres algorithmes démontre une plus grande efficacité de l'approche proposée dans cette recherche.Social participation of people with disabilities (PWD) is one of the challenging problems in our society. Social participation of PWD is influenced by results from the interactions between personal characteristics and the physical and social environments. One of the most significant daily activities in the urban environment is mobility which impacts on the social participation of PWD. The urban environment includes infrastructure and services are mostly designed for people without any disability and does not consider the specific needs of PWD. In this context, the design and development of intelligent environments can contribute to better mobility and social participation of PWD by leveraging the recent advancement in information and telecommunications technologies as well as sensor networks. Sensor networks, as an assistive technology for improving the mobility of people are generally designed based on the simplistic models of physical environment. Although sensor networks deployment approaches have been developed in recent years, the majority of them have considered the simple model of sensors (circle or spherical in the best case) and the environment (2D, without obstacles) regardless of the PWD needs during their mobility. In this regard, the global objective of this thesis is the determination of the position and type of sensors to enhance the efficiency of the people with motor disabilities (PWMD) mobility. We are more specifically interested in the mobility of people using manual wheelchair. To achieve this global objective, three specific objectives are demarcated. First, a framework is developed for legibility assessment of the indoor environment for PWMD to determine the appropriate method to evaluate the interactions between personal factors with environmental factors (e.g. slops, ramps, steps, etc.). Then, a local optimization algorithm based on 3D Voronoi structure for sensor deployment in the 3D indoor environment is developed to tackle the complexity of structure of indoor environment (e.g., various ceilings' height) to maximize the network coverage. Next, a purpose-oriented optimization algorithm for multi-type sensor deployment in the indoor environment to help the PWMD mobility is developed with consideration of the legibility assessment framework for PWMD. In this thesis, the most important question of this research is where the optimal places of sensors are for efficient guidance of the PWMD in their mobility in 3D complex indoor environments. To answer this question, the information of sensors characteristics, environmental elements and legibility of PWMD have been integrated into the local optimization algorithms for multi-type sensor networks deployment to enhance the network coverage as well as efficiently help the PWMD during their mobility. In this process, Voronoi diagram as a geometrical structure is used to change the sensors' location based on the sensor characteristics, environmental elements and legibility of PWMD. The proposed local optimization is implemented and tested for several scenarios in Quebec City Convention Centre. The obtained results show that these integration in our approach enhance its effectiveness compared to the existing methods

Cross-layer Optimized Wireless Video Surveillance

A wireless video surveillance system contains three major components, the video capture and preprocessing, the video compression and transmission over wireless sensor networks (WSNs), and the video analysis at the receiving end. The coordination of different components is important for improving the end-to-end video quality, especially under the communication resource constraint. Cross-layer control proves to be an efficient measure for optimal system configuration. In this dissertation, we address the problem of implementing cross-layer optimization in the wireless video surveillance system. The thesis work is based on three research projects. In the first project, a single PTU (pan-tilt-unit) camera is used for video object tracking. The problem studied is how to improve the quality of the received video by jointly considering the coding and transmission process. The cross-layer controller determines the optimal coding and transmission parameters, according to the dynamic channel condition and the transmission delay. Multiple error concealment strategies are developed utilizing the special property of the PTU camera motion. In the second project, the binocular PTU camera is adopted for video object tracking. The presented work studied the fast disparity estimation algorithm and the 3D video transcoding over the WSN for real-time applications. The disparity/depth information is estimated in a coarse-to-fine manner using both local and global methods. The transcoding is coordinated by the cross-layer controller based on the channel condition and the data rate constraint, in order to achieve the best view synthesis quality. The third project is applied for multi-camera motion capture in remote healthcare monitoring. The challenge is the resource allocation for multiple video sequences. The presented cross-layer design incorporates the delay sensitive, content-aware video coding and transmission, and the adaptive video coding and transmission to ensure the optimal and balanced quality for the multi-view videos. In these projects, interdisciplinary study is conducted to synergize the surveillance system under the cross-layer optimization framework. Experimental results demonstrate the efficiency of the proposed schemes. The challenges of cross-layer design in existing wireless video surveillance systems are also analyzed to enlighten the future work. Adviser: Song C