An Intelligent System for Video Surveillance in IoT Environments

© 2018 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works.[EN] Multimedia traffic has drastically grown in the last few years. In addition, some of the last paradigms proposed, like the Internet of Things (IoT), adds new types of traffic and applications. Software-defined networks (SDNs) improve the capability of network management. Combined with SDN, artificial intelligence (AI) can provide solutions to network problems based on classification and estimation techniques. In this paper, we propose an artificial intelligence system for detecting and correcting errors in multimedia transmission in a surveillance IoT environment connected through a SDN. The architecture, algorithm, and messages of the SDN are detailed. The AI system design is described, and the test-bed and the data set are explained. The AI module consists of two different parts. The first one is a classifying part, which detects the type of traffic that is sent through the network. The second part is an estimator that informs the SDN controller on which kind of action should be executed to guarantee the quality of service and quality of experience. Results show that with the actions performed by the network, like jitter can be reduced up to 70% of average and losses can be reduced from 9.07% to nearly 1.16%. Moreover, the presented AI module is able to detect critical traffic with 77% accuracyThis work was supported in part by the Ministerio de Educacion, Cultura y Deporte, through the Ayudas para contratos predoctorales de Formacion del Profesorado Universitario FPU (Convocatoria 2015) under Grant FPU15/06837, in part by the Programa para la Formacion de Personal Investigador de la Universitat Politecnica de Valencia 2014, Subprograma 2, (Codigo del contrato: 884), and in part by the Ministerio de Economia y Competitividad in the Programa Estatal de Fomento de la Investigacion Cientifica y Tecnica de Excelencia, Subprograma Estatal de Generacion de Conocimiento within the project under Grant TIN2014-57991-C3-1-P and Grant TIN2017-84802-C2-1-P.Rego Mañez, A.; Canovas Solbes, A.; Jimenez, JM.; Lloret, J. (2018). An Intelligent System for Video Surveillance in IoT Environments. IEEE Access. 6:31580-31598. https://doi.org/10.1109/ACCESS.2018.2842034S3158031598

Hierarchical video surveillance architecture: a chassis for video big data analytics and exploration

There is increasing reliance on video surveillance systems for systematic derivation, analysis and interpretation of the data needed for predicting, planning, evaluating and implementing public safety. This is evident from the massive number of surveillance cameras deployed across public locations. For example, in July 2013, the British Security Industry Association (BSIA) reported that over 4 million CCTV cameras had been installed in Britain alone. The BSIA also reveal that only 1.5% of these are state owned. In this paper, we propose a framework that allows access to data from privately owned cameras, with the aim of increasing the efficiency and accuracy of public safety planning, security activities, and decision support systems that are based on video integrated surveillance systems. The accuracy of results obtained from government-owned public safety infrastructure would improve greatly if privately owned surveillance systems ‘expose’ relevant video-generated metadata events, such as triggered alerts and also permit query of a metadata repository. Subsequently, a police officer, for example, with an appropriate level of system permission can query unified video systems across a large geographical area such as a city or a country to predict the location of an interesting entity, such as a pedestrian or a vehicle. This becomes possible with our proposed novel hierarchical architecture, the Fused Video Surveillance Architecture (FVSA). At the high level, FVSA comprises of a hardware framework that is supported by a multi-layer abstraction software interface. It presents video surveillance systems as an adapted computational grid of intelligent services, which is integration-enabled to communicate with other compatible systems in the Internet of Things (IoT)

Realizing Video Analytic Service in the Fog-Based Infrastructure-Less Environments

Deep learning has unleashed the great potential in many fields and now is the most significant facilitator for video analytics owing to its capability to providing more intelligent services in a complex scenario. Meanwhile, the emergence of fog computing has brought unprecedented opportunities to provision intelligence services in infrastructure-less environments like remote national parks and rural farms. However, most of the deep learning algorithms are computationally intensive and impossible to be executed in such environments due to the needed supports from the cloud. In this paper, we develop a video analytic framework, which is tailored particularly for the fog devices to realize video analytic service in a rapid manner. Also, the convolution neural networks are used as the core processing unit in the framework to facilitate the image analysing process