Enhanced context-aware framework for individual and crowd condition prediction

Context-aware framework is basic context-aware that utilizes contexts such as user with their individual activities, location and time, which are hidden information derived from smartphone sensors. These data are used to monitor a situation in a crowd scenario. Its application using embedded sensors has the potential to monitor tasks that are practically complicated to access. Inaccuracies observed in the individual activity recognition (IAR) due to faulty accelerometer data and data classification problem have led to its inefficiency when used for prediction. This study developed a solution to this problem by introducing a method of feature extraction and selection, which provides a higher accuracy by selecting only the relevant features and minimizing false negative rate (FNR) of IAR used for crowd condition prediction. The approach used was the enhanced context-aware framework (EHCAF) for the prediction of human movement activities during an emergency. Three new methods to ensure high accuracy and low FNR were introduced. Firstly, an improved statistical-based time-frequency domain (SBTFD) representing and extracting hidden context information from sensor signals with improved accuracy was introduced. Secondly, a feature selection method (FSM) to achieve improved accuracy with statistical-based time-frequency domain (SBTFD) and low false negative rate was used. Finally, a method for individual behaviour estimation (IBE) and crowd condition prediction in which the threshold and crowd density determination (CDD) was developed and used, achieved a low false negative rate. The approach showed that the individual behaviour estimation used the best selected features, flow velocity estimation and direction to determine the disparity value of individual abnormality behaviour in a crowd. These were used for individual and crowd density determination evaluation in terms of inflow, outflow and crowd turbulence during an emergency. Classifiers were used to confirm features ability to differentiate individual activity recognition data class. Experimenting SBTFD with decision tree (J48) classifier produced a maximum of 99:2% accuracy and 3:3% false negative rate. The individual classes were classified based on 7 best features, which produced a reduction in dimension, increased accuracy to 99:1% and had a low false negative rate (FNR) of 2:8%. In conclusion, the enhanced context-aware framework that was developed in this research proved to be a viable solution for individual and crowd condition prediction in our society

Detection of abnormal passenger behaviors on ships, using RGBD cameras

El objetivo de este trabajo fin de Máster (TFM) es el diseño, implementación, y evaluación de un sistema inteligente de videovigilancia, que permita la detección, seguimiento y conteo de personas, así como la detección de estampidas, para grandes embarcaciones. El sistema desarrollado debe ser portable, y funcionar en tiempo real. Para ello se ha realizado un estudio de las tecnologías disponibles en sistemas embebidos, para elegir las que mejor se adecúan al objetivo del TFM. Se ha desarrollado un sistema de detección de personas basado en una MobileNet-SSD, complementado con un banco de filtros de Kalman para el seguimiento. Además, se ha incorporado un detector de estampidas basado en el análisis de la entropía del flujo óptico. Todo ello se ha implementado y evaluado en un dispositivo embebido que incluye una unidad VPU. Los resultados obtenidos han permitido validar la propuesta.The aim of this Final Master Thesis (TFM) is the design, implementation and evaluation of an intelligent video surveillance system that allows the detection, monitoring and counting of people, as well as the detection of stampedes, for large ships. The developed system must be portable and work in real time. To this end, a study has been carried out of the technologies available in embedded systems, in order to choose those that best suit the objective of the TFM. A people detection system based on a MobileNetSSD has been developed, complemented by a Kalman filter bank for monitoring. In addition, a stampede detector based on optical flow entropy analysis has been incorporated. All this has been implemented and evaluated in an embedded device that includes a Vision Processing Unit (VPU) unit. The results obtained have allowed the validation of the proposal.Máster Universitario en Ingeniería de Telecomunicación (M125

SIMCD: SIMulated crowd data for anomaly detection and prediction

Smart Crowd management (SCM) solutions can mitigate overcrowding disasters by implementing efficient crowd learning models that can anticipate critical crowd conditions and potential catastrophes. Developing an SCM solution involves monitoring crowds and modelling their dynamics. Crowd monitoring produces vast amounts of data, with features such as densities and speeds, which are essential for training and evaluating crowd learning models. By and large, crowd datasets can be classified as real (e.g., real monitoring of crowds) or synthetic (e.g., simulation of crowds). Using real crowd datasets can produce effective and reliable crowd learning models. However, acquiring real crowd data faces several challenges, including the expensive installation of a sensory infrastructure, the data pre-processing costs and the lack of real datasets that cover particular crowd scenarios. Consequently, crowd management literature has adopted simulation tools for generating synthetic datasets to overcome the challenges associated with their real counterparts. The majority of existing datasets, whether real or synthetic, can be used for crowd counting applications or analysing the activities of individuals rather than collective crowd behaviour. Accordingly, this paper demonstrates the process of generating bespoke synthetic crowd datasets that can be used for crowd anomaly detection and prediction, using the MassMotion crowd simulator. The developed datasets present two types of crowd anomalies; namely, high densities and contra-flow walking direction. These datasets are: SIMulated Crowd Data (SIMCD)-Single Anomaly and SIMCD-Multiple Anomalies for anomaly detection tasks, besides two SIMCD-Prediction datasets for crowd prediction tasks. Furthermore, the paper demonstrates the data preparation (pre-processing) process by aggregating the data and proposing new essential features, such as the level of crowdedness and the crowd severity level, that are useful for developing crowd prediction and anomaly detection models

SIMCD: SIMulated crowd data for anomaly detection and prediction

Smart Crowd management (SCM) solutions can mitigate overcrowding disasters by implementing efficient crowd learning models that can anticipate critical crowd conditions and potential catastrophes. Developing an SCM solution involves monitoring crowds and modelling their dynamics. Crowd monitoring produces vast amounts of data, with features such as densities and speeds, which are essential for training and evaluating crowd learning models. By and large, crowd datasets can be classified as real (e.g., real monitoring of crowds) or synthetic (e.g., simulation of crowds). Using real crowd datasets can produce effective and reliable crowd learning models. However, acquiring real crowd data faces several challenges, including the expensive installation of a sensory infrastructure, the data pre-processing costs and the lack of real datasets that cover particular crowd scenarios. Consequently, crowd management literature has adopted simulation tools for generating synthetic datasets to overcome the challenges associated with their real counterparts. The majority of existing datasets, whether real or synthetic, can be used for crowd counting applications or analysing the activities of individuals rather than collective crowd behaviour. Accordingly, this paper demonstrates the process of generating bespoke synthetic crowd datasets that can be used for crowd anomaly detection and prediction, using the MassMotion crowd simulator. The developed datasets present two types of crowd anomalies; namely, high densities and contra-flow walking direction. These datasets are: SIMulated Crowd Data (SIMCD)-Single Anomaly and SIMCD-Multiple Anomalies for anomaly detection tasks, besides two SIMCD-Prediction datasets for crowd prediction tasks. Furthermore, the paper demonstrates the data preparation (pre-processing) process by aggregating the data and proposing new essential features, such as the level of crowdedness and the crowd severity level, that are useful for developing crowd prediction and anomaly detection models

A roadmap for the future of crowd safety research and practice: Introducing the Swiss Cheese Model of Crowd Safety and the imperative of a Vision Zero target

Crowds can be subject to intrinsic and extrinsic sources of risk, and previous records have shown that, in the absence of adequate safety measures, these sources of risk can jeopardise human lives. To mitigate these risks, we propose that implementation of multiple layers of safety measures for crowds—what we label The Swiss Cheese Model of Crowd Safety—should become the norm for crowd safety practice. Such system incorporates a multitude of safety protection layers including regulations and policymaking, planning and risk assessment, operational control, community preparedness, and incident response. The underlying premise of such model is that when one (or multiple) layer(s) of safety protection fail(s), the other layer(s) can still prevent an accident. In practice, such model requires a more effective implementation of technology, which can enable provision of real-time data, improved communication and coordination, and efficient incident response. Moreover, implementation of this model necessitates more attention to the overlooked role of public education, awareness raising, and promoting crowd safety culture at broad community levels, as one of last lines of defence against catastrophic outcomes for crowds. Widespread safety culture and awareness has the potential to empower individuals with the knowledge and skills that can prevent such outcomes or mitigate their impacts, when all other (exogenous) layers of protection (such as planning and operational control) fail. This requires safety campaigns and development of widespread educational programs. We conclude that, there is no panacea solution to the crowd safety problem, but a holistic multi-layered safety system that utilises active participation of all potential stakeholders can significantly reduce the likelihood of disastrous accidents. At a global level, we need to target a Vision Zero of Crowd Safety, i.e., set a global initiative of bringing deaths and severe injuries in crowded spaces to zero by a set year

Recent advances in video analytics for rail network surveillance for security, trespass and suicide prevention— a survey

Railway networks systems are by design open and accessible to people, but this presents challenges in the prevention of events such as terrorism, trespass, and suicide fatalities. With the rapid advancement of machine learning, numerous computer vision methods have been developed in closed-circuit television (CCTV) surveillance systems for the purposes of managing public spaces. These methods are built based on multiple types of sensors and are designed to automatically detect static objects and unexpected events, monitor people, and prevent potential dangers. This survey focuses on recently developed CCTV surveillance methods for rail networks, discusses the challenges they face, their advantages and disadvantages and a vision for future railway surveillance systems. State-of-the-art methods for object detection and behaviour recognition applied to rail network surveillance systems are introduced, and the ethics of handling personal data and the use of automated systems are also considered

Ecosystemic Evolution Feeded by Smart Systems

Information Society is advancing along a route of ecosystemic evolution. ICT and Internet advancements, together with the progression of the systemic approach for enhancement and application of Smart Systems, are grounding such an evolution. The needed approach is therefore expected to evolve by increasingly fitting into the basic requirements of a significant general enhancement of human and social well-being, within all spheres of life (public, private, professional). This implies enhancing and exploiting the net-living virtual space, to make it a virtuous beneficial integration of the real-life space. Meanwhile, contextual evolution of smart cities is aiming at strongly empowering that ecosystemic approach by enhancing and diffusing net-living benefits over our own lived territory, while also incisively targeting a new stable socio-economic local development, according to social, ecological, and economic sustainability requirements. This territorial focus matches with a new glocal vision, which enables a more effective diffusion of benefits in terms of well-being, thus moderating the current global vision primarily fed by a global-scale market development view. Basic technological advancements have thus to be pursued at the system-level. They include system architecting for virtualization of functions, data integration and sharing, flexible basic service composition, and end-service personalization viability, for the operation and interoperation of smart systems, supporting effective net-living advancements in all application fields. Increasing and basically mandatory importance must also be increasingly reserved for human–technical and social–technical factors, as well as to the associated need of empowering the cross-disciplinary approach for related research and innovation. The prospected eco-systemic impact also implies a social pro-active participation, as well as coping with possible negative effects of net-living in terms of social exclusion and isolation, which require incisive actions for a conformal socio-cultural development. In this concern, speed, continuity, and expected long-term duration of innovation processes, pushed by basic technological advancements, make ecosystemic requirements stricter. This evolution requires also a new approach, targeting development of the needed basic and vocational education for net-living, which is to be considered as an engine for the development of the related ‘new living know-how’, as well as of the conformal ‘new making know-how’

Privacy aware surveillance system design

Ph.DDOCTOR OF PHILOSOPH