Fireground location understanding by semantic linking of visual objects and building information models

This paper presents an outline for improved localization and situational awareness in fire emergency situations based on semantic technology and computer vision techniques. The novelty of our methodology lies in the semantic linking of video object recognition results from visual and thermal cameras with Building Information Models (BIM). The current limitations and possibilities of certain building information streams in the context of fire safety or fire incident management are addressed in this paper. Furthermore, our data management tools match higher-level semantic metadata descriptors of BIM and deep-learning based visual object recognition and classification networks. Based on these matches, estimations can be generated of camera, objects and event positions in the BIM model, transforming it from a static source of information into a rich, dynamic data provider. Previous work has already investigated the possibilities to link BIM and low-cost point sensors for fireground understanding, but these approaches did not take into account the benefits of video analysis and recent developments in semantics and feature learning research. Finally, the strengths of the proposed approach compared to the state-of-the-art is its (semi -)automatic workflow, generic and modular setup and multi-modal strategy, which allows to automatically create situational awareness, to improve localization and to facilitate the overall fire understanding

Real-time localisation system for GPS denied open areas using smart street furniture

Real-time measurement of crowd dynamics has been attracting significant interest, as it has many applications including real-time monitoring of emergencies and evacuation plans. To effectively measure crowd behaviour, an accurate estimate for pedestrians’ locations is required. However, estimating pedestrians’ locations is a great challenge especially for open areas with poor Global Positioning System (GPS) signal reception and/or lack of infrastructure to install expensive solutions such as video-based systems. Street furniture assets such as rubbish bins have become smart, as they have been equipped with low-power sensors. Currently, their role is limited to certain applications such as waste management. We believe that the role of street furniture can be extended to include building real-time localisation systems as street furniture provides excellent coverage across different areas such as parks, streets, homes, universities. In this thesis, we propose a novel wireless sensor network architecture designed for smart street furniture. We extend the functionality of sensor nodes to act as soft Access Point (AP), sensing Wifi signals received from surrounding Wifi-enabled devices. Our proposed architecture includes a real-time and low-power design for sensor nodes. We attached sensor nodes to rubbish bins located in a busy GPS denied open area at Murdoch University (Perth, Western Australia), known as Bush Court. This enabled us to introduce two unique Wifi-based localisation datasets: the first is the Fingerprint dataset called MurdochBushCourtLoC-FP (MBCLFP) in which four users generated Wifi fingerprints for all available cells in the gridded Bush Court, called Reference Points (RPs), using their smartphones, and the second is the APs dataset called MurdochBushCourtLoC-AP (MBCLAP) that includes auto-generated records received from over 1000 users’ devices. Finally, we developed a real-time localisation approach based on the two datasets using a four-layer deep learning classifier. The approach includes a light-weight algorithm to label the MBCLAP dataset using the MBCLFP dataset and convert the MBCLAP dataset to be synchronous. With the use of our proposed approach, up to 19% improvement in location prediction is achieved

A cyber-physical system for dynamic building evacuation

Tese de mestrado integrado. Engenharia Electrotécnica e de Computadores. Universidade do Porto. Faculdade de Engenharia. 201

A Modelling Approach To Human Navigation in Constrained Spaces

In this thesis, we consider algorithms and systems which dynamically guide evacuees towards exits during an emergency to minimise building evacuation time. We observe that the "shortest safe path" routing approach is inadequate when congestion is a predominant factor, and therefore focus on systems which manage congestion. We first implement a "Reactive" metric which compares paths based on real-time transit times. We find that regular route corrections must be issued to address the constant changes in path delays, and that routes oscillate. We also implement a model-based "Proactive" metric which forecasts the increase in future congestion that results from every routing decision, allowing the routing algorithm to operate offline. We combine both metrics with the Cognitive Packet Network (CPN), a distributed self-aware routing algorithm which uses neural networks to efficiently explore the building graph. We also present the first thorough sensitivity analysis on CPN's parameters, and use this to tune CPN for optimal performance. We then compare the proactive and reactive approaches through simulation and find both approaches reduce building evacuation times -- especially when evacuees are not evenly distributed in the building. We also find major differences between the Proactive and Reactive approach, in terms of stability, flexibility, sensory requirements, etc. Finally, we consider guiding evacuees using dynamic exit signs, whose pointing direction can be controlled. Dynamic signs can readily be used with Reactive routing, but since Proactive routing issues routes on an individual basis, one display is required for each evacuee. This is incompatible with dynamic signs; therefore we propose a novel algorithm which controls the dynamic signs according to the Proactive algorithm's output. We simulate both systems, compare their performance, and review their practical limitations. For both approaches, we find that updating the sign's display more often improves performance, but this may reduce evacuee compliance and make the system inefficient in real-life conditions.Open Acces

Supporting Cyber-Physical Systems with Wireless Sensor Networks: An Outlook of Software and Services

Sensing, communication, computation and control technologies are the essential building blocks of a cyber-physical system (CPS). Wireless sensor networks (WSNs) are a way to support CPS as they provide fine-grained spatial-temporal sensing, communication and computation at a low premium of cost and power. In this article, we explore the fundamental concepts guiding the design and implementation of WSNs. We report the latest developments in WSN software and services for meeting existing requirements and newer demands; particularly in the areas of: operating system, simulator and emulator, programming abstraction, virtualization, IP-based communication and security, time and location, and network monitoring and management. We also reflect on the ongoing efforts in providing dependable assurances for WSN-driven CPS. Finally, we report on its applicability with a case-study on smart buildings

Swarm Robotics, or: The Smartness of \u27a bunch of cheap dumb things\u27

Not only recent Science Fiction – e.g., Star Trek Beyond (USA 2016) – celebrates the capacities of robot collectives. Also RoboCup, an annual robot soccer competition, or Harvard University’s Kilobot Project show stunning examples of the central idea behind Swarm Robotics: »[U]sing swarms is the same as getting a bunch of small cheap dumb things to do the same job as an expensive smart thing« (Beni/Wang 1989). This article examines some crucial aspects of the techno-history of a research field which intertwines engineering and biological knowledge and whose applications deal with compelling questions about synchronization and self-organization in changing environments – on the ground, in the air, and under water

Swarm Robotics, or: The Smartness of 'a bunch of cheap dumb things'

Not only recent Science Fiction – e.g., Star Trek Beyond (USA 2016) – celebrates the capacities of robot collectives. Also RoboCup, an annual robot soccer competition, or Harvard University’s Kilobot Project show stunning examples of the central idea behind Swarm Robotics: »[U]sing swarms is the same as getting a bunch of small cheap dumb things to do the same job as an expensive smart thing« (Beni/Wang 1989). This article examines some crucial aspects of the techno-history of a research field which intertwines engineering and biological knowledge and whose applications deal with compelling questions about synchronization and self-organization in changing environments – on the ground, in the air, and under water