A computer vision system for detecting and analysing critical events in cities

Whether for commuting or leisure, cycling is a growing transport mode in many cities worldwide. However, it is still perceived as a dangerous activity. Although serious incidents related to cycling leading to major injuries are rare, the fear of getting hit or falling hinders the expansion of cycling as a major transport mode. Indeed, it has been shown that focusing on serious injuries only touches the tip of the iceberg. Near miss data can provide much more information about potential problems and how to avoid risky situations that may lead to serious incidents. Unfortunately, there is a gap in the knowledge in identifying and analysing near misses. This hinders drawing statistically significant conclusions to provide measures for the built-environment that ensure a safer environment for people on bikes. In this research, we develop a method to detect and analyse near misses and their risk factors using artificial intelligence. This is accomplished by analysing video streams linked to near miss incidents within a novel framework relying on deep learning and computer vision. This framework automatically detects near misses and extracts their risk factors from video streams before analysing their statistical significance. It also provides practical solutions implemented in a camera with embedded AI (URBAN-i Box) and a cloud-based service (URBAN-i Cloud) to tackle the stated issue in the real-world settings for use by researchers, policy-makers, or citizens. The research aims to provide human-centred evidence that may enable policy-makers and planners to provide a safer built environment for cycling in London, or elsewhere. More broadly, this research aims to contribute to the scientific literature with the theoretical and empirical foundations of a computer vision system that can be utilised for detecting and analysing other critical events in a complex environment. Such a system can be applied to a wide range of events, such as traffic incidents, crime or overcrowding

Classification de situations de conduite et détection des événements critiques d'un deux roues motorisé

This thesis aims to develop framework tools for analyzing and understanding the riding of Powered Two Wheelers (PTW). Experiments are conducted using instrumented PTW in real context including both normal (naturalistic) riding behaviors and critical riding behaviors (near fall and fall). The two objectives of this thesis are the riding patterns classification and critical riding events detection. In the first part of this thesis, a machine-learning framework is used for riding pattern recognition problem. Therefore, this problem is formulated as a classification task to identify the class of riding patterns. The approaches developed in this context have shown the interest to take into account the temporal aspect of the data in PTW riding. Moreover, we have shown the effectiveness of hidden Markov models for such problem. The second part of this thesis focuses on the development of the off-line detection and classification of critical riding events tools and the on-line fall detection. The problem of detection and classification of critical riding events has been performed towards two steps: (1) the segmentation step, where the multidimensional time of data were modeled and segmented by using a mixture model with quadratic logistic proportions; (2) the classification step, which consists in using a pattern recognition algorithm in order to assign each event by its extracted features to one of the three classes namely Fall, near Fall and Naturalistic riding. Regarding the fall detection problem, it is formulated as a sequential anomaly detection problem. The Multivariate CUmulative SUM (MCUSUM) control chart was applied on the data collected from sensors mounted on the motorcycle. The obtained results on a real database have shown the effectiveness of the proposed methodology for both riding pattern recognition and critical riding events detection problemsL'objectif de cette thèse est de développer des outils d'analyse de données recueillies sur les deux roues motorisés (2RMs). Dans ce cadre, des expérimentations sont menées sur des motos instrumentés dans un contexte de conduite réelle incluant à la fois des conduites normales dites naturelles et des conduites à risques (presque chute et chute). Dans la première partie de la thèse, des méthodes d'apprentissage supervisé ont été utilisées pour la classification de situations de conduite d'un 2RM. Les approches développées dans ce contexte ont montré l'intérêt de prendre en compte l'aspect temporel des données dans la conduite d'un 2RM. A cet effet, nous avons montré l'efficacité des modèles de Markov cachés. La seconde partie de cette thèse porte sur le développement d'outils de détection et de classification hors ligne des évènements critiques de conduite, ainsi que, la détection en ligne des situations de chute d'un 2RM. L'approche proposée pour la détection hors ligne des évènements critiques de conduite repose sur l'utilisation d'un modèle de mélange de densités gaussiennes à proportions logistiques. Ce modèle sert à la segmentation non supervisée des séquences de conduite. Des caractéristiques extraites du paramètre du modèle de mélange sont utilisées comme entrées d'un classifieur pour classifier les évènements critiques. Pour la détection en ligne de chute, une méthode simple de détection séquentielle d'anomalies basée sur la carte de contrôle MCUSUM a été proposée. Les résultats obtenus sur une base de données réelle ont permis de montrer l'efficacité des méthodologies proposées à la fois pour la classification de situations de conduite et à la détection des évènements critiques de conduit

Modelling drivers’ braking behaviour and comfort under normal driving

The increasing growth of population and a rising number of vehicles, connected to an individual, demand new solutions to reduce traffic delays and enhance road safety. Autonomous Vehicles (AVs) have been considered as an optimal solution to overcome those problems. Despite the remarkable research and development progress in the area of (semi) AVs over the last decades, there is still concern that occupants may not feel safe and comfortable due to the robot-like driving behaviour of the current technology. In order to facilitate their rapid uptake and market penetration, ride comfort in AVs must be ensured.Braking behaviour has been identified to be a crucial factor in ride comfort. There is a dearth of research on which factors affect the braking behaviour and the comfort level while braking and which braking profiles make the occupants feel safe and comfortable. Therefore, the primary aim of this thesis is to model the deceleration events of drivers under normal driving conditions to guide comfortable braking design. The aim was achieved by exploiting naturalistic driving data from three projects: (1) the Pan-European TeleFOT (Field Operational Tests of Aftermarket and Nomadic Devices in Vehicles) project, (2) the Field Operational Test (FOT) conducted by Loughborough University and Original Equipment Manufacturer (OEM), and (3) the UDRIVE Naturalistic Driving Study.A total of about 35 million observations were examined from 86 different drivers and 644 different trips resulting in almost 10,000 deceleration events for the braking features analysis and 21,600 deceleration events for the comfort level analysis. Since deceleration events are nested within trips and trips within drivers, multilevel mixed-effects linear models were employed to develop relationships between deceleration value and duration and the factors influencing them. The examined factors were kinematics, situational, driver and trip characteristics with the first two categories to affect the most the deceleration features. More specifically, the initial speed and the reason for braking play a significant role, whereas the driver’s characteristics, i.e. the age and gender do not affect the deceleration features, except for driver’s experience which significantly affects the deceleration duration.An algorithm was developed to calculate the braking profiles, indicating that the most used profile follows smooth braking at the beginning followed by a harder one. Moreover, comfort levels of drivers were analysed using the Mixed Multinomial Logit models to identify the effect of the explanatory factors on the comfort category of braking events. Kinematic factors and especially TTC and time headway (THW) were found to affect the most the comfort level. Particularly, when TTC or THW are increased by 1 second, the odds of the event to be “very comfortable” are respectively 1.03 and 4.5 times higher than being “very uncomfortable”. Moreover, the driver’s characteristic, i.e. age and gender affect significantly the comfort level of the deceleration event. Findings from this thesis can support vehicle manufacturers to ensure comfortable and safe braking operations of AVs.</div

Speech Recognition

Chapters in the first part of the book cover all the essential speech processing techniques for building robust, automatic speech recognition systems: the representation for speech signals and the methods for speech-features extraction, acoustic and language modeling, efficient algorithms for searching the hypothesis space, and multimodal approaches to speech recognition. The last part of the book is devoted to other speech processing applications that can use the information from automatic speech recognition for speaker identification and tracking, for prosody modeling in emotion-detection systems and in other speech processing applications that are able to operate in real-world environments, like mobile communication services and smart homes

Intelligent and High-Performance Behavior Design of Autonomous Systems via Learning, Optimization and Control

Nowadays, great societal demands have rapidly boosted the development of autonomous systems that densely interact with humans in many application domains, from manufacturing to transportation and from workplaces to daily lives. The shift from isolated working environments to human-dominated space requires autonomous systems to be empowered to handle not only environmental uncertainties such as external vibrations but also interaction uncertainties arising from human behavior which is in nature probabilistic, causal but not strictly rational, internally hierarchical and socially compliant.This dissertation is concerned with the design of intelligent and high-performance behavior of such autonomous systems, leveraging the strength from control, optimization, learning, and cognitive science. The work consists of two parts. In Part I, the problem of high-level hybrid human-machine behavior design is addressed. The goal is to achieve safe, efficient and human-like interaction with people. A framework based on the theory of mind, utility theories and imitation learning is proposed to efficiently represent and learn the complicated behavior of humans. Built upon that, machine behaviors at three different levels - the perceptual level, the reasoning level, and the action level - are designed via imitation learning, optimization, and online adaptation, allowing the system to interpret, reason and behave as human, particularly when a variety of uncertainties exist. Applications to autonomous driving are considered throughout Part I. Part II is concerned with the design of high-performance low-level individual machine behavior in the presence of model uncertainties and external disturbances. Advanced control laws based on adaptation, iterative learning and the internal structures of uncertainties/disturbances are developed to assure that the high-level interactive behaviors can be reliably executed. Applications on robot manipulators and high-precision motion systems are discussed in this part

Identification of infrastructure related risk factors, Deliverable 5.1 of the H2020 project SafetyCube

The present Deliverable (D5.1) describes the identification and evaluation of infrastructure related risk factors. It outlines the results of Task 5.1 of WP5 of SafetyCube, which aimed to identify and evaluate infrastructure related risk factors and related road safety problems by (i) presenting a taxonomy of infrastructure related risks, (ii) identifying “hot topics” of concern for relevant stakeholders and (iii) evaluating the relative importance for road safety outcomes (crash risk, crash frequency and severity etc.) within the scientific literature for each identified risk factor. To help achieve this, Task 5.1 has initially exploited current knowledge (e.g. existing studies) and, where possible, existing accident data (macroscopic and in-depth) in order to identify and rank risk factors related to the road infrastructure. This information will help further on in WP5 to identify countermeasures for addressing these risk factors and finally to undertake an assessment of the effects of these countermeasures. In order to develop a comprehensive taxonomy of road infrastructure-related risks, an overview of infrastructure safety across Europe was undertaken to identify the main types of road infrastructure-related risks, using key resources and publications such as the European Road Safety Observatory (ERSO), The Handbook of Road Safety Measures (Elvik et al., 2009), the iRAP toolkit and the SWOV factsheets, to name a few. The taxonomy developed contained 59 specific risk factors within 16 general risk factors, all within 10 infrastructure elements. In addition to this, stakeholder consultations in the form of a series of workshops were undertaken to prioritise risk factors (‘hot topics’) based on the feedback from the stakeholders on which risk factors they considered to be the most important or most relevant in terms of road infrastructure safety. The stakeholders who attended the workshops had a wide range of backgrounds (e.g. government, industry, research, relevant consumer organisations etc.) and a wide range of interests and knowledge. The identified ‘hot topics’ were ranked in terms of importance (i.e. which would have the greatest effect on road safety). SafetyCube analysis will put the greatest emphasis on these topics (e.g. pedestrian/cyclist safety, crossings, visibility, removing obstacles). To evaluate the scientific literature, a methodology was developed in Work Package 3 of the SafetyCube project. WP5 has applied this methodology to road infrastructure risk factors. This uniformed approach facilitated systematic searching of the scientific literature and consistent evaluation of the evidence for each risk factor. The method included a literature search strategy, a ‘coding template’ to record key data and metadata from individual studies, and guidelines for summarising the findings (Martensen et al, 2016b). The main databases used in the WP5 literature search were Scopus and TRID, with some risk factors utilising additional database searches (e.g. Google Scholar, Science Direct). Studies using crash data were considered highest priority. Where a high number of studies were found, further selection criteria were applied to ensure the best quality studies were included in the analysis (e.g. key meta-analyses, recent studies, country origin, importance). Once the most relevant studies were identified for a risk factor, each study was coded within a template developed in WP3. Information coded for each study included road system element, basic study information, road user group information, study design, measures of exposure, measures of outcomes and types of effects. The information in the coded templates will be included in the relational database developed to serve as the main source (‘back end’) of the Decision Support System (DSS) being developed for SafetyCube. Each risk factor was assigned a secondary coding partner who would carry out the control procedure and would discuss with the primary coding partner any coding issues they had found. Once all studies were coded for a risk factor, a synopsis was created, synthesising the coded studies and outlining the main findings in the form of meta-analyses (where possible) or another type of comprehensive synthesis (e.g. vote-count analysis). Each synopsis consists of three sections: a 2 page summary (including abstract, overview of effects and analysis methods); a scientific overview (short literature synthesis, overview of studies, analysis methods and analysis of the effects) and finally supporting documents (e.g. details of literature search and comparison of available studies in detail, if relevant). To enrich the background information in the synopses, in-depth accident investigation data from a number of sources across Europe (i.e. GIDAS, CARE/CADaS) was sourced. Not all risk factors could be enhanced with this data, but where it was possible, the aim was to provide further information on the type of crash scenarios typically found in collisions where specific infrastructure-related risk factors are present. If present, this data was included in the synopsis for the specific risk factor. After undertaking the literature search and coding of the studies, it was found that for some risk factors, not enough detailed studies could be found to allow a synopsis to be written. Therefore, the revised number of specific risk factors that did have a synopsis written was 37, within 7 infrastructure elements. Nevertheless, the coded studies on the remaining risk factors will be included in the database to be accessible by the interested DSS users. At the start of each synopsis, the risk factor is assigned a colour code, which indicates how important this risk factor is in terms of the amount of evidence demonstrating its impact on road safety in terms of increasing crash risk or severity. The code can either be Red (very clear increased risk), Yellow (probably risky), Grey (unclear results) or Green (probably not risky). In total, eight risk factors were given a Red code (e.g. traffic volume, traffic composition, road surface deficiencies, shoulder deficiencies, workzone length, low curve radius), twenty were given a Yellow code (e.g. secondary crashes, risks associated with road type, narrow lane or median, roadside deficiencies, type of junction, design and visibility at junctions) seven were given a Grey code (e.g. congestion, frost and snow, densely spaced junctions etc.). The specific risk factors given the red code were found to be distributed across a range of infrastructure elements, demonstrating that the greatest risk is spread across several aspects of infrastructure design and traffic control. However, four ‘hot topics’ were rated as being risky, which were ‘small work-zone length’, ‘low curve radius’, ‘absence of shoulder’ and ‘narrow shoulder’. Some limitations were identified. Firstly, because of the method used to attribute colour code, it is in theory possible for a risk factor with a Yellow colour code to have a greater overall magnitude of impact on road safety than a risk factor coded Red. This would occur if studies reported a large impact of a risk factor but without sufficient consistency to allocate a red colour code. Road safety benefits should be expected from implementing measures to mitigate Yellow as well as Red coded infrastructure risks. Secondly, findings may have been limited by both the implemented literature search strategy and the quality of the studies identified, but this was to ensure the studies included were of sufficiently high quality to inform understanding of the risk factor. Finally, due to difficulties of finding relevant studies, it was not possible to evaluate the effects on road safety of all topics listed in the taxonomy. The next task of WP5 is to begin identifying measures that will counter the identified risk factors. Priority will be placed on investigating measures aimed to mitigate the risk factors identified as Red. The priority of risk factors in the Yellow category will depend on why they were assigned to this category and whether or not they are a hot topic

Volume II: Mining Innovation

Contemporary exploitation of natural raw materials by borehole, opencast, underground, seabed, and anthropogenic deposits is closely related to, among others, geomechanics, automation, computer science, and numerical methods. More and more often, individual fields of science coexist and complement each other, contributing to lowering exploitation costs, increasing production, and reduction of the time needed to prepare and exploit the deposit. The continuous development of national economies is related to the increasing demand for energy, metal, rock, and chemical resources. Very often, exploitation is carried out in complex geological and mining conditions, which are accompanied by natural hazards such as rock bursts, methane, coal dust explosion, spontaneous combustion, water, gas, and temperature. In order to conduct a safe and economically justified operation, modern construction materials are being used more and more often in mining to support excavations, both under static and dynamic loads. The individual production stages are supported by specialized computer programs for cutting the deposit as well as for modeling the behavior of the rock mass after excavation in it. Currently, the automation and monitoring of the mining works play a very important role, which will significantly contribute to the improvement of safety conditions. In this Special Issue of Energies, we focus on innovative laboratory, numerical, and industrial research that has a positive impact on the development of safety and exploitation in mining

Effect of curing conditions and harvesting stage of maturity on Ethiopian onion bulb drying properties

The study was conducted to investigate the impact of curing conditions and harvesting stageson the drying quality of onion bulbs. The onion bulbs (Bombay Red cultivar) were harvested at three harvesting stages (early, optimum, and late maturity) and cured at three different temperatures (30, 40 and 50 oC) and relative humidity (30, 50 and 70%). The results revealed that curing temperature, RH, and maturity stage had significant effects on all measuredattributesexcept total soluble solids