Omnidirectional Stereo Vision Study from Vertical and Horizontal Stereo Configuration

In stereo vision, an omnidirectional camera has high distortion compared to a standard camera, so the camera calibration is very decisive in its stereo matching. In this study, we will perform stereo matching for an omnidirectional camera with vertical and horizontal configuration so that the result of the image's depth has a 360-degree field of view by transforming the image using a calibration-based method. The result is that by using a vertical camera configuration, the image can be stereo matched directly, but by configuring a horizontal image, it is necessary to carry out a different stereo-matching process in each direction. Stereo matching with the semi-global matching method has better image results than block matching with more image objects detectable by the semi-global block matching method with a maximum disparity value of 32 pixels and with a window size of 21 pixels

A study on detection of risk factors of a toddler’s fall injuries using visual dynamic motion cues

This thesis was submitted for the degree of Doctor of Philosophy and awarded by Brunel University.The research in this thesis is intended to aid caregivers’ supervision of toddlers to prevent accidental injuries, especially injuries due to falls in the home environment. There have been very few attempts to develop an automatic system to tackle young children’s accidents despite the fact that they are particularly vulnerable to home accidents and a caregiver cannot give continuous supervision. Vision-based analysis methods have been developed to recognise toddlers’ fall risk factors related to changes in their behaviour or environment. First of all, suggestions to prevent fall events of young children at home were collected from well-known organisations for child safety. A large number of fall records of toddlers who had sought treatment at a hospital were analysed to identify a toddler’s fall risk factors. The factors include clutter being a tripping or slipping hazard on the floor and a toddler moving around or climbing furniture or room structures. The major technical problem in detecting the risk factors is to classify foreground objects into human and non-human, and novel approaches have been proposed for the classification. Unlike most existing studies, which focus on human appearance such as skin colour for human detection, the approaches addressed in this thesis use cues related to dynamic motions. The first cue is based on the fact that there is relative motion between human body parts while typical indoor clutter does not have such parts with diverse motions. In addition, other motion cues are employed to differentiate a human from a pet since a pet also moves its parts diversely. They are angle changes of ellipse fitted to each object and history of its actual heights to capture the various posture changes and different body size of pets. The methods work well as long as foreground regions are correctly segmented

Exploring Motion Signatures for Vision-Based Tracking, Recognition and Navigation

As cameras become more and more popular in intelligent systems, algorithms and systems for understanding video data become more and more important. There is a broad range of applications, including object detection, tracking, scene understanding, and robot navigation. Besides the stationary information, video data contains rich motion information of the environment. Biological visual systems, like human and animal eyes, are very sensitive to the motion information. This inspires active research on vision-based motion analysis in recent years. The main focus of motion analysis has been on low level motion representations of pixels and image regions. However, the motion signatures can benefit a broader range of applications if further in-depth analysis techniques are developed. In this dissertation, we mainly discuss how to exploit motion signatures to solve problems in two applications: object recognition and robot navigation. First, we use bird species recognition as the application to explore motion signatures for object recognition. We begin with study of the periodic wingbeat motion of flying birds. To analyze the wing motion of a flying bird, we establish kinematics models for bird wings, and obtain wingbeat periodicity in image frames after the perspective projection. Time series of salient extremities on bird images are extracted, and the wingbeat frequency is acquired for species classification. Physical experiments show that the frequency based recognition method is robust to segmentation errors and measurement lost up to 30%. In addition to the wing motion, the body motion of the bird is also analyzed to extract the flying velocity in 3D space. An interacting multi-model approach is then designed to capture the combined object motion patterns and different environment conditions. The proposed systems and algorithms are tested in physical experiments, and the results show a false positive rate of around 20% with a low false negative rate close to zero. Second, we explore motion signatures for vision-based vehicle navigation. We discover that motion vectors (MVs) encoded in Moving Picture Experts Group (MPEG) videos provide rich information of the motion in the environment, which can be used to reconstruct the vehicle ego-motion and the structure of the scene. However, MVs suffer from high noise level. To handle the challenge, an error propagation model for MVs is first proposed. Several steps, including MV merging, plane-at-infinity elimination, and planar region extraction, are designed to further reduce noises. The extracted planes are used as landmarks in an extended Kalman filter (EKF) for simultaneous localization and mapping. Results show that the algorithm performs localization and plane mapping with a relative trajectory error below 5:1%. Exploiting the fact that MVs encodes both environment information and moving obstacles, we further propose to track moving objects at the same time of localization and mapping. This enables the two critical navigation functionalities, localization and obstacle avoidance, to be performed in a single framework. MVs are labeled as stationary or moving according to their consistency to geometric constraints. Therefore, the extracted planes are separated into moving objects and the stationary scene. Multiple EKFs are used to track the static scene and the moving objects simultaneously. In physical experiments, we show a detection rate of moving objects at 96:6% and a mean absolute localization error below 3:5 meters

Vehicle classification in intelligent transport systems: an overview, methods and software perspective

Vehicle Classification (VC) is a key element of Intelligent Transportation Systems (ITS). Diverse ranges of ITS applications like security systems, surveillance frameworks, fleet monitoring, traffic safety, and automated parking are using VC. Basically, in the current VC methods, vehicles are classified locally as a vehicle passes through a monitoring area, by fixed sensors or using a compound method. This paper presents a pervasive study on the state of the art of VC methods. We introduce a detailed VC taxonomy and explore the different kinds of traffic information that can be extracted via each method. Subsequently, traditional and cutting edge VC systems are investigated from different aspects. Specifically, strengths and shortcomings of the existing VC methods are discussed and real-time alternatives like Vehicular Ad-hoc Networks (VANETs) are investigated to convey physical as well as kinematic characteristics of the vehicles. Finally, we review a broad range of soft computing solutions involved in VC in the context of machine learning, neural networks, miscellaneous features, models and other methods

Integrating water-energy-nexus in carbon footprint analysis in water utility company

The purpose of this paper is to highlight the water-energy-nexus within the context of carbon footprint methodology and water utility industry. In particular, the carbon management for water utility industry is crucial in reducing carbon emission within the upstream water distribution system. The concept of water-energy nexus alone however can be misleading due to exclusion of indirect and embodied energy involved in the water production. The study highlights the total energy use within water supply system as well as embedded carbon emission through carbon footprint methodology. The case study approach is used as a research method. The carbon footprint analysis includes data collection from water utility company; and data identification of direct and indirect carbon emission from corporation operation. The result indicates that the indirect and embodied energy may not be significant in certain operation area but the energy use may be ambiguous when these elements are excluded. Integrating carbon footprint methodology within the water supply system can improve the understanding on water-energy-nexus when direct and indirect energy use is included in the analysis. This paper aims to benefit academics, government agencies and particularly water utility companies in integrating carbon footprint analysis in water production

Occlusion handling in multiple people tracking

Object tracking with occlusion handling is a challenging problem in automated video surveillance. Occlusion handling and tracking have always been considered as separate modules. We have proposed an automated video surveillance system, which automatically detects occlusions and perform occlusion handling, while the tracker continues to track resulting separated objects. A new approach based on sub-blobbing is presented for tracking objects accurately and steadily, when the target encounters occlusion in video sequences. We have used a feature-based framework for tracking, which involves feature extraction and feature matching

A Review on Vehicle Classification and Potential Use of Smart Vehicle-Assisted Techniques

Vehicle classification (VC) is an underlying approach in an intelligent transportation system and is widely used in various applications like the monitoring of traffic flow, automated parking systems, and security enforcement. The existing VC methods generally have a local nature and can classify the vehicles if the target vehicle passes through fixed sensors, passes through the short-range coverage monitoring area, or a hybrid of these methods. Using global positioning system (GPS) can provide reliable global information regarding kinematic characteristics; however, the methods lack information about the physical parameter of vehicles. Furthermore, in the available studies, smartphone or portable GPS apparatuses are used as the source of the extraction vehicle’s kinematic characteristics, which are not dependable for the tracking and classification of vehicles in real time. To deal with the limitation of the available VC methods, potential global methods to identify physical and kinematic characteristics in real time states are investigated. Vehicular Ad Hoc Networks (VANETs) are networks of intelligent interconnected vehicles that can provide traffic parameters such as type, velocity, direction, and position of each vehicle in a real time manner. In this study, VANETs are introduced for VC and their capabilities, which can be used for the above purpose, are presented from the available literature. To the best of the authors’ knowledge, this is the first study that introduces VANETs for VC purposes. Finally, a comparison is conducted that shows that VANETs outperform the conventional techniques

A Review on Vehicle Classification and Potential Use of Smart Vehicle-Assisted Techniques

Vehicle classification (VC) is an underlying approach in an intelligent transportation system and is widely used in various applications like the monitoring of traffic flow, automated parking systems, and security enforcement. The existing VC methods generally have a local nature and can classify the vehicles if the target vehicle passes through fixed sensors, passes through the short-range coverage monitoring area, or a hybrid of these methods. Using global positioning system (GPS) can provide reliable global information regarding kinematic characteristics; however, the methods lack information about the physical parameter of vehicles. Furthermore, in the available studies, smartphone or portable GPS apparatuses are used as the source of the extraction vehicle’s kinematic characteristics, which are not dependable for the tracking and classification of vehicles in real time. To deal with the limitation of the available VC methods, potential global methods to identify physical and kinematic characteristics in real time states are investigated. Vehicular Ad Hoc Networks (VANETs) are networks of intelligent interconnected vehicles that can provide traffic parameters such as type, velocity, direction, and position of each vehicle in a real time manner. In this study, VANETs are introduced for VC and their capabilities, which can be used for the above purpose, are presented from the available literature. To the best of the authors’ knowledge, this is the first study that introduces VANETs for VC purposes. Finally, a comparison is conducted that shows that VANETs outperform the conventional techniques