Development of robust high performance face detector under different environmental conditions.

足利工業大学201

Articulated human tracking and behavioural analysis in video sequences

Recently, there has been a dramatic growth of interest in the observation and tracking of human subjects through video sequences. Arguably, the principal impetus has come from the perceived demand for technological surveillance, however applications in entertainment, intelligent domiciles and medicine are also increasing. This thesis examines human articulated tracking and the classi cation of human movement, rst separately and then as a sequential process. First, this thesis considers the development and training of a 3D model of human body structure and dynamics. To process video sequences, an observation model is also designed with a multi-component likelihood based on edge, silhouette and colour. This is de ned on the articulated limbs, and visible from a single or multiple cameras, each of which may be calibrated from that sequence. Second, for behavioural analysis, we develop a methodology in which actions and activities are described by semantic labels generated from a Movement Cluster Model (MCM). Third, a Hierarchical Partitioned Particle Filter (HPPF) was developed for human tracking that allows multi-level parameter search consistent with the body structure. This tracker relies on the articulated motion prediction provided by the MCM at pose or limb level. Fourth, tracking and movement analysis are integrated to generate a probabilistic activity description with action labels. The implemented algorithms for tracking and behavioural analysis are tested extensively and independently against ground truth on human tracking and surveillance datasets. Dynamic models are shown to predict and generate synthetic motion, while MCM recovers both periodic and non-periodic activities, de ned either on the whole body or at the limb level. Tracking results are comparable with the state of the art, however the integrated behaviour analysis adds to the value of the approach.Overseas Research Students Awards Scheme (ORSAS

Wi-Fi based people tracking in challenging environments

People tracking is a key building block in many applications such as abnormal activity detection, gesture recognition, and elderly persons monitoring. Video-based systems have many limitations making them ineffective in many situations. Wi-Fi provides an easily accessible source of opportunity for people tracking that does not have the limitations of video-based systems. The system will detect, localise, and track people, based on the available Wi-Fi signals that are reflected from their bodies. Wi-Fi based systems still need to address some challenges in order to be able to operate in challenging environments. Some of these challenges include the detection of the weak signal, the detection of abrupt people motion, and the presence of multipath propagation. In this thesis, these three main challenges will be addressed. Firstly, a weak signal detection method that uses the changes in the signals that are reflected from static objects, to improve the detection probability of weak signals that are reflected from the person’s body. Then, a deep learning based Wi-Fi localisation technique is proposed that significantly improves the runtime and the accuracy in comparison with existing techniques. After that, a quantum mechanics inspired tracking method is proposed to address the abrupt motion problem. The proposed method uses some interesting phenomena in the quantum world, where the person is allowed to exist at multiple positions simultaneously. The results show a significant improvement in reducing the tracking error and in reducing the tracking delay

Particle filtering on large dimensional state spaces and applications in computer vision

Tracking of spatio-temporal events is a fundamental problem in computer vision and signal processing in general. For example, keeping track of motion activities from video sequences for abnormality detection or spotting neuronal activity patterns inside the brain from fMRI data. To that end, our research has two main aspects with equal emphasis - first, development of efficient Bayesian filtering frameworks for solving real-world tracking problems and second, understanding the temporal evolution dynamics of physical systems/phenomenon and build statistical models for them. These models facilitate prior information to the trackers as well as lead to intelligent signal processing for computer vision and image understanding. The first part of the dissertation deals with the key signal processing aspects of tracking and the challenges involved. In simple terms, tracking basically is the problem of estimating the hidden state of a system from noisy observed data(from sensors). As frequently encountered in real-life, due to the non-linear and non-Gaussian nature of the state spaces involved, Particle Filters (PF) give an approximate Bayesian inference under such problem setup. However, quite often we are faced with large dimensional state spaces together with multimodal observation likelihood due to occlusion and clutter. This makes the existing particle filters very inefficient for practical purposes. In order to tackle these issues, we have developed and implemented efficient particle filters on large dimensional state spaces with applications to various visual tracking problems in computer vision. In the second part of the dissertation, we develop dynamical models for motion activities inspired by human visual cognitive ability of characterizing temporal evolution pattern of shapes. We take a landmark shape based approach for the representation and tracking of motion activities. Basically, we have developed statistical models for the shape change of a configuration of ``landmark points (key points of interest) over time and to use these models for automatic landmark extraction and tracking, filtering and change detection from video sequences. In this regard, we demonstrate superior performance of our Non-Stationary Shape Activity(NSSA) model in comparison to other existing works. Also, owing to the large dimensional state space of this problem, we have utilized efficient particle filters(PF) for motion activity tracking. In the third part of the dissertation, we develop a visual tracking algorithm that is able to track in presence of illumination variations in the scene. In order to do that we build and learn a dynamical model for 2D illumination patterns based on Legendre basis functions. Under our problem formulation, we pose the visual tracking task as a large dimensional tracking problem in a joint motion-illumination space and thus use an efficient PF algorithm called PF-MT(PF with Mode Tracker) for tracking. In addition, we also demonstrate the use of change/abnormality detection framework for tracking across drastic illumination changes. Experiments with real-life video sequences demonstrate the usefulness of the algorithm while many other existing approaches fail. The last part of the dissertation explores the upcoming field of compressive sensing and looks into the possibilities of leveraging from particle filtering ideas to do better sequential reconstruction (i.e. tracking) of sparse signals from a small number of random linear measurements. Our preliminary results show several promising aspects to such an approach and it is an interesting direction of future research with many potential computer vision applications

Autocalibrating vision guided navigation of unmanned air vehicles via tactical monocular cameras in GPS denied environments

This thesis presents a novel robotic navigation strategy by using a conventional tactical monocular camera, proving the feasibility of using a monocular camera as the sole proximity sensing, object avoidance, mapping, and path-planning mechanism to fly and navigate small to medium scale unmanned rotary-wing aircraft in an autonomous manner. The range measurement strategy is scalable, self-calibrating, indoor-outdoor capable, and has been biologically inspired by the key adaptive mechanisms for depth perception and pattern recognition found in humans and intelligent animals (particularly bats), designed to assume operations in previously unknown, GPS-denied environments. It proposes novel electronics, aircraft, aircraft systems, systems, and procedures and algorithms that come together to form airborne systems which measure absolute ranges from a monocular camera via passive photometry, mimicking that of a human-pilot like judgement. The research is intended to bridge the gap between practical GPS coverage and precision localization and mapping problem in a small aircraft. In the context of this study, several robotic platforms, airborne and ground alike, have been developed, some of which have been integrated in real-life field trials, for experimental validation. Albeit the emphasis on miniature robotic aircraft this research has been tested and found compatible with tactical vests and helmets, and it can be used to augment the reliability of many other types of proximity sensors

Combining Sensors and Multibody Models for Applications in Vehicles, Machines, Robots and Humans

The combination of physical sensors and computational models to provide additional information about system states, inputs and/or parameters, in what is known as virtual sensing, is becoming increasingly popular in many sectors, such as the automotive, aeronautics, aerospatial, railway, machinery, robotics and human biomechanics sectors. While, in many cases, control-oriented models, which are generally simple, are the best choice, multibody models, which can be much more detailed, may be better suited to some applications, such as during the design stage of a new product

A Methodology to Develop Computer Vision Systems in Civil Engineering: Applications in Material Testing and Fish Tracking

[Resumen] La Visión Artificial proporciona una nueva y prometedora aproximación al campo de la Ingeniería Civil, donde es extremadamente importante medir con precisión diferentes procesos. Sin embargo, la Visión Artificial es un campo muy amplio que abarca multitud de técnicas y objetivos, y definir una aproximación de desarrollo sistemática es problemático. En esta tesis se propone una nueva metodología para desarrollar estos sistemas considerando las características y requisitos de la Ingeniería Civil. Siguiendo esta metodología se han desarrollado dos sistemas: Un sistema para la medición de desplazamientos y deformaciones en imágenes de ensayos de resistencia de materiales. Solucionando las limitaciones de los actuales sensores físicos que interfieren con el ensayo y solo proporcionan mediciones en un punto y una dirección determinada. Un sistema para la medición de la trayectoria de peces en escalas de hendidura vertical, con el que se pretende solucionar las carencias en el diseño de escalas obteniendo información sobre el comportamiento de los peces. Estas aplicaciones representan contribuciones significativas en el área, y demuestran que la metodología definida e implementada proporciona un marco de trabajo sistemático y confiable para el desarrollo de sistemas de Visión Artificial en Ingeniería Civil.[Resumo] A Visión Artificial proporciona unha nova e prometedora aproximación ó campo da Enxeñería Civil, onde é extremadamente importante medir con precisión diferentes procesos. Sen embargo, a Visión Artificial é un campo moi amplo que abarca multitude de técnicas e obxectivos, e definir unha aproximación de desenvolvemento sistemática é problemático. En esta tese proponse unha nova metodoloxía para desenvolver estes sistemas considerando as características e requisitos da Enxeñería Civil. Seguindo esta metodoloxía desenvolvéronse dous sistemas: Un sistema para a medición de desprazamentos e deformacións en imaxes de ensaios de resistencia de materiais. Solucionando as limitacións dos actuais sensores físicos que interfiren co ensaio e só proporcionan medicións nun punto e nunha dirección determinada. Un sistema para a medición da traxectoria de peixes en escalas de fenda vertical, co que se pretende solucionar as carencias no deseño de escalas obtendo información sobre o comportamento dos peixes. Estas aplicacións representan contribucións significativas na área, e demostran que a metodoloxía definida e implementada proporciona un marco de traballo sistemático e confiable para o desenvolvemento de sistemas de Visión Artificial en Enxeñería Civil.[Abstract] Computer Vision provides a new and promising approach to Civil Engineering, where it is extremely important to measure with accuracy real world processes. However, Computer Vision is a broad field, involving several techniques and topics, and the task of defining a systematic development approach is problematic. In this thesis a new methodology is carried out to develop these systems attending to the special characteristics and requirements of Civil Engineering. Following this methodology, two systems were developed: A system to measure displacements from real images of material surfaces taken during strength tests. This technique solves the limitation of current physical sensors, which interfere with the assay and which are limited to obtaining measurements in a single point of the material and in a single direction of the movement. A system to measure the trajectory of fishes in vertical slot fishways, whose purpose is to solve current lacks in the design of fishways by providing information of fish behavior. These applications represent significant contributions to the field and show that the defined and implemented methodology provides a systematic and reliable framework to develop a Computer Vision system in Civil Engineering

Particle Filtering Methods for Subcellular Motion Analysis

Advances in fluorescent probing and microscopic imaging technology have revolutionized biology in the past decade and have opened the door for studying subcellular dynamical processes. However, accurate and reproducible methods for processing and analyzing the images acquired for such studies are still lacking. Since manual image analysis is time consuming, potentially inaccurate, and poorly reproducible, many biologically highly relevant questions are either left unaddressed, or are answered with great uncertainty. The subject of this thesis is particle filtering methods and their application for multiple object tracking in different biological imaging applications. Particle filtering is a technique for implementing recursive Bayesian filtering by Monte Carlo sampling. A fundamental concept behind the Bayesian approach for performing inference is the possibility to encode the information about the imaging system, possible noise sources, and the system dynamics in terms of probability density functions. In this thesis, a set of novel PF based metho