Minimal paths and deformable models for image analysis

We present an overview of part of our work on minimal paths. Introduced first in order to find the global minimum of active contours' energy using Fast Marching [18], we have then used minimal paths for finding multiple contours for contour completion from points, curves or regions in 2D or 3D images. Some variations allow to decrease computation time, make easier initialization and centering a path in a tubular structure. Fast Marching is also an efficient way to solve balloon model evolution using level sets. We show applications like for road and vessel segmentation and for virtual endoscopy.Nous présentons une synthèse d'une partie de nos travaux sur les chemins minimaux. Introduits au départ pour trouver le minimum global de l'énergie pour les contours actifs à l'aide du Fast Marching [18], nous les avons utilisés par la suite pour la recherche de contours multiples pour compléter des points, des courbes ou des régions dans des images 2D et 3D. Plusieurs variantes permettent d'améliorer le temps de calcul, de simplifier l'initialisation ou de centrer le chemin dans une structure tubulaire. Le Fast Marching est aussi un moyen efficace de résoudre l'évolution d'un modèle de contour actif ballon par "level sets". Nous montrons des applications notamment pour la segmentation de routes et vaisseaux et pour l'endoscopie virtuelle

A robust framework for medical image segmentation through adaptable class-specific representation

Medical image segmentation is an increasingly important component in virtual pathology, diagnostic imaging and computer-assisted surgery. Better hardware for image acquisition and a variety of advanced visualisation methods have paved the way for the development of computer based tools for medical image analysis and interpretation. The routine use of medical imaging scans of multiple modalities has been growing over the last decades and data sets such as the Visible Human Project have introduced a new modality in the form of colour cryo section data. These developments have given rise to an increasing need for better automatic and semiautomatic segmentation methods. The work presented in this thesis concerns the development of a new framework for robust semi-automatic segmentation of medical imaging data of multiple modalities. Following the specification of a set of conceptual and technical requirements, the framework known as ACSR (Adaptable Class-Specific Representation) is developed in the first case for 2D colour cryo section segmentation. This is achieved through the development of a novel algorithm for adaptable class-specific sampling of point neighbourhoods, known as the PGA (Path Growing Algorithm), combined with Learning Vector Quantization. The framework is extended to accommodate 3D volume segmentation of cryo section data and subsequently segmentation of single and multi-channel greyscale MRl data. For the latter the issues of inhomogeneity and noise are specifically addressed. Evaluation is based on comparison with previously published results on standard simulated and real data sets, using visual presentation, ground truth comparison and human observer experiments. ACSR provides the user with a simple and intuitive visual initialisation process followed by a fully automatic segmentation. Results on both cryo section and MRI data compare favourably to existing methods, demonstrating robustness both to common artefacts and multiple user initialisations. Further developments into specific clinical applications are discussed in the future work section

Application of CBIR techniques for the purpose of biometric identification based on human gait

Intenzivan razvoj informaciono-komunikacionih tehnologija otvorio je vrata primeni biometrijskih tehnologija u menadžmentu identiteta. Biometrijski modalitet koji ima veliki potencijal za primenu u praksi je ljudski hod. Njega odlikuju neinvazivnost i neintruzivnost. Ovakve osobine posebno pogoduju primeni u uslovima tehnologije prismotre. Zahvaljujući tome, ovaj biometrijski modalitet tokom prethodnih godina izaziva veliko interesovanje akademske zajednice. Ovo interesovanje rezultiralo je razvojem velikog broja pristupa za prepoznavanje osoba na osnovu hoda. Uprkos tome, primena biometrijskih tehnologija zasnovanih na ljudskom hodu u praksi i dalje zaostaje za dobro ustanovljenim modalitetima poput otiska prsta, lica ili glasa. Glavni razlog je nedostatak odgovarajućeg pristupa koji bi omogućio stabilnu primenu u realnim uslovima. Cilj ovog rada je predlog novog postupka za prepoznavanje osoba na osnovu hoda koji bi omogućio razvoj robusnog i pristupačnog biometrijskog sistema. Inicijalno, urađen je sveobuhvatan pregled oblasti i aktuelnih istraživanja na osnovu čega je predložen novi postupak. Predloženi postupak se zasniva na ideji da se sekvenca ljudskog hoda može predstaviti kao jedna nepomična 2D slika. Ovakav postupak omogućio bi da se za potrebe prepoznavanja primene generičke metode za pretragu slika na osnovu sadržaja. Na ovakav način problem bi bio prenet iz prostorno-vremenskog domena u prostorni domen, konkretno domen 2D nepomične slike, koji je poznat i u kome postoji veliki broj dokazanih rešenja. Za potrebe akvizicije, postupak se oslanja na novu tehnologiju iz oblasti interakcije čovek-računar, Microsoft Kinect. Na osnovu predloženog postupka razvijen je modularni laboratorijski prototip kao i okruženje za testiranje i evaluaciju. Naučna zasnovanost i opravdanost predloženog postupka proverena je nizom eksperimenata. Eksperimenti su organizovani na takav način da ispitaju različite faktore koji tokom primene postupka mogu uticati na konačne performanse u prepoznavanju. Na osnovu dobijenih rezultata može se zaključiti da predloženi postupak odlilkuje visok stepen robusnosti kao i visoka preciznost u prepoznavanju...Intense progress of information and communications technology enabled application of biometric technology in identity management. Human gait, as a biometric modality, has great potential for practical application. This is due to its noninvasive and nonintrusive nature. Surveillance technology is especially fertile ground for recognition based on human gait. These facts caused spike in academic interest for this biometric modality. This in turn resulted in development of large number of different approaches to human gait recognition. Nevertheless, practical application of biometric technology based on human gait still trails those well established modalities such as fingerprint, face or voice. Main reason for this is lacking of such approach that would enable stable use in realistic conditions. Goal of this paper is to propose a new approach for human gait recognition that would result in robust and affordable biometric system. Initially, a comprehensive review of research area and existing research was done that served as a base for the proposition of new approach. This new approach is based on the idea that human gait sequence can be represented as a single 2D still image. Using images would open the possibility of applying Content Based Image Retrieval (CBIR) techniques for the purpose of final recognition. This procedure shifts the problem form spatio-temporal towards spatial domain, specifically the space of 2D still image that is well researched and familiar. For acquisition purposes approach relies on new human-computer interaction technology, Microsoft Kinect. As proof of concept, a modular laboratory prototype was developed as well as environment for testing and evaluation. Foundation of the proposed approach was tested through a series of experiments. Empirical evaluation was performed in such a manner to investigate the influence of different contributing factors to system performance. Based on retrieved results a conclusion is reached that the proposed approach is highly robust and achieves high recognition rates..

Application of Machine Vision in UAVs for Autonomous Target Tracking

This research presents experimental results for the application of Machine Vision (MV) techniques to address the problem of target detection and tracking. The main objective is the design of a prototype UAV surveillance environment to emulate real-life conditions. The model environment for this experiment consists of a target simulated by a small electric train system, located at ground level, and a MV camera mounted on a motion-based apparatus located directly above the model setup. This system is meant to be a non-flying mockup of an aerial robot retrofitted with a MV sensor. Therefore, the final design is a two degree-of-freedom gantry simulating aircraft motions above the ground level at a constant altitude. On the ground level, the design of the landscape is an attempt to achieve a realistic natural landscape within a laboratory setting. Therefore, the scenery consists of small scale trees, bushes, a mountain, and a tunnel system within a 914 mm by 1066 mm boundary. To detect and track the moving train, MV algorithms are implemented in a Matlab/SimulinkRTM based simulation environment. Specifically, image pre-processing techniques and circle detection algorithms are implemented to detect and identify the chimney stack on the train engine. The circle detection algorithms analyzed in this research effort consists of a least squares based method and the Hough transform (HT) method for circle detection. The experimental results will show that the solution to the target detection problem could produce a positive detection rate of 90% during each simulation while utilizing only 56% of the input image. Tracking and timing data also shows that the least squares based target detection method performs substantially better then the HT method. This is evident from the result of using a 1--2 Hz frequency update rate for the SimulinkRTM scheme which is acceptable, in some cases, for use in navigation for a UAV performing scouting and reconnaissance missions. The development of vision-based control strategies, similar to the approach presented in this research, allows UAVs to participate in complex missions involving autonomous target tracking

Intelligent Sensors for Human Motion Analysis

The book, "Intelligent Sensors for Human Motion Analysis," contains 17 articles published in the Special Issue of the Sensors journal. These articles deal with many aspects related to the analysis of human movement. New techniques and methods for pose estimation, gait recognition, and fall detection have been proposed and verified. Some of them will trigger further research, and some may become the backbone of commercial systems

Underwater Vehicles

For the latest twenty to thirty years, a significant number of AUVs has been created for the solving of wide spectrum of scientific and applied tasks of ocean development and research. For the short time period the AUVs have shown the efficiency at performance of complex search and inspection works and opened a number of new important applications. Initially the information about AUVs had mainly review-advertising character but now more attention is paid to practical achievements, problems and systems technologies. AUVs are losing their prototype status and have become a fully operational, reliable and effective tool and modern multi-purpose AUVs represent the new class of underwater robotic objects with inherent tasks and practical applications, particular features of technology, systems structure and functional properties

Harnessing rare category trinity for complex data

In the era of big data, we are inundated with the sheer volume of data being collected from various domains. In contrast, it is often the rare occurrences that are crucially important to many high-impact domains with diverse data types. For example, in online transaction platforms, the percentage of fraudulent transactions might be small, but the resultant financial loss could be significant; in social networks, a novel topic is often neglected by the majority of users at the initial stage, but it could burst into an emerging trend afterward; in the Sloan Digital Sky Survey, the vast majority of sky images (e.g., known stars, comets, nebulae, etc.) are of no interest to the astronomers, while only 0.001% of the sky images lead to novel scientific discoveries; in the worldwide pandemics (e.g., SARS, MERS, COVID19, etc.), the primary cases might be limited, but the consequences could be catastrophic (e.g., mass mortality and economic recession). Therefore, studying such complex rare categories have profound significance and longstanding impact in many aspects of modern society, from preventing financial fraud to uncovering hot topics and trends, from supporting scientific research to forecasting pandemic and natural disasters. In this thesis, we propose a generic learning mechanism with trinity modules for complex rare category analysis: (M1) Rare Category Characterization - characterizing the rare patterns with a compact representation; (M2) Rare Category Explanation - interpreting the prediction results and providing relevant clues for the end-users; (M3) Rare Category Generation - producing synthetic rare category examples that resemble the real ones. The key philosophy of our mechanism lies in "all for one and one for all" - each module makes unique contributions to the whole mechanism and thus receives support from its companions. In particular, M1 serves as the de-novo step to discover rare category patterns on complex data; M2 provides a proper lens to the end-users to examine the outputs and understand the learning process; and M3 synthesizes real rare category examples for data augmentation to further improve M1 and M2. To enrich the learning mechanism, we develop principled theorems and solutions to characterize, understand, and synthesize rare categories on complex scenarios, ranging from static rare categories to time-evolving rare categories, from attributed data to graph-structured data, from homogeneous data to heterogeneous data, from low-order connectivity patterns to high-order connectivity patterns, etc. It is worthy of mentioning that we have also launched one of the first visual analytic systems for dynamic rare category analysis, which integrates our developed techniques and enables users to investigate complex rare categories in practice