Machine learning techniques for high dimensional data

This thesis presents data processing techniques for three different but related application areas: embedding learning for classification, fusion of low bit depth images and 3D reconstruction from 2D images. For embedding learning for classification, a novel manifold embedding method is proposed for the automated processing of large, varied data sets. The method is based on binary classification, where the embeddings are constructed so as to determine one or more unique features for each class individually from a given dataset. The proposed method is applied to examples of multiclass classification that are relevant for large scale data processing for surveillance (e.g. face recognition), where the aim is to augment decision making by reducing extremely large sets of data to a manageable level before displaying the selected subset of data to a human operator. In addition, an indicator for a weighted pairwise constraint is proposed to balance the contributions from different classes to the final optimisation, in order to better control the relative positions between the important data samples from either the same class (intraclass) or different classes (interclass). The effectiveness of the proposed method is evaluated through comparison with seven existing techniques for embedding learning, using four established databases of faces, consisting of various poses, lighting conditions and facial expressions, as well as two standard text datasets. The proposed method performs better than these existing techniques, especially for cases with small sets of training data samples. For fusion of low bit depth images, using low bit depth images instead of full images offers a number of advantages for aerial imaging with UAVs, where there is a limited transmission rate/bandwidth. For example, reducing the need for data transmission, removing superfluous details, and reducing computational loading of on-board platforms (especially for small or micro-scale UAVs). The main drawback of using low bit depth imagery is discarding image details of the scene. Fortunately, this can be reconstructed by fusing a sequence of related low bit depth images, which have been properly aligned. To reduce computational complexity and obtain a less distorted result, a similarity transformation is used to approximate the geometric alignment between two images of the same scene. The transformation is estimated using a phase correlation technique. It is shown that that the phase correlation method is capable of registering low bit depth images, without any modi�cation, or any pre and/or post-processing. For 3D reconstruction from 2D images, a method is proposed to deal with the dense reconstruction after a sparse reconstruction (i.e. a sparse 3D point cloud) has been created employing the structure from motion technique. Instead of generating a dense 3D point cloud, this proposed method forms a triangle by three points in the sparse point cloud, and then maps the corresponding components in the 2D images back to the point cloud. Compared to the existing methods that use a similar approach, this method reduces the computational cost. Instated of utilising every triangle in the 3D space to do the mapping from 2D to 3D, it uses a large triangle to replace a number of small triangles for flat and almost flat areas. Compared to the reconstruction result obtained by existing techniques that aim to generate a dense point cloud, the proposed method can achieve a better result while the computational cost is comparable

OPTIMIZATION OF TERMINAL LAYOUTS: AN ANALYTICAL AND SIMULATIVE APPROACH BASED ON GENETIC ALGORITHMS

2012/2013Every day millions of pedestrian move with different needs and objectives through spaces each of them with its functional specifications. An accurate design or revisiting of transport terminals, as for example railway stations, underway stations, airports, as well as complex buildings, open spaces and a deep analysis of public events with relevant pedestrian flows, would improve its usability at users benefit. To reach this goal is necessary a careful integration among architecture, engineering needs and transport disciplines, that, starting from the study of users behavior and pedestrian dynamics, provides the fundamental elements to be considered during design stage to ensure a major level of service. In literature nothing much is known about the optimal dimension of pedestrian transportation terminals. The aim of this study is to develop a methodology to size the functional terminal layouts, by the integration of analytical and simulative models submitted to generic algorithms, taking into account the dynamics and flows generated inside the terminals. In order to obviate the lack of requisite data for models calibration, validation and verification, as well as testing the process developed, an algorithm for data acquisition has been elaborated. It has a dedicated graphic interface, which allows to reveal the pedestrian dynamics and consequently to generate database; with these data is possible to obtain statistical and behavioral indicators about pedestrians detected. The use of analytical models, both to define the sizing of facilities inside the terminals and to model the user behavior during their paths, allows to define an objective function able to represent the performances of the terminal functional layout. Defined the dimensional ranges of each functional element inside the layout according a specific Level of Service, performed a design of experiments methodology and applied genetic algorithms to minimize the objective function, it is possible to obtain a set of optimal solutions for the terminal configuration sizing, in coherence with flows and dynamics generated inside the terminals itself. A further simulative approach, based on the application of the social force algorithm, allows, through quantitative and qualitative parameters, to identify the best solution(s) inside the domain previously identified with genetic algorithm application. Starting from the motivation that inspired this work, analyzed the existing literature and the main methods for data acquisition, it will be introduced the algorithm for the automatic acquisition of data and pedestrian database generation. The application of this tool will be illustrated in order to manifest the potentiality of the instrument same. Subsequently introduced the tool developed for the definition of the characteristic elements sizing and the model chosen for the correct estimation of pedestrian travel times, it will be explored the structure of the objective function aimed to identify the right trade-off between infrastructure and pedestrian costs. Finally, the application of genetic algorithms, resulting in the identification of Pareto front, generates the domain of optimal solutions to sift through the simulation approach. The developed methodology reveals a flexible and simple instruments, but, at the same time, accurate in the resolution of the problems for which has been structured. The potential of the developed methodology is highlighted in the course of the work thanks to a case of study.Ogni giorno milioni di pedoni si muovono con esigenze ed obbiettivi diversi in contesti differenti, ognuno dei quali con le sue caratteristiche tecniche funzionali. Un’attenta progettazione o rivisitazione dei terminali di trasporto, quali stazioni ferroviarie, metropolitane, aeroporti, così come degli edifici complessi, degli spazi aperti ed una corretta disamina degli eventi pubblici con flussi pedonali rilevanti, consentirebbe di migliorarne la fruibilità a beneficio dell’utenza. Per raggiungere tale obiettivo risulta necessaria un’attenta integrazione tra esigenze architettoniche, ingegneristiche e le discipline trasportistiche, le quali, partendo dallo studio comportamentale degli utenti e dalle dinamiche pedonali, forniscano gli elementi fondamentali da tenersi in considerazione nella fase di progettazione per garantire un maggiore livello di servizio. Riscontrata in letteratura una carenza di approcci finalizzata alla determinazione del miglior layout funzionale dei terminali, attraverso l’integrazione di modelli analitici e simulativi sottoposti ad algoritmi genetici, è stata sviluppata una metodologia che, coerentemente con le dinamiche e i flussi che all’interno dei terminali stessi si generano, mirasse al dimensionamento ottimo dei terminali di trasporto pedonale. Per ovviare alla mancanza di dati necessari per i processi di calibrazione, validazione e verifica dei modelli così come per testare il metodo sviluppato è stato innanzitutto elaborato un algoritmo per l’acquisizione di dati, con interfaccia grafica dedicata, che consente di rilevare le dinamiche pedonali, generare database e conseguentemente ricavare dati statistici e comportamentali dei pedoni. L’utilizzo di modelli analitici, sia per l’identificazione dei range dimensionali degli elementi caratteristici presenti all’interno dei terminali che per la modellizzazione del comportamento degli utenti, permette di definire una funzione obbiettivo che rappresenti le performances dei layout funzionali dei terminali. Attraverso design of experiments calibrati sui range dimensionali dei singoli elementi funzionali presenti all’interno dei terminali e la successiva applicazione degli algoritmi genetici finalizzati alla minimizzazione della funzione obiettivo, è possibile definire un insieme di soluzioni ottime per il dimensionamento dei terminali, in coerenza con i flussi e le dinamiche che in esso si generano. Un’ulteriore approccio simulativo, basato sull’applicazione dell’algoritmo delle forze sociali, consente, attraverso la valutazione di parametri quantitativi e qualitativi, di identificare la/e miglior soluzione/i all’interno del dominio di soluzioni precedentemente identificate con l’applicazione degli algoritmi genetici. A partire dall’esplicitazione delle motivazioni che hanno alimentato questo lavoro, analizzata la letteratura esistente e le principali metodologie per l’acquisizione dati, verrà introdotto l’algoritmo per l’acquisizione automatica dei dati pedonali e la generazione di database contenenti i profili degli utenti rilevati. A seguire troverà spazio l’applicazione di questo strumento per manifestarne le potenzialità. Successivamente, introdotto il tool sviluppato per la definizione dei range dimensionali degli elementi caratteristici e il modello scelto per la corretta stima dei tempi di percorrenza pedonali, verrà esplorata la strutturazione della funzione obiettivo finalizzata alla ricerca del giusto trade off tra costi infrastrutturali e pedonali. Infine, l’applicazione degli algoritmi genetici, risultanti nell’identificazione del fronte paretiano, genererà il dominio di soluzioni ottime da vagliare attraverso l’approccio simulativo. La metodologia sviluppata si è rivelata uno strumento flessibile ed agevole, ma, allo stesso tempo, puntuale nel risolvere i problemi per cui è stata ideata. Le potenzialità della metodologia sviluppata vengono messe in risalto nel corso dell’elaborato grazie ad un caso di studio condotto.XXVI Ciclo198

Computer Science 2019 APR Self-Study & Documents

UNM Computer Science APR self-study report and review team report for Spring 2019, fulfilling requirements of the Higher Learning Commission

Neuroinformatics in Functional Neuroimaging

This Ph.D. thesis proposes methods for information retrieval in functional neuroimaging through automatic computerized authority identification, and searching and cleaning in a neuroscience database. Authorities are found through cocitation analysis of the citation pattern among scientific articles. Based on data from a single scientific journal it is shown that multivariate analyses are able to determine group structure that is interpretable as particular “known ” subgroups in functional neuroimaging. Methods for text analysis are suggested that use a combination of content and links, in the form of the terms in scientific documents and scientific citations, respectively. These included context sensitive author ranking and automatic labeling of axes and groups in connection with multivariate analyses of link data. Talairach foci from the BrainMap ™ database are modeled with conditional probability density models useful for exploratory functional volumes modeling. A further application is shown with conditional outlier detection where abnormal entries in the BrainMap ™ database are spotted using kernel density modeling and the redundancy between anatomical labels and spatial Talairach coordinates. This represents a combination of simple term and spatial modeling. The specific outliers that were found in the BrainMap ™ database constituted among others: Entry errors, errors in the article and unusual terminology

Automatic face recognition using stereo images

Face recognition is an important pattern recognition problem, in the study of both natural and artificial learning problems. Compaxed to other biometrics, it is non-intrusive, non- invasive and requires no paxticipation from the subjects. As a result, it has many applications varying from human-computer-interaction to access control and law-enforcement to crowd surveillance. In typical optical image based face recognition systems, the systematic vaxiability arising from representing the three-dimensional (3D) shape of a face by a two-dimensional (21)) illumination intensity matrix is treated as random vaxiability. Multiple examples of the face displaying vaxying pose and expressions axe captured in different imaging conditions. The imaging environment, pose and expressions are strictly controlled and the images undergo rigorous normalisation and pre-processing. This may be implemented in a paxtially or a fully automated system. Although these systems report high classification accuracies (>90%), they lack versatility and tend to fail when deployed outside laboratory conditions. Recently, more sophisticated 3D face recognition systems haxnessing the depth information have emerged. These systems usually employ specialist equipment such as laser scanners and structured light projectors. Although more accurate than 2D optical image based recognition, these systems are equally difficult to implement in a non-co-operative environment. Existing face recognition systems, both 2D and 3D, detract from the main advantages of face recognition and fail to fully exploit its non-intrusive capacity. This is either because they rely too much on subject co-operation, which is not always available, or because they cannot cope with noisy data. The main objective of this work was to investigate the role of depth information in face recognition in a noisy environment. A stereo-based system, inspired by the human binocular vision, was devised using a pair of manually calibrated digital off-the-shelf cameras in a stereo setup to compute depth information. Depth values extracted from 2D intensity images using stereoscopy are extremely noisy, and as a result this approach for face recognition is rare. This was cofirmed by the results of our experimental work. Noise in the set of correspondences, camera calibration and triangulation led to inaccurate depth reconstruction, which in turn led to poor classifier accuracy for both 3D surface matching and 211) 2 depth maps. Recognition experiments axe performed on the Sheffield Dataset, consisting 692 images of 22 individuals with varying pose, illumination and expressions

Application of CBIR techniques for the purpose of biometric identification based on human gait

Intenzivan razvoj informaciono-komunikacionih tehnologija otvorio je vrata primeni biometrijskih tehnologija u menadžmentu identiteta. Biometrijski modalitet koji ima veliki potencijal za primenu u praksi je ljudski hod. Njega odlikuju neinvazivnost i neintruzivnost. Ovakve osobine posebno pogoduju primeni u uslovima tehnologije prismotre. Zahvaljujući tome, ovaj biometrijski modalitet tokom prethodnih godina izaziva veliko interesovanje akademske zajednice. Ovo interesovanje rezultiralo je razvojem velikog broja pristupa za prepoznavanje osoba na osnovu hoda. Uprkos tome, primena biometrijskih tehnologija zasnovanih na ljudskom hodu u praksi i dalje zaostaje za dobro ustanovljenim modalitetima poput otiska prsta, lica ili glasa. Glavni razlog je nedostatak odgovarajućeg pristupa koji bi omogućio stabilnu primenu u realnim uslovima. Cilj ovog rada je predlog novog postupka za prepoznavanje osoba na osnovu hoda koji bi omogućio razvoj robusnog i pristupačnog biometrijskog sistema. Inicijalno, urađen je sveobuhvatan pregled oblasti i aktuelnih istraživanja na osnovu čega je predložen novi postupak. Predloženi postupak se zasniva na ideji da se sekvenca ljudskog hoda može predstaviti kao jedna nepomična 2D slika. Ovakav postupak omogućio bi da se za potrebe prepoznavanja primene generičke metode za pretragu slika na osnovu sadržaja. Na ovakav način problem bi bio prenet iz prostorno-vremenskog domena u prostorni domen, konkretno domen 2D nepomične slike, koji je poznat i u kome postoji veliki broj dokazanih rešenja. Za potrebe akvizicije, postupak se oslanja na novu tehnologiju iz oblasti interakcije čovek-računar, Microsoft Kinect. Na osnovu predloženog postupka razvijen je modularni laboratorijski prototip kao i okruženje za testiranje i evaluaciju. Naučna zasnovanost i opravdanost predloženog postupka proverena je nizom eksperimenata. Eksperimenti su organizovani na takav način da ispitaju različite faktore koji tokom primene postupka mogu uticati na konačne performanse u prepoznavanju. Na osnovu dobijenih rezultata može se zaključiti da predloženi postupak odlilkuje visok stepen robusnosti kao i visoka preciznost u prepoznavanju...Intense progress of information and communications technology enabled application of biometric technology in identity management. Human gait, as a biometric modality, has great potential for practical application. This is due to its noninvasive and nonintrusive nature. Surveillance technology is especially fertile ground for recognition based on human gait. These facts caused spike in academic interest for this biometric modality. This in turn resulted in development of large number of different approaches to human gait recognition. Nevertheless, practical application of biometric technology based on human gait still trails those well established modalities such as fingerprint, face or voice. Main reason for this is lacking of such approach that would enable stable use in realistic conditions. Goal of this paper is to propose a new approach for human gait recognition that would result in robust and affordable biometric system. Initially, a comprehensive review of research area and existing research was done that served as a base for the proposition of new approach. This new approach is based on the idea that human gait sequence can be represented as a single 2D still image. Using images would open the possibility of applying Content Based Image Retrieval (CBIR) techniques for the purpose of final recognition. This procedure shifts the problem form spatio-temporal towards spatial domain, specifically the space of 2D still image that is well researched and familiar. For acquisition purposes approach relies on new human-computer interaction technology, Microsoft Kinect. As proof of concept, a modular laboratory prototype was developed as well as environment for testing and evaluation. Foundation of the proposed approach was tested through a series of experiments. Empirical evaluation was performed in such a manner to investigate the influence of different contributing factors to system performance. Based on retrieved results a conclusion is reached that the proposed approach is highly robust and achieves high recognition rates..

Underwater Vehicles

For the latest twenty to thirty years, a significant number of AUVs has been created for the solving of wide spectrum of scientific and applied tasks of ocean development and research. For the short time period the AUVs have shown the efficiency at performance of complex search and inspection works and opened a number of new important applications. Initially the information about AUVs had mainly review-advertising character but now more attention is paid to practical achievements, problems and systems technologies. AUVs are losing their prototype status and have become a fully operational, reliable and effective tool and modern multi-purpose AUVs represent the new class of underwater robotic objects with inherent tasks and practical applications, particular features of technology, systems structure and functional properties

Autonomous navigation and mapping of mobile robots based on 2D/3D cameras combination

Aufgrund der tendenziell zunehmenden Nachfrage an Systemen zur Unterstützung des alltäglichen Lebens gibt es derzeit ein großes Interesse an autonomen Systemen. Autonome Systeme werden in Häusern, Büros, Museen sowie in Fabriken eingesetzt. Sie können verschiedene Aufgaben erledigen, beispielsweise beim Reinigen, als Helfer im Haushalt, im Bereich der Sicherheit und Bildung, im Supermarkt sowie im Empfang als Auskunft, weil sie dazu verwendet werden können, die Verarbeitungszeit zu kontrollieren und präzise, zuverlässige Ergebnisse zu liefern. Ein Forschungsgebiet autonomer Systeme ist die Navigation und Kartenerstellung. Das heißt, mobile Roboter sollen selbständig ihre Aufgaben erledigen und zugleich eine Karte der Umgebung erstellen, um navigieren zu können. Das Hauptproblem besteht darin, dass der mobile Roboter in einer unbekannten Umgebung, in der keine zusätzlichen Bezugsinformationen vorhanden sind, das Gelände erkunden und eine dreidimensionale Karte davon erstellen muss. Der Roboter muss seine Positionen innerhalb der Karte bestimmen. Es ist notwendig, ein unterscheidbares Objekt zu finden. Daher spielen die ausgewählten Sensoren und der Register-Algorithmus eine relevante Rolle. Die Sensoren, die sowohl Tiefen- als auch Bilddaten liefern können, sind noch unzureichend. Der neue 3D-Sensor, nämlich der "Photonic Mixer Device" (PMD), erzeugt mit hoher Bildwiederholfrequenz eine Echtzeitvolumenerfassung des umliegenden Szenarios und liefert Tiefen- und Graustufendaten. Allerdings erfordert die höhere Qualität der dreidimensionalen Erkundung der Umgebung Details und Strukturen der Oberflächen, die man nur mit einer hochauflösenden CCD-Kamera erhalten kann. Die vorliegende Arbeit präsentiert somit eine Exploration eines mobilen Roboters mit Hilfe der Kombination einer CCD- und PMD-Kamera, um eine dreidimensionale Karte der Umgebung zu erstellen. Außerdem wird ein Hochleistungsalgorithmus zur Erstellung von 3D Karten und zur Poseschätzung in Echtzeit unter Verwendung des "Simultaneous Localization and Mapping" (SLAM) Verfahrens präsentiert. Der autonom arbeitende, mobile Roboter soll ferner Aufgaben übernehmen, wie z.B. die Erkennung von Objekten in ihrer Umgebung, um verschiedene praktische Aufgaben zu lösen. Die visuellen Daten der CCD-Kamera liefern nicht nur eine hohe Auflösung der Textur-Daten für die Tiefendaten, sondern werden auch für die Objekterkennung verwendet. Der "Iterative Closest Point" (ICP) Algorithmus benutzt zwei Punktwolken, um den Bewegungsvektor zu bestimmen. Schließlich sind die Auswertung der Korrespondenzen und die Rekonstruktion der Karte, um die reale Umgebung abzubilden, in dieser Arbeit enthalten.Presently, intelligent autonomous systems have to perform very interesting tasks due to trendy increases in support demands of human living. Autonomous systems have been used in various applications like houses, offices, museums as well as in factories. They are able to operate in several kinds of applications such as cleaning, household assistance, transportation, security, education and shop assistance because they can be used to control the processing time, and to provide precise and reliable output. One research field of autonomous systems is mobile robot navigation and map generation. That means the mobile robot should work autonomously while generating a map, which the robot follows. The main issue is that the mobile robot has to explore an unknown environment and to generate a three dimensional map of an unknown environment in case that there is not any further reference information. The mobile robot has to estimate its position and pose. It is required to find distinguishable objects. Therefore, the selected sensors and registered algorithms are significant. The sensors, which can provide both, depth as well as image data are still deficient. A new 3D sensor, namely the Photonic Mixer Device (PMD), generates a high rate output in real-time capturing the surrounding scenario as well as the depth and gray scale data. However, a higher quality of three dimension explorations requires details and textures of surfaces, which can be obtained from a high resolution CCD camera. This work hence presents the mobile robot exploration using the integration of CCD and PMD camera in order to create a three dimensional map. In addition, a high performance algorithm for 3D mapping and pose estimation of the locomotion in real time, using the "Simultaneous Localization and Mapping" (SLAM) technique is proposed. The flawlessly mobile robot should also handle the tasks, such as the recognition of objects in its environment, in order to achieve various practical missions. Visual input from the CCD camera not only delivers high resolution texture data on depth volume, but is also used for object recognition. The “Iterative Closest Point” (ICP) algorithm is using two sets of points to find out the translation and rotation vector between two scans. Finally, the evaluation of the correspondences and the reconstruction of the map to resemble the real environment are included in this thesis