Learning as a Nonlinear Line of Attraction for Pattern Association, Classification and Recognition

Development of a mathematical model for learning a nonlinear line of attraction is presented in this dissertation, in contrast to the conventional recurrent neural network model in which the memory is stored in an attractive fixed point at discrete location in state space. A nonlinear line of attraction is the encapsulation of attractive fixed points scattered in state space as an attractive nonlinear line, describing patterns with similar characteristics as a family of patterns. It is usually of prime imperative to guarantee the convergence of the dynamics of the recurrent network for associative learning and recall. We propose to alter this picture. That is, if the brain remembers by converging to the state representing familiar patterns, it should also diverge from such states when presented by an unknown encoded representation of a visual image. The conception of the dynamics of the nonlinear line attractor network to operate between stable and unstable states is the second contribution in this dissertation research. These criteria can be used to circumvent the plasticity-stability dilemma by using the unstable state as an indicator to create a new line for an unfamiliar pattern. This novel learning strategy utilizes stability (convergence) and instability (divergence) criteria of the designed dynamics to induce self-organizing behavior. The self-organizing behavior of the nonlinear line attractor model can manifest complex dynamics in an unsupervised manner. The third contribution of this dissertation is the introduction of the concept of manifold of color perception. The fourth contribution of this dissertation is the development of a nonlinear dimensionality reduction technique by embedding a set of related observations into a low-dimensional space utilizing the result attained by the learned memory matrices of the nonlinear line attractor network. Development of a system for affective states computation is also presented in this dissertation. This system is capable of extracting the user\u27s mental state in real time using a low cost computer. It is successfully interfaced with an advanced learning environment for human-computer interaction

Multi-Modal Enhancement Techniques for Visibility Improvement of Digital Images

Image enhancement techniques for visibility improvement of 8-bit color digital images based on spatial domain, wavelet transform domain, and multiple image fusion approaches are investigated in this dissertation research. In the category of spatial domain approach, two enhancement algorithms are developed to deal with problems associated with images captured from scenes with high dynamic ranges. The first technique is based on an illuminance-reflectance (I-R) model of the scene irradiance. The dynamic range compression of the input image is achieved by a nonlinear transformation of the estimated illuminance based on a windowed inverse sigmoid transfer function. A single-scale neighborhood dependent contrast enhancement process is proposed to enhance the high frequency components of the illuminance, which compensates for the contrast degradation of the mid-tone frequency components caused by dynamic range compression. The intensity image obtained by integrating the enhanced illuminance and the extracted reflectance is then converted to a RGB color image through linear color restoration utilizing the color components of the original image. The second technique, named AINDANE, is a two step approach comprised of adaptive luminance enhancement and adaptive contrast enhancement. An image dependent nonlinear transfer function is designed for dynamic range compression and a multiscale image dependent neighborhood approach is developed for contrast enhancement. Real time processing of video streams is realized with the I-R model based technique due to its high speed processing capability while AINDANE produces higher quality enhanced images due to its multi-scale contrast enhancement property. Both the algorithms exhibit balanced luminance, contrast enhancement, higher robustness, and better color consistency when compared with conventional techniques. In the transform domain approach, wavelet transform based image denoising and contrast enhancement algorithms are developed. The denoising is treated as a maximum a posteriori (MAP) estimator problem; a Bivariate probability density function model is introduced to explore the interlevel dependency among the wavelet coefficients. In addition, an approximate solution to the MAP estimation problem is proposed to avoid the use of complex iterative computations to find a numerical solution. This relatively low complexity image denoising algorithm implemented with dual-tree complex wavelet transform (DT-CWT) produces high quality denoised images

Deliverable D1.1 State of the art and requirements analysis for hypervideo

This deliverable presents a state-of-art and requirements analysis report for hypervideo authored as part of the WP1 of the LinkedTV project. Initially, we present some use-case (viewers) scenarios in the LinkedTV project and through the analysis of the distinctive needs and demands of each scenario we point out the technical requirements from a user-side perspective. Subsequently we study methods for the automatic and semi-automatic decomposition of the audiovisual content in order to effectively support the annotation process. Considering that the multimedia content comprises of different types of information, i.e., visual, textual and audio, we report various methods for the analysis of these three different streams. Finally we present various annotation tools which could integrate the developed analysis results so as to effectively support users (video producers) in the semi-automatic linking of hypervideo content, and based on them we report on the initial progress in building the LinkedTV annotation tool. For each one of the different classes of techniques being discussed in the deliverable we present the evaluation results from the application of one such method of the literature to a dataset well-suited to the needs of the LinkedTV project, and we indicate the future technical requirements that should be addressed in order to achieve higher levels of performance (e.g., in terms of accuracy and time-efficiency), as necessary

Air Force Institute of Technology Research Report 2014

This report summarizes the research activities of the Air Force Institute of Technology’s Graduate School of Engineering and Management. It describes research interests and faculty expertise; lists student theses/dissertations; identifies research sponsors and contributions; and outlines the procedures for contacting the school. Included in the report are: faculty publications, conference presentations, consultations, and funded research projects. Research was conducted in the areas of Aeronautical and Astronautical Engineering, Electrical Engineering and Electro-Optics, Computer Engineering and Computer Science, Systems Engineering and Management, Operational Sciences, Mathematics, Statistics and Engineering Physics

Recent Application in Biometrics

In the recent years, a number of recognition and authentication systems based on biometric measurements have been proposed. Algorithms and sensors have been developed to acquire and process many different biometric traits. Moreover, the biometric technology is being used in novel ways, with potential commercial and practical implications to our daily activities. The key objective of the book is to provide a collection of comprehensive references on some recent theoretical development as well as novel applications in biometrics. The topics covered in this book reflect well both aspects of development. They include biometric sample quality, privacy preserving and cancellable biometrics, contactless biometrics, novel and unconventional biometrics, and the technical challenges in implementing the technology in portable devices. The book consists of 15 chapters. It is divided into four sections, namely, biometric applications on mobile platforms, cancelable biometrics, biometric encryption, and other applications. The book was reviewed by editors Dr. Jucheng Yang and Dr. Norman Poh. We deeply appreciate the efforts of our guest editors: Dr. Girija Chetty, Dr. Loris Nanni, Dr. Jianjiang Feng, Dr. Dongsun Park and Dr. Sook Yoon, as well as a number of anonymous reviewers

A Comprehensive survey on deep future frame video prediction

El present projecte planteja l'estudi comprensiu i extens per a la tasca de predicció de fotogrames donada una seqüència de vídeo. Mitjançant l'anàlisi de l'estat de l'art en generació d'imatges, xarxes convolucionals i adversàries l'objectiu és establir les forces i utilitats d'aquesta tasca

Towards a National 3D Mapping Product for Great Britain

Knowing where something happens and where people are located can be critically important to understand issues ranging from climate change to road accidents, crime, schooling, transport and much more. To analyse these spatial problems, two-dimensional representations of the world, such as paper or digital maps, have traditionally been used. Geographic information systems (GIS) are the tools that enable capture, modelling, storage, retrieval, sharing, manipulation, analysis, and presentation of geographically referenced data. Three-dimensional geographic information (3D GI) is data that can represent real-world features as objects in 3D space. 3D GI offers additional functionality not possible in 2D, including analysing and querying volume, visibility, surface and sub-surface, and shadowing. This thesis contributes to the understanding of user requirements and other data related considerations in the production of 3D geographic information at a national level. The study promotes Ordnance Survey’s efforts in developing a 3D geographic product through: (1) identifying potential applications; (2) analysing existing 3D city modelling approaches; (3) eliciting and formalising user requirements; (4) developing metrics to describe the usefulness of 3D data and; (5) evaluating the commerciality of 3D GI. A review of current applications of 3D showed that visualisation dominated as the main use, allowing for better communication, and supporting decision-making processes. Reflecting this, an examination of existing 3D city models showed that, despite the varying modelling approaches, there was a general focus towards accurate and realistic geometric representation of the urban environment. Web-based questionnaires and semi-structured interviews revealed that while some applications (e.g. subsurface, photovoltaics, air and noise quality) lead the field with a high adoption of 3D, others were laggards due to organisational inertia (e.g. insurance, facilities management). Individuals expressed positive views on the use of 3D, but still struggled to justify the value and business case. Simple building geometry coupled with non-building thematic classes was perceived to be most useful by users. Several metrics were developed to quantify and compare the characteristics of thirty-three 3D datasets. Results showed that geometry-based metrics such as minimum feature length or Euler characteristic can be used to provide additional information as part of fitness-for-purpose evaluations. The metrics can also contribute to quality control during data production. An investigation into the commercial opportunities explored the economic value of 3D, the market size of 3D data in Great Britain, as well as proposed a number of opportunities within the wider business context of Ordnance Survey

An assessment of tropical dryland forest ecosystem biomass and climate change impacts in the Kavango-Zambezi (KAZA) region of Southern Africa

The dryland forests of the Kavango-Zambezi (KAZA) region in Southern Africa are highly susceptible to disturbances from an increase in human population, wildlife pressures and the impacts of climate change. In this environment, reliable forest extent and structure estimates are difficult to obtain because of the size and remoteness of KAZA (519,912 km²). Whilst satellite remote sensing is generally well-suited to monitoring forest characteristics, there remain large uncertainties about its application for assessing changes at a regional scale to quantify forest structure and biomass in dry forest environments. This thesis presents research that combines Synthetic Aperture Radar, multispectral satellite imagery and climatological data with an inventory from a ground survey of woodland in Botswana and Namibia in 2019. The research utilised a multi-method approach including parametric and non-parametric algorithms and change detection models to address the following objectives: (1) To assess the feasibility of using openly accessible remote sensing data to estimate the dryland forest above ground biomass (2) to quantify the detail of vegetation dynamics using extensive archives of time series satellite data; (3) to investigate the relationship between fire, soil moisture, and drought on dryland vegetation as a means of characterising spatiotemporal changes in aridity. The results establish that a combination of radar and multispectral imagery produced the best fit to the ground observations for estimating forest above ground biomass. Modelling of the time-series shows that it is possible to identify abrupt changes, longer-term trends and seasonality in forest dynamics. The time series analysis of fire shows that about 75% of the study area burned at least once within the 17-year monitoring period, with the national parks more frequently affected than other protected areas. The results presented show a significant increase in dryness over the past 2 decades, with arid and semi-arid regions encroaching at the expense of dry sub-humid, particularly in the south of the region, notably between 2011-2019