Neural Computing in Quaternion Algebra

兵庫県立大学201

Financial distress prediction using the hybrid associative memory with translation

This paper presents an alternative technique for financial distress prediction systems. The method is based on a type of neural network, which is called hybrid associative memory with translation. While many different neural network architectures have successfully been used to predict credit risk and corporate failure, the power of associative memories for financial decision-making has not been explored in any depth as yet. The performance of the hybrid associative memory with translation is compared to four traditional neural networks, a support vector machine and a logistic regression model in terms of their prediction capabilities. The experimental results over nine real-life data sets show that the associative memory here proposed constitutes an appropriate solution for bankruptcy and credit risk prediction, performing significantly better than the rest of models under class imbalance and data overlapping conditions in terms of the true positive rate and the geometric mean of true positive and true negative rates.This work has partially been supported by the Mexican CONACYT through the Postdoctoral Fellowship Program [232167], the Spanish Ministry of Economy [TIN2013-46522-P], the Generalitat Valenciana [PROMETEOII/2014/062] and the Mexican PRODEP [DSA/103.5/15/7004]. We would like to thank the Reviewers for their valuable comments and suggestions, which have helped to improve the quality of this paper substantially

Associative learning on imbalanced environments: An empirical study

Associative memories have emerged as a powerful computational neural network model for several pattern classification problems. Like most traditional classifiers, these models assume that the classes share similar prior probabilities. However, in many real-life applications the ratios of prior probabilities between classes are extremely skewed. Although the literature has provided numerous studies that examine the performance degradation of renowned classifiers on different imbalanced scenarios, so far this effect has not been supported by a thorough empirical study in the context of associative memories. In this paper, we fix our attention on the applicability of the associative neural networks to the classification of imbalanced data. The key questions here addressed are whether these models perform better, the same or worse than other popular classifiers, how the level of imbalance affects their performance, and whether distinct resampling strategies produce a different impact on the associative memories. In order to answer these questions and gain further insight into the feasibility and efficiency of the associative memories, a large-scale experimental evaluation with 31 databases, seven classification models and four resampling algorithms is carried out here, along with a non-parametric statistical test to discover any significant differences between each pair of classifiers.This work has partially been supported by the Mexican Science and Technology Council (CONACYT-Mexico) through the Postdoctoral Fellowship Program (232167), the Mexican PRODEP(DSA/103.5/15/7004), the Spanish Ministry of Economy(TIN2013-46522-P) and the Generalitat Valenciana (PROMETEOII/2014/062)

Visual statistics using neural networks.

This thesis describes the application of statistical techniques to natural images as a means of gaining insight into the operation of low level vision. First, the statistical technique of principal component analysis is applied to a collection of natural images: a match with psychophysical data is found; and a solution to the dynamic range problem proposed. The problem of learning and calibrating psychological and physiological representations of space is t hen investigated. The grey level correlations in natural images are measured and their physical causes investigated. The resulting correlations are related both to psychological distortions of space and to the cortical representation of space in \T in macaque monkey. The interpretation in terms of a system calibrating itself using the correlations in the input signals is shown to produce accurate psychological and physiological predictions. Lastly the problems of creating low level models of the visual input is looked at using a framework originally proposed by Hinton and Sejnowski (1983). The way in which phase coherence of (neuronal) firing in a network can label the probability of an interpretation is demonstrated. A new search technique, inspired by the different time courses of inhibition and excitation in the cortex, is proposed for searching for the most likely visual interpretation. It is concluded that statistical techniques can provide insight into the operation of low level vision

Olfactory learning in Drosophila

Animals are able to form associative memories and benefit from past experience. In classical conditioning an animal is trained to associate an initially neutral stimulus by pairing it with a stimulus that triggers an innate response. The neutral stimulus is commonly referred to as conditioned stimulus (CS) and the reinforcing stimulus as unconditioned stimulus (US). The underlying neuronal mechanisms and structures are an intensely investigated topic. The fruit fly Drosophila melanogaster is a prime model animal to investigate the mechanisms of learning. In this thesis we propose fundamental circuit motifs that explain aspects of aversive olfactory learning as it is observed in the fruit fly. Changing parameters of the learning paradigm affects the behavioral outcome in different ways. The relative timing between CS and US affects the hedonic value of the CS. Reversing the order changes the behavioral response from conditioned avoidance to conditioned approach. We propose a timing-dependent biochemical reaction cascade, which can account for this phenomenon. In addition to form odor-specific memories, flies are able to associate a specific odor intensity. In aversive olfactory conditioning they show less avoidance to lower and higher intensities of the same odor. However the layout of the first two olfactory processing layers does not support this kind of learning due to a nested representation of odor intensity. We propose a basic circuit motif that transforms the nested monotonic intensity representation to a non-monotonic representation that supports intensity specific learning. Flies are able to bridge a stimulus free interval between CS and US to form an association. It is unclear so far where the stimulus trace of the CS is represented in the fly's nervous system. We analyze recordings from the first three layers of olfactory processing with an advanced machine learning approach. We argue that third order neurons are likely to harbor the stimulus trace

A survey of visual preprocessing and shape representation techniques

Many recent theories and methods proposed for visual preprocessing and shape representation are summarized. The survey brings together research from the fields of biology, psychology, computer science, electrical engineering, and most recently, neural networks. It was motivated by the need to preprocess images for a sparse distributed memory (SDM), but the techniques presented may also prove useful for applying other associative memories to visual pattern recognition. The material of this survey is divided into three sections: an overview of biological visual processing; methods of preprocessing (extracting parts of shape, texture, motion, and depth); and shape representation and recognition (form invariance, primitives and structural descriptions, and theories of attention)

Mnemonic construction and representation of temporal structure in the hippocampal formation

The hippocampal-entorhinal region supports memory for episodic details, such as temporal relations of sequential events, and mnemonic constructions combining experiences for inferential reasoning. However, it is unclear whether hippocampal event memories reflect temporal relations derived from mnemonic constructions, event order, or elapsing time, and whether these sequence representations generalize temporal relations across similar sequences. Here, participants mnemonically constructed times of events from multiple sequences using infrequent cues and their experience of passing time. After learning, event representations in the anterior hippocampus reflected temporal relations based on constructed times. Temporal relations were generalized across sequences, revealing distinct representational formats for events from the same or different sequences. Structural knowledge about time patterns, abstracted from different sequences, biased the construction of specific event times. These findings demonstrate that mnemonic construction and the generalization of relational knowledge combine in the hippocampus, consistent with the simulation of scenarios from episodic details and structural knowledge

Investigation of 10 sup 10 bit optical memory Interim report

Properties of Bragg holography in alkali halide crystals and application to optical data storage and processin

Dual coding with STDP in a spiking recurrent neural network model of the hippocampus.

The firing rate of single neurons in the mammalian hippocampus has been demonstrated to encode for a range of spatial and non-spatial stimuli. It has also been demonstrated that phase of firing, with respect to the theta oscillation that dominates the hippocampal EEG during stereotype learning behaviour, correlates with an animal's spatial location. These findings have led to the hypothesis that the hippocampus operates using a dual (rate and temporal) coding system. To investigate the phenomenon of dual coding in the hippocampus, we examine a spiking recurrent network model with theta coded neural dynamics and an STDP rule that mediates rate-coded Hebbian learning when pre- and post-synaptic firing is stochastic. We demonstrate that this plasticity rule can generate both symmetric and asymmetric connections between neurons that fire at concurrent or successive theta phase, respectively, and subsequently produce both pattern completion and sequence prediction from partial cues. This unifies previously disparate auto- and hetero-associative network models of hippocampal function and provides them with a firmer basis in modern neurobiology. Furthermore, the encoding and reactivation of activity in mutually exciting Hebbian cell assemblies demonstrated here is believed to represent a fundamental mechanism of cognitive processing in the brain