A survey of visual preprocessing and shape representation techniques

Many recent theories and methods proposed for visual preprocessing and shape representation are summarized. The survey brings together research from the fields of biology, psychology, computer science, electrical engineering, and most recently, neural networks. It was motivated by the need to preprocess images for a sparse distributed memory (SDM), but the techniques presented may also prove useful for applying other associative memories to visual pattern recognition. The material of this survey is divided into three sections: an overview of biological visual processing; methods of preprocessing (extracting parts of shape, texture, motion, and depth); and shape representation and recognition (form invariance, primitives and structural descriptions, and theories of attention)

Symposium on Frontiers of Molecular Neurobiology

Membrane structure, synaptic transmission, and fibrous proteins of neurons - conferenc

The synthesis of artificial neural networks using single string evolutionary techniques.

The research presented in this thesis is concerned with optimising the structure of Artificial Neural Networks. These techniques are based on computer modelling of biological evolution or foetal development. They are known as Evolutionary, Genetic or Embryological methods. Specifically, Embryological techniques are used to grow Artificial Neural Network topologies. The Embryological Algorithm is an alternative to the popular Genetic Algorithm, which is widely used to achieve similar results. The algorithm grows in the sense that the network structure is added to incrementally and thus changes from a simple form to a more complex form. This is unlike the Genetic Algorithm, which causes the structure of the network to evolve in an unstructured or random way. The thesis outlines the following original work: The operation of the Embryological Algorithm is described and compared with the Genetic Algorithm. The results of an exhaustive literature search in the subject area are reported. The growth strategies which may be used to evolve Artificial Neural Network structure are listed. These growth strategies are integrated into an algorithm for network growth. Experimental results obtained from using such a system are described and there is a discussion of the applications of the approach. Consideration is given of the advantages and disadvantages of this technique and suggestions are made for future work in the area. A new learning algorithm based on Taguchi methods is also described. The report concludes that the method of incremental growth is a useful and powerful technique for defining neural network structures and is more efficient than its alternatives. Recommendations are also made with regard to the types of network to which this approach is best suited. Finally, the report contains a discussion of two important aspects of Genetic or Evolutionary techniques related to the above. These are Modular networks (and their synthesis) and the functionality of the network itself

Using evolutionary artificial neural networks to design hierarchical animat nervous systems.

The research presented in this thesis examines the area of control systems for robots or animats (animal-like robots). Existing systems have problems in that they require a great deal of manual design or are limited to performing jobs of a single type. For these reasons, a better solution is desired. The system studied here is an Artificial Nervous System (ANS) which is biologically inspired; it is arranged as a hierarchy of layers containing modules operating in parallel. The ANS model has been developed to be flexible, scalable, extensible and modular. The ANS can be implemented using any suitable technology, for many different environments. The implementation focused on the two lowest layers (the reflex and action layers) of the ANS, which are concerned with control and rhythmic movement. Both layers were realised as Artificial Neural Networks (ANN) which were created using Evolutionary Algorithms (EAs). The task of the reflex layer was to control the position of an actuator (such as linear actuators or D.C. motors). The action layer performed the task of Central Pattern Generators (CPG), which produce rhythmic patterns of activity. In particular, different biped and quadruped gait patterns were created. An original neural model was specifically developed for assisting in the creation of these time-based patterns. It is shown in the thesis that Artificial Reflexes and CPGs can be configured successfully using this technique. The Artificial Reflexes were better at generalising across different actuators, without changes, than traditional controllers. Gaits such as pace, trot, gallop and pronk were successfully created using the CPGs. Experiments were conducted to determine whether modularity in the networks had an impact. It has been demonstrated that the degree of modularization in the network influences its evolvability, with more modular networks evolving more efficiently

A Hardware approach to neural networks silicon retina

The primary goal of this thesis was to emulate the function of the biological eye in silicon. In both neural and silicon technologies, the active devices occupy approximately 2 percent of the space, wire fills the entire remaining space. The silicon retina was modeled on the distal portion of the vertebrate retina. This chip generates, in real time, outputs that correspond directly to signals observed in the corresponding levels of the biological retinas. The design uses the principles of signal aggregation. It demonstrates a tolerance for device imperfection that is characteristic of a collective system. The digital computer is extremely effective at producing precise answers to well-defined questions. The nervous system accepts fuzzy, poorly conditioned input, performs a computation that is ill-defined, and produces approximate output

Artificial Intelligence, Mathematical Modeling and Magnetic Resonance Imaging for Precision Medicine in Neurology and Neuroradiology

La tesi affronta la possibilità di utilizzare metodi matematici, tecniche di simulazione, teorie fisiche riadattate e algoritmi di intelligenza artificiale per soddisfare le esigenze cliniche in neuroradiologia e neurologia al fine di descrivere e prevedere i patterns e l’evoluzione temporale di una malattia, nonché di supportare il processo decisionale clinico. La tesi è suddivisa in tre parti. La prima parte riguarda lo sviluppo di un workflow radiomico combinato con algoritmi di Machine Learning al fine di prevedere parametri che favoriscono la descrizione quantitativa dei cambiamenti anatomici e del coinvolgimento muscolare nei disordini neuromuscolari, con particolare attenzione alla distrofia facioscapolo-omerale. Il workflow proposto si basa su sequenze di risonanza magnetica convenzionali disponibili nella maggior parte dei centri neuromuscolari e, dunque, può essere utilizzato come strumento non invasivo per monitorare anche i più piccoli cambiamenti nei disturbi neuromuscolari oltre che per la valutazione della progressione della malattia nel tempo. La seconda parte riguarda l’utilizzo di un modello cinetico per descrivere la crescita tumorale basato sugli strumenti della meccanica statistica per sistemi multi-agente e che tiene in considerazione gli effetti delle incertezze cliniche legate alla variabilità della progressione tumorale nei diversi pazienti. L'azione dei protocolli terapeutici è modellata come controllo che agisce a livello microscopico modificando la natura della distribuzione risultante. Viene mostrato come lo scenario controllato permetta di smorzare le incertezze associate alla variabilità della dinamica tumorale. Inoltre, sono stati introdotti metodi di simulazione numerica basati sulla formulazione stochastic Galerkin del modello cinetico sviluppato. La terza parte si riferisce ad un progetto ancora in corso che tenta di descrivere una porzione di cervello attraverso la teoria quantistica dei campi e di simularne il comportamento attraverso l'implementazione di una rete neurale con una funzione di attivazione costruita ad hoc e che simula la funzione di risposta del modello biologico neuronale. E’ stato ottenuto che, nelle condizioni studiate, l'attività della porzione di cervello può essere descritta fino a O(6), i.e, considerando l’interazione fino a sei campi, come un processo gaussiano. Il framework quantistico definito può essere esteso anche al caso di un processo non gaussiano, ovvero al caso di una teoria di campo quantistico interagente utilizzando l’approccio della teoria wilsoniana di campo efficace.The thesis addresses the possibility of using mathematical methods, simulation techniques, repurposed physical theories and artificial intelligence algorithms to fulfill clinical needs in neuroradiology and neurology. The aim is to describe and to predict disease patterns and its evolution over time as well as to support clinical decision-making processes. The thesis is divided into three parts. Part 1 is related to the development of a Radiomic workflow combined with Machine Learning algorithms in order to predict parameters that quantify muscular anatomical involvement in neuromuscular diseases, with special focus on Facioscapulohumeral dystrophy. The proposed workflow relies on conventional Magnetic Resonance Imaging sequences available in most neuromuscular centers and it can be used as a non-invasive tool to monitor even fine change in neuromuscular disorders and to evaluate longitudinal diseases’ progression over time. Part 2 is about the description of a kinetic model for tumor growth by means of classical tools of statistical mechanics for many-agent systems also taking into account the effects of clinical uncertainties related to patients’ variability in tumor progression. The action of therapeutic protocols is modeled as feedback control at the microscopic level. The controlled scenario allows the dumping of uncertainties associated with the variability in tumors’ dynamics. Suitable numerical methods, based on Stochastic Galerkin formulation of the derived kinetic model, are introduced. Part 3 refers to a still-on going project that attempts to describe a brain portion through a quantum field theory and to simulate its behavior through the implementation of a neural network with an ad-hoc activation function mimicking the biological neuron model response function. Under considered conditions, the brain portion activity can be expressed up to O(6), i.e., up to six fields interaction, as a Gaussian Process. The defined quantum field framework may also be extended to the case of a Non-Gaussian Process behavior, or rather to an interacting quantum field theory in a Wilsonian Effective Field theory approach

Considerations in designing a cybernetic simple 'learning' model; and an overview of the problem of modelling learning

This thesis was submitted for the degree of Doctor of Philosophy and awarded by Brunel University.Learning is viewed as a central feature of living systems and must be manifested in any artifact that claims to exhibit general intelligence. The central aims of the thesis are twofold: (1) - To review and critically assess the empirical and theoretical aspects of learning as have been addressed in a multitude of disciplines, with the aim of extracting fundamental features and elements. (2) - To develop a more systematic approach to the cybernetic modelling of learning than has been achieved hitherto. In pursuit of aim (1) above the following discussions are included: Historical and Philosophical backgrounds; Natural learning, both physiological and psychological aspects; Hierarchies of learning identified in the evolutionary, functional and developmental senses; An extensive section on the general problem of modelling of learning and the formal tools, is included as a link between aims (1) and (2). Following this a systematic and historically oriented study of cybernetic and other related approaches to the problem of modelling of learning is presented. This then leads to the development of a state-of-the-art general purpose experimental cybernetic learning model. The programming and use of this model is also fully described, including an elaborate scheme for the manifestation of simple learning