Computational aspects of cellular intelligence and their role in artificial intelligence.

The work presented in this thesis is concerned with an exploration of the computational aspects of the primitive intelligence associated with single-celled organisms. The main aim is to explore this Cellular Intelligence and its role within Artificial Intelligence. The findings of an extensive literature search into the biological characteristics, properties and mechanisms associated with Cellular Intelligence, its underlying machinery - Cell Signalling Networks and the existing computational methods used to capture it are reported. The results of this search are then used to fashion the development of a versatile new connectionist representation, termed the Artificial Reaction Network (ARN). The ARN belongs to the branch of Artificial Life known as Artificial Chemistry and has properties in common with both Artificial Intelligence and Systems Biology techniques, including: Artificial Neural Networks, Artificial Biochemical Networks, Gene Regulatory Networks, Random Boolean Networks, Petri Nets, and S-Systems. The thesis outlines the following original work: The ARN is used to model the chemotaxis pathway of Escherichia coli and is shown to capture emergent characteristics associated with this organism and Cellular Intelligence more generally. The computational properties of the ARN and its applications in robotic control are explored by combining functional motifs found in biochemical network to create temporal changing waveforms which control the gaits of limbed robots. This system is then extended into a complete control system by combining pattern recognition with limb control in a single ARN. The results show that the ARN can offer increased flexibility over existing methods. Multiple distributed cell-like ARN based agents termed Cytobots are created. These are first used to simulate aggregating cells based on the slime mould Dictyostelium discoideum. The Cytobots are shown to capture emergent behaviour arising from multiple stigmergic interactions. Applications of Cytobots within swarm robotics are investigated by applying them to benchmark search problems and to the task of cleaning up a simulated oil spill. The results are compared to those of established optimization algorithms using similar cell inspired strategies, and to other robotic agent strategies. Consideration is given to the advantages and disadvantages of the technique and suggestions are made for future work in the area. The report concludes that the Artificial Reaction Network is a versatile and powerful technique which has application in both simulation of chemical systems, and in robotic control, where it can offer a higher degree of flexibility and computational efficiency than benchmark alternatives. Furthermore, it provides a tool which may possibly throw further light on the origins and limitations of the primitive intelligence associated with cells

Modelos de procesamiento de la información en el cerebro aplicados a Sistemas Conexionistas: Redes NeuroGliales Artificiales y Deep Learning

Programa Oficial de Doutoramento en Tecnoloxías da Información e as Comunicacións. 5032V01[Resumen] En el campo de la Inteligencia Artificial, los sistemas conexionistas se han inspirado en las neuronas ya que, según la visión clásica de la Neurociencia, eran las únicas células con capacidad para procesar la información. Descubrimientos recientes de Neurociencia han demostrado que las células gliales tienen un papel clave en el procesamiento de la información en el cerebro. Basándose en estos descubrimientos se han desarrollado las Redes NeuroGliales Artificiales (RNGA) que cuentan con dos tipos de elementos de procesado, neuronas y astrocitos. En esta tesis se ha continuado con esta línea de investigación multidisciplinar que combina la Neurociencia y la Inteligencia Artificial. Para ello, se ha desarrollado un nuevo comportamiento de los astrocitos que actúan sobre la salida de las neuronas en las RNGA. Se ha realizado una comparación con las Redes de Neuronas Artificiales (RNA) en cinco problemas de clasificación y se ha demostrado que el nuevo comportamiento de los astrocitos mejora de manera significativa los resultados. Tras demostrar la capacidad de los astrocitos para procesar la información, en esta tesis se ha desarrollado además una nueva metodología que permite por primera vez la creación de redes Deep Learning conteniendo miles de neuronas y astrocitos, denominadas Deep Neuron-Astrocyte Networks (DANAN). Tras probarlas en un problema de regresión, las DANAN obtienen mejores resultados que las RNA. Esto permitirá evaluar comportamientos más complejos de los astrocitos en las redes de Deep Learning, pudiendo incluso crearse redes de astrocitos en un futuro próximo.[Resumo] No campo da Intelixencia Artificial, os sistemas conexionistas inspiráronse nas neuronas xa que, segundo a visión clásica da Neuronciencia, eran as únicas células con capacidade para procesar a información. Descubrimentos recentes de Neurociencia demostraron que as células gliais teñen un papel crave no procesamento da información no cerebro. Baseándose nestes descubrimentos desenvolvéronse as Redes NeuroGliales Artificiais (RNGA) que contan con dous tipos de elementos de procesado, neuronas e astrocitos. Nesta tese continuouse con esta liña de investigación multidisciplinar que combina a Neurociencia e a Intelixencia Artificial. Para iso, desenvolveuse un novo comportamento dos astrocitos que actúan sobre a saída das neuronas nas RNGA. Realizouse unha comparación coas Redes de Neuronas Artificiais (RNA) en cinco problemas de clasificación e demostrouse que o novo comportamento dos astrocitos mellora de xeito significativo os resultados. Tras demostrar a capacidade dos astrocitos para procesar a información, nesta tese desenvolveuse ademais unha nova metodoloxía que permite por primeira vez a creación de redes Deep Learning contendo miles de neuronas e astrocitos, denominadas Deep Neuron-Astrocyte Networks (DANAN). Tras probalas nun problema de regresión, as DANAN obteñen mellores resultados cas RNA. Isto permitirá avaliar comportamentos máis complexos dos astrocitos nas redes de Deep Learning, podendo ata crearse redes de astrocitos nun futuro próximo.[Abstract] In the field of Artificial Intelligence, connectionist systems have been inspired by neurons and, according to the classical view of neuroscience, they were the only cells capable of processing information. The latest advances in Neuroscience have shown that glial cells have a key role in the processing of information in the brain. Based on these discoveries, Artificial NeuroGlial Networks (RNGA) have been developed, which have two types of processing elements, neurons and astrocytes. In this thesis, this line of multidisciplinary research that combines Neuroscience and Artificial Intelligence has been continued. For this goal, a new behavior of the astrocytes that act on the output of the neurons in the RNGA has been developed. A comparison has been made with the Artificial Neuron Networks (ANN) in five classification problems and it has been demonstrated that the new behavior of the astrocytes significantly improves the results. After prove the capacity of astrocytes for information processing, in this thesis has been developed a new methodology that allows for the first time the creation of Deep Learning networks containing thousands of neurons and astrocytes, called Deep Neuron-Astrocyte Networks (DANAN). After testing them in a regression problem, the DANAN obtain better results than ANN. This allows testing more complexes astrocyte behaviors in Deep Learning networks, and even creates astrocyte networks in the near future

Space Communications: Theory and Applications. Volume 3: Information Processing and Advanced Techniques. A Bibliography, 1958 - 1963

Annotated bibliography on information processing and advanced communication techniques - theory and applications of space communication

A Practical Investigation into Achieving Bio-Plausibility in Evo-Devo Neural Microcircuits Feasible in an FPGA

Many researchers has conjectured, argued, or in some cases demonstrated, that bio-plausibility can bring about emergent properties such as adaptability, scalability, fault-tolerance, self-repair, reliability, and autonomy to bio-inspired intelligent systems. Evolutionary-developmental (evo-devo) spiking neural networks are a very bio-plausible mixture of such bio-inspired intelligent systems that have been proposed and studied by a few researchers. However, the general trend is that the complexity and thus the computational cost grow with the bio-plausibility of the system. FPGAs (Field- Programmable Gate Arrays) have been used and proved to be one of the flexible and cost efficient hardware platforms for research' and development of such evo-devo systems. However, mapping a bio-plausible evo-devo spiking neural network to an FPGA is a daunting task full of different constraints and trade-offs that makes it, if not infeasible, very challenging. This thesis explores the challenges, trade-offs, constraints, practical issues, and some possible approaches in achieving bio-plausibility in creating evolutionary developmental spiking neural microcircuits in an FPGA through a practical investigation along with a series of case studies. In this study, the system performance, cost, reliability, scalability, availability, and design and testing time and complexity are defined as measures for feasibility of a system and structural accuracy and consistency with the current knowledge in biology as measures for bio-plausibility. Investigation of the challenges starts with the hardware platform selection and then neuron, cortex, and evo-devo models and integration of these models into a whole bio-inspired intelligent system are examined one by one. For further practical investigation, a new PLAQIF Digital Neuron model, a novel Cortex model, and a new multicellular LGRN evo-devo model are designed, implemented and tested as case studies. Results and their implications for the researchers, designers of such systems, and FPGA manufacturers are discussed and concluded in form of general trends, trade-offs, suggestions, and recommendations

Computer simulation of a neurological model of learning

A number of problems in psychology and neurology are discussed to orient the reader to a theory of neural integration. The importance is stressed of the comprehensive temporal and spatial integration of sensory, motor and motivational aspects of brain function. It is argued that an extended neural template theory could provide such an integration. Contemporary solutions to the problem of neural integration are discussed. The available knowledge concerning the structure of neural tissue leads to the description of a theory of neural integration which might provide such neural templates. Integrating Neurons are suggested to be organised in columns or pools. Sub-sets of Neurons are formed as a result of excitation and can preferentially exchange excitation. These sub-sets or Linked Constellations would act as spatial templates to be matched with subsequent states of excitation. Inhibition acts to restrict spike emission to the most highly activated sub-sets. An initial computer simulation represented a simple learning or classical conditioning situation. In a variety of test computer runs the performance confirmed the main predictions of the theoretical model. The model was then extended to include representation of instrumental, consummatory, motivational and other aspects of behaviour. The intention of these further simulations was not to demonstrate the predictions of prior formulations but rather to use the computer to develop simulations progressively able to represent behaviour. Difficulties were encountered which were remedied by incorporating rhythmic mechanisms. A number of different versions of the model were explored. It was shown that the models could be trained to produced a different response to discriminative cues, when those cues had previously signalled different contingencies of obtaining the opportunity to perform consummatory behaviour. A published experiment on the Spiral Illusion is reported, which confirmed predictions suggested by the model.<p

MS FT-2-2 7 Orthogonal polynomials and quadrature: Theory, computation, and applications

Quadrature rules find many applications in science and engineering. Their analysis is a classical area of applied mathematics and continues to attract considerable attention. This seminar brings together speakers with expertise in a large variety of quadrature rules. It is the aim of the seminar to provide an overview of recent developments in the analysis of quadrature rules. The computation of error estimates and novel applications also are described

Generalized averaged Gaussian quadrature and applications

A simple numerical method for constructing the optimal generalized averaged Gaussian quadrature formulas will be presented. These formulas exist in many cases in which real positive GaussKronrod formulas do not exist, and can be used as an adequate alternative in order to estimate the error of a Gaussian rule. We also investigate the conditions under which the optimal averaged Gaussian quadrature formulas and their truncated variants are internal