Reinforcement learning in populations of spiking neurons

Population coding is widely regarded as a key mechanism for achieving reliable behavioral responses in the face of neuronal variability. But in standard reinforcement learning a flip-side becomes apparent. Learning slows down with increasing population size since the global reinforcement becomes less and less related to the performance of any single neuron. We show that, in contrast, learning speeds up with increasing population size if feedback about the populationresponse modulates synaptic plasticity in addition to global reinforcement. The two feedback signals (reinforcement and population-response signal) can be encoded by ambient neurotransmitter concentrations which vary slowly, yielding a fully online plasticity rule where the learning of a stimulus is interleaved with the processing of the subsequent one. The assumption of a single additional feedback mechanism therefore reconciles biological plausibility with efficient learning

Spatial Intuition in Elementary Arithmetic: A Neurocomputational Account

Elementary arithmetic (e.g., addition, subtraction) in humans has been shown to exhibit spatial properties. Its exact nature has remained elusive, however. To address this issue, we combine two earlier models for parietal cortex: A model we recently proposed on number-space interactions and a modeling framework of parietal cortex that implements radial basis functions for performing spatial transformations. Together, they provide us with a framework in which elementary arithmetic is based on evolutionarily more basic spatial transformations, thus providing the first implemented instance of Dehaene and Cohen's recycling hypothesis

Surface Modification and Planar Defects of Calcium Carbonates by Magnetic Water Treatment

Powdery calcium carbonates, predominantly calcite and aragonite, with planar defects and cation–anion mixed surfaces as deposited on low-carbon steel by magnetic water treatment (MWT) were characterized by X-ray diffraction, electron microscopy, and vibration spectroscopy. Calcite were found to form faceted nanoparticles having 3x () commensurate superstructure and with well-developed {} and {} surfaces to exhibit preferred orientations. Aragonite occurred as laths having 3x () commensurate superstructure and with well-developed () surface extending along [100] direction up to micrometers in length. The (hkil)-specific coalescence of calcite and rapid lath growth of aragonite under the combined effects of Lorentz force and a precondensation event account for a beneficial larger particulate/colony size for the removal of the carbonate scale from the steel substrate. The coexisting magnetite particles have well-developed {011} surfaces regardless of MWT

The Skeletal Organic Matrix from Mediterranean Coral Balanophyllia europaea Influences Calcium Carbonate Precipitation

Scleractinian coral skeletons are made mainly of calcium carbonate in the form of aragonite. The mineral deposition occurs in a biological confined environment, but it is still a theme of discussion to what extent the calcification occurs under biological or environmental control. Hence, the shape, size and organization of skeletal crystals from the cellular level through the colony architecture, were attributed to factors as diverse as mineral supersaturation levels and organic mediation of crystal growth. The skeleton contains an intra-skeletal organic matrix (OM) of which only the water soluble component was chemically and physically characterized. In this work that OM from the skeleton of the Balanophyllia europaea, a solitary scleractinian coral endemic to the Mediterranean Sea, is studied in vitro with the aim of understanding its role in the mineralization of calcium carbonate. Mineralization of calcium carbonate was conducted by overgrowth experiments on coral skeleton and in calcium chloride solutions containing different ratios of water soluble and/or insoluble OM and of magnesium ions. The precipitates were characterized by diffractometric, spectroscopic and microscopic techniques. The results showed that both soluble and insoluble OM components influence calcium carbonate precipitation and that the effect is enhanced by their co-presence. The role of magnesium ions is also affected by the presence of the OM components. Thus, in vitro, OM influences calcium carbonate crystal morphology, aggregation and polymorphism as a function of its composition and of the content of magnesium ions in the precipitation media. This research, although does not resolve the controversy between environmental or biological control on the deposition of calcium carbonate in corals, sheds a light on the role of OM, which appears mediated by the presence of magnesium ions

The role of collagen in bone apatite formation in the presence of hydroxyapatite nucleation inhibitors

Bone is a composite material in which collagen fibrils form a scaffold for a highly organized arrangement of uniaxially oriented apatite crystals. In the periodic 67¿nm cross-striated pattern of the collagen fibril, the less dense 40-nm-long gap zone has been implicated as the place where apatite crystals nucleate from an amorphous phase, and subsequently grow. This process is believed to be directed by highly acidic non-collagenous proteins, however, the role of the collagen matrix during bone apatite mineralization remains unknown. Here, combining nanometre-scale resolution cryogenic transmission electron microscopy and cryogenic electron tomography with molecular modelling, we show that collagen functions in synergy with inhibitors of hydroxyapatite nucleation to actively control mineralization. The positive net charge close to the C-terminal end of the collagen molecules promotes the infiltration of the fibrils with amorphous calcium phosphate (ACP). Furthermore, the clusters of charged amino acids, both in gap and overlap regions, form nucleation sites controlling the conversion of ACP into a parallel array of oriented apatite crystals. We developed a model describing the mechanisms through which the structure, supramolecular assembly and charge distribution of collagen can control mineralization in the presence of inhibitors of hydroxyapatite nucleatio

Towards Comprehensive Foundations of Computational Intelligence

Abstract. Although computational intelligence (CI) covers a vast variety of different methods it still lacks an integrative theory. Several proposals for CI foundations are discussed: computing and cognition as compression, meta-learning as search in the space of data models, (dis)similarity based methods providing a framework for such meta-learning, and a more general approach based on chains of transformations. Many useful transformations that extract information from features are discussed. Heterogeneous adaptive systems are presented as particular example of transformation-based systems, and the goal of learning is redefined to facilitate creation of simpler data models. The need to understand data structures leads to techniques for logical and prototype-based rule extraction, and to generation of multiple alternative models, while the need to increase predictive power of adaptive models leads to committees of competent models. Learning from partial observations is a natural extension towards reasoning based on perceptions, and an approach to intuitive solving of such problems is presented. Throughout the paper neurocognitive inspirations are frequently used and are especially important in modeling of the higher cognitive functions. Promising directions such as liquid and laminar computing are identified and many open problems presented.

Stable prenucleation mineral clusters are liquid-like ionic polymers

Calcium carbonate is an abundant substance that can be created in several mineral forms by the reaction of dissolved carbon dioxide in water with calcium ions. Through biomineralization, organisms can harness and control this process to form various functional materials that can act as anything from shells through to lenses. The early stages of calcium carbonate formation have recently attracted attention as stable prenucleation clusters have been observed, contrary to classical models. Here we show, using computer simulations combined with the analysis of experimental data, that these mineral clusters are made of an ionic polymer, composed of alternating calcium and carbonate ions, with a dynamic topology consisting of chains, branches and rings. The existence of a disordered, flexible and strongly hydrated precursor provides a basis for explaining the formation of other liquid-like amorphous states of calcium carbonate, in addition to the non-classical behaviour during growth of amorphous calcium carbonate