A Bio-Logical Theory of Animal Learning

This article provides the foundation for a new predictive theory of animal learning that is based upon a simple logical model. The knowledge of experimental subjects at a given time is described using logical equations. These logical equations are then used to predict a subject’s response when presented with a known or a previously unknown situation. This new theory suc- cessfully anticipates phenomena that existing theories predict, as well as phenomena that they cannot. It provides a theoretical account for phenomena that are beyond the domain of existing models, such as extinction and the detection of novelty, from which “external inhibition” can be explained. Examples of the methods applied to make predictions are given using previously published results. The present theory proposes a new way to envision the minimal functions of the nervous system, and provides possible new insights into the way that brains ultimately create and use knowledge about the world

Adjusting foraging strategies : a comparison of rural and urban common mynas (Acridotheres tristis)

The research was funded by a FP7-PEOPLE-2013-IRSES research staff exchange grant to TB, SH, OG and ASG. OG was additionally supported by Gu227/16-1 and IF by an FWF grant (Y366-B17) to TB.Establishment in urbanized environments is associated with changes in physiology, behaviour, and problem-solving. We compared the speed of learning in urban and rural female common mynas, Acridotheres tristis, using a standard visual discrimination task followed by a reversal learning phase. We also examined how quickly each bird progressed through different stages of learning, including sampling and acquisition within both initial and reversal learning, and persistence following reversal. Based on their reliance on very different food resources, we expected urban mynas to learn and reversal learn more quickly but to sample new contingencies for proportionately longer before learning them. When quantified from first presentation to criterion achievement, urban mynas took more 20-trial blocks to learn the initial discrimination, as well as the reversed contingency, than rural mynas. More detailed analyses at the level of stage revealed that this was because urban mynas explored the novel cue-outcome contingencies for longer, and despite transitioning faster through subsequent acquisition, remained overall slower than rural females. Our findings draw attention to fine adjustments in learning strategies in response to urbanization and caution against interpreting the speed to learn a task as a reflection of cognitive ability.PostprintPeer reviewe

Planning with Information-Processing Constraints and Model Uncertainty in Markov Decision Processes

Information-theoretic principles for learning and acting have been proposed to solve particular classes of Markov Decision Problems. Mathematically, such approaches are governed by a variational free energy principle and allow solving MDP planning problems with information-processing constraints expressed in terms of a Kullback-Leibler divergence with respect to a reference distribution. Here we consider a generalization of such MDP planners by taking model uncertainty into account. As model uncertainty can also be formalized as an information-processing constraint, we can derive a unified solution from a single generalized variational principle. We provide a generalized value iteration scheme together with a convergence proof. As limit cases, this generalized scheme includes standard value iteration with a known model, Bayesian MDP planning, and robust planning. We demonstrate the benefits of this approach in a grid world simulation.Comment: 16 pages, 3 figure

Leptin fails to blunt the lipopolysaccharide-induced activation of the hypothalamic-pituitary-adrenal axis in rats

Copyright @ 2013 The authors. This work is licensed under a Creative Commons Attribution 3.0 Unported License.Obesity is a risk factor for sepsis morbidity and mortality, whereas the hypothalamic-pituitary-adrenal (HPA) axis plays a protective role in the body's defence against sepsis. Sepsis induces a profound systemic immune response and cytokines serve as excellent markers for sepsis as they act as mediators of the immune response. Evidence suggests that the adipokine leptin may play a pathogenic role in sepsis. Mouse endotoxaemic models present with elevated leptin levels and exogenously added leptin increased mortality whereas human septic patients have elevated circulating levels of the soluble leptin receptor (Ob-Re). Evidence suggests that leptin can inhibit the regulation of the HPA axis. Thus, leptin may suppress the HPA axis, impairing its protective role in sepsis.We hypothesised that leptin would attenuate the HPA axis response to sepsis.We investigated the direct effects of an i.p. injection of 2 mg/kg leptin on the HPA axis response to intraperitoneally injected 25 μg/kg lipopolysaccharide (LPS) in the male Wistar rat. We found that LPS potently activated the HPA axis, as shown by significantly increased plasma stress hormones, ACTH and corticosterone, and increased plasma interleukin 1β (IL1β) levels, 2 h after administration. Pre-treatment with leptin, 2 h before LPS administration, did not influence the HPA axis response to LPS. In turn, LPS did not affect plasma leptin levels. Our findings suggest that leptin does not influence HPA function or IL1b secretion in a rat model of LPS-induced sepsis, and thus that leptin is unlikely to be involved in the acute-phase endocrine response to bacterial infection in rats.The section is funded by grants from the MRC, BBSRC, NIHR and an Integrative Mammalian Biology (IMB) Capacity Building Award, and by a FP7-HEALTH-2009-241592 EuroCHIP grant and is supported by the NIHR Imperial Biomedical Research Centre Funding Scheme. This work is supported by a BBSRC Doctoral Training-Strategic Skills Award grant (BB/F017340/1)

The historical vanishing of the Blazhko effect of RR Lyr from GEOS and Kepler surveys

RR Lyr is one of the most studied variable stars. Its light curve has been regularly monitored since the discovery of the periodic variability in 1899. Analysis of all observed maxima allows us to identify two primary pulsation states defined as pulsation over a long (P0 longer than 0.56684 d) and a short (P0 shorter than 0.56682 d) primary pulsation period. These states alternate with intervals of 13-16 yr, and are well defined after 1943. The 40.8 d periodical modulations of the amplitude and the period (i.e. Blazhko effect) were noticed in 1916. We provide homogeneous determinations of the Blazhko period in the different primary pulsation states. The Blazhko period does not follow the variations of P0 and suddenly diminished from 40.8 d to around 39.0 d in 1975. The monitoring of these periodicities deserved and deserves a continuous and intensive observational effort. For this purpose we have built dedicated, transportable and autonomous small instruments, Very Tiny Telescopes (VTTs), to observe the times of maximum brightness of RR Lyr. As immediate results the VTTs recorded the last change of P0 state in mid-2009 and extended the time coverage of the Kepler observations, thus recording a maximum O-C amplitude of the Blazhko effect at the end of 2008, followed by the historically smallest O-C amplitude in late 2013. This decrease is still ongoing and VTT instruments are ready to monitor the expected increase in the next few years.Comment: 10 pages, 6 figures. Accepted for publication in MNRAS. Contents of appendix B may be requested to first autho

Measurement of Aerosols at the Pierre Auger Observatory

The air fluorescence detectors (FDs) of the Pierre Auger Observatory are vital for the determination of the air shower energy scale. To compensate for variations in atmospheric conditions that affect the energy measurement, the Observatory operates an array of monitoring instruments to record hourly atmospheric conditions across the detector site, an area exceeding 3,000 square km. This paper presents results from four instruments used to characterize the aerosol component of the atmosphere: the Central Laser Facility (CLF), which provides the FDs with calibrated laser shots; the scanning backscatter lidars, which operate at three FD sites; the Aerosol Phase Function monitors (APFs), which measure the aerosol scattering cross section at two FD locations; and the Horizontal Attenuation Monitor (HAM), which measures the wavelength dependence of aerosol attenuation.Comment: Contribution to the 30th International Cosmic Ray Conference, Merida Mexico, July 2007; 4 pages, 4 figure

Mastering the game of Go without human knowledge

A long-standing goal of artificial intelligence is an algorithm that learns, tabula rasa, superhuman proficiency in challenging domains. Recently, AlphaGo became the first program to defeat a world champion in the game of Go. The tree search in AlphaGo evaluated positions and selected moves using deep neural networks. These neural networks were trained by supervised learning from human expert moves, and by reinforcement learning from self-play. Here we introduce an algorithm based solely on reinforcement learning, without human data, guidance or domain knowledge beyond game rules. AlphaGo becomes its own teacher: a neural network is trained to predict AlphaGo’s own move selections and also the winner of AlphaGo’s games. This neural network improves the strength of the tree search, resulting in higher quality move selection and stronger self-play in the next iteration. Starting tabula rasa, our new program AlphaGo Zero achieved superhuman performance, winning 100–0 against the previously published, champion-defeating AlphaGo

Follow-up observations at 16 and 33 GHz of extragalactic sources from WMAP 3-year data: I - Spectral properties

We present follow-up observations of 97 point sources from the Wilkinson Microwave Anisotropy Probe (WMAP) 3-year data, contained within the New Extragalactic WMAP Point Source (NEWPS) catalogue between declinations of -4 and +60 degrees; the sources form a flux-density-limited sample complete to 1.1 Jy (approximately 5 sigma) at 33 GHz. Our observations were made at 16 GHz using the Arcminute Microkelvin Imager (AMI) and at 33 GHz with the Very Small Array (VSA). 94 of the sources have reliable, simultaneous -- typically a few minutes apart -- observations with both telescopes. The spectra between 13.9 and 33.75 GHz are very different from those of bright sources at low frequency: 44 per cent have rising spectra (alpha < 0.0), where flux density is proportional to frequency^-alpha, and 93 per cent have spectra with alpha < 0.5; the median spectral index is 0.04. For the brighter sources, the agreement between VSA and WMAP 33-GHz flux densities averaged over sources is very good. However, for the fainter sources, the VSA tends to measure lower values for the flux densities than WMAP. We suggest that the main cause of this effect is Eddington bias arising from variability.Comment: 12 pages, 13 figures, submitted to MNRA

First principles electronic structure of spinel LiCr2O4: A possible half-metal?

We have employed first-principles electronic structure calculations to examine the hypothetical (but plausible) oxide spinel, LiCr2O4 with the d^{2.5} electronic configuration. The cell (cubic) and internal (oxygen position) structural parameters have been obtained for this compound through structural relaxation in the first-principles framework. Within the one-electron band picture, we find that LiCr2O4 is magnetic, and a candidate half-metal. The electronic structure is substantially different from the closely related and well known rutile half-metal CrO2. In particular, we find a smaller conduction band width in the spinel compound, perhaps as a result of the distinct topology of the spinel crystal structure, and the reduced oxidation state. The magnetism and half-metallicity of LiCr2O4 has been mapped in the parameter space of its cubic crystal structure. Comparisons with superconducting LiTi2O4 (d^{0.5}), heavy-fermion LiV2O4 (d^{1.5}) and charge-ordering LiMn2O4 (d^{3.5}) suggest the effectiveness of a nearly-rigid band picture involving simple shifts of the position of E_F in these very different materials. Comparisons are also made with the electronic structure of ZnV2O4 (d^{2}), a correlated insulator that undergoes a structural and antiferromagnetic phase transition.Comment: 9 pages, 7 Figures, version as published in PR

Towards the growth of Cu2ZnSn1 xGexS4 thin films by a single stage process Effect of substrate temperature and composition

Cu2ZnSn1-xGexS4 (CZTGS) thin films prepared by flash evaporation of a Zn-rich Cu2ZnSn0.5Ge0.5S4 bulk compound in powder form, and a subsequent thermal annealing in S containing Ar atmosphere are studied. The effect of the substrate temperature during evaporation and the initial composition of the precursor powder on the growth mechanism and properties of the final CZTGS thin film are investigated. The microstructure of the films and elemental depth profiles depend strongly on the growth conditions used. Incorporation of Ge into the Cu2ZnSnS4 lattice is demonstrated by the shift of the relevant X-ray diffraction peaks and Raman vibrational modes towards higher diffraction angles and frequencies respectively. A Raman mode at around 348-351 cm-1 is identified as characteristic of CZTGS alloys for x = [Ge]/([Sn]+[Ge]) = 0.14-0.30. The supply of Ge enables the reduction of the Sn loss via a saccrifical Ge loss. This fact allows increasing the substrate temperature up to 350º C during the evaporation, forming a high quality kesterite material and therefore, reducing the deposition process to one single stageRC acknowledges financial support from Spanish MINECO within the Ramón y Cajal programme (RYC-2011-08521) and VIR for the Juan de la Cierva fellowship (JCI-2011-10782). GB also acknowledges the CSIC-JAE pre-doctoral program, co-funded by the European Social Fund. This work was supported by the Marie Curie-IRSES project (PVICOKEST, GA: 269167), Marie Curie-ITN project (KESTCELL, GA: 316488), DAAD project (INTERKEST, Ref: 57050358), and MINECO projects (SUNBEAM, ENE2013-49136-C4-3-R) (TEC2012-38901-C02-01). A. Scheu is acknowledged for GDOES measurement