Combining Hebbian and reinforcement learning in a minibrain model

A toy model of a neural network in which both Hebbian learning and reinforcement learning occur is studied. The problem of `path interference', which makes that the neural net quickly forgets previously learned input-output relations is tackled by adding a Hebbian term (proportional to the learning rate $\eta$) to the reinforcement term (proportional to $\rho$) in the learning rule. It is shown that the number of learning steps is reduced considerably if $1/4 < \eta/\rho < 1/2$, i.e., if the Hebbian term is neither too small nor too large compared to the reinforcement term

Conservatism and “copy-if-better” in chimpanzees (Pan troglodytes)

This work was funded by the project SOMICS, ERC-Synergy grant # 609819 to Josep Call.Social learning is predicted to evolve in socially living animals provided the learning process is not random but biased by certain socio-ecological factors. One bias of particular interest for the emergence of (cumulative) culture is the tendency to forgo personal behaviour in favour of relatively better variants observed in others, also known as the "copy-if-better" strategy. We investigated whether chimpanzees employ copy-if-better in a simple token-exchange paradigm controlling for individual and random social learning. After being trained on one token-type, subjects were confronted with a conspecific demonstrator who either received the same food reward as the subject (control condition) or a higher value food reward than the subject (test condition) for exchanging another token-type. In general, the chimpanzees persisted in exchanging the token-type they were trained on individually, indicating a form of conservatism consistent with previous studies. However, the chimpanzees were more inclined to copy the demonstrator in the test compared to the control condition, indicating a tendency to employ a copy-if-better strategy. We discuss our findings in light of their relevance to the emergence of cumulative culture.Publisher PDFPeer reviewe

Production costs for synthetic methane in 2030 and 2050 of an optimized Power-to-Gas plant with intermediate hydrogen storage

The publication gives an overview of the production costs of synthetic methane in a Power-to-Gas process. The production costs depend in particularly on the electricity price and the full load hours of the plant sub-systems electrolysis and methanation. The full-load hours of electrolysis are given by the electricity supply concept. In order to increase the full-load hours of methanation, the size of the intermediate hydrogen storage tank and the size of the methanation are optimised on the basis of the availability of hydrogen. The calculation of the production costs for synthetic methane are done with economics for 2030 and 2050 and the expenditures are calculated for one year of operation. The sources of volume of purchased electricity are the short-term market, long-term contracts, direct-coupled renewable energy sources or seasonal use of surpluses. Gas sales are either traded on the short-term market or guaranteed by long-term contracts. The calculations show, that an intermediate storage tank for hydrogen, adjustment of the methanation size and operating electrolysis and methanation separately, increase the workload of the sub-system methanation. The gas production costs can be significantly reduced. With the future expected development of capital expenditures, operational expenditure, electricity prices, gas costs and efficiencies, an economic production of synthetic natural gas for the years 2030, especially for 2050, is feasible. The results show that Power-to-Gas is an option for long-term, large-scale seasonal storage of renewable energy. Especially the cases with high operating hours for the sub-system methanation and low electricity prices show gas production costs below the expected market prices for synthetic gas and biogas

Helium 2 3S - 2 1S metrology at 1557 nm

An experiment is proposed to excite the 'forbidden' 1s2s 3S1 - 1s2s 1S0 magnetic dipole (M1) transition at 1557 nm in a collimated and slow atomic beam of metastable helium atoms. It is demonstrated that an excitation rate of 5000 /s can be realised with the beam of a 2W narrowband telecom fiber laser intersecting the atomic beam perpendicularly. A Doppler-limited sub-MHz spectroscopic linewidth is anticipated. Doppler-free excitation of 2% of trapped and cooled atoms may be realised in a one-dimensional optical lattice geometry, using the 2W laser both for trapping and spectroscopy. The very small (8 Hz) natural linewidth of this transition presents an opportunity for accurate tests of atomic structure calculations of the helium atom. A measurement of the 3He - 4He isotope shift allows for accurate determination of the difference in nuclear charge radius of both isotopes.Comment: accepted for publication in Europhysics Letter

A charged particle in a magnetic field - Jarzynski Equality

We describe some solvable models which illustrate the Jarzynski theorem and related fluctuation theorems. We consider a charged particle in the presence of magnetic field in a two dimensional harmonic well. In the first case the centre of the harmonic potential is translated with a uniform velocity, while in the other case the particle is subjected to an ac force. We show that Jarzynski identity complements Bohr-van Leeuwen theorem on the absence of diamagnetism in equilibrium classical system.Comment: 5 pages, minor corrections made and journal reference adde

Vitality of Complex Water Governance Systems: Condition and Evolution

In this article the evolution of vitality of social systems in water governance processes, approached as social-ecological systems, is studied. Vitality as well as conditions for vitality are theorized and measured in two cases of the Dutch southwest Delta region. Different patterns and developments in the rise and fall of vitality are found in the two cases. We followed the developments of five conditions explaining the discovered changes in the levels of vitality throughout the years in the two cases. The first conclusion is that the conditions can be treated as clear enablers for increasing the level of vitality in both cases. Furthermore, a low score on (most of) the conditions are accompanied with low scores on vitality. The secon

O potencial das palmeiras tropicais no Brasil: acertos e fracassos das últimas décadas.

Palmeiras oleaginosas. Palmeiras para alimentação. Palmeiras para palmito. Palmeiras para cosméticos

Total energies from variational functionals of the Green function and the renormalized four-point vertex

We derive variational expressions for the grand potential or action in terms of the many-body Green function $G$ which describes the propagation of particles and the renormalized four-point vertex $\Gamma$ which describes the scattering of two particles in many-body systems. The main ingredient of the variational functionals is a term we denote as the $\Xi$-functional which plays a role analogously to the usual $\Phi$-functional studied by Baym (G.Baym, Phys.Rev. 127, 1391 (1962)) in connection with the conservation laws in many-body systems. We show that any $\Xi$-derivable theory is also $\Phi$-derivable and therefore respects the conservation laws. We further set up a computational scheme to obtain accurate total energies from our variational functionals without having to solve computationally expensive sets of self-consistent equations. The input of the functional is an approximate Green function $\tilde{G}$ and an approximate four-point vertex $\tilde{\Gamma}$ obtained at a relatively low computational cost. The variational property of the functional guarantees that the error in the total energy is only of second order in deviations of the input Green function and vertex from the self-consistent ones that make the functional stationary. The functionals that we will consider for practical applications correspond to infinite order summations of ladder and exchange diagrams and are therefore particularly suited for applications to highly correlated systems. Their practical evaluation is discussed in detail.Comment: 21 pages, 10 figures. Physical Review B (accepted

Spin-polarized stable phases of the 2-D electron fluid at finite temperatures

The Helmholtz free energy F of the interacting 2-D electron fluid is calculated nonperturbatively using a mapping of the quantum fluid to a classical Coulomb fluid [Phys. Rev. Letters, vol. 87, 206404 (2001)]. For density parameters rs such that rs<~25, the fluid is unpolarized at all temperatures t=T/EF where EF is the Fermi energy. For lower densities, the system becomes fully spin polarized for t<~0.35, and partially polarized for 0.35<t< 2, depending on the density. At rs ~25-30, and t ~0.35, an ''ambispin'' phase where F is almost independent of the spin polarization is found. These results support recent claims, based on quantum Monte Carlo results, for a stable, fully spin-polarized fluid phase at T = 0 for rs larger than about 25-26.Comment: Latex manuscript (4-5 pages) and two postscript figures; see also http://nrcphy1.phy.nrc.ca/ims/qp/chandre/chnc