Memory Aware Synapses: Learning what (not) to forget

Humans can learn in a continuous manner. Old rarely utilized knowledge can be overwritten by new incoming information while important, frequently used knowledge is prevented from being erased. In artificial learning systems, lifelong learning so far has focused mainly on accumulating knowledge over tasks and overcoming catastrophic forgetting. In this paper, we argue that, given the limited model capacity and the unlimited new information to be learned, knowledge has to be preserved or erased selectively. Inspired by neuroplasticity, we propose a novel approach for lifelong learning, coined Memory Aware Synapses (MAS). It computes the importance of the parameters of a neural network in an unsupervised and online manner. Given a new sample which is fed to the network, MAS accumulates an importance measure for each parameter of the network, based on how sensitive the predicted output function is to a change in this parameter. When learning a new task, changes to important parameters can then be penalized, effectively preventing important knowledge related to previous tasks from being overwritten. Further, we show an interesting connection between a local version of our method and Hebb's rule,which is a model for the learning process in the brain. We test our method on a sequence of object recognition tasks and on the challenging problem of learning an embedding for predicting $$ triplets. We show state-of-the-art performance and, for the first time, the ability to adapt the importance of the parameters based on unlabeled data towards what the network needs (not) to forget, which may vary depending on test conditions.Comment: ECCV 201

Bimodality as a signal of Liquid-Gas phase transition in nuclei?

We use the HIPSE (Heavy-Ion Phase-Space Exploration) Model to discuss the origin of the bimodality in charge asymmetry observed in nuclear reactions around the Fermi energy. We show that it may be related to the important angular momentum (spin) transferred into the quasi-projectile before secondary decay. As the spin overcomes the critical value, a sudden opening of decay channels is induced and leads to a bimodal distribution for the charge asymmetry. In the model, it is not assigned to a liquid-gas phase transition but to specific instabilities in nuclei with high spin. Therefore, we propose to use these reactions to study instabilities in rotating nuclear droplets.Comment: 4 pages, 4 figures Accepted to PR

Spinodal Instabilities in Nuclear Matter in a Stochastic Relativistic Mean-Field Approach

Spinodal instabilities and early growth of baryon density fluctuations in symmetric nuclear matter are investigated in the basis of stochastic extension of relativistic mean-field approach in the semi-classical approximation. Calculations are compared with the results of non-relativistic calculations based on Skyrme-type effective interactions under similar conditions. A qualitative difference appears in the unstable response of the system: the system exhibits most unstable behavior at higher baryon densities around $\rho_{b}=0.4 ~\rho_{0}$ in the relativistic approach while most unstable behavior occurs at lower baryon densities around $\rho_{b}=0.2 ~\rho_{0}$ in the non-relativistic calculationsComment: 18 pages, 7 figure

A Solvable Model for Many Quark Systems in QCD Hamiltonians

Motivated by a canonical, QCD Hamiltonian we propose an effective Hamiltonian to represent an arbitrary number of quarks in hadronic bags. The structure of the effective Hamiltonian is discussed and the BCS-type solutions that may represent constituent quarks are presented. The single particle orbitals are chosen as 3-dimensional harmonic oscillators and we discuss a class of exact solutions that can be obtained when a subset of single-particle basis states is restricted to include a certain number of orbital excitations. The general problem, which includes all possible orbital states, can also be solved by combining analytical and numerical methods.Comment: 24 pages, 2 figures, research articl

Generalized rotational hamiltonians from nonlinear angular momentum algebras

Higgs algebras are used to construct rotational Hamiltonians. The correspondence between the spectrum of a triaxial rotor and the spectrum of a cubic Higgs algebra is demonstrated. It is shown that a suitable choice of the parameters of the polynomial algebra allows for a precise identification of rotational properties. The harmonic limit is obtained by a contraction of the algebra, leading to a linear symmetry.Comment: 3 figures, 6 pages, 15 references. Phys. Rev. C (in press, ms CZ10038

Topological characterization of neutron star crusts

Neutron star crusts are studied using a classical molecular dynamics model developed for heavy ion reactions. After the model is shown to produce a plethora of the so-called "pasta" shapes, a series of techniques borrowed from nuclear physics, condensed matter physics and topology are used to craft a method that can be used to characterize the shape of the pasta structures in an unequivocal way

Book Reviews

Reviews of the following books: Maine Becomes A State: The Movement to Separate Maine from Massachusetts, 1785-1820 by Ronald F. Banks; The Eastern Frontier: The Settlement of Northern New England, 1620-1763 by Charles E. Clark; Enduring Friendships edited by Al Robert

The relativistic self-energy in nuclear dynamics

It is a well known fact that Dirac phenomenology of nuclear forces predicts the existence of large scalar and vector mean fields in matter. To analyse the relativistic self-energy in a model independent way, modern high precision nucleon-nucleon ($NN$) potentials are mapped on a relativistic operator basis using projection techniques. This allows to compare the various potentials at the level of covariant amplitudes were a remarkable agreement is found. It allows further to calculate the relativistic self-energy in nuclear matter in Hartree-Fock approximation. Independent of the choice of the nucleon-nucleon interaction large scalar and vector mean fields of several hundred MeV magnitude are generated at tree level. In the framework of chiral EFT these fields are dominantly generated by contact terms which occur at next-to-leading order in the chiral expansion. Consistent with Dirac phenomenology the corresponding low energy constants which generate the large fields are closely connected to the spin-orbit interaction in $NN$ scattering. The connection to QCD sum rules is discussed as well.Comment: 49 pages, 13 figure

Relativistic Mean Field Approach and the Pseudo-Spin Symmetry

Based on the Relativistic Mean Field (RMF) approach the existence of the broken pseudo-spin symmetry is investigated. Both spherical RMF and constrained deformed RMF calculations are carried out employing realistic Lagrangian parameters for spherical and for deformed sample nuclei. The quasi - degenerate pseudo-spin doublets are confirmed to exist near the fermi surface for both spherical and deformed nuclei.Comment: 9 pages RevTex, 4 p.s figures, to appear in Phys. Rev. C as R.