Intrinsic adaptation in autonomous recurrent neural networks

A massively recurrent neural network responds on one side to input stimuli and is autonomously active, on the other side, in the absence of sensory inputs. Stimuli and information processing depends crucially on the qualia of the autonomous-state dynamics of the ongoing neural activity. This default neural activity may be dynamically structured in time and space, showing regular, synchronized, bursting or chaotic activity patterns. We study the influence of non-synaptic plasticity on the default dynamical state of recurrent neural networks. The non-synaptic adaption considered acts on intrinsic neural parameters, such as the threshold and the gain, and is driven by the optimization of the information entropy. We observe, in the presence of the intrinsic adaptation processes, three distinct and globally attracting dynamical regimes, a regular synchronized, an overall chaotic and an intermittent bursting regime. The intermittent bursting regime is characterized by intervals of regular flows, which are quite insensitive to external stimuli, interseeded by chaotic bursts which respond sensitively to input signals. We discuss these finding in the context of self-organized information processing and critical brain dynamics.Comment: 24 pages, 8 figure

Impact of Labrador Sea convection on the North Atlantic meridional overturning circulation

Author Posting. © American Meteorological Society, 2007. This article is posted here by permission of American Meteorological Society for personal use, not for redistribution. The definitive version was published in Journal of Physical Oceanography 37 (2007): 2207-2227, doi:10.1175/jpo3178.1.The overturning and horizontal circulations of the Labrador Sea are deduced from a composite vertical section across the basin. The data come from the late-spring/early-summer occupations of the World Ocean Circulation Experiment (WOCE) AR7W line, during the years 1990–97. This time period was chosen because it corresponded to intense wintertime convection—the deepest and densest in the historical record—suggesting that the North Atlantic meridional overturning circulation (MOC) would be maximally impacted. The composite geostrophic velocity section was referenced using a mean lateral velocity profile from float data and then subsequently adjusted to balance mass. The analysis was done in depth space to determine the net sinking that results from convection and in density space to determine the diapycnal mass flux (i.e., the transformation of light water to Labrador Sea Water). The mean overturning cell is calculated to be 1 Sv (1 Sv ≡ 106 m3 s−1), as compared with a horizontal gyre of 18 Sv. The total water mass transformation is 2 Sv. These values are consistent with recent modeling results. The diagnosed heat flux of 37.6 TW is found to result predominantly from the horizontal circulation, both in depth space and density space. These results suggest that the North Atlantic MOC is not largely impacted by deep convection in the Labrador Sea.This work was funded by the National Science Foundation through Grants OCE-0450658 (RP) and OCE-024978 (MS)

Analysis of Different Types of Regret in Continuous Noisy Optimization

The performance measure of an algorithm is a crucial part of its analysis. The performance can be determined by the study on the convergence rate of the algorithm in question. It is necessary to study some (hopefully convergent) sequence that will measure how "good" is the approximated optimum compared to the real optimum. The concept of Regret is widely used in the bandit literature for assessing the performance of an algorithm. The same concept is also used in the framework of optimization algorithms, sometimes under other names or without a specific name. And the numerical evaluation of convergence rate of noisy algorithms often involves approximations of regrets. We discuss here two types of approximations of Simple Regret used in practice for the evaluation of algorithms for noisy optimization. We use specific algorithms of different nature and the noisy sphere function to show the following results. The approximation of Simple Regret, termed here Approximate Simple Regret, used in some optimization testbeds, fails to estimate the Simple Regret convergence rate. We also discuss a recent new approximation of Simple Regret, that we term Robust Simple Regret, and show its advantages and disadvantages.Comment: Genetic and Evolutionary Computation Conference 2016, Jul 2016, Denver, United States. 201

A simple interpretation of quantum mirages

In an interesting new experiment the electronic structure of a magnetic atom adsorbed on the surface of Cu(111), observed by STM, was projected into a remote location on the same surface. The purpose of the present paper is to interpret this experiment with a model Hamiltonian, using ellipses of the size of the experimental ones, containing about 2300 atoms. The charge distribution for the different wavefunctions is analyzed, in particular, for those with energy close to the Fermi energy of copper Ef. Some of them show two symmetric maxima located on the principal axis of the ellipse but not necessarily at the foci. If a Co atom is adsorbed at the site where the wavefunction with energy $E_F$ has a maximum and the interaction is small, the main effect of the adsorbed atom will be to split this particular wavefunction in two. The total charge density will remain the same but the local density of states will present a dip at Ef at any site where the charge density is large enough. We relate the presence of this dip to the observation of quantum mirages. Our interpretation suggests that other sites, apart from the foci of the ellipses, can be used for projecting atomic images and also indicates the conditions for other non magnetic adsorbates to produce mirages.Comment: 3 pages, 3 Fig

Response to a steady poleward outflow. Part I : the linear, quasigeostrophic problem

Author Posting. © American Meteorological Society, 2009. This article is posted here by permission of American Meteorological Society for personal use, not for redistribution. The definitive version was published in Journal of Physical Oceanography 39 (2009): 1541-1550, doi:10.1175/2008JPO3999.1.The response of a zonal channel to a uniform, switched-on but subsequently steady poleward outflow is presented. An eastward coastal current with a Kelvin wave’s cross-shore structure is found to be generated instantly upon initiation of the outflow. The current is essentially in geostrophic balance everywhere except for the vicinity of the outflow channel mouth, where the streamlines must cross planetary vorticity contours to feed the current. The adjustment of this region generates a plume that propagates westward at Rossby wave speeds. The cross-shore structure of the plume varies with longitude, and at any given longitude it evolves with time. The authors show that the plume evolution can be understood both conceptually and quantitatively as the westward propagation of the Kelvin current’s meridional spectrum, with each spectral element propagating at its own Rossby wave group velocity.This work was completed at Woods Hole Oceanographic Institution while T.S. Durland was supported by the Ocean and Climate Change Institute. M.A. Spall was supported by NSF Grant OCE-0423975, and J. Pedlosky by NSF Grant OCE-0451086. T.S. Durland acknowledges additional report preparation support from NASA Grant NNG05GN98G

Method of measurements with random perturbation: Application in photoemission experiments

We report an application of a simultaneous perturbation stochastic approximation (SPSA) algorithm to filtering systematic noise (SN) with non-zero mean value in photoemission data. In our analysis we have used a series of 50 single-scan photoemission spectra of W(110) surface where randomly chosen SN was added. It was found that the SPSA-evaluated spectrum is in good agreement with the spectrum measured without SN. On the basis of our results a wide application of SPSA for evaluation of experimental data is anticipated.Comment: 11 pages, 3 figure

Variational ground states of 2D antiferromagnets in the valence bond basis

We study a variational wave function for the ground state of the two-dimensional S=1/2 Heisenberg antiferromagnet in the valence bond basis. The expansion coefficients are products of amplitudes h(x,y) for valence bonds connecting spins separated by (x,y) lattice spacings. In contrast to previous studies, in which a functional form for h(x,y) was assumed, we here optimize all the amplitudes for lattices with up to 32*32 spins. We use two different schemes for optimizing the amplitudes; a Newton/conjugate-gradient method and a stochastic method which requires only the signs of the first derivatives of the energy. The latter method performs significantly better. The energy for large systems deviates by only approx. 0.06% from its exact value (calculated using unbiased quantum Monte Carlo simulations). The spin correlations are also well reproduced, falling approx. 2% below the exact ones at long distances. The amplitudes h(r) for valence bonds of long length r decay as 1/r^3. We also discuss some results for small frustrated lattices.Comment: v2: 8 pages, 5 figures, significantly expanded, new optimization method, improved result

Corrigendum

Author Posting. © American Meteorological Society, 2010. This article is posted here by permission of American Meteorological Society for personal use, not for redistribution. The definitive version was published in Journal of Physical Oceanography 40 (2010): 1910–1914, doi:10.1175/2010JPO4483.1.Corrigendum: Spall, M. A., R. S. Pickart, P. S. Fratantoni, and A. J. Plueddemann, 2008: Western Arctic shelfbreak eddies: Formation and transport. J. Phys. Oceanogr., 38, 1644–166

Western Arctic shelfbreak eddies : formation and transport

Author Posting. © American Meteorological Society, 2008. This article is posted here by permission of American Meteorological Society for personal use, not for redistribution. The definitive version was published in Journal of Physical Oceanography 38 (2008): 1644-1668, doi:10.1175/2007JPO3829.1.The mean structure and time-dependent behavior of the shelfbreak jet along the southern Beaufort Sea, and its ability to transport properties into the basin interior via eddies are explored using high-resolution mooring data and an idealized numerical model. The analysis focuses on springtime, when weakly stratified winter-transformed Pacific water is being advected out of the Chukchi Sea. When winds are weak, the observed jet is bottom trapped with a low potential vorticity core and has maximum mean velocities of O(25 cm s−1) and an eastward transport of 0.42 Sv (1 Sv ≡ 106 m3 s−1). Despite the absence of winds, the current is highly time dependent, with relative vorticity and twisting vorticity often important components of the Ertel potential vorticity. An idealized primitive equation model forced by dense, weakly stratified waters flowing off a shelf produces a mean middepth boundary current similar in structure to that observed at the mooring site. The model boundary current is also highly variable, and produces numerous strong, small anticyclonic eddies that transport the shelf water into the basin interior. Analysis of the energy conversion terms in both the mooring data and the numerical model indicates that the eddies are formed via baroclinic instability of the boundary current. The structure of the eddies in the basin interior compares well with observations from drifting ice platforms. The results suggest that eddies shed from the shelfbreak jet contribute significantly to the offshore flux of heat, salt, and other properties, and are likely important for the ventilation of the halocline in the western Arctic Ocean. Interaction with an anticyclonic basin-scale circulation, meant to represent the Beaufort gyre, enhances the offshore transport of shelf water and results in a loss of mass transport from the shelfbreak jet.This study was supported by the National Science Foundation Office of Polar Programs under Grants 0421904 and 035268 (MS), and by the Office of Naval Research Grant N00014-02-1-0317 (RP and PF). Analysis by AJP was supported by the Office of Naval Research under Grant N00014-97-1-0135 and by the National Science Foundation under Grant OPP-9815303

Systems approaches and algorithms for discovery of combinatorial therapies

Effective therapy of complex diseases requires control of highly non-linear complex networks that remain incompletely characterized. In particular, drug intervention can be seen as control of signaling in cellular networks. Identification of control parameters presents an extreme challenge due to the combinatorial explosion of control possibilities in combination therapy and to the incomplete knowledge of the systems biology of cells. In this review paper we describe the main current and proposed approaches to the design of combinatorial therapies, including the empirical methods used now by clinicians and alternative approaches suggested recently by several authors. New approaches for designing combinations arising from systems biology are described. We discuss in special detail the design of algorithms that identify optimal control parameters in cellular networks based on a quantitative characterization of control landscapes, maximizing utilization of incomplete knowledge of the state and structure of intracellular networks. The use of new technology for high-throughput measurements is key to these new approaches to combination therapy and essential for the characterization of control landscapes and implementation of the algorithms. Combinatorial optimization in medical therapy is also compared with the combinatorial optimization of engineering and materials science and similarities and differences are delineated.Comment: 25 page