Estimating Functions of Probability Distributions from a Finite Set of Samples, Part 1: Bayes Estimators and the Shannon Entropy

We present estimators for entropy and other functions of a discrete probability distribution when the data is a finite sample drawn from that probability distribution. In particular, for the case when the probability distribution is a joint distribution, we present finite sample estimators for the mutual information, covariance, and chi-squared functions of that probability distribution.Comment: uuencoded compressed tarfile, submitte

An adaptive Metropolis-Hastings scheme: sampling and optimization

We propose an adaptive Metropolis-Hastings algorithm in which sampled data are used to update the proposal distribution. We use the samples found by the algorithm at a particular step to form the information-theoretically optimal mean-field approximation to the target distribution, and update the proposal distribution to be that approximatio. We employ our algorithm to sample the energy distribution for several spin-glasses and we demonstrate the superiority of our algorithm to the conventional MH algorithm in sampling and in annealing optimization.Comment: To appear in Europhysics Letter

Collective Intelligence for Control of Distributed Dynamical Systems

We consider the El Farol bar problem, also known as the minority game (W. B. Arthur, ``The American Economic Review'', 84(2): 406--411 (1994), D. Challet and Y.C. Zhang, ``Physica A'', 256:514 (1998)). We view it as an instance of the general problem of how to configure the nodal elements of a distributed dynamical system so that they do not ``work at cross purposes'', in that their collective dynamics avoids frustration and thereby achieves a provided global goal. We summarize a mathematical theory for such configuration applicable when (as in the bar problem) the global goal can be expressed as minimizing a global energy function and the nodes can be expressed as minimizers of local free energy functions. We show that a system designed with that theory performs nearly optimally for the bar problem.Comment: 8 page

On the Semi-Relative Condition for Closed (TOPOLOGICAL) Strings

We provide a simple lagrangian interpretation of the meaning of the $b_0^-$ semi-relative condition in closed string theory. Namely, we show how the semi-relative condition is equivalent to the requirement that physical operators be cohomology classes of the BRS operators acting on the space of local fields {\it covariant} under world-sheet reparametrizations. States trivial in the absolute BRS cohomology but not in the semi-relative one are explicitly seen to correspond to BRS variations of operators which are not globally defined world-sheet tensors. We derive the covariant expressions for the observables of topological gravity. We use them to prove a formula that equates the expectation value of the gravitational descendant of ghost number 4 to the integral over the moduli space of the Weil-Peterson K\"ahler form.Comment: 10 pages, harvmac, CERN-TH-7084/93, GEF-TH-21/199

Pattern Formation by Boundary Forcing in Convectively Unstable, Oscillatory Media With and Without Differential Transport

Motivated by recent experiments and models of biological segmentation, we analyze the exicitation of pattern-forming instabilities of convectively unstable reaction-diffusion-advection (RDA) systems, occuring by means of constant or periodic forcing at the upstream boundary. Such boundary-controlled pattern selection is a generalization of the flow-distributed oscillation (FDO) mechanism that can include Turing or differential flow instability (DIFI) modes. Our goal is to clarify the relationships among these mechanisms in the general case where there is differential flow as well as differential diffusion. We do so by analyzing the dispersion relation for linear perturbations and showing how its solutions are affected by differential transport. We find a close relationship between DIFI and FDO, while the Turing mechanism gives rise to a distinct set of unstable modes. Finally, we illustrate the relevance of the dispersion relations using nonlinear simulations and we discuss the experimental implications of our results.Comment: Revised version with added content (new section and figures added), changes to wording and organizatio

A low-energy solar cosmic ray experiment for OGO-F

Instrumentation data for low energy solar cosmic ray measurements using OGO-F satellit

Hybrid Local-Order Mechanism for Inversion Symmetry Breaking

Using classical Monte Carlo simulations, we study a simple statistical mechanical model of relevance to the emergence of polarisation from local displacements on the square and cubic lattices. Our model contains two key ingredients: a Kitaev-like orientation-dependent interaction between nearest neighbours, and a steric term that acts between next-nearest neighbours. Taken by themselves, each of these two ingredients is incapable of driving long-range symmetry breaking, despite the presence of a broad feature in the corresponding heat capacity functions. Instead each component results in a "hidden" transition on cooling to a manifold of degenerate states, the two manifolds are different in the sense that they reflect distinct types of local order. Remarkably, their intersection---\emph{i.e.} the ground state when both interaction terms are included in the Hamiltonian---supports a spontaneous polarisation. In this way, our study demonstrates how local ordering mechanisms might be combined to break global inversion symmetry in a manner conceptually similar to that operating in the "hybrid" improper ferroelectrics. We discuss the relevance of our analysis to the emergence of spontaneous polarisation in well-studied ferroelectrics such as BaTiO$_3$ and KNbO$_3$.Comment: 8 pages, 8 figure