Information theoretic approach to interactive learning

The principles of statistical mechanics and information theory play an important role in learning and have inspired both theory and the design of numerous machine learning algorithms. The new aspect in this paper is a focus on integrating feedback from the learner. A quantitative approach to interactive learning and adaptive behavior is proposed, integrating model- and decision-making into one theoretical framework. This paper follows simple principles by requiring that the observer's world model and action policy should result in maximal predictive power at minimal complexity. Classes of optimal action policies and of optimal models are derived from an objective function that reflects this trade-off between prediction and complexity. The resulting optimal models then summarize, at different levels of abstraction, the process's causal organization in the presence of the learner's actions. A fundamental consequence of the proposed principle is that the learner's optimal action policies balance exploration and control as an emerging property. Interestingly, the explorative component is present in the absence of policy randomness, i.e. in the optimal deterministic behavior. This is a direct result of requiring maximal predictive power in the presence of feedback.Comment: 6 page

The thermodynamics of prediction

A system responding to a stochastic driving signal can be interpreted as computing, by means of its dynamics, an implicit model of the environmental variables. The system's state retains information about past environmental fluctuations, and a fraction of this information is predictive of future ones. The remaining nonpredictive information reflects model complexity that does not improve predictive power, and thus represents the ineffectiveness of the model. We expose the fundamental equivalence between this model inefficiency and thermodynamic inefficiency, measured by dissipation. Our results hold arbitrarily far from thermodynamic equilibrium and are applicable to a wide range of systems, including biomolecular machines. They highlight a profound connection between the effective use of information and efficient thermodynamic operation: any system constructed to keep memory about its environment and to operate with maximal energetic efficiency has to be predictive.Comment: 5 pages, 1 figur

Quasi-Homogeneous Thermodynamics and Black Holes

We propose a generalized thermodynamics in which quasi-homogeneity of the thermodynamic potentials plays a fundamental role. This thermodynamic formalism arises from a generalization of the approach presented in paper [1], and it is based on the requirement that quasi-homogeneity is a non-trivial symmetry for the Pfaffian form $\delta Q_{rev}$. It is shown that quasi-homogeneous thermodynamics fits the thermodynamic features of at least some self-gravitating systems. We analyze how quasi-homogeneous thermodynamics is suggested by black hole thermodynamics. Then, some existing results involving self-gravitating systems are also shortly discussed in the light of this thermodynamic framework. The consequences of the lack of extensivity are also recalled. We show that generalized Gibbs-Duhem equations arise as a consequence of quasi-homogeneity of the thermodynamic potentials. An heuristic link between this generalized thermodynamic formalism and the thermodynamic limit is also discussed.Comment: 39 pages, uses RevteX. Published version (minor changes w.r.t. the original one

A Class of Eccentric Binaries with Dynamic Tidal Distortions Discovered with Kepler

We have discovered a class of eccentric binary systems within the Kepler data archive that have dynamic tidal distortions and tidally-induced pulsations. Each has a uniquely shaped light curve that is characterized by periodic brightening or variability at time scales of 4-20 days, frequently accompanied by shorter period oscillations. We can explain the dominant features of the entire class with orbitally-varying tidal forces that occur in close, eccentric binary systems. The large variety of light curve shapes arises from viewing systems at different angles. This hypothesis is supported by spectroscopic radial velocity measurements for five systems, each showing evidence of being in an eccentric binary system. Prior to the discovery of these 17 new systems, only four stars, where KOI-54 is the best example, were known to have evidence of these dynamic tides and tidally-induced oscillations. We perform preliminary fits to the light curves and radial velocity data, present the overall properties of this class and discuss the work required to accurately model these systems.Comment: 13 pages, submitted to Ap

Evolutionary influences on the structure of red-giant acoustic oscillation spectra from 600d of Kepler observations

Context: The Kepler space mission is reaching continuous observing times long enough to start studying the fine structure of the observed p-mode spectra. Aims: In this paper, we aim to study the signature of stellar evolution on the radial and p-dominated l=2 modes in an ensemble of red giants that show solar-type oscillations. Results: We find that the phase shift of the central radial mode (eps_c) is significantly different for red giants at a given large frequency separation (Dnu_c) but which burn only H in a shell (RGB) than those that have already ignited core He burning. Even though not directly probing the stellar core the pair of local seismic observables (Dnu_c, eps_c) can be used as an evolutionary stage discriminator that turned out to be as reliable as the period spacing of the mixed dipole modes. We find a tight correlation between eps_c and Dnu_c for RGB stars and no indication that eps_c depends on other properties of these stars. It appears that the difference in eps_c between the two populations becomes if we use an average of several radial orders, instead of a local, i.e. only around the central radial mode, Dnu to determine the phase shift. This indicates that the information on the evolutionary stage is encoded locally, in the shape of the radial mode sequence. This shape turns out to be approximately symmetric around the central radial mode for RGB stars but asymmetric for core He burning stars. We computed radial modes for a sequence of RG models and find them to qualitatively confirm our findings. We also find that, at least in our models, the local Dnu is an at least as good and mostly better proxy for both the asymptotic spacing and the large separation scaled from the model density than the average Dnu. Finally, we investigate the signature of the evolutionary stage on the small frequency separation and quantify the mass dependency of this seismic parameter.Comment: 12 pages, 9 figures, accepted for publication in A&

Orbital dynamics of Cygnus X-3

Orbital-phased-resolved infrared spectra of Cygnus X-3 in outburst and quiescence, including tomographic analysis, are presented. We confirm the phasing of broad HeII and NV lines in quiescence, such that maximum blue shift corresponds to the X-ray minimum at phase = 0.00 +/- 0.04. In outburst, double-peaked HeI structures show a similar phasing with two significant differences: (a) although varying in relative strength, there is continuous line emission in blue and red peaks around the orbit, and (b) an absorption component, ~1/4 of an orbit out of phase with the emission features, is discerned. Doppler tomograms of the double-peaked profiles are consistent with a disk-wind geometry, rotating at velocities of 1000 km/s. Regrettably, the tomography algorithm will produce a similar ring structure from alternative line sources if contaminated by overlying P Cygni profiles. This is certainly the case in the strong 2.0587 micron HeI line, leading to an ambiguous solution for the nature of double-peaked emission. The absorption feature, detected 1/4 of an orbit out of phase with the emission features, is consistent with an origin in the He star wind and yields for the first time a plausible radial velocity curve for the system. We directly derive the mass function of the system, 0.027 M_sun. If we assume a neutron star accretor and adopt a high orbital inclination, i > 60 degrees, we obtain a mass range for the He star of 5 M_sun < M_WR < 11 M_sun. Alternatively if the compact object is a black hole, we estimate M_BH < 10 M_sun. We discuss the implications of these masses for the nature and size of the binary system.Comment: Accepted for publication in ApJ main journa

Ultraviolet number counts of galaxies from Swift UV/Optical Telescope deep imaging of the Chandra Deep Field South

Deep Swift UV/Optical Telescope (UVOT) imaging of the Chandra Deep Field South is used to measure galaxy number counts in three near ultraviolet (NUV) filters (uvw2: 1928 A, uvm2: 2246 A, uvw1: 2600 A) and the u band (3645 A). UVOT observations cover the break in the slope of the NUV number counts with greater precision than the number counts by the Hubble Space Telescope (HST) Space Telescope Imaging Spectrograph (STIS) and the Galaxy Evolution Explorer (GALEX), spanning a range from 21 < m_AB < 25. Number counts models confirm earlier investigations in favoring models with an evolving galaxy luminosity function.Comment: 20 pages, 6 figures, accepted to Ap

Network information and connected correlations

Entropy and information provide natural measures of correlation among elements in a network. We construct here the information theoretic analog of connected correlation functions: irreducible $N$--point correlation is measured by a decrease in entropy for the joint distribution of $N$ variables relative to the maximum entropy allowed by all the observed $N-1$ variable distributions. We calculate the ``connected information'' terms for several examples, and show that it also enables the decomposition of the information that is carried by a population of elements about an outside source.Comment: 4 pages, 3 figure

The First Swift Ultra-Violet/Optical Telescope GRB Afterglow Catalog

We present the first Swift Ultra-Violet/Optical Telescope (UVOT) gamma-ray burst (GRB) afterglow catalog. The catalog contains data from over 64,000 independent UVOT image observations of 229 GRBs first detected by Swift, the High Energy Transient Explorer 2 (HETE2), the INTErnational Gamma-Ray Astrophysics Laboratory (INTEGRAL), and the Interplanetary Network (IPN). The catalog covers GRBs occurring during the period from 2005 Jan 17 to 2007 Jun 16 and includes ~86% of the bursts detected by the Swift Burst Alert Telescope (BAT). The catalog provides detailed burst positional, temporal, and photometric information extracted from each of the UVOT images. Positions for bursts detected at the 3-sigma-level are provided with a nominal accuracy, relative to the USNO-B1 catalog, of ~0.25 arcseconds. Photometry for each burst is given in three UV bands, three optical bands, and a 'white' or open filter. Upper limits for magnitudes are reported for sources detected below 3-sigma. General properties of the burst sample and light curves, including the filter-dependent temporal slopes, are also provided. The majority of the UVOT light curves, for bursts detected at the 3-sigma-level, can be fit by a single power-law, with a median temporal slope (alpha) of 0.96, beginning several hundred seconds after the burst trigger and ending at ~1x10^5 s. The median UVOT v-band (~5500 Angstroms) magnitude at 2000 s for a sample of "well" detected bursts is 18.02. The UVOT flux interpolated to 2000 s after the burst, shows relatively strong correlations with both the prompt Swift BAT fluence, and the Swift X-ray flux at 11 hours after the trigger.Comment: 60 pages, 17 figures, 8 tables, accepted for publication by the Astrophysical Journa

A Compilation of observations from moored current meters. Vol. VII. Oregon continental shelf, July-August 1973

Aanderaa recording current meters, moored off the Oregon coast at fixed depths measured water temperature, current speed, current direction and for some meters, conductivity and pressure. In addition to these sub­surface meters, surface meteorological buoys were installed to measure wind speed, wind direction, air and water temperature. Data from each current meter string are shown by means of pertinent statistics, real time plots of hourly values, progressive vector diagrams, and rotary spectra