Information theoretic approach to interactive learning

The principles of statistical mechanics and information theory play an important role in learning and have inspired both theory and the design of numerous machine learning algorithms. The new aspect in this paper is a focus on integrating feedback from the learner. A quantitative approach to interactive learning and adaptive behavior is proposed, integrating model- and decision-making into one theoretical framework. This paper follows simple principles by requiring that the observer's world model and action policy should result in maximal predictive power at minimal complexity. Classes of optimal action policies and of optimal models are derived from an objective function that reflects this trade-off between prediction and complexity. The resulting optimal models then summarize, at different levels of abstraction, the process's causal organization in the presence of the learner's actions. A fundamental consequence of the proposed principle is that the learner's optimal action policies balance exploration and control as an emerging property. Interestingly, the explorative component is present in the absence of policy randomness, i.e. in the optimal deterministic behavior. This is a direct result of requiring maximal predictive power in the presence of feedback.Comment: 6 page

A Tale of Two Animats: What does it take to have goals?

What does it take for a system, biological or not, to have goals? Here, this question is approached in the context of in silico artificial evolution. By examining the informational and causal properties of artificial organisms ('animats') controlled by small, adaptive neural networks (Markov Brains), this essay discusses necessary requirements for intrinsic information, autonomy, and meaning. The focus lies on comparing two types of Markov Brains that evolved in the same simple environment: one with purely feedforward connections between its elements, the other with an integrated set of elements that causally constrain each other. While both types of brains 'process' information about their environment and are equally fit, only the integrated one forms a causally autonomous entity above a background of external influences. This suggests that to assess whether goals are meaningful for a system itself, it is important to understand what the system is, rather than what it does.Comment: This article is a contribution to the FQXi 2016-2017 essay contest "Wandering Towards a Goal

Quasi-Homogeneous Thermodynamics and Black Holes

We propose a generalized thermodynamics in which quasi-homogeneity of the thermodynamic potentials plays a fundamental role. This thermodynamic formalism arises from a generalization of the approach presented in paper [1], and it is based on the requirement that quasi-homogeneity is a non-trivial symmetry for the Pfaffian form $\delta Q_{rev}$. It is shown that quasi-homogeneous thermodynamics fits the thermodynamic features of at least some self-gravitating systems. We analyze how quasi-homogeneous thermodynamics is suggested by black hole thermodynamics. Then, some existing results involving self-gravitating systems are also shortly discussed in the light of this thermodynamic framework. The consequences of the lack of extensivity are also recalled. We show that generalized Gibbs-Duhem equations arise as a consequence of quasi-homogeneity of the thermodynamic potentials. An heuristic link between this generalized thermodynamic formalism and the thermodynamic limit is also discussed.Comment: 39 pages, uses RevteX. Published version (minor changes w.r.t. the original one

Optical Follow-up of New SMC Wing Be/X-ray Binaries

We investigate the optical counterparts of recently discovered Be/X-ray binaries in the Small Magellanic Cloud. In total four sources, SXP101, SXP700, SXP348 and SXP65.8 were detected during the Chandra Survey of the Wing of the SMC. SXP700 and SXP65.8 were previously unknown. Many optical ground based telescopes have been utilised in the optical follow-up, providing coverage in both the red and blue bands. This has led to the classification of all of the counterparts as Be stars and confirms that three lie within the Galactic spectral distribution of known Be/X-ray binaries. SXP101 lies outside this distribution becoming the latest spectral type known. Monitoring of the Halpha emission line suggests that all the sources bar SXP700 have highly variable circumstellar disks, possibly a result of their comparatively short orbital periods. Phase resolved X-ray spectroscopy has also been performed on SXP65.8, revealing that the emission is indeed harder during the passage of the X-ray beam through the line of sight.Comment: 9 pages, 9 figures, 2 tables, accepted for publication in MNRA

A burst from the direction of UZ Fornacis with XMM-Newton

The XMM-Newton pointing towards the magnetic cataclysmic variable UZ For finds the source to be a factor > 10^3 fainter than previous EXOSAT and ROSAT observations. The source was not detected for the majority of a 22 ksec exposure with the EPIC cameras, suggesting that the accretion rate either decreased, or stopped altogether. However a 1.1 ksec burst was detected from UZ For during the observation. Spectral fits favour optically thin, kT = 4.4 keV thermal emission. Detection of the burst by the on-board Optical Monitor indicates that this was most probably an accretion event. The 0.1-10 keV luminosity of 2.1 x 10^30 erg/s is typical for accretion shock emission from high state polars and would result from the potential energy release of ~ 10^16 g of gas. There is no significant soft excess due to reprocessing in the white dwarf atmosphere.Comment: 7 pages, 2 postscript figures, ApJL, in pres

Multi‐century stasis in C3 and C4 grass distributions across the contiguous United States since the industrial revolution

AimsUnderstanding the functional response of ecosystems to past global change is crucial to predicting performance in future environments. One sensitive and functionally significant attribute of grassland ecosystems is the percentage of species that use the C4 versus C3 photosynthetic pathway. Grasses using C3 and C4 pathways are expected to have different responses to many aspects of anthropogenic environmental change that have followed the industrial revolution, including increases in temperature and atmospheric CO2, changes to land management and fire regimes, precipitation seasonality, and nitrogen deposition. In spite of dramatic environmental changes over the past 300 years, it is unknown if the C4 grass percentage in grasslands has shifted.LocationContiguous United States of America.MethodsHere, we used stable carbon isotope data (i.e. δ13C) from 30 years of soil samples, as well as herbivore tissues that date to 1739 CE, to reconstruct coarse‐grain C3 and C4 grass composition in North American grassland sites to compare with modern vegetation. We spatially resampled these three datasets to a shared 100‐km grid, allowing comparison of δ13C values at a resolution and extent common for climate model outputs and biogeographical studies.ResultsAt this spatial grain, the bison tissue proxy was superior to the soil proxy because the soils reflect integration of local carbon inputs, whereas bison sample vegetation across landscapes. Bison isotope values indicate that historical grassland photosynthetic‐type composition was similar to modern vegetation.Main conclusionsDespite major environmental change, comparing modern plot vegetation data to three centuries of bison δ13C data revealed that the biogeographical distribution of C3 and C4 grasses has not changed significantly since the 1700s. This is particularly surprising given the expected CO2 fertilization of C3 grasses. Our findings highlight the critical importance of capturing the full range of physiological, ecological and demographical processes in biosphere models predicting future climates and ecosystems.Peer Reviewedhttps://deepblue.lib.umich.edu/bitstream/2027.42/139065/1/jbi13061.pdfhttps://deepblue.lib.umich.edu/bitstream/2027.42/139065/2/jbi13061_am.pd

Comparison of Measured and Predicted Resting Energy Expenditure in Obese Pre-bariatric Surgery Patients

Please download pdf version here

Network information and connected correlations

Entropy and information provide natural measures of correlation among elements in a network. We construct here the information theoretic analog of connected correlation functions: irreducible $N$--point correlation is measured by a decrease in entropy for the joint distribution of $N$ variables relative to the maximum entropy allowed by all the observed $N-1$ variable distributions. We calculate the ``connected information'' terms for several examples, and show that it also enables the decomposition of the information that is carried by a population of elements about an outside source.Comment: 4 pages, 3 figure

Orbital dynamics of Cygnus X-3

Orbital-phased-resolved infrared spectra of Cygnus X-3 in outburst and quiescence, including tomographic analysis, are presented. We confirm the phasing of broad HeII and NV lines in quiescence, such that maximum blue shift corresponds to the X-ray minimum at phase = 0.00 +/- 0.04. In outburst, double-peaked HeI structures show a similar phasing with two significant differences: (a) although varying in relative strength, there is continuous line emission in blue and red peaks around the orbit, and (b) an absorption component, ~1/4 of an orbit out of phase with the emission features, is discerned. Doppler tomograms of the double-peaked profiles are consistent with a disk-wind geometry, rotating at velocities of 1000 km/s. Regrettably, the tomography algorithm will produce a similar ring structure from alternative line sources if contaminated by overlying P Cygni profiles. This is certainly the case in the strong 2.0587 micron HeI line, leading to an ambiguous solution for the nature of double-peaked emission. The absorption feature, detected 1/4 of an orbit out of phase with the emission features, is consistent with an origin in the He star wind and yields for the first time a plausible radial velocity curve for the system. We directly derive the mass function of the system, 0.027 M_sun. If we assume a neutron star accretor and adopt a high orbital inclination, i > 60 degrees, we obtain a mass range for the He star of 5 M_sun < M_WR < 11 M_sun. Alternatively if the compact object is a black hole, we estimate M_BH < 10 M_sun. We discuss the implications of these masses for the nature and size of the binary system.Comment: Accepted for publication in ApJ main journa