All Else Being Equal Be Empowered

The original publication is available at www.springerlink.com . Copyright Springer DOI : 10.1007/11553090_75The classical approach to using utility functions suffers from the drawback of having to design and tweak the functions on a case by case basis. Inspired by examples from the animal kingdom, social sciences and games we propose empowerment, a rather universal function, defined as the information-theoretic capacity of an agent’s actuation channel. The concept applies to any sensorimotoric apparatus. Empowerment as a measure reflects the properties of the apparatus as long as they are observable due to the coupling of sensors and actuators via the environment.Peer reviewe

Thinking About Causation : A Causal Language with Epistemic Operators

In this paper we propose a formal framework for modeling the interaction of causal and (qualitative) epistemic reasoning. To this purpose, we extend the notion of a causal model [11, 16, 17, 26] with a representation of the epistemic state of an agent. On the side of the object language, we add operators to express knowledge and the act of observing new information. We provide a sound and complete axiomatization of the logic, and discuss the relation of this framework to causal team semantics.Peer reviewe

Evidence for Thermally Activated Spontaneous Fluxoid Formation in Superconducting Thin-Film Rings

We have observed spontaneous fluxoid generation in thin-film rings of the amorphous superconductor Mo$_3$Si, cooled through the normal-superconducting transition, as a function of quench rate and externally applied magnetic field, using a variable sample temperature scanning SQUID microscope. Our results can be explained using a model of freezout of thermally activated fluxoids, mediated by the transport of bulk vortices across the ring walls. This mechanism is complementary to a mechanism proposed by Kibble and Zurek, which only relies on causality to produce a freezout of order parameter fluctuations.Comment: 4 pages, 3 figure

Statistical Mechanical Development of a Sparse Bayesian Classifier

The demand for extracting rules from high dimensional real world data is increasing in various fields. However, the possible redundancy of such data sometimes makes it difficult to obtain a good generalization ability for novel samples. To resolve this problem, we provide a scheme that reduces the effective dimensions of data by pruning redundant components for bicategorical classification based on the Bayesian framework. First, the potential of the proposed method is confirmed in ideal situations using the replica method. Unfortunately, performing the scheme exactly is computationally difficult. So, we next develop a tractable approximation algorithm, which turns out to offer nearly optimal performance in ideal cases when the system size is large. Finally, the efficacy of the developed classifier is experimentally examined for a real world problem of colon cancer classification, which shows that the developed method can be practically useful.Comment: 13 pages, 6 figure

Ignorance based inference of optimality in thermodynamic processes

We derive ignorance based prior distribution to quantify incomplete information and show its use to estimate the optimal work characteristics of a heat engine.Comment: Latex, 10 pages, 3 figure

The sensitivity of land emissivity estimates from AMSR-E at C and X bands to surface properties

Microwave observations at low frequencies exhibit more sensitivity to surface and subsurface properties with little interference from the atmosphere. The objective of this study is to develop a global land emissivity product using passive microwave observations from the Advanced Microwave Scanning Radiometer – Earth Observing System (AMSR-E) and to investigate its sensitivity to land surface properties. The developed product complements existing land emissivity products from SSM/I and AMSU by adding land emissivity estimates at two lower frequencies, 6.9 and 10.65 GHz (C- and X-band, respectively). Observations at these low frequencies penetrate deeper into the soil layer. Ancillary data used in the analysis, such as surface skin temperature and cloud mask, are obtained from International Satellite Cloud Climatology Project (ISCCP). Atmospheric properties are obtained from the TIROS Operational Vertical Sounder (TOVS) observations to determine the small upwelling and downwelling atmospheric emissions as well as the atmospheric transmission. A sensitivity test confirms the small effect of the atmosphere but shows that skin temperature accuracy can significantly affect emissivity estimates. Retrieved emissivities at C- and X-bands and their polarization differences exhibit similar patterns of variation with changes in land cover type, soil moisture, and vegetation density as seen at SSM/I-like frequencies (Ka and Ku bands). The emissivity maps from AMSR-E at these higher frequencies agree reasonably well with the existing SSM/I-based product. The inherent discrepancy introduced by the difference between SSM/I and AMSR-E frequencies, incidence angles, and calibration has been assessed. Significantly greater standard deviation of estimated emissivities compared to SSM/I land emissivity product was found over desert regions. Large differences between emissivity estimates from ascending and descending overpasses were found at lower frequencies due to the inconsistency between thermal IR skin temperatures and passive microwave brightness temperatures which can originate from below the surface. The mismatch between day and night AMSR-E emissivities is greater than ascending and descending differences of SSM/I emissivity. This is because of unique orbit time of AMSR-E (01:30 a.m./p.m. LT) while other microwave sensors have orbit time of 06:00 to 09:00 (a.m./p.m.). This highlights the importance of considering the penetration depth of the microwave signal and diurnal variability of the temperature in emissivity retrieval. The effect of these factors is greater for AMSR-E observations than SSM/I observations, as AMSR-E observations exhibit a greater difference between day and night measures. This issue must be addressed in future studies to improve the accuracy of the emissivity estimates especially at AMSR-E lower frequencies

Replicated Bethe Free Energy: A Variational Principle behind Survey Propagation

A scheme to provide various mean-field-type approximation algorithms is presented by employing the Bethe free energy formalism to a family of replicated systems in conjunction with analytical continuation with respect to the number of replicas. In the scheme, survey propagation (SP), which is an efficient algorithm developed recently for analyzing the microscopic properties of glassy states for a fixed sample of disordered systems, can be reproduced by assuming the simplest replica symmetry on stationary points of the replicated Bethe free energy. Belief propagation and generalized SP can also be offered in the identical framework under assumptions of the highest and broken replica symmetries, respectively.Comment: appeared in Journal of the Physical Society of Japan 74, 2133-2136 (2005

Picturing classical and quantum Bayesian inference

We introduce a graphical framework for Bayesian inference that is sufficiently general to accommodate not just the standard case but also recent proposals for a theory of quantum Bayesian inference wherein one considers density operators rather than probability distributions as representative of degrees of belief. The diagrammatic framework is stated in the graphical language of symmetric monoidal categories and of compact structures and Frobenius structures therein, in which Bayesian inversion boils down to transposition with respect to an appropriate compact structure. We characterize classical Bayesian inference in terms of a graphical property and demonstrate that our approach eliminates some purely conventional elements that appear in common representations thereof, such as whether degrees of belief are represented by probabilities or entropic quantities. We also introduce a quantum-like calculus wherein the Frobenius structure is noncommutative and show that it can accommodate Leifer's calculus of `conditional density operators'. The notion of conditional independence is also generalized to our graphical setting and we make some preliminary connections to the theory of Bayesian networks. Finally, we demonstrate how to construct a graphical Bayesian calculus within any dagger compact category.Comment: 38 pages, lots of picture

Quantifying Self-Organization with Optimal Predictors

Despite broad interest in self-organizing systems, there are few quantitative, experimentally-applicable criteria for self-organization. The existing criteria all give counter-intuitive results for important cases. In this Letter, we propose a new criterion, namely an internally-generated increase in the statistical complexity, the amount of information required for optimal prediction of the system's dynamics. We precisely define this complexity for spatially-extended dynamical systems, using the probabilistic ideas of mutual information and minimal sufficient statistics. This leads to a general method for predicting such systems, and a simple algorithm for estimating statistical complexity. The results of applying this algorithm to a class of models of excitable media (cyclic cellular automata) strongly support our proposal.Comment: Four pages, two color figure

Variations of the McEliece Cryptosystem

Two variations of the McEliece cryptosystem are presented. The first one is based on a relaxation of the column permutation in the classical McEliece scrambling process. This is done in such a way that the Hamming weight of the error, added in the encryption process, can be controlled so that efficient decryption remains possible. The second variation is based on the use of spatially coupled moderate-density parity-check codes as secret codes. These codes are known for their excellent error-correction performance and allow for a relatively low key size in the cryptosystem. For both variants the security with respect to known attacks is discussed