Estimating the Accuracy of Spectral Learning for HMMs

Hidden Markov models (HMMs) are usually learned using the expectation maximisation algorithm which is, unfortunately, subject to local optima. Spectral learning for HMMs provides a unique, optimal solution subject to availability of a sufficient amount of data. However, with access to limited data, there is no means of estimating the accuracy of the solution of a given model. In this paper, a new spectral evaluation method has been proposed which can be used to assess whether the algorithm is converging to a stable solution on a given dataset. The proposed method is designed for real-life datasets where the true model is not available. A number of empirical experiments on synthetic as well as real datasets indicate that our criterion is an accurate proxy to measure quality of models learned using spectral learning

Planning with Information-Processing Constraints and Model Uncertainty in Markov Decision Processes

Information-theoretic principles for learning and acting have been proposed to solve particular classes of Markov Decision Problems. Mathematically, such approaches are governed by a variational free energy principle and allow solving MDP planning problems with information-processing constraints expressed in terms of a Kullback-Leibler divergence with respect to a reference distribution. Here we consider a generalization of such MDP planners by taking model uncertainty into account. As model uncertainty can also be formalized as an information-processing constraint, we can derive a unified solution from a single generalized variational principle. We provide a generalized value iteration scheme together with a convergence proof. As limit cases, this generalized scheme includes standard value iteration with a known model, Bayesian MDP planning, and robust planning. We demonstrate the benefits of this approach in a grid world simulation.Comment: 16 pages, 3 figure

Empirical likelihood estimation of the spatial quantile regression

The spatial quantile regression model is a useful and flexible model for analysis of empirical problems with spatial dimension. This paper introduces an alternative estimator for this model. The properties of the proposed estimator are discussed in a comparative perspective with regard to the other available estimators. Simulation evidence on the small sample properties of the proposed estimator is provided. The proposed estimator is feasible and preferable when the model contains multiple spatial weighting matrices. Furthermore, a version of the proposed estimator based on the exponentially tilted empirical likelihood could be beneficial if model misspecification is suspect

Composite Fermion Metals from Dyon Black Holes and S-Duality

We propose that string theory in the background of dyon black holes in four-dimensional anti-de Sitter spacetime is holographic dual to conformally invariant composite Dirac fermion metal. By utilizing S-duality map, we show that thermodynamic and transport properties of the black hole match with those of composite fermion metal, exhibiting Fermi liquid-like. Built upon Dirac-Schwinger-Zwanziger quantization condition, we argue that turning on magnetic charges to electric black hole along the orbit of Gamma(2) subgroup of SL(2,Z) is equivalent to attaching even unit of statistical flux quanta to constituent fermions. Being at metallic point, the statistical magnetic flux is interlocked to the background magnetic field. We find supporting evidences for proposed holographic duality from study of internal energy of black hole and probe bulk fermion motion in black hole background. They show good agreement with ground-state energy of composite fermion metal in Thomas-Fermi approximation and cyclotron motion of a constituent or composite fermion excitation near Fermi-point.Comment: 30 pages, v2. 1 figure added, minor typos corrected; v3. revised version to be published in JHE

Land of Addicts? An Empirical Investigation of Habit-Based Asset Pricing Models

A popular explanation of aggregate stock market behavior suggests that assets are priced as if there were a representative investor whose utility is a power function of the difference between aggregate consumption and a “habit” level, where the habit is some function of lagged and (possibly) contemporaneous consumption. But theory does not provide precise guidelines about the parametric functional relationship between the habit and aggregate consumption. This makes for- mal estimation and testing challenging; at the same time, it raises an empirical question about the functional form of the habit that best explains asset pricing data. This paper studies the ability of a general class of habit-based asset pricing models to match the conditional moment restrictions implied by asset pricing theory. Our approach is to treat the functional form of the habit as unknown, and to estimate it along with the rest of the model’s finite dimensional parameters. This semiparametric approach allows us to empirically evaluate a number of interesting hypotheses about the specification of habit-based asset pricing models. Using stationary quarterly data on consumption growth, assets returns and instruments, our empirical results indicate that the estimated habit function is nonlinear, the habit formation is internal, and the estimated time-preference parameter and the power utility parameter are sensible. In addition, our estimated habit function generates a positive stochastic discount factor (SDF) proxy and performs well in explaining cross-sectional stock return data. We find that an internal habit SDF proxy can explain a cross-section of size and book-market sorted portfolio equity returns better than (i) the Fama and French (1993) three-factor model, (ii) the Lettau and Ludvigson (2001b) scaled consumption CAPM model, (iii) an external habit SDF proxy, (iv) the classic CAPM, and (v) the classic consumption CAPM

Risk, Unexpected Uncertainty, and Estimation Uncertainty: Bayesian Learning in Unstable Settings

Recently, evidence has emerged that humans approach learning using Bayesian updating rather than (model-free) reinforcement algorithms in a six-arm restless bandit problem. Here, we investigate what this implies for human appreciation of uncertainty. In our task, a Bayesian learner distinguishes three equally salient levels of uncertainty. First, the Bayesian perceives irreducible uncertainty or risk: even knowing the payoff probabilities of a given arm, the outcome remains uncertain. Second, there is (parameter) estimation uncertainty or ambiguity: payoff probabilities are unknown and need to be estimated. Third, the outcome probabilities of the arms change: the sudden jumps are referred to as unexpected uncertainty. We document how the three levels of uncertainty evolved during the course of our experiment and how it affected the learning rate. We then zoom in on estimation uncertainty, which has been suggested to be a driving force in exploration, in spite of evidence of widespread aversion to ambiguity. Our data corroborate the latter. We discuss neural evidence that foreshadowed the ability of humans to distinguish between the three levels of uncertainty. Finally, we investigate the boundaries of human capacity to implement Bayesian learning. We repeat the experiment with different instructions, reflecting varying levels of structural uncertainty. Under this fourth notion of uncertainty, choices were no better explained by Bayesian updating than by (model-free) reinforcement learning. Exit questionnaires revealed that participants remained unaware of the presence of unexpected uncertainty and failed to acquire the right model with which to implement Bayesian updating

Investor heterogeneity and the cross-section of U.K. investment trust performance

We use the upper and lower bounds derived by Ferson and Lin (2010) to examine the impact of investor heterogeneity on the performance of U.K. investment trusts relative to alternative linear factor models. We find using the upper bounds that investor heterogeneity has an important impact for nearly all investment trusts. The upper bounds are large in economic terms and significantly different from zero. We find no evidence of any trusts where all investors agree on the sign of performance beyond what we expect by chance. Using the lower bound, we find that trusts with a larger disagreement about trust performance have a weaker relation between the trust premium and past Net Asset Value (NAV) performance

The porin and the permeating antibiotic: A selective diffusion barrier in gram-negative bacteria

Gram-negative bacteria are responsible for a large proportion of antibiotic resistant bacterial diseases. These bacteria have a complex cell envelope that comprises an outer membrane and an inner membrane that delimit the periplasm. The outer membrane contains various protein channels, called porins, which are involved in the influx of various compounds, including several classes of antibiotics. Bacterial adaptation to reduce influx through porins is an increasing problem worldwide that contributes, together with efflux systems, to the emergence and dissemination of antibiotic resistance. An exciting challenge is to decipher the genetic and molecular basis of membrane impermeability as a bacterial resistance mechanism. This Review outlines the bacterial response towards antibiotic stress on altered membrane permeability and discusses recent advances in molecular approaches that are improving our knowledge of the physico-chemical parameters that govern the translocation of antibiotics through porin channel

Search For Heavy Pointlike Dirac Monopoles

We have searched for central production of a pair of photons with high transverse energies in $p\bar p$ collisions at $\sqrt{s} = 1.8$ TeV using $70 pb^{-1}$ of data collected with the D\O detector at the Fermilab Tevatron in 1994--1996. If they exist, virtual heavy pointlike Dirac monopoles could rescatter pairs of nearly real photons into this final state via a box diagram. We observe no excess of events above background, and set lower 95% C.L. limits of $610, 870, or 1580 GeV/c^2$ on the mass of a spin 0, 1/2, or 1 Dirac monopole.Comment: 12 pages, 4 figure

Observation of associated near-side and away-side long-range correlations in √sNN=5.02 TeV proton-lead collisions with the ATLAS detector

Two-particle correlations in relative azimuthal angle (Δϕ) and pseudorapidity (Δη) are measured in √sNN=5.02  TeV p+Pb collisions using the ATLAS detector at the LHC. The measurements are performed using approximately 1  μb-1 of data as a function of transverse momentum (pT) and the transverse energy (ΣETPb) summed over 3.1<η<4.9 in the direction of the Pb beam. The correlation function, constructed from charged particles, exhibits a long-range (2<|Δη|<5) “near-side” (Δϕ∼0) correlation that grows rapidly with increasing ΣETPb. A long-range “away-side” (Δϕ∼π) correlation, obtained by subtracting the expected contributions from recoiling dijets and other sources estimated using events with small ΣETPb, is found to match the near-side correlation in magnitude, shape (in Δη and Δϕ) and ΣETPb dependence. The resultant Δϕ correlation is approximately symmetric about π/2, and is consistent with a dominant cos⁡2Δϕ modulation for all ΣETPb ranges and particle pT