On the Prior Sensitivity of Thompson Sampling

The empirically successful Thompson Sampling algorithm for stochastic bandits has drawn much interest in understanding its theoretical properties. One important benefit of the algorithm is that it allows domain knowledge to be conveniently encoded as a prior distribution to balance exploration and exploitation more effectively. While it is generally believed that the algorithm's regret is low (high) when the prior is good (bad), little is known about the exact dependence. In this paper, we fully characterize the algorithm's worst-case dependence of regret on the choice of prior, focusing on a special yet representative case. These results also provide insights into the general sensitivity of the algorithm to the choice of priors. In particular, with $p$ being the prior probability mass of the true reward-generating model, we prove $O(\sqrt{T/p})$ and $O(\sqrt{(1-p)T})$ regret upper bounds for the bad- and good-prior cases, respectively, as well as \emph{matching} lower bounds. Our proofs rely on the discovery of a fundamental property of Thompson Sampling and make heavy use of martingale theory, both of which appear novel in the literature, to the best of our knowledge.Comment: Appears in the 27th International Conference on Algorithmic Learning Theory (ALT), 201

Correction to: The association between anxiety and disease activity and quality of life in rheumatoid arthritis: a systematic review and meta-analysis.

The authors of the published original version of the above article wanted to correct the below text in the Abstract section

On the Theory of Evolution Versus the Concept of Evolution: Three Observations

Here we address three misconceptions stated by Rice et al. in their observations of our article Paz-y-Miño and Espinosa (Evo Edu Outreach 2:655–675, 2009), published in this journal. The five authors titled their note “The Theory of Evolution is Not an Explanation for the Origin of Life.” First, we argue that it is fallacious to believe that because the formulation of the theory of evolution, as conceived in the 1800s, did not include an explanation for the origin of life, nor of the universe, the concept of evolution would not allow us to hypothesize the possible beginnings of life and its connections to the cosmos. Not only Stanley Miller’s experiments of 1953 led scientists to envision a continuum from the inorganic world to the origin and diversification of life, but also Darwin’s own writings of 1871. Second, to dismiss the notion of Rice et al. that evolution does not provide explanations concerning the universe or the cosmos, we identify compelling scientific discussions on the topics: Zaikowski et al. (Evo Edu Outreach 1:65–73, 2008), Krauss (Evo Edu Outreach 3:193–197, 2010), Peretó et al. (Orig Life Evol Biosph 39:395–406, 2009) and Follmann and Brownson (Naturwissenschaften 96:1265–1292, 2009). Third, although we acknowledge that the term Darwinism may not be inclusive of all new discoveries in evolution, and also that creationists and Intelligent Designers hijack the term to portray evolution as ideology, we demonstrate that there is no statistical evidence suggesting that the word Darwinism interferes with public acceptance of evolution, nor does the inclusion of the origin of life or the universe within the concept of evolution. We examine the epistemological and empirical distinction between the theory of evolution and the concept of evolution and conclude that, although the distinction is important, it should not compromise scientific logic

Altered Neural and Behavioral Dynamics in Huntington's Disease: An Entropy Conservation Approach

Background: Huntington’s disease (HD) is an inherited condition that results in neurodegeneration of the striatum, the forebrain structure that processes cortical information for behavioral output. In the R6/2 transgenic mouse model of HD, striatal neurons exhibit aberrant firing patterns that are coupled with reduced flexibility in the motor system. The aim of this study was to test the patterns of unpredictability in brain and behavior in wild-type (WT) and R6/2 mice. Methodology/Principal Findings: Striatal local field potentials (LFP) were recorded from 18 WT and 17 R6/2 mice (aged 8– 11 weeks) while the mice were exploring a plus-shaped maze. We targeted LFP activity for up to 2 s before and 2 s after each choice-point entry. Approximate Entropy (ApEn) was calculated for LFPs and Shannon Entropy was used to measure the probability of arm choice, as well as the likelihood of making consecutive 90-degree turns in the maze. We found that although the total number of choice-point crossings and entropy of arm-choice probability was similar in both groups, R6/2 mice had more predictable behavioral responses (i.e., were less likely to make 90-degree turns and perform them in alternation with running straight down the same arm), while exhibiting more unpredictable striatal activity, as indicated by higher ApEn values. In both WT and R6/2 mice, however, behavioral unpredictability was negatively correlated with LFP ApEn. Conclusions/Significance: HD results in a perseverative exploration of the environment, occurring in concert with mor

Control of breathing and respiratory gas exchange in high-altitude ducks native to the Andes

We examined the control of breathing and respiratory gas exchange in six species of high-altitude duck that independently colonized the high Andes. We compared ducks from high-altitude populations in Peru (Lake Titicaca at ∼3800 m above sea level; Chancay River at ∼3000–4100 m) with closely related populations or species from low altitude. Hypoxic ventilatory responses were measured shortly after capture at the native altitude. In general, ducks responded to acute hypoxia with robust increases in total ventilation and pulmonary O2 extraction. O2 consumption rates were maintained or increased slightly in acute hypoxia, despite ∼1–2°C reductions in body temperature in most species. Two high-altitude taxa – yellow-billed pintail and torrent duck – exhibited higher total ventilation than their low-altitude counterparts, and yellow-billed pintail exhibited greater increases in pulmonary O2 extraction in severe hypoxia. In contrast, three other high-altitude taxa – Andean ruddy duck, Andean cinnamon teal and speckled teal – had similar or slightly reduced total ventilation and pulmonary O2 extraction compared with low-altitude relatives. Arterial O2 saturation (SaO2) was elevated in yellow-billed pintails at moderate levels of hypoxia, but there were no differences in SaO2 in other high-altitude taxa compared with their close relatives. This finding suggests that improvements in SaO2 in hypoxia can require increases in both breathing and haemoglobin–O2 affinity, because the yellow-billed pintail was the only high-altitude duck with concurrent increases in both traits compared with its low-altitude relative. Overall, our results suggest that distinct physiological strategies for coping with hypoxia can exist across different high-altitude lineages, even among those inhabiting very similar high-altitude habitats

Evidence of a high incidence of subclinically affected calves in a herd of cattle with fatal cases of Bovine Neonatal Pancytopenia (BNP).

BACKGROUND: Bovine Neonatal Pancytopenia (BNP) is a disease of calves characterised by bone marrow trilineage hypoplasia, mediated by ingestion of alloantibodies in colostrum. Suspected subclinical forms of BNP have been reported, suggesting that observed clinical cases may not represent the full extent of the disease. However to date there are no objective data available on the incidence of subclinical disease or its temporal distribution. This study aimed to 1) ascertain whether subclinical BNP occurs and, if so, to determine the incidence on an affected farm and 2) determine whether there is evidence of temporal clustering of BNP cases on this farm. To achieve these aims, haematological screening of calves born on the farm during one calving season was carried out, utilising blood samples collected at defined ages. These data were then analysed in comparison to data from both known BNP-free control animals and histopathologically confirmed BNP cases. An ordinal logistic regression model was used to create a composite haematology score to predict the probabilities of calves being normal, based on their haematology measurements at 10–14 days old. RESULTS: This study revealed that 15% (21 of 139) of the clinically normal calves on this farm had profoundly abnormal haematology (<5% chance of being normal) and could be defined as affected by subclinical BNP. Together with clinical BNP cases, this gave the study farm a BNP incidence of 18%. Calves with BNP were found to be distributed throughout the calving period, with no clustering, and no significant differences in the date of birth of cases or subclinical cases were found compared to the rest of the calves. This study did not find any evidence of increased mortality or increased time from birth to sale in subclinical BNP calves but, as the study only involved a single farm and adverse effects may be determined by other inter-current diseases it remains possible that subclinical BNP has a detrimental impact on the health and productivity of calves under certain circumstances. CONCLUSIONS: Subclinical BNP was found to occur at a high incidence in a herd of cattle with fatal cases of BNP

High emotional contagion and empathy are associated with enhanced detection of emotional authenticity in laughter

Nonverbal vocalisations such as laughter pervade social interactions, and the ability to accurately interpret them is an important skill. Previous research has probed the general mechanisms supporting vocal emotional processing, but the factors that determine individual differences in this ability remain poorly understood. Here, we ask whether the propensity to resonate with others’ emotions—as measured by trait levels of emotional contagion and empathy—relates to the ability to perceive different types of laughter. We focus on emotional authenticity detection in spontaneous and voluntary laughs: spontaneous laughs reflect a less controlled and genuinely felt emotion, and voluntary laughs reflect a more deliberate communicative act (e.g., polite agreement). In total, 119 participants evaluated the authenticity and contagiousness of spontaneous and voluntary laughs and completed two self-report measures of resonance with others’ emotions: the Emotional Contagion Scale and the Empathic Concern scale of the Interpersonal Reactivity Index. We found that higher scores on these measures predict enhanced ability to detect laughter authenticity. We further observed that perceived contagion responses during listening to laughter significantly relate to authenticity detection. These findings suggest that resonating with others’ emotions provides a mechanism for processing complex aspects of vocal emotional information