On the Prior Sensitivity of Thompson Sampling

The empirically successful Thompson Sampling algorithm for stochastic bandits has drawn much interest in understanding its theoretical properties. One important benefit of the algorithm is that it allows domain knowledge to be conveniently encoded as a prior distribution to balance exploration and exploitation more effectively. While it is generally believed that the algorithm's regret is low (high) when the prior is good (bad), little is known about the exact dependence. In this paper, we fully characterize the algorithm's worst-case dependence of regret on the choice of prior, focusing on a special yet representative case. These results also provide insights into the general sensitivity of the algorithm to the choice of priors. In particular, with $p$ being the prior probability mass of the true reward-generating model, we prove $O(\sqrt{T/p})$ and $O(\sqrt{(1-p)T})$ regret upper bounds for the bad- and good-prior cases, respectively, as well as \emph{matching} lower bounds. Our proofs rely on the discovery of a fundamental property of Thompson Sampling and make heavy use of martingale theory, both of which appear novel in the literature, to the best of our knowledge.Comment: Appears in the 27th International Conference on Algorithmic Learning Theory (ALT), 201

Rock glaciers of the Beartooth and northern Absaroka ranges, Montana, USA

Six hundred sixty‐one rock glaciers in the northern Absaroka and Beartooth Ranges of south‐central Montana were digitized and evaluated using geographic information systems technology and an array of topographic and environmental parameters. Beartooth rock glaciers are larger, occur at higher elevations, receive more precipitation, and are subject to lower temperatures than northern Absaroka rock glaciers. Elevation is strongly correlated with rock glacier activity. Comparative analysis of these adjacent mountain ranges indicates that Beartooth geomorphic landscapes are shifting from predominantly glacial to periglacial regimes, and that the northern Absarokas have largely completed this transition. Because glaciers are declining in response to climate warming, rock glaciers could soon become the most important source of ice in the region. View the dataset associated with this article. Read the thesis associated with this article

Worm Grunting, Fiddling, and Charming—Humans Unknowingly Mimic a Predator to Harvest Bait

Background: For generations many families in and around Florida’s Apalachicola National Forest have supported themselves by collecting the large endemic earthworms (Diplocardia mississippiensis). This is accomplished by vibrating a wooden stake driven into the soil, a practice called ‘‘worm grunting’’. In response to the vibrations, worms emerge to the surface where thousands can be gathered in a few hours. Why do these earthworms suddenly exit their burrows in response to vibrations, exposing themselves to predation? Principal Findings: Here it is shown that a population of eastern American moles (Scalopus aquaticus) inhabits the area where worms are collected and that earthworms have a pronounced escape response from moles consisting of rapidly exiting their burrows to flee across the soil surface. Recordings of vibrations generated by bait collectors and moles suggest that ‘‘worm grunters’ ’ unknowingly mimic digging moles. An alternative possibility, that worms interpret vibrations as rain and surface to avoid drowning is not supported. Conclusions: Previous investigations have revealed that both wood turtles and herring gulls vibrate the ground to elicit earthworm escapes, indicating that a range of predators may exploit the predator-prey relationship between earthworms and moles. In addition to revealing a novel escape response that may be widespread among soil fauna, the results sho

Recent global-warming hiatus tied to equatorial Pacific surface cooling

Despite the continued increase of atmospheric greenhouse gases, the annual-mean global temperature has not risen in this century, challenging the prevailing view that anthropogenic forcing causes climate warming. Various mechanisms have been proposed for this hiatus of global warming, but their relative importance has not been quantified, hampering observational estimates of climate sensitivity. Here we show that accounting for recent cooling in the eastern equatorial Pacific reconciles climate simulations and observations. We present a novel method to unravel mechanisms for global temperature change by prescribing the observed history of sea surface temperature over the deep tropical Pacific in a climate model, in addition to radiative forcing. Although the surface temperature prescription is limited to only 8.2% of the global surface, our model reproduces the annual-mean global temperature remarkably well with r = 0.97 for 1970-2012 (a period including the current hiatus and an accelerated global warming). Moreover, our simulation captures major seasonal and regional characteristics of the hiatus, including the intensified Walker circulation, the winter cooling in northwestern and prolonged drought in southern North America. Our results show that the current hiatus is part of natural climate variability, tied specifically to a La Niña-like decadal cooling. While similar decadal hiatus events may occur in the future, multi-decadal warming trend is very likely to continue with greenhouse gas increase

A transcriptomic snapshot of early molecular communication between Pasteuria penetrans and Meloidogyne incognita

© The Author(s). 2018Background: Southern root-knot nematode Meloidogyne incognita (Kofoid and White, 1919), Chitwood, 1949 is a key pest of agricultural crops. Pasteuria penetrans is a hyperparasitic bacterium capable of suppressing the nematode reproduction, and represents a typical coevolved pathogen-hyperparasite system. Attachment of Pasteuria endospores to the cuticle of second-stage nematode juveniles is the first and pivotal step in the bacterial infection. RNA-Seq was used to understand the early transcriptional response of the root-knot nematode at 8 h post Pasteuria endospore attachment. Results: A total of 52,485 transcripts were assembled from the high quality (HQ) reads, out of which 582 transcripts were found differentially expressed in the Pasteuria endospore encumbered J2 s, of which 229 were up-regulated and 353 were down-regulated. Pasteuria infection caused a suppression of the protein synthesis machinery of the nematode. Several of the differentially expressed transcripts were putatively involved in nematode innate immunity, signaling, stress responses, endospore attachment process and post-attachment behavioral modification of the juveniles. The expression profiles of fifteen selected transcripts were validated to be true by the qRT PCR. RNAi based silencing of transcripts coding for fructose bisphosphate aldolase and glucosyl transferase caused a reduction in endospore attachment as compared to the controls, whereas, silencing of aspartic protease and ubiquitin coding transcripts resulted in higher incidence of endospore attachment on the nematode cuticle. Conclusions: Here we provide evidence of an early transcriptional response by the nematode upon infection by Pasteuria prior to root invasion. We found that adhesion of Pasteuria endospores to the cuticle induced a down-regulated protein response in the nematode. In addition, we show that fructose bisphosphate aldolase, glucosyl transferase, aspartic protease and ubiquitin coding transcripts are involved in modulating the endospore attachment on the nematode cuticle. Our results add new and significant information to the existing knowledge on early molecular interaction between M. incognita and P. penetrans.Peer reviewedFinal Published versio

Taurine: a potential marker of apoptosis in gliomas

New cancer therapies are being developed that trigger tumour apoptosis and an in vivo method of apoptotic detection and early treatment response would be of great value. Magnetic resonance spectroscopy (MRS) can determine the tumour biochemical profile in vivo, and we have investigated whether a specific spectroscopic signature exists for apoptosis in human astrocytomas. High-resolution magic angle spinning (HRMAS) 1H MRS provided detailed 1H spectra of brain tumour biopsies for direct correlation with histopathology. Metabolites, mobile lipids and macromolecules were quantified from presaturation HRMAS 1H spectra acquired from 41 biopsies of grades II (n=8), III (n=3) and IV (n=30) astrocytomas. Subsequently, TUNEL and H&E staining provided quantification of apoptosis, cell density and necrosis. Taurine was found to significantly correlate with apoptotic cell density (TUNEL) in both non-necrotic (R=0.727, P=0.003) and necrotic (R=0.626, P=0.0005) biopsies. However, the ca 2.8 p.p.m. polyunsaturated fatty acid peak, observed in other studies as a marker of apoptosis, correlated only in non-necrotic biopsies (R=0.705, P<0.005). We suggest that the taurine 1H MRS signal in astrocytomas may be a robust apoptotic biomarker that is independent of tumour necrotic status

Regulation of proteinaceous effector expression in phytopathogenic fungi

Effectors are molecules used by microbial pathogens to facilitate infection via effector-triggered susceptibility or tissue necrosis in their host. Much research has been focussed on the identification and elucidating the function of fungal effectors during plant pathogenesis. By comparison, knowledge of how phytopathogenic fungi regulate the expression of effector genes has been lagging. Several recent studies have illustrated the role of various transcription factors, chromosome-based control, effector epistasis, and mobilisation of endosomes within the fungal hyphae in regulating effector expression and virulence on the host plant. Improved knowledge of effector regulation is likely to assist in improving novel crop protection strategies

Chick Embryo Partial Ischemia Model: A New Approach to Study Ischemia Ex Vivo

Background: Ischemia is a pathophysiological condition due to blockade in blood supply to a specific tissue thus damaging the physiological activity of the tissue. Different in vivo models are presently available to study ischemia in heart and other tissues. However, no ex vivo ischemia model has been available to date for routine ischemia research and for faster screening of anti-ischemia drugs. In the present study, we took the opportunity to develop an ex vivo model of partial ischemia using the vascular bed of 4th day incubated chick embryo. Methodology/Principal Findings: Ischemia was created in chick embryo by ligating the right vitelline artery using sterile surgical suture. Hypoxia inducible factor- 1 alpha (HIF-1a), creatine phospho kinase-MB and reactive oxygen species in animal tissues and cells were measured to confirm ischemia in chick embryo. Additionally, ranolazine, N-acetyl cysteine and trimetazidine were administered as an anti-ischemic drug to validate the present model. Results from the present study depicted that blocking blood flow elevates HIF-1a, lipid peroxidation, peroxynitrite level in ischemic vessels while ranolazine administration partially attenuates ischemia driven HIF-1a expression. Endothelial cell incubated on ischemic blood vessels elucidated a higher level of HIF-1a expression with time while ranolazine treatment reduced HIF-1a in ischemic cells. Incubation of caprine heart strip on chick embryo ischemia model depicted an elevated creatine phospho kinase-MB activity under ischemic condition while histology of the treated heart sections evoked edema and disruption of myofibril structures. Conclusions/Significance: The present study concluded that chick embryo partial ischemia model can be used as a novel ex vivo model of ischemia. Therefore, the present model can be used parallel with the known in vivo ischemia models in understanding the mechanistic insight of ischemia development and in evaluating the activity of anti-ischemic drug.status: publishe

Co-Administration of IL-1+IL-6+TNF-α with Mycobacterium tuberculosis Infected Macrophages Vaccine Induces Better Protective T Cell Memory than BCG

BCG has been administered globally for more than 75 years, yet tuberculosis (TB) continues to kill more than 2 million people annually. Further, BCG protects childhood TB but is quite inefficient in adults. This indicates that BCG fails to induce long-term protection. Hence there is a need to explore alternative vaccination strategies that can stimulate enduring T cell memory response. Dendritic cell based vaccination has attained extensive popularity following their success in various malignancies. In our previous study, we have established a novel and unique vaccination strategy against Mycobacterium tuberculosis (M. tb) and Salmonella typhimurium by utilizing infected macrophages (IM). In short-term experiments (30 days), substantial degree of protection was observed. However, remarkable difference was not observed in long-term studies (240 days) due to failure of the vaccine to generate long-lasting memory T cells. Hence, in the present study we employed T cell memory augmenting cytokines IL-1+IL-6+TNF-α and IL-7+IL-15 for the induction of the enhancement of long-term protection by the vaccine. We co-administered the M. tb infected macrophages vaccine with IL-1+IL-6+TNF-α (IM-1.6.α) and IL-7+IL-15 (IM-7.15). The mice were then rested for a reasonably large period (240 days) to study the bona fide T cell memory response before exposing them to aerosolized M. tb. IM-1.6.α but not IM-7.15 significantly improved memory T cell response against M. tb, as evidenced by recall responses of memory T cells, expansion of both central as well as effector memory CD4 and CD8 T cell pools, elicitation of mainly Th1 memory response, reduction in the mycobacterial load and alleviated lung pathology. Importantly, the protection induced by IM-1.6.α was significantly better than BCG. Thus, this study demonstrates that not only antigen-pulsed DCs can be successfully employed as vaccines against cancer and infectious diseases but also macrophages infected with M. tb can be utilized with great efficacy especially in protection against TB

Histoplasma capsulatum Heat-Shock 60 Orchestrates the Adaptation of the Fungus to Temperature Stress

Heat shock proteins (Hsps) are among the most widely distributed and evolutionary conserved proteins. Hsps are essential regulators of diverse constitutive metabolic processes and are markedly upregulated during stress. A 62 kDa Hsp (Hsp60) of Histoplasma capsulatum (Hc) is an immunodominant antigen and the major surface ligand to CR3 receptors on macrophages. However little is known about the function of this protein within the fungus. We characterized Hc Hsp60-protein interactions under different temperature to gain insights of its additional functions oncell wall dynamism, heat stress and pathogenesis. We conducted co-immunoprecipitations with antibodies to Hc Hsp60 using cytoplasmic and cell wall extracts. Interacting proteins were identified by shotgun proteomics. For the cell wall, 84 common interactions were identified among the 3 growth conditions, including proteins involved in heat-shock response, sugar and amino acid/protein metabolism and cell signaling. Unique interactions were found at each temperature [30°C (81 proteins), 37°C (14) and 37/40°C (47)]. There were fewer unique interactions in cytoplasm [30°C (6), 37°C (25) and 37/40°C (39)] and four common interactions, including additional Hsps and other known virulence factors. These results show the complexity of Hsp60 function and provide insights into Hc biology, which may lead to new avenues for the management of histoplasmosis