Provably Efficient Maximum Entropy Exploration

Suppose an agent is in a (possibly unknown) Markov Decision Process in the absence of a reward signal, what might we hope that an agent can efficiently learn to do? This work studies a broad class of objectives that are defined solely as functions of the state-visitation frequencies that are induced by how the agent behaves. For example, one natural, intrinsically defined, objective problem is for the agent to learn a policy which induces a distribution over state space that is as uniform as possible, which can be measured in an entropic sense. We provide an efficient algorithm to optimize such such intrinsically defined objectives, when given access to a black box planning oracle (which is robust to function approximation). Furthermore, when restricted to the tabular setting where we have sample based access to the MDP, our proposed algorithm is provably efficient, both in terms of its sample and computational complexities. Key to our algorithmic methodology is utilizing the conditional gradient method (a.k.a. the Frank-Wolfe algorithm) which utilizes an approximate MDP solver.Comment: Updated experiment results; minor revisions in writin

Online Control with Adversarial Disturbances

We study the control of a linear dynamical system with adversarial disturbances (as opposed to statistical noise). The objective we consider is one of regret: we desire an online control procedure that can do nearly as well as that of a procedure that has full knowledge of the disturbances in hindsight. Our main result is an efficient algorithm that provides nearly tight regret bounds for this problem. From a technical standpoint, this work generalizes upon previous work in two main aspects: our model allows for adversarial noise in the dynamics, and allows for general convex costs

Many-body diagrammatic expansion in a Kohn-Sham basis: implications for Time-Dependent Density Functional Theory of excited states

We formulate diagrammatic rules for many-body perturbation theory which uses Kohn-Sham (KS) Green's functions as basic propagators. The diagram technique allows to study the properties of the dynamic nonlocal exchange-correlation (xc) kernel $f_{xc}$. We show that the spatial non-locality of $f_{xc}$ is strongly frequency-dependent. In particular, in extended systems the non-locality range diverges at the excitation energies. This divergency is related to the discontinuity of the xc potential.Comment: 4 RevTeX pages including 3 eps figures, submitted to Phys. Rev. Lett; revised version with new reference

Iron Source Preference and Regulation of Iron Uptake in Cryptococcus neoformans

The level of available iron in the mammalian host is extremely low, and pathogenic microbes must compete with host proteins such as transferrin for iron. Iron regulation of gene expression, including genes encoding iron uptake functions and virulence factors, is critical for the pathogenesis of the fungus Cryptococcus neoformans. In this study, we characterized the roles of the CFT1 and CFT2 genes that encode C. neoformans orthologs of the Saccharomyces cerevisiae high-affinity iron permease FTR1. Deletion of CFT1 reduced growth and iron uptake with ferric chloride and holo-transferrin as the in vitro iron sources, and the cft1 mutant was attenuated for virulence in a mouse model of infection. A reduction in the fungal burden in the brains of mice infected with the cft1 mutant was observed, thus suggesting a requirement for reductive iron acquisition during cryptococcal meningitis. CFT2 played no apparent role in iron acquisition but did influence virulence. The expression of both CFT1 and CFT2 was influenced by cAMP-dependent protein kinase, and the iron-regulatory transcription factor Cir1 positively regulated CFT1 and negatively regulated CFT2. Overall, these results indicate that C. neoformans utilizes iron sources within the host (e.g., holo-transferrin) that require Cft1 and a reductive iron uptake system

Withaferin a alone and in combination with Cisplatin suppresses growth and metastasis of ovarian cancer by targeting putative cancer stem cells.

Currently, the treatment for ovarian cancer entails cytoreductive surgery followed by chemotherapy, mainly, carboplatin combined with paclitaxel. Although this regimen is initially effective in a high percentage of cases, unfortunately within few months of initial treatment, tumor relapse occurs because of platinum-resistance. This is attributed to chemo-resistance of cancer stem cells (CSCs). Herein we show for the first time that withaferin A (WFA), a bioactive compound isolated from the plant Withania somnifera, when used alone or in combination with cisplatin (CIS) targets putative CSCs. Treatment of nude mice bearing orthotopic ovarian tumors generated by injecting human ovarian epithelial cancer cell line (A2780) with WFA and cisplatin (WFA) alone or in combination resulted in a 70 to 80% reduction in tumor growth and complete inhibition of metastasis to other organs compared to untreated controls. Histochemical and Western blot analysis of the tumors revealed that inclusion of WFA (2 mg/kg) resulted in a highly significant elimination of cells expressing CSC markers - CD44, CD24, CD34, CD117 and Oct4 and downregulation of Notch1, Hes1 and Hey1 genes. In contrast treatment of mice with CIS alone (6 mg/kg) had opposite effect on those cells. Increase in cells expressing CSC markers and Notch1 signaling pathway in tumors exposed to CIS may explain recurrence of cancer in patients treated with carboplatin and paclitaxel. Since, WFA alone or in combination with CIS eliminates putative CSCs, we conclude that WFA in combination with CIS may present more efficacious therapy for ovarian cancer

A new generalized Kohn-Sham method for fundamental band-gaps in solids

We developed a method for calculating solid-state ground-state properties and fundamental band-gaps using a generalized Kohn-Sham approach combining a local density approximation (LDA) functional with a long-range explicit exchange orbital functional. We found that when the range parameter is selected according to the formula \gamma=A/(\eps_\inf - \eps_\tilde) where \eps_\inf is the optical dielectric constant of the solid and \eps_\tilde= 0.84 and A= 0.216a0^(-1), predictions of the fundamental band-gap close to the experimental values are obtained for a variety of solids of different types. For most solids the range parameter \gamma is small (i.e. explicit exchange is needed only at long distances) so the predicted values for lattice constants and bulk modulii are similar to those based on conventional LDA calculations

Risk assessment for the spread of Serratia marcescens within dental-unit waterline systems using Vermamoeba vermiformis

Vermamoeba vermiformis is associated with the biofilm ecology of dental-unit waterlines (DUWLs). This study investigated whether V. vermiformis is able to act as a vector for potentially pathogenic bacteria and so aid their dispersal within DUWL systems. Clinical dental water was initially examined for Legionella species by inoculating it onto Legionella selective-medium plates. The molecular identity/profile of the glassy colonies obtained indicated none of these isolates were Legionella species. During this work bacterial colonies were identified as a non-pigmented Serratia marcescens. As the water was from a clinical DUWL which had been treated with Alpron™ this prompted the question as to whether S. marcescens had developed resistance to the biocide. Exposure to Alpron™ indicated that this dental biocide was effective, under laboratory conditions, against S. marcescens at up to 1x108 colony forming units/millilitre (cfu/ml). V. vermiformis was cultured for eight weeks on cells of S. marcescens and Escherichia coli. Subsequent electron microscopy showed that V. vermiformis grew equally well on S. marcescens and E. coli (p = 0.0001). Failure to detect the presence of S. marcescens within the encysted amoebae suggests that V. vermiformis is unlikely to act as a vector supporting the growth of this newly isolated, nosocomial bacterium