Incentivizing Exploration with Heterogeneous Value of Money

Recently, Frazier et al. proposed a natural model for crowdsourced exploration of different a priori unknown options: a principal is interested in the long-term welfare of a population of agents who arrive one by one in a multi-armed bandit setting. However, each agent is myopic, so in order to incentivize him to explore options with better long-term prospects, the principal must offer the agent money. Frazier et al. showed that a simple class of policies called time-expanded are optimal in the worst case, and characterized their budget-reward tradeoff. The previous work assumed that all agents are equally and uniformly susceptible to financial incentives. In reality, agents may have different utility for money. We therefore extend the model of Frazier et al. to allow agents that have heterogeneous and non-linear utilities for money. The principal is informed of the agent's tradeoff via a signal that could be more or less informative. Our main result is to show that a convex program can be used to derive a signal-dependent time-expanded policy which achieves the best possible Lagrangian reward in the worst case. The worst-case guarantee is matched by so-called "Diamonds in the Rough" instances; the proof that the guarantees match is based on showing that two different convex programs have the same optimal solution for these specific instances. These results also extend to the budgeted case as in Frazier et al. We also show that the optimal policy is monotone with respect to information, i.e., the approximation ratio of the optimal policy improves as the signals become more informative.Comment: WINE 201

Dynamic sampling schemes for optimal noise learning under multiple nonsmooth constraints

We consider the bilevel optimisation approach proposed by De Los Reyes, Sch\"onlieb (2013) for learning the optimal parameters in a Total Variation (TV) denoising model featuring for multiple noise distributions. In applications, the use of databases (dictionaries) allows an accurate estimation of the parameters, but reflects in high computational costs due to the size of the databases and to the nonsmooth nature of the PDE constraints. To overcome this computational barrier we propose an optimisation algorithm that by sampling dynamically from the set of constraints and using a quasi-Newton method, solves the problem accurately and in an efficient way

Transcriptional and functional profilling of human embryonic stem cell-derived cardiomyocytes

Human embryonic stemcells (hESCs) can serve as a potentially limitless source of cells that may enable regeneration of diseased tissue and organs. Here we investigate the use of human embryonic stemcell-derived cardiomyocytes (hESC-CMs) in promoting recovery from cardiac ischemia reperfusion injury in a mouse model. Using microarrays, we have described the hESC-CM transcriptome within the spectrum of changes that occur between undifferentiated hESCs and fetal heart cells. The hESC-CMs expressed cardiomyocyte genes at levels similar to those found in 20-week fetal heart cells, making this population a good source of potential replacement cells in vivo. Echocardiographic studies showed significant improvement in heart function by 8 weeks after transplantation. Finally, we demonstrate long-term engraftment of hESC-CMs by using molecular imaging to track cellular localization, survival, and proliferation in vivo. Taken together, global gene expression profiling of hESC differentiation enables a systems-based analysis of the biological processes, networks, and genes that drive hESC fate decisions, and studies such as this will serve as the foundation for future clinical applications of stem cell therapies. © 2008 Cao et al.published_or_final_versio

Serum methylarginines and spirometry-measured lung function in older adults

Rationale: Methylarginines are endogenous nitric oxide synthase inhibitors that have been implicated in animal models of lung disease but have not previously been examined for their association with spirometric measures of lung function in humans. Objectives: This study measured serum concentrations of asymmetric and symmetric dimethylarginine in a representative sample of older community-dwelling adults and determined their association with spirometric lung function measures. Methods: Data on clinical, lifestyle, and demographic characteristics, methylated arginines, and L-arginine (measured using LC-MS/MS) were collected from a population-based sample of older Australian adults from the Hunter Community Study. The five key lung function measures included as outcomes were Forced Expiratory Volume in 1 second, Forced Vital Capacity, Forced Expiratory Volume in 1 second to Forced Vital Capacity ratio, Percent Predicted Forced Expiratory Volume in 1 second, and Percent Predicted Forced Vital Capacity. Measurements and Main Results: In adjusted analyses there were statistically significant independent associations between a) higher asymmetric dimethylarginine, lower Forced Expiratory Volume in 1 second and lower Forced Vital Capacity; and b) lower L-arginine/asymmetric dimethylarginine ratio, lower Forced Expiratory Volume in 1 second, lower Percent Predicted Forced Expiratory Volume in 1 second and lower Percent Predicted Forced Vital Capacity. By contrast, no significant associations were observed between symmetric dimethylarginine and lung function. Conclusions: After adjusting for clinical, demographic, biochemical, and pharmacological confounders, higher serum asymmetric dimethylarginine was independently associated with a reduction in key measures of lung function. Further research is needed to determine if methylarginines predict the decline in lung function

The relationship between priestly motivational styles and personal wellbeing in ministry : exploring the connection between religious orientation and purpose in life among Catholic priests serving in Italy

This study examines the association between priestly motivation (accessed via the psychological notion of religious orientation) and personal wellbeing (accessed via the psychological notion of purpose in life) among a sample of 155 Catholic priests serving in Italy. The data confirm a positive association between intrinsic religious orientation and purpose in life, but a negative association between quest religious orientation and purpose in life. These findings are discussed in light of the expectations placed on Catholic priests by the Church and by society

Hsp90 governs dispersion and drug resistance of fungal biofilms

Fungal biofilms are a major cause of human mortality and are recalcitrant to most treatments due to intrinsic drug resistance. These complex communities of multiple cell types form on indwelling medical devices and their eradication often requires surgical removal of infected devices. Here we implicate the molecular chaperone Hsp90 as a key regulator of biofilm dispersion and drug resistance. We previously established that in the leading human fungal pathogen, Candida albicans, Hsp90 enables the emergence and maintenance of drug resistance in planktonic conditions by stabilizing the protein phosphatase calcineurin and MAPK Mkc1. Hsp90 also regulates temperature-dependent C. albicans morphogenesis through repression of cAMP-PKA signalling. Here we demonstrate that genetic depletion of Hsp90 reduced C. albicans biofilm growth and maturation in vitro and impaired dispersal of biofilm cells. Further, compromising Hsp90 function in vitro abrogated resistance of C. albicans biofilms to the most widely deployed class of antifungal drugs, the azoles. Depletion of Hsp90 led to reduction of calcineurin and Mkc1 in planktonic but not biofilm conditions, suggesting that Hsp90 regulates drug resistance through different mechanisms in these distinct cellular states. Reduction of Hsp90 levels led to a marked decrease in matrix glucan levels, providing a compelling mechanism through which Hsp90 might regulate biofilm azole resistance. Impairment of Hsp90 function genetically or pharmacologically transformed fluconazole from ineffectual to highly effective in eradicating biofilms in a rat venous catheter infection model. Finally, inhibition of Hsp90 reduced resistance of biofilms of the most lethal mould, Aspergillus fumigatus, to the newest class of antifungals to reach the clinic, the echinocandins. Thus, we establish a novel mechanism regulating biofilm drug resistance and dispersion and that targeting Hsp90 provides a much-needed strategy for improving clinical outcome in the treatment of biofilm infections

Altered Neurocircuitry in the Dopamine Transporter Knockout Mouse Brain

The plasma membrane transporters for the monoamine neurotransmitters dopamine, serotonin, and norepinephrine modulate the dynamics of these monoamine neurotransmitters. Thus, activity of these transporters has significant consequences for monoamine activity throughout the brain and for a number of neurological and psychiatric disorders. Gene knockout (KO) mice that reduce or eliminate expression of each of these monoamine transporters have provided a wealth of new information about the function of these proteins at molecular, physiological and behavioral levels. In the present work we use the unique properties of magnetic resonance imaging (MRI) to probe the effects of altered dopaminergic dynamics on meso-scale neuronal circuitry and overall brain morphology, since changes at these levels of organization might help to account for some of the extensive pharmacological and behavioral differences observed in dopamine transporter (DAT) KO mice. Despite the smaller size of these animals, voxel-wise statistical comparison of high resolution structural MR images indicated little morphological change as a consequence of DAT KO. Likewise, proton magnetic resonance spectra recorded in the striatum indicated no significant changes in detectable metabolite concentrations between DAT KO and wild-type (WT) mice. In contrast, alterations in the circuitry from the prefrontal cortex to the mesocortical limbic system, an important brain component intimately tied to function of mesolimbic/mesocortical dopamine reward pathways, were revealed by manganese-enhanced MRI (MEMRI). Analysis of co-registered MEMRI images taken over the 26 hours after introduction of Mn^(2+) into the prefrontal cortex indicated that DAT KO mice have a truncated Mn^(2+) distribution within this circuitry with little accumulation beyond the thalamus or contralateral to the injection site. By contrast, WT littermates exhibit Mn^(2+) transport into more posterior midbrain nuclei and contralateral mesolimbic structures at 26 hr post-injection. Thus, DAT KO mice appear, at this level of anatomic resolution, to have preserved cortico-striatal-thalamic connectivity but diminished robustness of reward-modulating circuitry distal to the thalamus. This is in contradistinction to the state of this circuitry in serotonin transporter KO mice where we observed more robust connectivity in more posterior brain regions using methods identical to those employed here

Galactic and Extragalactic Samples of Supernova Remnants: How They Are Identified and What They Tell Us

Supernova remnants (SNRs) arise from the interaction between the ejecta of a supernova (SN) explosion and the surrounding circumstellar and interstellar medium. Some SNRs, mostly nearby SNRs, can be studied in great detail. However, to understand SNRs as a whole, large samples of SNRs must be assembled and studied. Here, we describe the radio, optical, and X-ray techniques which have been used to identify and characterize almost 300 Galactic SNRs and more than 1200 extragalactic SNRs. We then discuss which types of SNRs are being found and which are not. We examine the degree to which the luminosity functions, surface-brightness distributions and multi-wavelength comparisons of the samples can be interpreted to determine the class properties of SNRs and describe efforts to establish the type of SN explosion associated with a SNR. We conclude that in order to better understand the class properties of SNRs, it is more important to study (and obtain additional data on) the SNRs in galaxies with extant samples at multiple wavelength bands than it is to obtain samples of SNRs in other galaxiesComment: Final 2016 draft of a chapter in "Handbook of Supernovae" edited by Athem W. Alsabti and Paul Murdin. Final version available at https://doi.org/10.1007/978-3-319-20794-0_90-