Rainbow: Combining Improvements in Deep Reinforcement Learning

The deep reinforcement learning community has made several independent improvements to the DQN algorithm. However, it is unclear which of these extensions are complementary and can be fruitfully combined. This paper examines six extensions to the DQN algorithm and empirically studies their combination. Our experiments show that the combination provides state-of-the-art performance on the Atari 2600 benchmark, both in terms of data efficiency and final performance. We also provide results from a detailed ablation study that shows the contribution of each component to overall performance.Comment: Under review as a conference paper at AAAI 201

Vectors Based on Modified Vaccinia Ankara Expressing Influenza H5N1 Hemagglutinin Induce Substantial Cross-Clade Protective Immunity

New highly pathogenic H5N1 influenza viruses are continuing to evolve with a potential threat for an influenza pandemic. So far, the H5N1 influenza viruses have not widely circulated in humans and therefore constitute a high risk for the non immune population. The aim of this study was to evaluate the cross-protective potential of the hemagglutinins of five H5N1 strains of divergent clades using a live attenuated modified vaccinia Ankara (MVA) vector vaccine.The replication-deficient MVA virus was used to express influenza hemagglutinin (HA) proteins. Specifically, recombinant MVA viruses expressing the HA genes of the clade 1 virus A/Vietnam/1203/2004 (VN/1203), the clade 2.1.3 virus A/Indonesia/5/2005 (IN5/05), the clade 2.2 viruses A/turkey/Turkey/1/2005 (TT01/05) and A/chicken/Egypt/3/2006 (CE/06), and the clade 2.3.4 virus A/Anhui/1/2005 (AH1/05) were constructed. These experimental live vaccines were assessed in a lethal mouse model. Mice vaccinated with the VN/1203 hemagglutinin-expressing MVA induced excellent protection against all the above mentioned clades. Also mice vaccinated with the IN5/05 HA expressing MVA induced substantial protection against homologous and heterologous AH1/05 challenge. After vaccination with the CE/06 HA expressing MVA, mice were fully protected against clade 2.2 challenge and partially protected against challenge of other clades. Mice vaccinated with AH1/05 HA expressing MVA vectors were only partially protected against homologous and heterologous challenge. The live vaccines induced substantial amounts of neutralizing antibodies, mainly directed against the homologous challenge virus, and high levels of HA-specific IFN-γ secreting CD4 and CD8 T-cells against epitopes conserved among the H5 clades and subclades.The highest level of cross-protection was induced by the HA derived from the VN/1203 strain, suggesting that pandemic H5 vaccines utilizing MVA vector technology, should be based on the VN/1203 hemagglutinin. Furthermore, the recombinant MVA-HA-VN, as characterized in the present study, would be a promising candidate for such a vaccine

High sensitive troponin T and heart fatty acid binding protein: Novel biomarker in heart failure with normal ejection fraction?: A cross-sectional study

Background: High sensitive troponin T (hsTnT) and heart fatty acid binding protein (hFABP) are both markers of myocardial injury and predict adverse outcome in patients with systolic heart failure (SHF). We tested whether hsTnT and hFABP plasma levels are elevated in patients with heart failure with normal ejection fraction (HFnEF). Methods: We analyzed hsTnT, hFABP and N-terminal brain natriuretic peptide in 130 patients comprising 49 HFnEF patients, 51 patients with asymptomatic left ventricular diastolic dysfunction (LVDD), and 30 controls with normal diastolic function. Patients were classified to have HFnEF when the diagnostic criteria as recommended by the European Society of Cardiology were met. Results: Levels of hs TnT and hFABP were significantly higher in patients with asymptomatic LVDD and HFnEF (both p < 0.001) compared to controls. The hsTnT levels were 5.6 [0.0-9.8] pg/ml in LVDD vs. 8.5 [3.9-17.5] pg/ml in HFnEF vs. < 0.03 [< 0.03-6.4] pg/ml in controls; hFABP levels were 3029 [2533-3761] pg/ml in LVDD vs. 3669 [2918-4839] pg/ml in HFnEF vs. 2361 [1860-3081] pg/ml in controls. Furthermore, hsTnT and hFABP levels were higher in subjects with HFnEF compared to LVDD (p = 0.015 and p = 0.022). Conclusion: In HFnEF patients, hsTnT and hFABP are elevated independent of coronary artery disease, suggesting that ongoing myocardial damage plays a critical role in the pathophysiology. A combination of biomarkers and echocardiographic parameters might improve diagnostic accuracy and risk stratification of patients with HFnEF

Knockout of the Bcmo1 gene results in an inflammatory response in female lung, which is suppressed by dietary beta-carotene

Beta-carotene 15,15′-monooxygenase 1 knockout (Bcmo1−/−) mice accumulate beta-carotene (BC) similarly to humans, whereas wild-type (Bcmo1+/+) mice efficiently cleave BC. Bcmo1−/− mice are therefore suitable to investigate BC-induced alterations in gene expression in lung, assessed by microarray analysis. Bcmo1−/− mice receiving control diet had increased expression of inflammatory genes as compared to BC-supplemented Bcmo1−/− mice and Bcmo1+/+ mice that received either control or BC-supplemented diets. Differential gene expression in Bcmo1−/− mice was confirmed by real-time quantitative PCR. Histochemical analysis indeed showed an increase in inflammatory cells in lungs of control Bcmo1−/− mice. Supported by metabolite and gene-expression data, we hypothesize that the increased inflammatory response is due to an altered BC metabolism, resulting in an increased vitamin A requirement in Bcmo1−/− mice. This suggests that effects of BC may depend on inter-individual variations in BC-metabolizing enzymes, such as the frequently occurring human polymorphisms in BCMO1

Beta-Carotene Reduces Body Adiposity of Mice via BCMO1

Evidence from cell culture studies indicates that β-carotene-(BC)-derived apocarotenoid signaling molecules can modulate the activities of nuclear receptors that regulate many aspects of adipocyte physiology. Two BC metabolizing enzymes, the BC-15,15′-oxygenase (Bcmo1) and the BC-9′,10′-oxygenase (Bcdo2) are expressed in adipocytes. Bcmo1 catalyzes the conversion of BC into retinaldehyde and Bcdo2 into β-10′-apocarotenal and β-ionone. Here we analyzed the impact of BC on body adiposity of mice. To genetically dissect the roles of Bcmo1 and Bcdo2 in this process, we used wild-type and Bcmo1-/- mice for this study. In wild-type mice, BC was converted into retinoids. In contrast, Bcmo1-/- mice showed increased expression of Bcdo2 in adipocytes and β-10′-apocarotenol accumulated as the major BC derivative. In wild-type mice, BC significantly reduced body adiposity (by 28%), leptinemia and adipocyte size. Genome wide microarray analysis of inguinal white adipose tissue revealed a generalized decrease of mRNA expression of peroxisome proliferator-activated receptor γ (PPARγ) target genes. Consistently, the expression of this key transcription factor for lipogenesis was significantly reduced both on the mRNA and protein levels. Despite β-10′-apocarotenoid production, this effect of BC was absent in Bcmo1-/- mice, demonstrating that it was dependent on the Bcmo1-mediated production of retinoids. Our study evidences an important role of BC for the control of body adiposity in mice and identifies Bcmo1 as critical molecular player for the regulation of PPARγ activity in adipocyte

A Pandemic Influenza H1N1 Live Vaccine Based on Modified Vaccinia Ankara Is Highly Immunogenic and Protects Mice in Active and Passive Immunizations

The development of novel influenza vaccines inducing a broad immune response is an important objective. The aim of this study was to evaluate live vaccines which induce both strong humoral and cell-mediated immune responses against the novel human pandemic H1N1 influenza virus, and to show protection in a lethal animal challenge model.For this purpose, the hemagglutinin (HA) and neuraminidase (NA) genes of the influenza A/California/07/2009 (H1N1) strain (CA/07) were inserted into the replication-deficient modified vaccinia Ankara (MVA) virus - a safe poxviral live vector – resulting in MVA-H1-Ca and MVA-N1-Ca vectors. These live vaccines, together with an inactivated whole virus vaccine, were assessed in a lung infection model using immune competent Balb/c mice, and in a lethal challenge model using severe combined immunodeficient (SCID) mice after passive serum transfer from immunized mice. Balb/c mice vaccinated with the MVA-H1-Ca virus or the inactivated vaccine were fully protected from lung infection after challenge with the influenza H1N1 wild-type strain, while the neuraminidase virus MVA-N1-Ca induced only partial protection. The live vaccines were already protective after a single dose and induced substantial amounts of neutralizing antibodies and of interferon-γ-secreting (IFN-γ) CD4- and CD8 T-cells in lungs and spleens. In the lungs, a rapid increase of HA-specific CD4- and CD8 T cells was observed in vaccinated mice shortly after challenge with influenza swine flu virus, which probably contributes to the strong inhibition of pulmonary viral replication observed. In addition, passive transfer of antisera raised in MVA-H1-Ca vaccinated immune-competent mice protected SCID mice from lethal challenge with the CA/07 wild-type virus.The non-replicating MVA-based H1N1 live vaccines induce a broad protective immune response and are promising vaccine candidates for pandemic influenza

Dictator Games: A Meta Study

Over the last 25 years, more than a hundred dictator game experiments have been published. This meta study summarizes the evidence. Exploiting the fact that most experiments had to fix parameters they did not intend to test, the meta study explores a rich set of control variables for multivariate analysis. It shows that Tobit models (assuming that dictators would even want to take money) and hurdle models (assuming that the decision to give a positive amount is separate from the choice of amount, conditional on giving) outperform mere meta-regression and OLS

Lokale Bildgebung der Prostata

In den letzten Jahren wurden neue Verfahren für die Bildgebung der Prostata entwickelt, um die Diagnostik des Prostatakarzinoms zu verbessern. Hierbei wurde v. a. der transrektale Ultraschall (TRUS) zum sog. „enhanced ultrasound weiterentwickelt. Die Elastographie zeigt in mehreren Studien gute Fähigkeiten, sowohl Karzinomherde in der Prostata zu identifizieren, als auch die Detektionsrate einer randomisierten Biopsie um bis zu 10¿% absolut zu verbessern. Der Kontrastmittelultraschall zeigt unterschiedliche Ergebnisse in den publizierten Studien, mit z. T. verbesserten Detektionsraten und z. T. unveränderten Detektionsraten im Vergleich zur randomisierten Biopsie. Das „online verfügbare ANNA/C-TRUS-System weist mit 6 gezielten Biopsien Detektionsraten auf, welche mit den publizierten Daten der randomisierten Sättigungsbiopsie vergleichbar sind. Direkte systematische Vergleiche zur randomisierten Biopsie stehen jedoch noch aus. Zum Histoscanningsystem ist aktuell die unzureichendste Datenlage verfügbar, denn es liegen noch keine Biopsiestudien vor. Multizentrische Studien sind für sämtliche Bildgebungsverfahren notwendig, um diese Verfahren in der klinischen Praxis als Standard zu etablieren. Recently several new technologies for prostate imaging have been developed. The aim of these technologies was to improve the diagnosis of prostate cancer. Especially the transrectal ultrasound (TRUS) has been refined to the so-called enhanced ultrasound, as regular grey scale TRUS has limited ability to identify cancer lesions in the prostate. In several studies elastography has shown good capability to identify cancer lesions in the prostate as well as to absolutely increase the detection rate of randomized biopsies by up to 10 %.. Contrast-enhanced ultrasound shows varying results in the published literature with increased detection rates on the one hand and unchanged detection rates relative to randomized biopsy on the other hand. The online available ANNA/C-TRUS system shows detection rates with six targeted biopsies that are comparable to the published detection rates of randomized saturation biopsies. Direct systematic comparison to randomized biopsies is missing. The Histoscanning system currently provides the poorest data as no biopsy studies are available. Multicenter trials are mandatory for all new imaging technologies in order to implement them as standard into clinical practice