Distral: Robust Multitask Reinforcement Learning

Most deep reinforcement learning algorithms are data inefficient in complex and rich environments, limiting their applicability to many scenarios. One direction for improving data efficiency is multitask learning with shared neural network parameters, where efficiency may be improved through transfer across related tasks. In practice, however, this is not usually observed, because gradients from different tasks can interfere negatively, making learning unstable and sometimes even less data efficient. Another issue is the different reward schemes between tasks, which can easily lead to one task dominating the learning of a shared model. We propose a new approach for joint training of multiple tasks, which we refer to as Distral (Distill & transfer learning). Instead of sharing parameters between the different workers, we propose to share a "distilled" policy that captures common behaviour across tasks. Each worker is trained to solve its own task while constrained to stay close to the shared policy, while the shared policy is trained by distillation to be the centroid of all task policies. Both aspects of the learning process are derived by optimizing a joint objective function. We show that our approach supports efficient transfer on complex 3D environments, outperforming several related methods. Moreover, the proposed learning process is more robust and more stable---attributes that are critical in deep reinforcement learning

Season of the year influences infection rates following total hip arthroplasty

To research the influence of season of the year on periprosthetic joint infections. METHODS We conducted a retrospective review of the entire Medicare files from 2005 to 2014. Seasons were classified as spring, summer, fall or winter. Regional variations were accounted for by dividing patients into four geographic regions as per the United States Census Bureau (Northeast, Midwest, West and South). Acute postoperative infection and deep periprosthetic infections within 90 d after surgery were tracked. RESULTS In all regions, winter had the highest incidence of periprosthetic infections (mean 0.98%, SD 0.1%) and was significantly higher than other seasons in the Midwest, South and West (P \u3c 0.05 for all) but not the Northeast (P = 0.358). Acute postoperative infection rates were more frequent in the summer and were significantly affected by season of the year in the West. CONCLUSION Season of the year is a risk factor for periprosthetic joint infection following total hip arthroplasty (THA). Understanding the influence of season on outcomes following THA is essential when risk-stratifying patients to optimize outcomes and reduce episode of care costs. © The Author(s) 2017

Which resource acquisition acts drive growth of informal firms? Evidence from Zambia

Purpose: The study seeks to differentiate informal firms with high-growth prospects by their resource acquisition acts and to improve identification of growth-oriented informal firms for effective design and targeting of support measures. Design/methodology/approach: An original set of firm-level data was collected using face-to-face survey in Lusaka, Zambia. Six clearly defined criteria were used to sample informal firms, apart from general informal business. Regression analyses were conducted to test the association of different resource acquisition acts with two growth dimensions: number of employees and business earnings of the 325 informal firms sampled. Findings: Accessing clientele beyond local market, linking up with formal businesses and acquiring information and knowledge via online sources were found influential to growth in business earnings. Surprising, acquisition of finance and skills showed no effect. Employment expansion, though widely used, may not be a stable indicator of informal firm growth. Research limitations/implications: The study highlights the relevance of the emerging entrepreneurship perspective to understanding the topic. It cautions against pre-setting a size threshold for sampling informal firms and against relying on employment expansion as the sole proxy of growth. Practical implications: The findings prompt a rethink of the effectiveness of conventional support programmes to drive growth of informal firms such as funding and training. Directing support measures to target growth-oriented informal firms will lead to creation of decent and sustainable jobs and formalisation. Originality/value: With an original firm-level dataset, the study challenges a long-held assumption that growth of informal firm is negligible and shows that segments of informal firms are sustainable and could attain significant growth and derives new insights into researching and supporting informal firm growth

Elevated glutamatergic compounds in pregenual anterior cingulate in pediatric autism spectrum disorder demonstrated by 1H MRS and 1H MRSI.

Recent research in autism spectrum disorder (ASD) has aroused interest in anterior cingulate cortex and in the neurometabolite glutamate. We report two studies of pregenual anterior cingulate cortex (pACC) in pediatric ASD. First, we acquired in vivo single-voxel proton magnetic resonance spectroscopy ((1)H MRS) in 8 children with ASD and 10 typically developing controls who were well matched for age, but with fewer males and higher IQ. In the ASD group in midline pACC, we found mean 17.7% elevation of glutamate + glutamine (Glx) (p<0.05) and 21.2% (p<0.001) decrement in creatine + phosphocreatine (Cr). We then performed a larger (26 subjects with ASD, 16 controls) follow-up study in samples now matched for age, gender, and IQ using proton magnetic resonance spectroscopic imaging ((1)H MRSI). Higher spatial resolution enabled bilateral pACC acquisition. Significant effects were restricted to right pACC where Glx (9.5%, p<0.05), Cr (6.7%, p<0.05), and N-acetyl-aspartate + N-acetyl-aspartyl-glutamate (10.2%, p<0.01) in the ASD sample were elevated above control. These two independent studies suggest hyperglutamatergia and other neurometabolic abnormalities in pACC in ASD, with possible right-lateralization. The hyperglutamatergic state may reflect an imbalance of excitation over inhibition in the brain as proposed in recent neurodevelopmental models of ASD

Hot Start PCR with heat-activatable primers: a novel approach for improved PCR performance

The polymerase chain reaction (PCR) is widely used for applications which require a high level of specificity and reliability, such as genetic testing, clinical diagnostics, blood screening, forensics and biodefense. Great improvements to PCR performance have been achieved by the use of Hot Start activation strategies that aim to prevent DNA polymerase extension until more stringent, higher temperatures are reached. Herein we present a novel Hot Start activation approach in PCR where primers contain one or two thermolabile, 4-oxo-1-pentyl (OXP) phosphotriester (PTE) modification groups at 3′-terminal and 3′-penultimate internucleotide linkages. Studies demonstrated that the presence of one or more OXP PTE modifications impaired DNA polymerase primer extension at the lower temperatures that exist prior to PCR amplification. Furthermore, incubation of the OXP-modified primers at elevated temperatures was found to produce the corresponding unmodified phosphodiester (PDE) primer, which was then a suitable DNA polymerase substrate. The OXP-modified primers were tested in conventional PCR with endpoint detection, in one-step reverse transcription (RT)–PCR and in real-time PCR with SYBR Green I dye and Taqman® probe detection. When OXP-modified primers were used as substitutes for unmodified PDE primers in PCR, significant improvement was observed in the specificity and efficiency of nucleic acid target amplification

A Novel DPYD Variant Associated With Severe Toxicity of Fluoropyrimidines: Role of Pre-emptive DPYD Genotype Screening

Background: The fluoropyrimidine anticancer drug, especially 5- fluorouracil (5-FU) and its prodrug capecitabine are still being the backbone of chemotherapeutic regimens for colorectal cancer. Dihydropyrimidine dehydrogenase (DPD) is the crucial enzyme in the catabolism of 5-FU. Over the past 30 years, there is substantial clinical evidence showing that DPD deficiency is strongly associated with severe and fatal fluoropyrimidine-induced toxicity.Patients and methods: A 49-year-old lady with resected stage III carcinoma of sigmoid colon was scheduled to have a course of 5-FU based adjuvant chemotherapy. She developed unexpected acute severe (grade 4) toxicity after the first cycle of chemotherapy. Genomic DNA was isolated from 3 ml peripheral blood cells for full sequencing of DPYD (the gene encoding DPD).Results: Exome sequencing confirmed that she is heterozygous for NM_000110.3: c.321+2T>C of the DPYD gene. To the best of our knowledge, this variant is a novel pathogenic splicing variant of the DPYD gene resulting in a non-functional allele. As she has a heterozygous genotype and considered having decreased DPD activity, we followed the international recommendation and restart chemotherapy with at least 50% reduction for 5-FU dose. We then titrated the 5-FU dose, and she tolerated the subsequent cycles of chemotherapy and completed the whole course of adjuvant chemotherapy.Conclusions: With a pre-emptive test on DPD deficiency before the administration of the fluoropyrimidine drugs, the aforementioned patient's life-threatening event could be avoided. This clinical utility has been confirmed by two recent large-scale studies and called for a drug label update

MOAP-1 Mediates Fas-Induced Apoptosis in Liver by Facilitating tBid Recruitment to Mitochondria

SummaryFas apoptotic signaling regulates diverse physiological processes. Acute activation of Fas signaling triggers massive apoptosis in liver. Upon Fas receptor stimulation, the BH3-only protein Bid is cleaved into the active form, tBid. Subsequent tBid recruitment to mitochondria, which is facilitated by its receptor MTCH2 at the outer mitochondrial membrane (OMM), is a critical step for commitment to apoptosis via the effector proteins Bax or Bak. MOAP-1 is a Bax-binding protein enriched at the OMM. Here, we show that MOAP-1-deficient mice are resistant to Fas-induced hepatocellular apoptosis and lethality. In the absence of MOAP-1, mitochondrial accumulation of tBid is markedly impaired. MOAP-1 binds to MTCH2, and this interaction appears necessary for MTCH2 to engage tBid. These findings reveal a role for MOAP-1 in Fas signaling in the liver by promoting MTCH2-mediated tBid recruitment to mitochondria