Knowledge Prompts: Injecting World Knowledge into Language Models through Soft Prompts

Soft prompts have been recently proposed as a tool for adapting large frozen language models (LMs) to new tasks. In this work, we repurpose soft prompts to the task of injecting world knowledge into LMs. We introduce a method to train soft prompts via self-supervised learning on data from knowledge bases. The resulting soft knowledge prompts (KPs) are task independent and work as an external memory of the LMs. We perform qualitative and quantitative experiments and demonstrate that: (1) KPs can effectively model the structure of the training data; (2) KPs can be used to improve the performance of LMs in different knowledge intensive tasks

Stage-specific miRNAs regulate gene expression associated with growth, development and parasite-host interaction during the intra-mammalian migration of the zoonotic helminth parasite Fasciola hepatica

Abstract Background MiRNAs are small non-coding RNAs that post-transcriptionally regulate gene expression in organisms ranging from viruses to mammals. There is great relevance in understanding how miRNAs regulate genes involved in the growth, development, and maturation of the many parasitic worms (helminths) that together afflict more than 2 billion people. Results Here, we describe the miRNAs expressed by each of the predominant intra-mammalian development stages of Fasciola hepatica, a foodborne flatworm that infects a wide range of mammals worldwide, most importantly humans and their livestock. A total of 124 miRNAs were profiled, 72 of which had been previously reported and three of which were conserved miRNA sequences described here for the first time. The remaining 49 miRNAs were novel sequences of which, 31 were conserved with F. gigantica and the remaining 18 were specific to F. hepatica. The newly excysted juveniles express 22 unique miRNAs while the immature liver and mature bile duct stages each express 16 unique miRNAs. We discovered several sequence variant miRNAs (IsomiRs) as well as miRNA clusters that exhibit strict temporal expression paralleling parasite development. Target analysis revealed the close association between miRNA expression and stage-specific changes in the transcriptome; for example, we identified specific miRNAs that target parasite proteases known to be essential for intestinal wall penetration (cathepsin L3). Moreover, we demonstrate that miRNAs fine-tune the expression of genes involved in the metabolic pathways that allow the parasites to move from an aerobic external environment to the anerobic environment of the host. Conclusions These results provide novel insight into the regulation of helminth parasite development and identifies new genes and miRNAs for therapeutic development to limit the virulence and pathogenesis caused by F. hepatica. </jats:sec

Exploring the utility of circulating miRNAs as diagnostic biomarkers of fasciolosis.

Effective management and control of parasitic infections on farms depends on their early detection. Traditional serological diagnostic methods for Fasciola hepatica infection in livestock are specific and sensitive, but currently the earliest detection of the parasite only occurs at approximately three weeks post-infection. At this timepoint, parasites have already entered the liver and caused the tissue damage and immunopathology that results in reduced body weight and loss in productivity. Here, we investigated whether the differential abundance of micro(mi)miRNAs in sera of F. hepatica-infected sheep has potential as a tool for the early diagnosis of infection. Using miRNA sequencing analysis, we discovered specific profiles of sheep miRNAs at both the pre-hepatic and hepatic infection phases in comparison to non-infected sheep. In addition, six F. hepatica-derived miRNAs were specifically identified in sera from infected sheep. Thus, a panel of differentially expressed miRNAs comprising four sheep (miR-3231-3p; miR133-5p; 3957-5p; 1197-3p) and two parasite miRNAs (miR-124-3p; miR-Novel-11-5p) were selected as potential biomarkers. The expression of these candidates in sera samples from longitudinal sheep infection studies collected between 7 days and 23 weeks was quantified using RT-qPCR and compared to samples from age-matched non-infected sheep. We identified oar-miR-133-5p and oar-miR-3957-5p as promising biomarkers of fasciolosis, detecting infection as early as 7 days. The differential expression of the other selected miRNAs was not sufficient to diagnose infection; however, our analysis found that the most abundant forms of fhe-miR-124-3p in sera were sequence variants (IsomiRs) of the canonical miRNA, highlighting the critical importance of primer design for accurate diagnostic RT-qPCR. Accordingly, this investigative study suggests that certain miRNAs are biomarkers of F. hepatica infection and validates miRNA-based diagnostics for the detection of fasciolosis in sheep

Disparate contributions of the Fanconi anemia pathway and homologous recombination in preventing spontaneous mutagenesis

Fanconi anemia (FA) is a chromosomal instability disorder in which DNA-damage processing defects are reported for translesion synthesis (TLS), non-homologous end joining (NHEJ) and homologous recombination (HR; both increased and decreased). To reconcile these diverse findings, we compared spontaneous mutagenesis in FA and HR mutants of hamster CHO cells. In the fancg mutant we find a reduced mutation rate accompanied by an increased proportion of deletions within the hprt gene. Moreover, in fancg cells gene amplification at the CAD and dhfr loci is elevated, another manifestation of inappropriate processing of damage during DNA replication. In contrast, the rad51d HR mutant has a greatly elevated rate of hprt mutations, >85% of which are deletions. Our analysis supports the concept that HR faithfully restores broken replication forks, whereas the FA pathway acts more globally to ensure chromosome stability by promoting efficient end joining of replication-derived breaks, as well as TLS and HR

PaLM 2 Technical Report

We introduce PaLM 2, a new state-of-the-art language model that has better multilingual and reasoning capabilities and is more compute-efficient than its predecessor PaLM. PaLM 2 is a Transformer-based model trained using a mixture of objectives. Through extensive evaluations on English and multilingual language, and reasoning tasks, we demonstrate that PaLM 2 has significantly improved quality on downstream tasks across different model sizes, while simultaneously exhibiting faster and more efficient inference compared to PaLM. This improved efficiency enables broader deployment while also allowing the model to respond faster, for a more natural pace of interaction. PaLM 2 demonstrates robust reasoning capabilities exemplified by large improvements over PaLM on BIG-Bench and other reasoning tasks. PaLM 2 exhibits stable performance on a suite of responsible AI evaluations, and enables inference-time control over toxicity without additional overhead or impact on other capabilities. Overall, PaLM 2 achieves state-of-the-art performance across a diverse set of tasks and capabilities. When discussing the PaLM 2 family, it is important to distinguish between pre-trained models (of various sizes), fine-tuned variants of these models, and the user-facing products that use these models. In particular, user-facing products typically include additional pre- and post-processing steps. Additionally, the underlying models may evolve over time. Therefore, one should not expect the performance of user-facing products to exactly match the results reported in this report

Safety and efficacy of fluoxetine on functional outcome after acute stroke (AFFINITY): a randomised, double-blind, placebo-controlled trial

Background Trials of fluoxetine for recovery after stroke report conflicting results. The Assessment oF FluoxetINe In sTroke recoverY (AFFINITY) trial aimed to show if daily oral fluoxetine for 6 months after stroke improves functional outcome in an ethnically diverse population. Methods AFFINITY was a randomised, parallel-group, double-blind, placebo-controlled trial done in 43 hospital stroke units in Australia (n=29), New Zealand (four), and Vietnam (ten). Eligible patients were adults (aged ≥18 years) with a clinical diagnosis of acute stroke in the previous 2–15 days, brain imaging consistent with ischaemic or haemorrhagic stroke, and a persisting neurological deficit that produced a modified Rankin Scale (mRS) score of 1 or more. Patients were randomly assigned 1:1 via a web-based system using a minimisation algorithm to once daily, oral fluoxetine 20 mg capsules or matching placebo for 6 months. Patients, carers, investigators, and outcome assessors were masked to the treatment allocation. The primary outcome was functional status, measured by the mRS, at 6 months. The primary analysis was an ordinal logistic regression of the mRS at 6 months, adjusted for minimisation variables. Primary and safety analyses were done according to the patient's treatment allocation. The trial is registered with the Australian New Zealand Clinical Trials Registry, ACTRN12611000774921. Findings Between Jan 11, 2013, and June 30, 2019, 1280 patients were recruited in Australia (n=532), New Zealand (n=42), and Vietnam (n=706), of whom 642 were randomly assigned to fluoxetine and 638 were randomly assigned to placebo. Mean duration of trial treatment was 167 days (SD 48·1). At 6 months, mRS data were available in 624 (97%) patients in the fluoxetine group and 632 (99%) in the placebo group. The distribution of mRS categories was similar in the fluoxetine and placebo groups (adjusted common odds ratio 0·94, 95% CI 0·76–1·15; p=0·53). Compared with patients in the placebo group, patients in the fluoxetine group had more falls (20 [3%] vs seven [1%]; p=0·018), bone fractures (19 [3%] vs six [1%]; p=0·014), and epileptic seizures (ten [2%] vs two [<1%]; p=0·038) at 6 months. Interpretation Oral fluoxetine 20 mg daily for 6 months after acute stroke did not improve functional outcome and increased the risk of falls, bone fractures, and epileptic seizures. These results do not support the use of fluoxetine to improve functional outcome after stroke

Size-independent versus size-dependent policies in scheduling heavy-tailed distributions

Thesis (M. Eng.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2008.This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections.Includes bibliographical references (p. 47-48).We study the problem of scheduling jobs on a two-machine distributed server, where the job size distribution is heavy-tailed. We focus on two distributions, for which we prove that the performance of the optimal size-independent policy is asymptotically worse than that of a simple size-dependent policy. First, we consider a simple distribution where incoming jobs can only be of two possible sizes. The motivation is that with two largely different sizes, the simple distribution captures the important aspects of a heavy tail. Second, we extend to a bounded Pareto distribution, which has an actual heavy tail. For both cases, we analyze the performance with regards to slowdown (waiting time divided by job size) for several size-independent and size-dependent policies. We see that the size-dependent policies perform better, and then go on to prove that even the best size-independent policy cannot achieve the same performance. We conclude that as we increase the variance of our job size distribution, the gap between size-independent and size-dependent policies grows.by John Nham.M.Eng

Disparate contributions of the Fanconi anemia

pathway and homologous recombination in preventing spontaneous mutagenesi