BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models

We show that with small-to-medium training data, fine-tuning only the bias terms (or a subset of the bias terms) of pre-trained BERT models is competitive with (and sometimes better than) fine-tuning the entire model. For larger data, bias-only fine-tuning is competitive with other sparse fine-tuning methods. Besides their practical utility, these findings are relevant for the question of understanding the commonly-used process of finetuning: they support the hypothesis that finetuning is mainly about exposing knowledge induced by language-modeling training, rather than learning new task-specific linguistic knowledge

Studies of multiple stellar systems - IV. The triple-lined spectroscopic system Gliese 644

We present a radial-velocity study of the triple-lined system Gliese 644 and derive spectroscopic elements for the inner and outer orbits with periods of 2.9655 and 627 days. We also utilize old visual data, as well as modern speckle and adaptive optics observations, to derive a new astrometric solution for the outer orbit. These two orbits together allow us to derive masses for each of the three components in the system: M_A = 0.410 +/- 0.028 (6.9%), M_Ba = 0.336 +/- 0.016 (4.7%), and $M_Bb = 0.304 +/- 0.014 (4.7%) M_solar. We suggest that the relative inclination of the two orbits is very small. Our individual masses and spectroscopic light ratios for the three M stars in the Gliese 644 system provide three points for the mass-luminosity relation near the bottom of the Main Sequence, where the relation is poorly determined. These three points agree well with theoretical models for solar metallicity and an age of 5 Gyr. Our radial velocities for Gliese 643 and vB 8, two common-proper-motion companions of Gliese 644, support the interpretation that all five M stars are moving together in a physically bound group. We discuss possible scenarios for the formation and evolution of this configuration, such as the formation of all five stars in a sequence of fragmentation events leading directly to the hierarchical configuration now observed, versus formation in a small N cluster with subsequent dynamical evolution into the present hierarchical configuration.Comment: 17 pages, 9 figures, Accepted for publication in MNRA

IR Detection of Low-Mass Secondaries in Spectroscopic Binaries

This paper outlines an infrared spectroscopic technique to measure the radial velocities of faint secondaries in known single-lined binaries. The paper presents our H-band observations with the CSHELL and Phoenix spectrographs and describes detections of three low-mass secondaries in main-sequence binaries: G147-36, G164-67, and HD144284 with mass ratios of 0.562+-0.011, 0.423+-0.042, and 0.380+-0.013, respectively. The latter is one of the smallest mass ratios derived to date

FTS and 2-DG induce pancreatic cancer cell death and tumor shrinkage in mice

The Ras inhibitor S-trans-trans farnesylthiosalicylic acid (FTS) inhibits active Ras, which controls cell proliferation, differentiation, survival, and metabolism. FTS also inhibits HIF1α expression in cancer cells, leading to an energy crisis. The synthetic glucose analog 2-deoxy-D-glucose (2-DG), which inhibits glycolysis, is selectively directed to tumor cells that exhibit increased glucose consumption. The 2-DG enters tumor cells, where it competes with glucose for glycolytic enzymes. In cancer models, as well as in human phase 1 trials, 2-DG inhibits tumor growth without toxicity. We postulated that under normoxic conditions, tumor cells treated with FTS would be more sensitive than normal cells to 2-DG. We show here that combined treatment with FTS and 2-DG inhibited cancer cell proliferation additively, yet induced apoptotic cell death synergistically both in vitro and in vivo. The induced apoptosis was inferred from QVD-OPH inhibition, an increase in cleaved caspase 3, and loss of survivin. FTS and 2-DG when combined, but not separately, also induced an increase in fibrosis of the tumor tissue, chronic inflammation, and tumor shrinkage. Overall, these results suggest a possible new treatment of pancreatic tumors by the combined administration of FTS and 2-DG, which together induce pancreatic tumor cell death and tumor shrinkage under non-toxic conditions

Interventions for preventing oral mucositis for patients with cancer receiving treatment

Interventions for preventing oral mucositis for patients with cancer receiving treatmentTreatment for cancer (including bone marrow transplant) can cause oral mucositis (severe ulcers in the mouth). This painful condition can cause difficulties in eating, drinking and swallowing, and may also be associated with infections which may require the patient to stay longer in hospital. Different strategies are used to try and prevent this condition, and the review of trials found that some of these are effective. Two interventions, cryotherapy (ice chips) and keratinocyte growth factor (palifermin®) showed some benefit in preventing mucositis. Sucralfate is effective in reducing the severity of mucositis, and a further seven interventions, aloe vera, amifostine, intravenous glutamine, granulocyte‐colony stimulating factor (G‐CSF), honey, laser and antibiotic lozenges containing polymixin/tobramycin/amphotericin (PTA) showed weaker evidence of benefit. These were evaluated in patients with different types of cancer, undergoing different types of cancer treatment. Benefits may be restricted to the disease and treatment combinations evaluated

Germline HOXB13 mutations p.G84E and p.R217C do not confer an increased breast cancer risk

In breast cancer, high levels of homeobox protein Hox-B13 (HOXB13) have been associated with disease progression of ER-positive breast cancer patients and resistance to tamoxifen treatment. Since HOXB13 p.G84E is a prostate cancer risk allele, we evaluated the association between HOXB13 germline mutations and breast cancer risk in a previous study consisting of 3,270 familial non-BRCA1/2 breast cancer cases and 2,327 controls from the Netherlands. Although both recurrent HOXB13 mutations p.G84E and p.R217C were not associated with breast cancer risk, the risk estimation for p.R217C was not very precise. To provide more conclusive evidence regarding the role of HOXB13 in breast cancer susceptibility, we here evaluated the association between HOXB13 mutations and increased breast cancer risk within 81 studies of the international Breast Cancer Association Consortium containing 68,521 invasive breast cancer patients and 54,865 controls. Both HOXB13 p.G84E and p.R217C did not associate with the development of breast cancer in European women, neither in the overall analysis (OR = 1.035, 95% CI = 0.859-1.246, P = 0.718 and OR = 0.798, 95% CI = 0.482-1.322, P = 0.381 respectively), nor in specific high-risk subgroups or breast cancer subtypes. Thus, although involved in breast cancer progression, HOXB13 is not a material breast cancer susceptibility gene.Peer reviewe

Germline HOXB13 mutations p.G84E and p.R217C do not confer an increased breast cancer risk

Abstract: In breast cancer, high levels of homeobox protein Hox-B13 (HOXB13) have been associated with disease progression of ER-positive breast cancer patients and resistance to tamoxifen treatment. Since HOXB13 p.G84E is a prostate cancer risk allele, we evaluated the association between HOXB13 germline mutations and breast cancer risk in a previous study consisting of 3,270 familial non-BRCA1/2 breast cancer cases and 2,327 controls from the Netherlands. Although both recurrent HOXB13 mutations p.G84E and p.R217C were not associated with breast cancer risk, the risk estimation for p.R217C was not very precise. To provide more conclusive evidence regarding the role of HOXB13 in breast cancer susceptibility, we here evaluated the association between HOXB13 mutations and increased breast cancer risk within 81 studies of the international Breast Cancer Association Consortium containing 68,521 invasive breast cancer patients and 54,865 controls. Both HOXB13 p.G84E and p.R217C did not associate with the development of breast cancer in European women, neither in the overall analysis (OR = 1.035, 95% CI = 0.859–1.246, P = 0.718 and OR = 0.798, 95% CI = 0.482–1.322, P = 0.381 respectively), nor in specific high-risk subgroups or breast cancer subtypes. Thus, although involved in breast cancer progression, HOXB13 is not a material breast cancer susceptibility gene

Vaccines for preventing typhoid fever (Review)

Background Typhoid fever and paratyphoid fever continue to be important causes of illness and death, particularly among children and adolescents in south-central and southeast Asia. Two typhoid vaccines are commercially available, Ty21a (oral) and Vi polysaccharide (parenteral), but neither is used routinely. Other vaccines, such as a new, modified, conjugated Vi vaccine called Vi-rEPA, are in development. Objectives To evaluate the efficacy and adverse effects of vaccines used to prevent typhoid fever. Search methods In June 2013, we searched the Cochrane Infectious Diseases Group Specialized Register, CENTRAL, MEDLINE, EMBASE, LILACS, and mRCT. We also searched relevant conference proceedings up to 2013 and scanned the reference lists of all included trials. Selection criteria Randomized and quasi-randomized controlled trials (RCTs) comparing typhoid fever vaccines with other typhoid fever vaccines or with an inactive agent (placebo or vaccine for a different disease). Data collection and analysis Two review authors independently applied inclusion criteria and extracted data. We computed vaccine efficacy per year of follow-up and cumulative three-year efficacy, stratifying for vaccine type and dose. The outcome addressed was typhoid fever, defined as isolation of Salmonella typhi in blood. We calculated risk ratios (RRs) and efficacy (1-RR as a percentage) with 95% confidence intervals (CIs). Main results In total, 18 RCTs were included in this review; 12 evaluated efficacy (Ty21a: five trials; Vi polysaccharide: six trials; Vi-rEPA: one trial), and 11 reported on adverse events. Ty21a vaccine (oral vaccine, three doses) A three-dose schedule of Ty21a vaccine prevents around one-third to one-half of typhoid cases in the first two years after vaccination (Year 1: 35%, 95% CI 8% to 54%; Year 2: 58%, 95% CI 40% to 71%; one trial, 20,543 participants; moderate quality evidence; data taken from a single trial conducted in Indonesia in the 1980s). No benefit was detected in the third year after vaccination. Four additional cluster-RCTs have been conducted, but the study authors did not adjust for clustering. Compared with placebo, this vaccine was not associated with more participants with vomiting, diarrhoea, nausea or abdominal pain (four trials, 2066 participants; moderate quality evidence) headache, or rash (two trials, 1190 participants; moderate quality evidence); however, fever (four trials, 2066 participants; moderate quality evidence) was more common in the vaccine group. Vi polysaccharide vaccine (injection, one dose) A single dose of Vi polysaccharide vaccine prevents around two-thirds of typhoid cases in the first year after vaccination (Year 1: 69%, 95% CI 63% to 74%; three trials, 99,979 participants; high quality evidence). In Year 2, the trial results were more variable, with the vaccine preventing between 45% and 69% of typhoid cases (Year 2: 59%, 95% CI 45% to 69%; four trials, 194,969 participants; moderate quality evidence). The three-year cumulative efficacy of the vaccine is around 55% (95% CI 30% to 70%; 11,384 participants, one trial; moderate quality evidence). These data are taken from a single trial in South Africa in the 1980s. Compared with placebo, this vaccine was not associated with more participants with fever (four trials, 133,038 participants; moderate quality evidence) or erythema (three trials, 132,261 participants; low quality evidence); however, swelling (three trials, 1767 participants; moderate quality evidence) and pain at the injection site (one trial, 667 participants; moderate quality evidence) were more common in the vaccine group. Vi-rEPA vaccine (two doses) Administration of two doses of the Vi-rEPA vaccine prevents between 50% and 96% of typhoid cases during the first two years after vaccination (Year 1: 94%, 95% CI 75% to 99%; Year 2: 87%, 95% CI 56% to 96%; one trial, 12,008 participants; moderate quality evidence). These data are taken from a single trial with children 2 to 5 years of age conducted in Vietnam. Compared with placebo, the first and second doses of this vaccine were not associated with increased risk of adverse events. The first dose of this vaccine was not associated with fever (2 studies, 12,209 participants; low quality evidence), erythema (two trials, 12,209 participants; moderate quality evidence) or swelling at the injection site (two trials, 12,209 participants; moderate quality evidence). The second dose of this vaccine was not associated with fever (two trials, 11,286 participants; low quality evidence), erythema (two trials, 11,286 participants; moderate quality evidence) and swelling at the injection site (two trials, 11,286 participants; moderate quality evidence). Authors' conclusions The licensed Ty21a and Vi polysaccharide vaccines are efficacious. The new and unlicensed Vi-rEPA vaccine is as efficacious and may confer longer immunity