Beyond Contrastive Learning: A Variational Generative Model for Multilingual Retrieval

Contrastive learning has been successfully used for retrieval of semantically aligned sentences, but it often requires large batch sizes or careful engineering to work well. In this paper, we instead propose a generative model for learning multilingual text embeddings which can be used to retrieve or score sentence pairs. Our model operates on parallel data in $N$ languages and, through an approximation we introduce, efficiently encourages source separation in this multilingual setting, separating semantic information that is shared between translations from stylistic or language-specific variation. We show careful large-scale comparisons between contrastive and generation-based approaches for learning multilingual text embeddings, a comparison that has not been done to the best of our knowledge despite the popularity of these approaches. We evaluate this method on a suite of tasks including semantic similarity, bitext mining, and cross-lingual question retrieval -- the last of which we introduce in this paper. Overall, our Variational Multilingual Source-Separation Transformer (VMSST) model outperforms both a strong contrastive and generative baseline on these tasks.Comment: Published as a long paper at ACL 202

BREEDING BEHAVIOR OF THE GRAY-BREASTED FLYCATCHER (LATHROTRICCUS GRISEIPECTUS) IN SOUTHWESTERN ECUADOR

Abstract ∙ Little is known about the nesting behavior of the Gray-breasted Flycatcher (Lathrotriccus griseipectus), a species listed as Vulnerable by the International Union for Conservation of Nature. In order to add fundamental information on the life history of this species, we recorded parental behavior at a nest in February–March 2010 in the Jorupe Reserve in southwestern Ecuador. Recordings were made on a tripod-mounted video camera and took place during part of the incubation and nestling stages. Both adults provisioned nestlings. We recorded 7.1 feeds per nestling-hour, with the highest average provisioning rates occurring from 12:00–13:00 h. Nestlings produced an average of 0.8 fecal sacs per nestling-hour. Nestlings fledged in quick succession shortly before 12:00 h on nestling-day 14.Resumen ∙ El cuidado parental del Mosquero Pechigrís (Lathrotriccus griseipectus) en el suroeste del Ecuador La biología reproductiva del Mosquero Pechigrís (Lathrotriccus griseipectus), una especie catalogada como “Vulnerable” por la Unión Internacional para la Conservación de la Naturaleza, es poco conocida. Con el fin de añadir datos básicos sobre la historia de vida del Mosquero Pechigrís, utilizamos una cámara de video para realizar observaciones de un nido ubicado en la Reserva Jorupe en el suroeste de Ecuador, entre febrero y marzo de 2010. Las grabaciones tuvieron lugar durante parte de las etapas de incubación y polluelo. Ambos adultos aprovisionaron polluelos. Registramos 7.1 alimentaciones de polluelo por hora, siendo las tasas de aprovisionamiento más altas de 12:00–13:00 h. Los polluelos produjeron un promedio de 0.8 sacos fecales por hora y polluelo. Los polluelos emplumaron en rápida sucesión poco antes del mediodía 14 días luego de la eclosión

Spitzer Space Telescope Mid-IR Light Curves of Neptune

We have used the Spitzer Space Telescope in 2016 February to obtain high cadence, high signal-to-noise, 17 hr duration light curves of Neptune at 3.6 and 4.5 μm. The light curve duration was chosen to correspond to the rotation period of Neptune. Both light curves are slowly varying with time, with full amplitudes of 1.1 mag at 3.6 μm and 0.6 mag at 4.5 μm. We have also extracted sparsely sampled 18 hr light curves of Neptune at W1 (3.4 μm) and W2 (4.6 μm) from the Wide-feld Infrared Survey Explorer (WISE)/NEOWISE archive at six epochs in 2010–2015. These light curves all show similar shapes and amplitudes compared to the Spitzer light curves but with considerable variation from epoch to epoch. These amplitudes are much larger than those observed with Kepler/K2 in the visible (amplitude ~0.02 mag) or at 845 nm with the Hubble Space Telescope (HST) in 2015 and at 763 nm in 2016 (amplitude ~0.2 mag). We interpret the Spitzer and WISE light curves as arising entirely from reflected solar photons, from higher levels in Neptune's atmosphere than for K2. Methane gas is the dominant opacity source in Neptune's atmosphere, and methane absorption bands are present in the HST 763 and 845 nm, WISE W1, and Spitzer 3.6 μm filters

Possible role of human herpesvirus 8 in the lymphoproliferative disorders in common variable immunodeficiency

Patients who have common variable immunodeficiency (CVID) and granulomatous/lymphocytic interstitial lung disease (GLILD) are at high risk for early mortality and B cell lymphomas. Infection with human herpes virus type 8 (HHV8), a B cell lymphotrophic virus, is linked to lymphoproliferative disorders in people who have secondary immunodeficiencies. Therefore, we determined the prevalence of HHV8 infection in CVID patients with GLILD. Genomic DNA isolated from peripheral blood mononuclear cells was screened by nested- and real time-quantitative PCR (QRT-PCR) for the presence of HHV8 genome. It was positive in 6/9 CVID patients with GLILD (CVID-GLILD), 1/21 CVID patients without GLILD (CVID-control), and no patients receiving intravenous gamma globulin (n = 13) or normal blood donors (n = 20). Immunohistochemistry (IHC) demonstrated expression of the latency-associated nuclear antigen-1 (LANA-1) in the biopsies of the lung, liver, and bone marrow of four patients with CVID-GLILD. One CVID-GLILD patient developed a B cell lymphoma during the course of the study. QRT-PCR demonstrated high copy number of HHV8 genome and IHC showed diffuse staining for LANA-1 in the malignant lymph node. HHV8 infection may be an important factor in the pathogenesis of the interstitial lung disease and lymphoproliferative disorders in patients with CVID

The First Definitive Binary Orbit Determined with the Hubble Space Telescope Fine Guidance Sensors: Wolf 1062 (Gliese 748)

The M dwarf binary, Wolf 1062 (Gliese 748), has been observed with the Hubble Space Telescope (HST) Fine Guidance Sensor 3 in the transfer function scan mode to determine the apparent orbit. This is the first orbit defined fully and exclusively with HST, and is the most accurate definitive orbit for any resolved, noneclipsing system. The orbital period is 2.4490 ± 0.0119 yr and the semimajor axis is 01470 ± 00007—both quantities are now known to better than 1%. Using the weighted mean of seven parallax measurements and these HST data, we find the system mass to be 0.543 ± 0.031 M⊙, where the error of 6% is due almost entirely to the parallax error. An estimated fractional mass from the infrared brightness ratio and infrared mass-luminosity relation yields a mass for the primary of 0.37 M⊙, and the secondary falls in the regime of very low mass stars, with a mass of only 0.17 M⊙

The SDSS-III Baryon Oscillation Spectroscopic Survey: Quasar Target Selection for Data Release Nine

The SDSS-III Baryon Oscillation Spectroscopic Survey (BOSS), a five-year spectroscopic survey of 10,000 deg^2, achieved first light in late 2009. One of the key goals of BOSS is to measure the signature of baryon acoustic oscillations in the distribution of Ly-alpha absorption from the spectra of a sample of ~150,000 z>2.2 quasars. Along with measuring the angular diameter distance at z\approx2.5, BOSS will provide the first direct measurement of the expansion rate of the Universe at z > 2. One of the biggest challenges in achieving this goal is an efficient target selection algorithm for quasars over 2.2 < z < 3.5, where their colors overlap those of stars. During the first year of the BOSS survey, quasar target selection methods were developed and tested to meet the requirement of delivering at least 15 quasars deg^-2 in this redshift range, out of 40 targets deg^-2. To achieve these surface densities, the magnitude limit of the quasar targets was set at g <= 22.0 or r<=21.85. While detection of the BAO signature in the Ly-alpha absorption in quasar spectra does not require a uniform target selection, many other astrophysical studies do. We therefore defined a uniformly-selected subsample of 20 targets deg^-2, for which the selection efficiency is just over 50%. This "CORE" subsample will be fixed for Years Two through Five of the survey. In this paper we describe the evolution and implementation of the BOSS quasar target selection algorithms during the first two years of BOSS operations. We analyze the spectra obtained during the first year. 11,263 new z>2.2 quasars were spectroscopically confirmed by BOSS. Our current algorithms select an average of 15 z > 2.2 quasars deg^-2 from 40 targets deg^-2 using single-epoch SDSS imaging. Multi-epoch optical data and data at other wavelengths can further improve the efficiency and completeness of BOSS quasar target selection. [Abridged]Comment: 33 pages, 26 figures, 12 tables and a whole bunch of quasars. Submitted to Ap

The Science Case for an Extended Spitzer Mission

Although the final observations of the Spitzer Warm Mission are currently scheduled for March 2019, it can continue operations through the end of the decade with no loss of photometric precision. As we will show, there is a strong science case for extending the current Warm Mission to December 2020. Spitzer has already made major impacts in the fields of exoplanets (including microlensing events), characterizing near Earth objects, enhancing our knowledge of nearby stars and brown dwarfs, understanding the properties and structure of our Milky Way galaxy, and deep wide-field extragalactic surveys to study galaxy birth and evolution. By extending Spitzer through 2020, it can continue to make ground-breaking discoveries in those fields, and provide crucial support to the NASA flagship missions JWST and WFIRST, as well as the upcoming TESS mission, and it will complement ground-based observations by LSST and the new large telescopes of the next decade. This scientific program addresses NASA's Science Mission Directive's objectives in astrophysics, which include discovering how the universe works, exploring how it began and evolved, and searching for life on planets around other stars.Comment: 75 pages. See page 3 for Table of Contents and page 4 for Executive Summar

Felony Murder and Capital Punishment: an Examination of the Deterrence Question

A proper test of the deterrent effect of the death penalty must consider capital homicides. However, the criterion variable in most investigations has been total homicides—most of which bear no legal or theoretical relationship to capital punishment. To address this fundamental data problem, this investigation used Federal Bureau of Investigation data for 1976–1987 to examine the relationship between capital punishment and felony murder, the most common type of capital homicide. We conducted time series analyses of monthly felony murder rates, the frequency of executions, and the amount and type of television coverage of executions over the period. The analyses revealed occasional departures (for vehicle theft and narcotics killings) from the null hypotheses. However, on balance, and in line with the vast majority of capital punishment studies, this investigation found no consistent evidence that executions and the television coverage they receive are associated significantly with rates for total, index, or different types of felony murder

WISEA J041451.67–585456.7 and WISEA J181006.18–101000.5: The First Extreme T-type Subdwarfs?

We present the discoveries of WISEA J041451.67−585456.7 and WISEA J181006.18−101000.5, two low-temperature (1200–1400 K), high proper motion T-type subdwarfs. Both objects were discovered via their high proper motion (>0".5 yr⁻¹); WISEA J181006.18−101000.5 as part of the NEOWISE proper motion survey and WISEA J041451.67−585456.7 as part of the citizen science project Backyard Worlds; Planet 9. We have confirmed both as brown dwarfs with follow-up near-infrared spectroscopy. Their spectra and near-infrared colors are unique among known brown dwarfs, with some colors consistent with L-type brown dwarfs and other colors resembling those of the latest-type T dwarfs. While no forward model consistently reproduces the features seen in their near-infrared spectra, the closest matches suggest very low metallicities ([Fe/H] ⩽ −1), making these objects likely the first examples of extreme subdwarfs of the T spectral class (esdT). WISEA J041451.67−585456.7 and WISEA J181006.18−101000.5 are found to be part of a small population of objects that occupy the "substellar transition zone," and have the lowest masses and effective temperatures of all objects in this group