Training Curricula for Open Domain Answer Re-Ranking

In precision-oriented tasks like answer ranking, it is more important to rank many relevant answers highly than to retrieve all relevant answers. It follows that a good ranking strategy would be to learn how to identify the easiest correct answers first (i.e., assign a high ranking score to answers that have characteristics that usually indicate relevance, and a low ranking score to those with characteristics that do not), before incorporating more complex logic to handle difficult cases (e.g., semantic matching or reasoning). In this work, we apply this idea to the training of neural answer rankers using curriculum learning. We propose several heuristics to estimate the difficulty of a given training sample. We show that the proposed heuristics can be used to build a training curriculum that down-weights difficult samples early in the training process. As the training process progresses, our approach gradually shifts to weighting all samples equally, regardless of difficulty. We present a comprehensive evaluation of our proposed idea on three answer ranking datasets. Results show that our approach leads to superior performance of two leading neural ranking architectures, namely BERT and ConvKNRM, using both pointwise and pairwise losses. When applied to a BERT-based ranker, our method yields up to a 4% improvement in MRR and a 9% improvement in P@1 (compared to the model trained without a curriculum). This results in models that can achieve comparable performance to more expensive state-of-the-art techniques.Comment: Accepted at SIGIR 2020 (long

Metallicities of M Dwarf Planet Hosts from Spectral Synthesis

We present the first spectroscopic metallicities of three M dwarfs with known or candidate planetary mass companions. We have analyzed high resolution, high signal-to-noise spectra of these stars which we obtained at McDonald Observatory. Our analysis technique is based on spectral synthesis of atomic and molecular features using recently revised cool-star model atmospheres and spectrum synthesis code. The technique has been shown to yield results consistent with the analyses of solar-type stars and allows measurements of M dwarf [M/H] values to 0.12 dex precision. From our analysis, we find [M/H] = -0.12, -0.32, and -0.33 for GJ 876, GJ 436, and GJ 581 respectively. These three M dwarf planet hosts have sub-solar metallicities, a surprising departure from the trend observed in FGK-type stars. This study is the first part of our ongoing work to determine the metallicities of the M dwarfs included in the McDonald Observatory planet search program.Comment: 13 pages, 2 figures, accepted for publication in ApJ

Look Who's Talking Now: Implications of AV's Explanations on Driver's Trust, AV Preference, Anxiety and Mental Workload

Explanations given by automation are often used to promote automation adoption. However, it remains unclear whether explanations promote acceptance of automated vehicles (AVs). In this study, we conducted a within-subject experiment in a driving simulator with 32 participants, using four different conditions. The four conditions included: (1) no explanation, (2) explanation given before or (3) after the AV acted and (4) the option for the driver to approve or disapprove the AV's action after hearing the explanation. We examined four AV outcomes: trust, preference for AV, anxiety and mental workload. Results suggest that explanations provided before an AV acted were associated with higher trust in and preference for the AV, but there was no difference in anxiety and workload. These results have important implications for the adoption of AVs.Comment: 42 pages, 5 figures, 3 Table

The Counting of Generalized Polarizabilities

We demonstrate a concise method to enumerate the number of generalized polarizabilities---quantities characterizing the independent observables in singly-virtual Compton scattering---for a target particle of arbitrary spin s. By using crossing symmetry and J^{PC} conservation, we show that this number is (10s+1+delta_{s,0}).Comment: 10 pages, revtex4, no figures. Version to appear in Phys. Rev. D. Paper now divided into sections and clarifying comments added, but physics content unchange