37 research outputs found
Evaluating and Improving the Coreference Capabilities of Machine Translation Models
Machine translation (MT) requires a wide range of linguistic capabilities,
which current end-to-end models are expected to learn implicitly by observing
aligned sentences in bilingual corpora. In this work, we ask: \emph{How well do
MT models learn coreference resolution from implicit signal?} To answer this
question, we develop an evaluation methodology that derives coreference
clusters from MT output and evaluates them without requiring annotations in the
target language. We further evaluate several prominent open-source and
commercial MT systems, translating from English to six target languages, and
compare them to state-of-the-art coreference resolvers on three challenging
benchmarks. Our results show that the monolingual resolvers greatly outperform
MT models. Motivated by this result, we experiment with different methods for
incorporating the output of coreference resolution models in MT, showing
improvement over strong baselines.Comment: EACL pape
Controlling Clusters of Colloidal Platelets:The Effects of Edge and Face Surface Chemistries on the Behaviour of Montmorillonite Suspensions
Integration of new biological and physical retrospective dosimetry methods into EU emergency response plans : joint RENEB and EURADOS inter-laboratory comparisons
Purpose: RENEB, 'Realising the European Network of Biodosimetry and Physical Retrospective Dosimetry,' is a network for research and emergency response mutual assistance in biodosimetry within the EU. Within this extremely active network, a number of new dosimetry methods have recently been proposed or developed. There is a requirement to test and/or validate these candidate techniques and inter-comparison exercises are a well-established method for such validation.
Materials and methods: The authors present details of inter-comparisons of four such new methods: dicentric chromosome analysis including telomere and centromere staining; the gene expression assay carried out in whole blood; Raman spectroscopy on blood lymphocytes, and detection of radiation induced thermoluminescent signals in glass screens taken from mobile phones.
Results: In general the results show good agreement between the laboratories and methods within the expected levels of uncertainty, and thus demonstrate that there is a lot of potential for each of the candidate techniques.
Conclusions: Further work is required before the new methods can be included within the suite of reliable dosimetry methods for use by RENEB partners and others in routine and emergency response scenarios
Estilos de pensamiento sociolĂłgico: sociologĂas, epistemologĂas y la bĂşsqueda de la verdad en MĂ©xico y Estados Unidos
DS1_ST_10.1177_0735275118759697 – Supplemental material for The Love of Neuroscience: A Sociological Account
<p>Supplemental material, DS1_ST_10.1177_0735275118759697 for The Love of Neuroscience: A Sociological Account by Gabriel Abend in Sociological Theory</p
Estilos de pensamiento sociolĂłgico: sociologĂas, epistemologĂas y la bĂşsqueda de la verdad en MĂ©xico y Estados Unidos
Estilos de pensamiento sociolĂłgico : sociologĂas, epistemologĂas y la bĂşsqueda de la verdad en MĂ©xico y Estados Unidos
Recommended from our members
A Nurse is Blue and Elephant is Rugby: Cross Domain Alignment in Large Language Models Reveal Human-like Patterns
Cross-domain alignment refers to the task of mapping a concept from one domain to another, for example, ``If a \textit{doctor} were a \textit{color}, what color would it be?''. This seemingly peculiar task was designed to investigate how people represent concrete and abstract concepts through their mappings between categories and their reasoning processes over those mappings. In this paper, we adapt this task from cognitive science to evaluate the conceptualization and reasoning abilities of large language models (LLMs) through a behavioral study. We examine several LLMs by prompting them with a cross-domain mapping task and analyzing their responses at the population level and the individual level. Additionally, we assess the models' ability to reason about their predictions by analyzing and categorizing their explanations for these mappings. The results reveal several similarities between humans' and models' mappings and explanations, suggesting that models represent concepts similarly to humans. This similarity is evident not only at the model representation level but also in their behavior. Furthermore, the models mostly provide valid explanations and deploy reasoning paths that are similar to humans