Problems in Evaluating Grammatical Error Detection Systems

ABSTRACT Many evaluation issues for grammatical error detection have previously been overlooked, making it hard to draw meaningful comparisons between different approaches, even when they are evaluated on the same corpus. To begin with, the three-way contingency between a writer's sentence, the annotator's correction, and the system's output makes evaluation more complex than in some other NLP tasks, which we address by presenting an intuitive evaluation scheme. Of particular importance to error detection is the skew of the data -the low frequency of errors as compared to non-errors -which distorts some traditional measures of performance and limits their usefulness, leading us to recommend the reporting of raw measurements (true positives, false negatives, false positives, true negatives). Other issues that are particularly vexing for error detection focus on defining these raw measurements: specifying the size or scope of an error, properly treating errors as graded rather than discrete phenomena, and counting non-errors. We discuss recommendations for best practices with regard to reporting the results of system evaluation for these cases, recommendations which depend upon making clear one's assumptions and applications for error detection. By highlighting the problems with current error detection evaluation, the field will be better able to move forward

Search for the direct production of charginos and neutralinos in final states with tau leptons in √s=13 TeV collisions with the ATLAS detector

A search for the direct production of charginos and neutralinos in final states with at least two hadronically decaying tau leptons is presented. The analysis uses a dataset of pp collisions corresponding to an integrated luminosity of 36.1 fb−1, recorded with the ATLAS detector at the Large Hadron Collider at a centre-of-mass energy of 13TeV.Nosignificant deviation from the expected Standard Model background is observed. Limits are derived in scenarios of ˜χ+1 ˜χ−1 pair production and of ˜χ±1 ˜χ02 and ˜χ+1 ˜χ−1 production in simplified models where the neutralinos and charginos decay solely via intermediate left-handed staus and tau sneutrinos, and the mass of the ˜ τL state is set to be halfway between the masses of the ˜χ±1 and the ˜χ01. Chargino masses up to 630 GeV are excluded at 95% confidence level in the scenario of direct production of ˜χ+1 ˜χ−1 for a massless ˜χ01. Common ˜χ±1 and ˜χ02 masses up to 760 GeV are excluded in the case of production of ˜χ±1 ˜χ02 and ˜χ+1 ˜χ−1 assuming a massless ˜χ01. Exclusion limits for additional benchmark scenarios with large and small mass-splitting between the ˜χ±1 and the ˜χ01 are also studied by varying the ˜ τL mass between the masses of the ˜χ±1 and the ˜χ01

Anatomy of the sign-problem in heavy-dense QCD

QCD at finite densities of heavy quarks is investigated using the density-of-states method. The phase factor expectation value of the quark determinant is calculated to unprecedented precision as a function of the chemical potential. Results are validated using those from a reweighting approach where the latter can produce a significant signalto-noise ratio. We confirm the particle–hole symmetry at low temperatures, find a strong sign problem at intermediate values of the chemical potential, and an inverse Silver Blaze feature for chemical potentials close to the onset value: here, the phase-quenched theory underestimates the density of the full theory

Studies of Zγ production in association with a high-mass dijet system in pp collisions at √s=8 TeV with the ATLAS detector

The production of a Z boson and a photon in association with a high-mass dijet system is studied using 20.2 fb −1 of proton-proton collision data at a centre-of-mass energy of s=8 TeV recorded with the ATLAS detector in 2012 at the Large Hadron Collider. Final states with a photon and a Z boson decaying into a pair of either electrons, muons, or neutrinos are analysed. Electroweak and total pp → Zγjj cross-sections are extracted in two fiducial regions with different sensitivities to electroweak production processes. Quartic couplings of vector bosons are studied in regions of phase space with an enhanced contribution from pure electroweak production, sensitive to vector-boson scattering processes VV → Zγ. No deviations from Standard Model predictions are observed and constraints are placed on anomalous couplings parameterized by higher-dimensional operators using effective field theory.[Figure not available: see fulltext.]

Measurement of W+W− production in association with one jet in proton–proton collisions at sqrt(s) = 8TeV with the ATLAS detector

The production of W boson pairs in association with one jet in pp collisions at View the MathML sources=8 TeV is studied using data corresponding to an integrated luminosity of 20.3 fb−1 collected by the ATLAS detector during 2012 at the CERN Large Hadron Collider. The cross section is measured in a fiducial phase-space region defined by the presence of exactly one electron and one muon, missing transverse momentum and exactly one jet with a transverse momentum above 25 GeV and a pseudorapidity of |η|<4.5|η|<4.5. The leptons are required to have opposite electric charge and to pass transverse momentum and pseudorapidity requirements. The fiducial cross section is found to be View the MathML sourceσWWfid,1-jet=136±6(stat)±14(syst)±3(lumi) fb. In combination with a previous measurement restricted to leptonic final states with no associated jets, the fiducial cross section of WW production with zero or one jet is measured to be View the MathML sourceσWWfid,≤1-jet=511±9(stat)±26(syst)±10(lumi) fb. The ratio of fiducial cross sections in final states with one and zero jets is determined to be 0.36±0.050.36±0.05. Finally, a total cross section extrapolated from the fiducial measurement of WW production with zero or one associated jet is reported. The measurements are compared to theoretical predictions and found in good agreement

Study of ordered hadron chains with the ATLAS detector

The analysis of the momentum difference between charged hadrons in high-energy proton-proton collisions is performed in order to study coherent particle production. The observed correlation pattern agrees with a model of a helical QCD string fragmenting into a chain of ground-state hadrons. A threshold momentum difference in the production of adjacent pairs of charged hadrons is observed, in agreement with model predictions. The presence of low-mass hadron chains also explains the emergence of charge-combination-dependent two-particle correlations commonly attributed to Bose-Einstein interference. The data sample consists of 190 μb−1 of minimum-bias events collected with proton-proton collisions at a center-of-mass energy √s=7 TeV in the early low-luminosity data taking with the ATLAS detector at the LHC

Search for dark matter at √s=13 TeV in final states containing an energetic photon and large missing transverse momentum with the ATLAS detector

Results of a search for physics beyond the Standard Model in events containing an energetic photon and large missing transverse momentum with the ATLAS detector at the Large Hadron Collider are reported. As the number of events observed in data, corresponding to an integrated luminosity of 36.1 fb−1 of proton–proton collisions at a centre-of-mass energy of 13 TeV, is in agreement with the Standard Model expectations, model-independent limits are set on the fiducial cross section for the production of events in this final state. Exclusion limits are also placed in models where dark-matter candidates are pair-produced. For dark-matter production via an axial-vector or a vector mediator in the s-channel, this search excludes mediator masses below 750–1200 GeV for dark-matter candidate masses below 230–480 GeV at 95% confidence level, depending on the couplings. In an effective theory of dark-matter production, the limits restrict the value of the suppression scale M∗ to be above 790 GeV at 95% confidence level. A limit is also reported on the production of a high-mass scalar resonance by processes beyond the Standard Model, in which the resonance decays to Zγ and the Z boson subsequently decays into neutrinos

Measurements of integrated and differential cross sections for isolated photon pair production in pp collisions at √s=8 TeV with the ATLAS detector

A measurement of the production cross section for two isolated photons in proton-proton collisions at a center-of-mass energy of √s=8 TeV is presented. The results are based on an integrated luminosity of 20.2 fb−1 recorded by the ATLAS detector at the Large Hadron Collider. The measurement considers photons with pseudorapidities satisfying |ηγ|40GeV and EγT,2>30 GeV for the two leading photons ordered in transverse energy produced in the interaction. The background due to hadronic jets and electrons is subtracted using data-driven techniques. The fiducial cross sections are corrected for detector effects and measured differentially as a function of six kinematic observables. The measured cross section integrated within the fiducial volume is 16.8 ± 0.8  pb . The data are compared to fixed-order QCD calculations at next-to-leading-order and next-to-next-to-leading-order accuracy as well as next-to-leading-order computations including resummation of initial-state gluon radiation at next-to-next-to-leading logarithm or matched to a parton shower, with relative uncertainties varying from 5% to 20%

Measurement of the W±Z boson pair-production cross section in pp collisions at √s=13TeV with the ATLAS detector

published_or_final_versio

Measurement of the inelastic proton-proton cross section at √s=13 TeV with the ATLAS detector at the LHC

This Letter presents a measurement of the inelastic proton-proton cross section using 60  μb −1 of pp collisions at a center-of-mass energy √s of 13 TeV with the ATLAS detector at the LHC. Inelastic interactions are selected using rings of plastic scintillators in the forward region (2.0710 −6 , where M X is the larger invariant mass of the two hadronic systems separated by the largest rapidity gap in the event. In this ξ range the scintillators are highly efficient. For diffractive events this corresponds to cases where at least one proton dissociates to a system with M X >13  GeV . The measured cross section is compared with a range of theoretical predictions. When extrapolated to the full phase space, a cross section of 78.1±2.9  mb is measured, consistent with the inelastic cross section increasing with center-of-mass energy