22 research outputs found
Cross-Domain Generalization of Neural Constituency Parsers
Neural parsers obtain state-of-the-art results on benchmark treebanks for
constituency parsing -- but to what degree do they generalize to other domains?
We present three results about the generalization of neural parsers in a
zero-shot setting: training on trees from one corpus and evaluating on
out-of-domain corpora. First, neural and non-neural parsers generalize
comparably to new domains. Second, incorporating pre-trained encoder
representations into neural parsers substantially improves their performance
across all domains, but does not give a larger relative improvement for
out-of-domain treebanks. Finally, despite the rich input representations they
learn, neural parsers still benefit from structured output prediction of output
trees, yielding higher exact match accuracy and stronger generalization both to
larger text spans and to out-of-domain corpora. We analyze generalization on
English and Chinese corpora, and in the process obtain state-of-the-art parsing
results for the Brown, Genia, and English Web treebanks.Comment: ACL 2019. DF and NK contributed equall
Advancing NLP with Cognitive Language Processing Signals
When we read, our brain processes language and generates cognitive processing
data such as gaze patterns and brain activity. These signals can be recorded
while reading. Cognitive language processing data such as eye-tracking features
have shown improvements on single NLP tasks. We analyze whether using such
human features can show consistent improvement across tasks and data sources.
We present an extensive investigation of the benefits and limitations of using
cognitive processing data for NLP. Specifically, we use gaze and EEG features
to augment models of named entity recognition, relation classification, and
sentiment analysis. These methods significantly outperform the baselines and
show the potential and current limitations of employing human language
processing data for NLP
Can Natural Language Processors Help Unlock the Black Box of Language Comprehension?
Honors (Bachelor's)Cognitive ScienceUniversity of Michiganhttps://deepblue.lib.umich.edu/bitstream/2027.42/147353/1/cowellty.pd