3 research outputs found
Neural Natural Language Inference Models Enhanced with External Knowledge
Modeling natural language inference is a very challenging task. With the
availability of large annotated data, it has recently become feasible to train
complex models such as neural-network-based inference models, which have shown
to achieve the state-of-the-art performance. Although there exist relatively
large annotated data, can machines learn all knowledge needed to perform
natural language inference (NLI) from these data? If not, how can
neural-network-based NLI models benefit from external knowledge and how to
build NLI models to leverage it? In this paper, we enrich the state-of-the-art
neural natural language inference models with external knowledge. We
demonstrate that the proposed models improve neural NLI models to achieve the
state-of-the-art performance on the SNLI and MultiNLI datasets.Comment: Accepted by ACL 201
Compare, Compress and Propagate: Enhancing Neural Architectures with Alignment Factorization for Natural Language Inference
This paper presents a new deep learning architecture for Natural Language
Inference (NLI). Firstly, we introduce a new architecture where alignment pairs
are compared, compressed and then propagated to upper layers for enhanced
representation learning. Secondly, we adopt factorization layers for efficient
and expressive compression of alignment vectors into scalar features, which are
then used to augment the base word representations. The design of our approach
is aimed to be conceptually simple, compact and yet powerful. We conduct
experiments on three popular benchmarks, SNLI, MultiNLI and SciTail, achieving
competitive performance on all. A lightweight parameterization of our model
also enjoys a times reduction in parameter size compared to the
existing state-of-the-art models, e.g., ESIM and DIIN, while maintaining
competitive performance. Additionally, visual analysis shows that our
propagated features are highly interpretable.Comment: EMNLP 2018 CRC and Update CAFE + ELMo result on SNL