5 research outputs found
Answering Comparative Questions: Better than Ten-Blue-Links?
We present CAM (comparative argumentative machine), a novel open-domain IR
system to argumentatively compare objects with respect to information extracted
from the Common Crawl. In a user study, the participants obtained 15% more
accurate answers using CAM compared to a "traditional" keyword-based search and
were 20% faster in finding the answer to comparative questions.Comment: In Proceeding of 2019 Conference on Human Information Interaction and
Retrieval (CHIIR '19), March 10--14, 2019, Glasgow, United Kingdo
When Do Discourse Markers Affect Computational Sentence Understanding?
The capabilities and use cases of automatic natural language processing (NLP)
have grown significantly over the last few years. While much work has been
devoted to understanding how humans deal with discourse connectives, this
phenomenon is understudied in computational systems. Therefore, it is important
to put NLP models under the microscope and examine whether they can adequately
comprehend, process, and reason within the complexity of natural language. In
this chapter, we introduce the main mechanisms behind automatic sentence
processing systems step by step and then focus on evaluating discourse
connective processing. We assess nine popular systems in their ability to
understand English discourse connectives and analyze how context and language
understanding tasks affect their connective comprehension. The results show
that NLP systems do not process all discourse connectives equally well and that
the computational processing complexity of different connective kinds is not
always consistently in line with the presumed complexity order found in human
processing. In addition, while humans are more inclined to be influenced during
the reading procedure but not necessarily in the final comprehension
performance, discourse connectives have a significant impact on the final
accuracy of NLP systems. The richer knowledge of connectives a system learns,
the more negative effect inappropriate connectives have on it. This suggests
that the correct explicitation of discourse connectives is important for
computational natural language processing.Comment: Chapter 7 of Discourse Markers in Interaction, published in Trends in
Linguistics. Studies and Monograph