13,710 research outputs found
Contextual Dialogue Act Classification for Open-Domain Conversational Agents
Classifying the general intent of the user utterance in a conversation, also
known as Dialogue Act (DA), e.g., open-ended question, statement of opinion, or
request for an opinion, is a key step in Natural Language Understanding (NLU)
for conversational agents. While DA classification has been extensively studied
in human-human conversations, it has not been sufficiently explored for the
emerging open-domain automated conversational agents. Moreover, despite
significant advances in utterance-level DA classification, full understanding
of dialogue utterances requires conversational context. Another challenge is
the lack of available labeled data for open-domain human-machine conversations.
To address these problems, we propose a novel method, CDAC (Contextual Dialogue
Act Classifier), a simple yet effective deep learning approach for contextual
dialogue act classification. Specifically, we use transfer learning to adapt
models trained on human-human conversations to predict dialogue acts in
human-machine dialogues. To investigate the effectiveness of our method, we
train our model on the well-known Switchboard human-human dialogue dataset, and
fine-tune it for predicting dialogue acts in human-machine conversation data,
collected as part of the Amazon Alexa Prize 2018 competition. The results show
that the CDAC model outperforms an utterance-level state of the art baseline by
8.0% on the Switchboard dataset, and is comparable to the latest reported
state-of-the-art contextual DA classification results. Furthermore, our results
show that fine-tuning the CDAC model on a small sample of manually labeled
human-machine conversations allows CDAC to more accurately predict dialogue
acts in real users' conversations, suggesting a promising direction for future
improvements.Comment: SIGIR 201
Contextual Topic Modeling For Dialog Systems
Accurate prediction of conversation topics can be a valuable signal for
creating coherent and engaging dialog systems. In this work, we focus on
context-aware topic classification methods for identifying topics in free-form
human-chatbot dialogs. We extend previous work on neural topic classification
and unsupervised topic keyword detection by incorporating conversational
context and dialog act features. On annotated data, we show that incorporating
context and dialog acts leads to relative gains in topic classification
accuracy by 35% and on unsupervised keyword detection recall by 11% for
conversational interactions where topics frequently span multiple utterances.
We show that topical metrics such as topical depth is highly correlated with
dialog evaluation metrics such as coherence and engagement implying that
conversational topic models can predict user satisfaction. Our work for
detecting conversation topics and keywords can be used to guide chatbots
towards coherent dialog
Would you Like to Talk about Sports Now? Towards Contextual Topic Suggestion for Open-Domain Conversational Agents
To hold a true conversation, an intelligent agent should be able to
occasionally take initiative and recommend the next natural conversation topic.
This is a challenging task. A topic suggested by the agent should be relevant
to the person, appropriate for the conversation context, and the agent should
have something interesting to say about it. Thus, a scripted, or
one-size-fits-all, popularity-based topic suggestion is doomed to fail.
Instead, we explore different methods for a personalized, contextual topic
suggestion for open-domain conversations. We formalize the Conversational Topic
Suggestion problem (CTS) to more clearly identify the assumptions and
requirements. We also explore three possible approaches to solve this problem:
(1) model-based sequential topic suggestion to capture the conversation context
(CTS-Seq), (2) Collaborative Filtering-based suggestion to capture previous
successful conversations from similar users (CTS-CF), and (3) a hybrid approach
combining both conversation context and collaborative filtering. To evaluate
the effectiveness of these methods, we use real conversations collected as part
of the Amazon Alexa Prize 2018 Conversational AI challenge. The results are
promising: the CTS-Seq model suggests topics with 23% higher accuracy than the
baseline, and incorporating collaborative filtering signals into a hybrid
CTS-Seq-CF model further improves recommendation accuracy by 12%. Together, our
proposed models, experiments, and analysis significantly advance the study of
open-domain conversational agents, and suggest promising directions for future
improvements.Comment: CHIIR 202
Neural Approaches to Conversational AI
The present paper surveys neural approaches to conversational AI that have
been developed in the last few years. We group conversational systems into
three categories: (1) question answering agents, (2) task-oriented dialogue
agents, and (3) chatbots. For each category, we present a review of
state-of-the-art neural approaches, draw the connection between them and
traditional approaches, and discuss the progress that has been made and
challenges still being faced, using specific systems and models as case
studies.Comment: Foundations and Trends in Information Retrieval (95 pages
A Survey on Practical Applications of Multi-Armed and Contextual Bandits
In recent years, multi-armed bandit (MAB) framework has attracted a lot of
attention in various applications, from recommender systems and information
retrieval to healthcare and finance, due to its stellar performance combined
with certain attractive properties, such as learning from less feedback. The
multi-armed bandit field is currently flourishing, as novel problem settings
and algorithms motivated by various practical applications are being
introduced, building on top of the classical bandit problem. This article aims
to provide a comprehensive review of top recent developments in multiple
real-life applications of the multi-armed bandit. Specifically, we introduce a
taxonomy of common MAB-based applications and summarize state-of-art for each
of those domains. Furthermore, we identify important current trends and provide
new perspectives pertaining to the future of this exciting and fast-growing
field.Comment: under review by IJCAI 2019 Surve
Advancing the State of the Art in Open Domain Dialog Systems through the Alexa Prize
Building open domain conversational systems that allow users to have engaging
conversations on topics of their choice is a challenging task. Alexa Prize was
launched in 2016 to tackle the problem of achieving natural, sustained,
coherent and engaging open-domain dialogs. In the second iteration of the
competition in 2018, university teams advanced the state of the art by using
context in dialog models, leveraging knowledge graphs for language
understanding, handling complex utterances, building statistical and
hierarchical dialog managers, and leveraging model-driven signals from user
responses. The 2018 competition also included the provision of a suite of tools
and models to the competitors including the CoBot (conversational bot) toolkit,
topic and dialog act detection models, conversation evaluators, and a sensitive
content detection model so that the competing teams could focus on building
knowledge-rich, coherent and engaging multi-turn dialog systems. This paper
outlines the advances developed by the university teams as well as the Alexa
Prize team to achieve the common goal of advancing the science of
Conversational AI. We address several key open-ended problems such as
conversational speech recognition, open domain natural language understanding,
commonsense reasoning, statistical dialog management, and dialog evaluation.
These collaborative efforts have driven improved experiences by Alexa users to
an average rating of 3.61, the median duration of 2 mins 18 seconds, and
average turns to 14.6, increases of 14%, 92%, 54% respectively since the launch
of the 2018 competition. For conversational speech recognition, we have
improved our relative Word Error Rate by 55% and our relative Entity Error Rate
by 34% since the launch of the Alexa Prize. Socialbots improved in quality
significantly more rapidly in 2018, in part due to the release of the CoBot
toolkit.Comment: 2018 Alexa Prize Proceeding
User Intent Inference for Web Search and Conversational Agents
User intent understanding is a crucial step in designing both conversational
agents and search engines. Detecting or inferring user intent is challenging,
since the user utterances or queries can be short, ambiguous, and contextually
dependent. To address these research challenges, my thesis work focuses on: 1)
Utterance topic and intent classification for conversational agents 2) Query
intent mining and classification for Web search engines, focusing on the
e-commerce domain. To address the first topic, I proposed novel models to
incorporate entity information and conversation-context clues to predict both
topic and intent of the user's utterances. For the second research topic, I
plan to extend the existing state of the art methods in Web search intent
prediction to the e-commerce domain, via: 1) Developing a joint learning model
to predict search queries' intents and the product categories associated with
them, 2) Discovering new hidden users' intents. All the models will be
evaluated on the real queries available from a major e-commerce site search
engine. The results from these studies can be leveraged to improve performance
of various tasks such as natural language understanding, query scoping, query
suggestion, and ranking, resulting in an enriched user experience.Comment: WSDM202
A Survey of Arabic Dialogues Understanding for Spontaneous Dialogues and Instant Message
Building dialogues systems interaction has recently gained considerable
attention, but most of the resources and systems built so far are tailored to
English and other Indo-European languages. The need for designing systems for
other languages is increasing such as Arabic language. For this reasons, there
are more interest for Arabic dialogue acts classification task because it a key
player in Arabic language understanding to building this systems. This paper
surveys different techniques for dialogue acts classification for Arabic. We
describe the main existing techniques for utterances segmentations and
classification, annotation schemas, and test corpora for Arabic dialogues
understanding that have introduced in the literatur
Information Seeking in the Spirit of Learning: a Dataset for Conversational Curiosity
Open-ended human learning and information-seeking are increasingly mediated
by digital assistants. However, such systems often ignore the user's
pre-existing knowledge. Assuming a correlation between engagement and user
responses such as "liking" messages or asking followup questions, we design a
Wizard-of-Oz dialog task that tests the hypothesis that engagement increases
when users are presented with facts related to what they know. Through
crowd-sourcing of this experiment, we collect and release 14K dialogs (181K
utterances) where users and assistants converse about geographic topics like
geopolitical entities and locations. This dataset is annotated with
pre-existing user knowledge, message-level dialog acts, grounding to Wikipedia,
and user reactions to messages. Responses using a user's prior knowledge
increase engagement. We incorporate this knowledge into a multi-task model that
reproduces human assistant policies and improves over a BERT content model by
13 mean reciprocal rank points.Comment: EMNLP 2020: https://www.aclweb.org/anthology/2020.emnlp-main.655
ACII 2009: Affective Computing and Intelligent Interaction. Proceedings of the Doctoral Consortium
This volume collects the contributions presented at the ACII 2009 Doctoral Consortium, the event aimed at gathering PhD students with the goal of sharing ideas about the theories behind affective computing; its development; and its application. Published papers have been selected out a large number of high quality submissions covering a wide spectrum of topics including the analysis of human-human, human-machine and human-robot interactions, the analysis of physiology and nonverbal behavior in affective phenomena, the effect of emotions on language and spoken interaction, and the embodiment of affective behaviors
- …