4 research outputs found
Quantized-Dialog Language Model for Goal-Oriented Conversational Systems
We propose a novel methodology to address dialog learning in the context of
goal-oriented conversational systems. The key idea is to quantize the dialog
space into clusters and create a language model across the clusters, thus
allowing for an accurate choice of the next utterance in the conversation. The
language model relies on n-grams associated with clusters of utterances. This
quantized-dialog language model methodology has been applied to the end-to-end
goal-oriented track of the latest Dialog System Technology Challenges (DSTC6).
The objective is to find the correct system utterance from a pool of candidates
in order to complete a dialog between a user and an automated
restaurant-reservation system. Our results show that the technique proposed in
this paper achieves high accuracy regarding selection of the correct candidate
utterance, and outperforms other state-of-the-art approaches based on neural
networks
Unsupervised Dialog Structure Learning
Learning a shared dialog structure from a set of task-oriented dialogs is an
important challenge in computational linguistics. The learned dialog structure
can shed light on how to analyze human dialogs, and more importantly contribute
to the design and evaluation of dialog systems. We propose to extract dialog
structures using a modified VRNN model with discrete latent vectors. Different
from existing HMM-based models, our model is based on variational-autoencoder
(VAE). Such model is able to capture more dynamics in dialogs beyond the
surface forms of the language. We find that qualitatively, our method extracts
meaningful dialog structure, and quantitatively, outperforms previous models on
the ability to predict unseen data. We further evaluate the model's
effectiveness in a downstream task, the dialog system building task.
Experiments show that, by integrating the learned dialog structure into the
reward function design, the model converges faster and to a better outcome in a
reinforcement learning setting.Comment: Long paper accepted by NAACL 201
The Rapidly Changing Landscape of Conversational Agents
Conversational agents have become ubiquitous, ranging from goal-oriented
systems for helping with reservations to chit-chat models found in modern
virtual assistants. In this survey paper, we explore this fascinating field. We
look at some of the pioneering work that defined the field and gradually move
to the current state-of-the-art models. We look at statistical, neural,
generative adversarial network based and reinforcement learning based
approaches and how they evolved. Along the way we discuss various challenges
that the field faces, lack of context in utterances, not having a good
quantitative metric to compare models, lack of trust in agents because they do
not have a consistent persona etc. We structure this paper in a way that
answers these pertinent questions and discusses competing approaches to solve
them.Comment: 14 pages, 7 figures. arXiv admin note: text overlap with
arXiv:1704.07130, arXiv:1507.04808, arXiv:1603.06155, arXiv:1611.06997,
arXiv:1704.08966 by other author
Recent Progress in Conversational AI
Conversational artificial intelligence (AI) is becoming an increasingly
popular topic among industry and academia. With the fast development of neural
network-based models, a lot of neural-based conversational AI system are
developed. We will provide a brief review of the recent progress in the
Conversational AI, including the commonly adopted techniques, notable works,
famous competitions from academia and industry and widely used datasets.Comment: 6 page