54,140 research outputs found
Ethical Challenges in Data-Driven Dialogue Systems
The use of dialogue systems as a medium for human-machine interaction is an
increasingly prevalent paradigm. A growing number of dialogue systems use
conversation strategies that are learned from large datasets. There are well
documented instances where interactions with these system have resulted in
biased or even offensive conversations due to the data-driven training process.
Here, we highlight potential ethical issues that arise in dialogue systems
research, including: implicit biases in data-driven systems, the rise of
adversarial examples, potential sources of privacy violations, safety concerns,
special considerations for reinforcement learning systems, and reproducibility
concerns. We also suggest areas stemming from these issues that deserve further
investigation. Through this initial survey, we hope to spur research leading to
robust, safe, and ethically sound dialogue systems.Comment: In Submission to the AAAI/ACM conference on Artificial Intelligence,
Ethics, and Societ
End-to-End Knowledge-Routed Relational Dialogue System for Automatic Diagnosis
Beyond current conversational chatbots or task-oriented dialogue systems that
have attracted increasing attention, we move forward to develop a dialogue
system for automatic medical diagnosis that converses with patients to collect
additional symptoms beyond their self-reports and automatically makes a
diagnosis. Besides the challenges for conversational dialogue systems (e.g.
topic transition coherency and question understanding), automatic medical
diagnosis further poses more critical requirements for the dialogue rationality
in the context of medical knowledge and symptom-disease relations. Existing
dialogue systems (Madotto, Wu, and Fung 2018; Wei et al. 2018; Li et al. 2017)
mostly rely on data-driven learning and cannot be able to encode extra expert
knowledge graph. In this work, we propose an End-to-End Knowledge-routed
Relational Dialogue System (KR-DS) that seamlessly incorporates rich medical
knowledge graph into the topic transition in dialogue management, and makes it
cooperative with natural language understanding and natural language
generation. A novel Knowledge-routed Deep Q-network (KR-DQN) is introduced to
manage topic transitions, which integrates a relational refinement branch for
encoding relations among different symptoms and symptom-disease pairs, and a
knowledge-routed graph branch for topic decision-making. Extensive experiments
on a public medical dialogue dataset show our KR-DS significantly beats
state-of-the-art methods (by more than 8% in diagnosis accuracy). We further
show the superiority of our KR-DS on a newly collected medical dialogue system
dataset, which is more challenging retaining original self-reports and
conversational data between patients and doctors.Comment: 8 pages, 5 figues, AAA
Deep Active Learning for Dialogue Generation
We propose an online, end-to-end, neural generative conversational model for
open-domain dialogue. It is trained using a unique combination of offline
two-phase supervised learning and online human-in-the-loop active learning.
While most existing research proposes offline supervision or hand-crafted
reward functions for online reinforcement, we devise a novel interactive
learning mechanism based on hamming-diverse beam search for response generation
and one-character user-feedback at each step. Experiments show that our model
inherently promotes the generation of semantically relevant and interesting
responses, and can be used to train agents with customized personas, moods and
conversational styles.Comment: Accepted at 6th Joint Conference on Lexical and Computational
Semantics (*SEM) 2017 (Previously titled "Online Sequence-to-Sequence Active
Learning for Open-Domain Dialogue Generation" on ArXiv
End-to-end optimization of goal-driven and visually grounded dialogue systems
End-to-end design of dialogue systems has recently become a popular research
topic thanks to powerful tools such as encoder-decoder architectures for
sequence-to-sequence learning. Yet, most current approaches cast human-machine
dialogue management as a supervised learning problem, aiming at predicting the
next utterance of a participant given the full history of the dialogue. This
vision is too simplistic to render the intrinsic planning problem inherent to
dialogue as well as its grounded nature, making the context of a dialogue
larger than the sole history. This is why only chit-chat and question answering
tasks have been addressed so far using end-to-end architectures. In this paper,
we introduce a Deep Reinforcement Learning method to optimize visually grounded
task-oriented dialogues, based on the policy gradient algorithm. This approach
is tested on a dataset of 120k dialogues collected through Mechanical Turk and
provides encouraging results at solving both the problem of generating natural
dialogues and the task of discovering a specific object in a complex picture
- …