1,969 research outputs found
Better Conversations by Modeling,Filtering,and Optimizing for Coherence and Diversity
We present three enhancements to existing encoder-decoder models for
open-domain conversational agents, aimed at effectively modeling coherence and
promoting output diversity: (1) We introduce a measure of coherence as the
GloVe embedding similarity between the dialogue context and the generated
response, (2) we filter our training corpora based on the measure of coherence
to obtain topically coherent and lexically diverse context-response pairs, (3)
we then train a response generator using a conditional variational autoencoder
model that incorporates the measure of coherence as a latent variable and uses
a context gate to guarantee topical consistency with the context and promote
lexical diversity. Experiments on the OpenSubtitles corpus show a substantial
improvement over competitive neural models in terms of BLEU score as well as
metrics of coherence and diversity
Posterior-GAN: Towards Informative and Coherent Response Generation with Posterior Generative Adversarial Network
Neural conversational models learn to generate responses by taking into
account the dialog history. These models are typically optimized over the
query-response pairs with a maximum likelihood estimation objective. However,
the query-response tuples are naturally loosely coupled, and there exist
multiple responses that can respond to a given query, which leads the
conversational model learning burdensome. Besides, the general dull response
problem is even worsened when the model is confronted with meaningless response
training instances. Intuitively, a high-quality response not only responds to
the given query but also links up to the future conversations, in this paper,
we leverage the query-response-future turn triples to induce the generated
responses that consider both the given context and the future conversations. To
facilitate the modeling of these triples, we further propose a novel
encoder-decoder based generative adversarial learning framework, Posterior
Generative Adversarial Network (Posterior-GAN), which consists of a forward and
a backward generative discriminator to cooperatively encourage the generated
response to be informative and coherent by two complementary assessment
perspectives. Experimental results demonstrate that our method effectively
boosts the informativeness and coherence of the generated response on both
automatic and human evaluation, which verifies the advantages of considering
two assessment perspectives.Comment: Accepted by AAAI 202
A Tripartite Framework for Leadership Evaluation
The Tripartite Framework for Leadership Evaluation provides a comprehensive examination of the leadership evaluation landscape and makes key recommendations about how the field of leadership evaluation should proceed. The chief concern addressed by this working paper is the use of student outcome data as a measurement of leadership effectiveness. A second concern in our work with urban leaders is the absence or surface treatment of race and equity in nearly all evaluation instruments or processes. Finally, we call for an overhaul of the conventional cycle of inquiry, which is based largely on needs analysis and leader deficits, and incomplete use of evidence to support recurring short cycles within the larger yearly cycle of inquiry
Learning from Easy to Complex: Adaptive Multi-curricula Learning for Neural Dialogue Generation
Current state-of-the-art neural dialogue systems are mainly data-driven and
are trained on human-generated responses. However, due to the subjectivity and
open-ended nature of human conversations, the complexity of training dialogues
varies greatly. The noise and uneven complexity of query-response pairs impede
the learning efficiency and effects of the neural dialogue generation models.
What is more, so far, there are no unified dialogue complexity measurements,
and the dialogue complexity embodies multiple aspects of
attributes---specificity, repetitiveness, relevance, etc. Inspired by human
behaviors of learning to converse, where children learn from easy dialogues to
complex ones and dynamically adjust their learning progress, in this paper, we
first analyze five dialogue attributes to measure the dialogue complexity in
multiple perspectives on three publicly available corpora. Then, we propose an
adaptive multi-curricula learning framework to schedule a committee of the
organized curricula. The framework is established upon the reinforcement
learning paradigm, which automatically chooses different curricula at the
evolving learning process according to the learning status of the neural
dialogue generation model. Extensive experiments conducted on five
state-of-the-art models demonstrate its learning efficiency and effectiveness
with respect to 13 automatic evaluation metrics and human judgments.Comment: Accepted to AAAI 202
- …