21 research outputs found
Better Conversations by Modeling,Filtering,and Optimizing for Coherence and Diversity
We present three enhancements to existing encoder-decoder models for
open-domain conversational agents, aimed at effectively modeling coherence and
promoting output diversity: (1) We introduce a measure of coherence as the
GloVe embedding similarity between the dialogue context and the generated
response, (2) we filter our training corpora based on the measure of coherence
to obtain topically coherent and lexically diverse context-response pairs, (3)
we then train a response generator using a conditional variational autoencoder
model that incorporates the measure of coherence as a latent variable and uses
a context gate to guarantee topical consistency with the context and promote
lexical diversity. Experiments on the OpenSubtitles corpus show a substantial
improvement over competitive neural models in terms of BLEU score as well as
metrics of coherence and diversity
Plan-And-Write: Towards Better Automatic Storytelling
Automatic storytelling is challenging since it requires generating long,
coherent natural language to describes a sensible sequence of events. Despite
considerable efforts on automatic story generation in the past, prior work
either is restricted in plot planning, or can only generate stories in a narrow
domain. In this paper, we explore open-domain story generation that writes
stories given a title (topic) as input. We propose a plan-and-write
hierarchical generation framework that first plans a storyline, and then
generates a story based on the storyline. We compare two planning strategies.
The dynamic schema interweaves story planning and its surface realization in
text, while the static schema plans out the entire storyline before generating
stories. Experiments show that with explicit storyline planning, the generated
stories are more diverse, coherent, and on topic than those generated without
creating a full plan, according to both automatic and human evaluations.Comment: Accepted by AAAI 201