4,483 research outputs found
Goal-oriented Dialogue Policy Learning from Failures
Reinforcement learning methods have been used for learning dialogue policies.
However, learning an effective dialogue policy frequently requires
prohibitively many conversations. This is partly because of the sparse rewards
in dialogues, and the very few successful dialogues in early learning phase.
Hindsight experience replay (HER) enables learning from failures, but the
vanilla HER is inapplicable to dialogue learning due to the implicit goals. In
this work, we develop two complex HER methods providing different trade-offs
between complexity and performance, and, for the first time, enabled HER-based
dialogue policy learning. Experiments using a realistic user simulator show
that our HER methods perform better than existing experience replay methods (as
applied to deep Q-networks) in learning rate
Derivation-Simple Algebras and the Structures of Generalized Lie Algebras of Witt Type
We classify all the pairs of a commutative associative algebra with an
identity element and its finite-dimensional commutative locally-finite
derivation subalgebra such that the commutative associative algebra is
derivation-simple with respect to the derivation subalgebra over an
algebraically closed field with characteristic 0. Such pairs are the
fundamental ingredients for constructing generalized simple Lie algebras of
Cartan type. Moreover, we determine the isomorphic classes of the generalized
simple Lie algebras of Witt Type. The structure space of these algebras is
given explicitly.Comment: 20pages, Latex file; To appear in Journal of Algebr
- …