A generative adversarial strategy for modeling relation paths in knowledge base representation learning

Abstract

Enabling neural networks to perform multi-hop (mh) reasoning over knowledge bases (KBs) is vital for tasks such as question-answering and query expansion. Typically, recurrent neural networks (RNNs) trained with explicit objectives are used to model mh relation paths (mh-RPs). In this work, we hypothesize that explicit objectives are not the most effective strategy effective for learning mh-RNN reasoning models, proposing instead a generative adversarial network (GAN) based approach. The proposed model – mh Relation GAN (mh-RGAN) – consists of two networks; a generator GG, and discriminator DD. GG is tasked with composing a mh-RP and DD with discriminating between real and fake paths. During training, GG and DD contest each other adversarially as follows: GG attempts to fool DD by composing an indistinguishably invalid mh-RP given a head entity and a relation, while DD attempts to discriminate between valid and invalid reasoning chains until convergence. The resulting model is tested on benchmarks WordNet and FreeBase datasets and evaluated on the link prediction task using MRR and HIT@ 10, achieving best-in-class performance in all cases

    Similar works