58 research outputs found
Cross-relation Cross-bag Attention for Distantly-supervised Relation Extraction
Distant supervision leverages knowledge bases to automatically label
instances, thus allowing us to train relation extractor without human
annotations. However, the generated training data typically contain massive
noise, and may result in poor performances with the vanilla supervised
learning. In this paper, we propose to conduct multi-instance learning with a
novel Cross-relation Cross-bag Selective Attention (CSA), which leads to
noise-robust training for distant supervised relation extractor. Specifically,
we employ the sentence-level selective attention to reduce the effect of noisy
or mismatched sentences, while the correlation among relations were captured to
improve the quality of attention weights. Moreover, instead of treating all
entity-pairs equally, we try to pay more attention to entity-pairs with a
higher quality. Similarly, we adopt the selective attention mechanism to
achieve this goal. Experiments with two types of relation extractor demonstrate
the superiority of the proposed approach over the state-of-the-art, while
further ablation studies verify our intuitions and demonstrate the
effectiveness of our proposed two techniques.Comment: AAAI 201
Multi-labeled Relation Extraction with Attentive Capsule Network
To disclose overlapped multiple relations from a sentence still keeps
challenging. Most current works in terms of neural models inconveniently
assuming that each sentence is explicitly mapped to a relation label, cannot
handle multiple relations properly as the overlapped features of the relations
are either ignored or very difficult to identify. To tackle with the new issue,
we propose a novel approach for multi-labeled relation extraction with capsule
network which acts considerably better than current convolutional or recurrent
net in identifying the highly overlapped relations within an individual
sentence. To better cluster the features and precisely extract the relations,
we further devise attention-based routing algorithm and sliding-margin loss
function, and embed them into our capsule network. The experimental results
show that the proposed approach can indeed extract the highly overlapped
features and achieve significant performance improvement for relation
extraction comparing to the state-of-the-art works.Comment: To be published in AAAI 201
- …