Joint Entity and Relation Extraction with a Hybrid Transformer and Reinforcement Learning Based Model

Authors

  • Ya Xiao Tongji University
  • Chengxiang Tan Tongji University
  • Zhijie Fan The Third Research Institute of the Ministry of Public Security
  • Qian Xu Tongji University
  • Wenye Zhu Tongji University

DOI:

https://doi.org/10.1609/aaai.v34i05.6471

Abstract

Joint extraction of entities and relations is a task that extracts the entity mentions and semantic relations between entities from the unstructured texts with one single model. Existing entity and relation extraction datasets usually rely on distant supervision methods which cannot identify the corresponding relations between a relation and the sentence, thus suffers from noisy labeling problem. We propose a hybrid deep neural network model to jointly extract the entities and relations, and the model is also capable of filtering noisy data. The hybrid model contains a transformer-based encoding layer, an LSTM entity detection module and a reinforcement learning-based relation classification module. The output of the transformer encoder and the entity embedding generated from the entity detection module are combined as the input state of the reinforcement learning module to improve the relation classification and noisy data filtering. We conduct experiments on the public dataset produced by the distant supervision method to verify the effectiveness of our proposed model. Different experimental results show that our model gains better performance on entity and relation extraction than the compared methods and also has the ability to filter noisy sentences.

Downloads

Published

2020-04-03

How to Cite

Xiao, Y., Tan, C., Fan, Z., Xu, Q., & Zhu, W. (2020). Joint Entity and Relation Extraction with a Hybrid Transformer and Reinforcement Learning Based Model. Proceedings of the AAAI Conference on Artificial Intelligence, 34(05), 9314-9321. https://doi.org/10.1609/aaai.v34i05.6471

Issue

Section

AAAI Technical Track: Natural Language Processing