Neural Question Generation with Answer Pivot

Authors

  • Bingning Wang Sogou
  • Xiaochuan Wang Sogou
  • Ting Tao Sogou
  • Qi Zhang Sogou
  • Jingfang Xu Sogou

DOI:

https://doi.org/10.1609/aaai.v34i05.6449

Abstract

Neural question generation (NQG) is the task of generating questions from the given context with deep neural networks. Previous answer-aware NQG methods suffer from the problem that the generated answers are focusing on entity and most of the questions are trivial to be answered. The answer-agnostic NQG methods reduce the bias towards named entities and increasing the model's degrees of freedom, but sometimes result in generating unanswerable questions which are not valuable for the subsequent machine reading comprehension system. In this paper, we treat the answers as the hidden pivot for question generation and combine the question generation and answer selection process in a joint model. We achieve the state-of-the-art result on the SQuAD dataset according to automatic metric and human evaluation.

Downloads

Published

2020-04-03

How to Cite

Wang, B., Wang, X., Tao, T., Zhang, Q., & Xu, J. (2020). Neural Question Generation with Answer Pivot. Proceedings of the AAAI Conference on Artificial Intelligence, 34(05), 9138-9145. https://doi.org/10.1609/aaai.v34i05.6449

Issue

Section

AAAI Technical Track: Natural Language Processing