Publishing Service

Polishing & Checking

Frontiers of Information Technology & Electronic Engineering

ISSN 2095-9184 (print), ISSN 2095-9230 (online)

Hybrid embedding and joint training of stacked encoder for opinion question machine reading comprehension

Abstract: Opinion question machine reading comprehension (MRC) requires a machine to answer questions by analyzing corresponding passages. Compared with traditional MRC tasks where the answer to every question is a segment of text in corresponding passages, opinion question MRC is more challenging because the answer to an opinion question may not appear in corresponding passages but needs to be deduced from multiple sentences. In this study, a novel framework based on neural networks is proposed to address such problems, in which a new hybrid embedding training method combining text features is used. Furthermore, extra attention and output layers which generate auxiliary losses are introduced to jointly train the stacked recurrent neural networks. To deal with imbalance of the dataset, irrelevancy of question and passage is used for data augmentation. Experimental results show that the proposed method achieves state-of-the-art performance. We are the biweekly champion in the opinion question MRC task in Artificial Intelligence Challenger 2018 (AIC2018).

Key words: Machine reading comprehension, Neural networks, Joint training, Data augmentation

Chinese Summary  <26> 观点型问题机器阅读理解中混合词向量和层叠循环神经网络联合训练方法的应用

黄祥洲,汤斯亮,张引,魏宝刚
浙江大学计算机科学与技术学院,中国杭州市,310027

摘要:观点型问题机器阅读理解指计算机通过分析相应段落回答问题。相比于传统机器阅读理解任务的答案是在相关段落中的某一段文本,观点型问题因其答案可能不出现在相关段落中而需由多个句子推理得出,其对应的机器阅读理解任务更具挑战性。针对这个任务,提出一种新颖的基于神经网络的解决方案,其中使用了一种结合文本特征的混合词向量训练方法。此外,引入额外的注意力网络和输出层,产生多个辅助损失函数用于联合训练层叠循环神经网络。针对数据集样本分布不平衡的问题,引入问题和段落的不相关性实现数据增强。实验结果验证了所提方法的有效性。该方案获得了AIC2018观点型问题机器阅读理解赛道的双周赛冠军。

关键词组:机器阅读理解;神经网络;联合训练;数据增强


Share this article to: More

Go to Contents

References:

<Show All>

Open peer comments: Debate/Discuss/Question/Opinion

<1>

Please provide your name, email address and a comment





DOI:

10.1631/FITEE.1900571

CLC number:

TP391.1

Download Full Text:

Click Here

Downloaded:

6222

Download summary:

<Click Here> 

Downloaded:

1400

Clicked:

4592

Cited:

0

On-line Access:

2020-09-09

Received:

2019-10-19

Revision Accepted:

2020-03-16

Crosschecked:

2020-08-10

Journal of Zhejiang University-SCIENCE, 38 Zheda Road, Hangzhou 310027, China
Tel: +86-571-87952276; Fax: +86-571-87952331; E-mail: jzus@zju.edu.cn
Copyright © 2000~ Journal of Zhejiang University-SCIENCE