lixinsu / RCZoo

question answering, reading comprehension toolkit

Introduction

The RCZoo project is a toolkit for reading comprehension model. It contains the PyTorch reimplement of multiple reading comprehension models

Usage

• run sh download.sh to download the dataset and the glove embeddings.
• run sh runs/train_squad.sh [bidaf|drqa|slqa|fusionnet|docqa] to start the train process. (Check the xxx.sh scripts before run, as the preprocessing only need to be executed once)

Dependencies

python 3.5
Pytorch 0.4
tqdm

performance

We train each model on train set for 40 epoch, and report the best performance on dev set.

Model	Exact Match	F1	EM(+ELMo)	F1(+ELMo)
Rnet	69.25	78.97
BiDAF	70.47	79.90	73.04	81.48
documentqa	71.47	80.84
DrQA	68.39	77.90
QAnet	...	...
SLQA	67.09	76.67
FusionNet	68.27	77.79

Current progress

Rnet

BiDAF

documentqa

DrQA

QAnet

SLQA

FusionNet

acknowledgement

some code are borrowed from DrQA, a cool project about reading comprehension.