stanleychu2 / AI2021-final-project

Artificial Intelligence 2021 Spring - Fact Verification

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Artificial Intelligence 2021 Spring - Fact Verification

Data

  • data folder: original data from fever.ai
  • preprocess folder: add knowledge from wiki.json
gdown --id "1OQ6oK08jqjFHnlrM24m3gXYB6VdWQD6C"
unzip wiki.zip
rm wiki.zip
python3 preprocess.py data/train.jsonl preprocess/train.json

Train

  • MODEL=xlnet-base-cased
  • MODEL=distilgpt2
  • MODEL=nielsr/coref-roberta-base
  • weights save at ckpt
bash run_fever.sh

Predict

python3 predict.py --test preprocess/valid.json --ckpt checkpoint

About

Artificial Intelligence 2021 Spring - Fact Verification


Languages

Language:Python 97.2%Language:Shell 2.8%