xcmyz / bert-race

BERT/ALBERT based model for RACE dataset, support multi-worker, multi-GPU, FP16 and bind CPU.

BERT for RACE dataset

Run

1. multi-worker, multi-GPU (blind cpu):
   • bash run_multiworker.sh 0 <addr> 0 1 <model name> <dataset name> 320 <batch size on single GPU>
2. evaluation:
   • bash eval.sh