luyug / Condenser

EMNLP 2021 - Pre-training architectures for dense retrieval

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Hi, i got this problem when pre-training Condenser. I try several version of transformer to fix but it didn't work. Can you help me please

PNMinh286 opened this issue · comments

It looks like you didn't point the code to the proper training data directory.

It looks like you didn't point the code to the proper training data directory.
Thank you for answering. I try ver 4.2.0 and it worked

commented

Function _remove_unused_columns(in latest transformers's trainer.py ) will set dataset to None.
So higher version transformers doesn't work.