luyug / Reranker

Build Text Rerankers with Deep Language Models

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

some problem with the model performance

Wenjun-Peng opened this issue · comments

I follow the example of msmarco, but can not get the consistent results in your report.

the ckpt of bert is bert-base-uncased, here is my result on dev:
{'MRR @100': 0.41827504737896776, 'QueriesRanked': 5193}

Did I miss something?