facebookresearch / SemDeDup

Code for "SemDeDup", a simple method for identifying and removing semantic duplicates from a dataset (data pairs which are semantically similar, but not exactly identical).

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

facebookresearch/SemDeDup Stargazers