jiangnanboy / text-de-duplication

text de-duplication 文本去重

text de-duplication

利用tf-idf，simhash进行文本去重 A program about text keywords calculation by statistics and text similarity de-duplication by simhash.