JunyiYe / text-token-diff

Difference comparison at the token level for texts

Repository from Github https://github.comJunyiYe/text-token-diffRepository from Github https://github.comJunyiYe/text-token-diff

text-token-diff

Difference comparison at the token level for texts

Sample examples

Here we show the difference among

  1. Character-level text difference.
  2. Word-level text difference (Here, words are elementes that are splited by whitespaces). Limitation: Punctuation is usually attached to the preceding word.
  3. Token-level text difference image

About

Difference comparison at the token level for texts

License:MIT License


Languages

Language:Python 100.0%