Dedupe.io

dedupe

:id: A python library for accurate and scalable fuzzy matching, record deduplication and entity-resolution.

dedupe-examples

:id: Examples for using the dedupe library

affinegap

:triangular_ruler: A Cython implementation of the affine gap string distance

hcluster

Hierarchical Clustering Algorithms

pylbfgs

:mountain_cableway: Python/Cython wrapper for liblbfgs

pyhacrf

:triangular_ruler: Hidden alignment conditional random field for classifying string pairs.

dedupe-geocoder

:round_pushpin: Demonstration of how dedupe might be used as geocoder

doublemetaphone

:sound: Python wrapper for a C++ Double Metaphone

fuzzycategory

:triangular_ruler: Fuzzy Categorical Distances

rlr

Regularized Logistic Regression

dedupe-variable-address

Address Variable Type for dedupe

dedupe-variable-person

Dedupe variable for person names. just people. no companies.

dedupe-variable-name

name variable type for dedupe

dedupeio-web-api-docs

Dedupe.io web API allows for matching and training against projects using a standard RESTful framework.

highered

CRF Edit Distance

Levenshtein_search

Python search module for fast approximate string matching

soft-tfidf

Mispelling tolerant tf-idf similarity metric

dedupe-variable-employer

categorical-distance

:triangular_ruler: Compare categorical variables

dedupe-variable-datetime

DateTime variable for dedupe

dedupe-variable-fuzzycategory

Dedupe Variable for Fuzzy Categories

dedupe-vowpal

Vowpal Wabbit Active Labeler for Dedupe

learned-string-alignments

Learning String Alignments for Entity Aliases

datetime-distance

 📐 Compare dates and times

dedupe-variable-number

Try to cast strings to numbers, then compare

parseratorvariable

Base class for dedupe variables for parsed fields

simplecosine

:triangular_ruler: simple cosine distance

dedupe-variable-ilcs

Dedupe variable for Illinois Compiled Statute (ILCS) codes

fastcluster

Fast hierarchical clustering routines for R and Python.

dedupe-variable-embedding

Use embeddings for semantic comparisons