data-matching
There are 12 repositories under data-matching topic.
moj-analytical-services / splink
Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends
Language:Python 1292- recordlinkage
J535D165 / recordlinkage
A powerful and modular toolkit for record linkage and duplicate detection in Python
Language:Python 952 A list of free data matching and record linkage software.
RobinL / fuzzymatcher
Record linking package that fuzzy matches two Python pandas dataframes using sqlite3 fts4
Language:Python 281- Language:Python 183
vintasoftware / entity-embed
PyTorch library for transforming entities like companies, products, etc. into vectors to support scalable Record Linkage / Entity Resolution using Approximate Nearest Neighbors.
Language:Jupyter Notebook 146ropeladder / record-linkage-resources
Resources for tackling record linkage / deduplication / data matching problems
- Language:Python 97
- pyJedAI
AI-team-UoA / pyJedAI
An open-source library that leverages Python’s data science ecosystem to build powerful end-to-end Entity Resolution workflows.
Language:Python 68 Senzing / awesome
Curated list of awesome software and resources for Senzing, The First Real-Time AI for Entity Resolution.
Language:Python 51A browser user interface for manual labeling of record pairs.
Language:JavaScript 41- snowman
HPI-Information-Systems / snowman
Welcome to Snowman App – a Data Matching Benchmark Platform.
Language:TypeScript 37 lewinfox / levitate
Fuzzy string matching in R. Inspired by Python's thefuzz (but without the Python).
Language:R 34vaneseltine / nominally
A maximum-strength name parser for record linkage.
Language:Python 30carlosraphael / specification-pattern
https://medium.com/@carlosraphael/specification-design-pattern-in-java-8-bac6f5f943bc
Language:Java 29- Language:Python 17
- Language:Python 10
wbsg-uni-mannheim / winter
WInte.r is a Java framework for end-to-end data integration. The WInte.r framework implements well-known methods for data pre-processing, schema matching, identity resolution, data fusion, and result evaluation.
Language:Java 7Evnsn / awsome-entity-resolution
A collection of awesome resources regarding Record Linkage.
ihmeuw / person_linkage_case_study
Emulates the methods the US Census Bureau uses to link people across multiple data sources, using open-source software (Splink) and simulated data (from pseudopeople).
Language:HTML 3rohitgarud / asreview-preprocess
An extension for ASReview Lab to preprocess the dataset before importing in ASReview
Language:Python 2AvinashSingh786 / WekaComparator
Weka Comparator to match rules to test data with filtering abilites
Language:Java 1Knodl-LLC / KnoDL-Match
Service for automatic matching two data sets without mapping
Language:Shell 1sevetseh28 / data-integration-extensible-framework
Undergraduate Final Project (needs README up to date!!) - Scientific paper soon to be included
Language:HTML 1greyhub / job_center
Crawl, matching and explore data about jobs in Viet Nam.
Language:Jupyter Notebook 0pkhaan / AutoCuratedMovieLists
This projects aims to provide lists containing only great movies to users based only a gew filters and search parameters.
Language:Dart 0boscoj2008 / AdapterEM
AdapterEM: Pre-trained Language Model Adaptation for Generalized Entity Matching using Adapter-tuning
Language:PythonGust4voSales / proxcluster-deduplicator
ProxCluster is a framework for Incremental Entity Resolution that leverages concepts similar to K-Means for clustering duplicates. This work was developed as the final paper for my Bachelor degree in Computer Science
Language:Jupyter NotebookKNehe / musical
A Single View application aggregates and reconciles data from multiple sources to create a single view of an entity.
Language:Pythonlokhande-vishnu / cs838-data-science
Repository for CS 838 (Spring 2017) Data Science project
Language:Jupyter NotebookXhst / ml-record-linkage
Unstructured Record Linkage using Siamese Networks and Large Language Models (LLMs) such as LLAMA3 and ChatGPT-4o.
Language:Python
