entity-matching

There are 7 repositories under entity-matching topic.

• scify / JedAIToolkit

  An open source, high scalability toolkit in Java for Entity Resolution.

  entity-resolutionentity-matchingscalabilityblocking
  Language:Java 217

• zentity-io / zentity

  Entity resolution for Elasticsearch.

  elasticsearchelasticsearch-pluginentity-resolutiongdpridentity-resolutionname-matchingaddress-matchingentity-matching
  Language:Java 159

• vintasoftware / entity-embed

  PyTorch library for transforming entities like companies, products, etc. into vectors to support scalable Record Linkage / Entity Resolution using Approximate Nearest Neighbors.

  approximate-nearest-neighborsdata-matchingdeduplicationdeep-learningembeddingsentity-matchingentity-resolutionpythonpytorchrecord-linkagerepresentation-learning
  Language:Jupyter Notebook 151
• linktransformer

  dell-research-harvard / linktransformer

  A convenient way to link, deduplicate, aggregate and cluster data(frames) in Python using deep learning

  deep-learningentity-matchingentity-resolutionhuggingface-transformersnlppythonrecord-linkagesentence-transformerstransformers
  Language:Python 115
• pyJedAI

  AI-team-UoA / pyJedAI

  An open-source library that leverages Python’s data science ecosystem to build powerful end-to-end Entity Resolution workflows.

  deduplicationentity-matchingentity-resolutionpythonlink-discoverydata-matchingfuzzy-matchingmachine-learningdata-disambigationduplicate-detection
  Language:Python 74

• ing-bank / EntityMatchingModel

  Entity Matching Model solves the problem of matching company names between two possibly very large datasets.

  entity-matchingpandasspark
  Language:Python 67

• Senzing / awesome

  Curated list of awesome software and resources for Senzing, The First Real-Time AI for Entity Resolution.

  senzingentity-resolutionentityresolutionrecord-linkageentity-matchingresourceawesomedata-matchingde-duplicatingdedupededuplicationfuzzy-matchingfuzzymatchidentityidentity-resolutiondisambiguationentitiesentity-linkingsenzing-community
  Language:Python 56

• data61 / clkhash

  CLK hash: hash pii for entity matching

  record-linkageprivacy-enhancing-technologieshashingentity-matchingprivacy-preserving-record-linkage
  Language:Python 47

• deweylab / MetaSRA-pipeline

  MetaSRA: normalized sample-specific metadata for the Sequence Read Archive

  ontologiesannotation-processorrna-seqbioinformaticstext-miningbiologybiomedical-informaticsentity-matchingnatural-language-processingdata-mining
  Language:Python 43

• ZJU-DAILY / CollaborEM

  Code for the paper "CollaborEM: A Self-supervised Entity Matching Framework Using Multi-features Collaboration". TKDE 2021.

  entity-matching
  Language:Python 40

• ZJU-DAILY / PromptEM

  Code for the paper "PromptEM: Prompt-tuning for Low-resource Generalized Entity Matching". VLDB 2023.

  prompt-tuningentity-matching
  Language:Python 27

• phymbert / spark-search

  Spark Search - high performance advanced search features based on Apache Lucene

  sparklucenelucenesearchentity-matchingdeduplicationsearchfulltext
  Language:Scala 23

• abcsys / libem

  Compound AI toolchain for fast and accurate entity matching, powered by LLMs.

  entity-matchingentity-resolutionllmpythoncompound-ai-systemsdata-matchinglarge-language-modelsdata-integrationopenaiaidatabasegptllamacompound-systems
  Language:Python 22

• ArjitJ / DIAL

  Implementation of the paper "Deep Indexed Active Learning for Matching Heterogeneous Entity Representations"

  active-learningblockingentity-matchingentity-resolution
  Language:Python 16

• okgreece / Alignment

  Alignment, a collaborative, system aided, user driven ontology/vocabulary matching and validation platform.

  alignmentontologiesmatchingsemantic-weblinked-dataontology-matchingentity-matching
  Language:JavaScript 12

• tshu-w / ComEM

  Code for the paper "Match, Compare, or Select? An Investigation of Large Language Models for Entity Matching" (COLING 2025)

  compound-ai-systemsentity-matchingentity-resolutionlarge-language-modelllmdata-integrationdata-intelligence
  Language:Python 11

• magantoine / JobSkape

  JOBSKAPE: A Framework for Generating Synthetic Job Postings to Enhance Skill Matching

  dataset-generationentity-matchingllm
  Language:Python 8

• wbsg-uni-mannheim / winter

  WInte.r is a Java framework for end-to-end data integration. The WInte.r framework implements well-known methods for data pre-processing, schema matching, identity resolution, data fusion, and result evaluation.

  conflict-resolutionconflict-resolverdata-fusiondata-matchingdeduplicationentity-matchingentity-resolutionlink-discovery
  Language:Java 8

• enricopal / STEM

  entity-matchinglink-discoverydukesilkmachine-learning
  Language:Java 7

• Evnsn / awsome-entity-resolution

  A collection of awesome resources regarding Record Linkage.

  awesomeawesome-listdata-matchingentity-resolutionrecord-linkagedata-linkagedatamatchingentityresolutionmachine-learningpythonrecordlinkageentity-matchingerdmem
  7
• WinnER

  Nikoletos-K / WinnER

  A Winner-Take-All Hashing-Based Unsupervised Model for Entity Resolution Problems. [B. Sc. Thesis]

  entity-resolutionnlpjedailocality-sensitive-hashingmachine-learningoptunaprototype-selectionwtablockingdeduplicationentity-matchinglink-discoverypattern-recognitionpython
  Language:Jupyter Notebook 7

• Gaglia88 / ruler

  Scalable record-level matching rules

  similarity-joindistributed-computingentity-matchingentity-resolution
  Language:Scala 6

• INCATools / neoplasmer

  Neoplasm Entity Recognition: matching disease names to ontology classes

  nernlpobofoundrymondoncitcancerneoplasmentity-matching
  Language:Prolog 5

• tshu-w / EMBer

  Code and data for the paper "Bridging the Gap between Reality and Ideality of Entity Matching: A Revisiting and Benchmark Re-Construction" (IJCAI 2022)

  entity-matchingentity-resolutionbenchmarkijcai2022
  Language:Python 5

• tteofili / certa

  CERTA - Computing Entity Resolution explanations with TriAngles

  entity-matchingxaiexplainable-aidata-integrationentity-resolutionrecord-linkagemachine-learningpython
  Language:Python 5

• kylegilde / Entity-Matching-in-Online-Retail

  Master's Degree Final Project using Python & NLP

  nlpentity-matching
  Language:Jupyter Notebook 4

• rutgers-db / EntityBlockingBySimilarityJoins

  An end-to-end entity matching system

  data-integrationend-to-endentity-matchingsimilarity-join
  Language:C++ 4

• abcsys / libem-sample-data

  Libem sample datasets.

  compound-ai-systemsdatasetentity-matchingentity-resolutionlarge-language-modelsllm
  Language:Python 3

• diaspora-orm / diaspora

  :coffee: Multi-source ORM for Javascript Client+Server

  promiseentityentity-matchingormmodeldatabaselocalstorage-adaptermvc-helpers
  Language:TypeScript 3

• UIC-InDeXLab / fair_entity_matching

  Fair Entity Matching: A Fairness Suite for Auditing Entity Matching Approaches

  bias-detectiondata-integrationentity-matchingfairnessresearch-paper
  Language:Python 3

• wbsg-uni-mannheim-students / cross-lingual-product-matching

  nlptransformersentity-matchingproduct-matchingcross-lingual-transfer
  Language:Python 3

• ivan-bilan / Entity-Matching-Tutorial

  entity-matching
  Language:Jupyter Notebook 2

• tteofili / er-utils

  utilities for working with Entity Resolution models

  entity-resolutionentity-matchingdata-managementaideep-learningrecord-linkage
  Language:Python 2

• abcsys / libem-notebook

  Libem notebooks.

  entity-matchingentity-resolutionlarge-language-modelsllmlibem
  Language:Jupyter Notebook 1

• catalyst-cooperative / ccai-entity-matching

  An exploration of generalizable approaches to unsupervised entity matching for use in linking tabular public energy data sources.

  entity-matchingrecord-linkageembeddingsmachine-learningnlpword2vecautoencoderspgmtf-idfccai
  Language:Jupyter Notebook 1

• softlab-unimore / landmark

  Entity Matching specific Explanation tool. Landmark generates reliable and coherent explanations through a perturbation analysis.

  entity-matchingexplanationmachine-learningdeep-learning
  Language:Jupyter Notebook 1