entity-matching

There are 7 repositories under entity-matching topic.

• scify / JedAIToolkit

  An open source, high scalability toolkit in Java for Entity Resolution.

  blockingentity-matchingentity-resolutionscalability
  Language:Java 215

• zentity-io / zentity

  Entity resolution for Elasticsearch.

  address-matchingelasticsearchelasticsearch-pluginentity-matchingentity-resolutiongdpridentity-resolutionname-matching
  Language:Java 158

• vintasoftware / entity-embed

  PyTorch library for transforming entities like companies, products, etc. into vectors to support scalable Record Linkage / Entity Resolution using Approximate Nearest Neighbors.

  approximate-nearest-neighborsdata-matchingdeduplicationdeep-learningembeddingsentity-matchingentity-resolutionpythonpytorchrecord-linkagerepresentation-learning
  Language:Jupyter Notebook 148
• linktransformer

  dell-research-harvard / linktransformer

  A convenient way to link, deduplicate, aggregate and cluster data(frames) in Python using deep learning

  deep-learningentity-matchingentity-resolutionhuggingface-transformersnlppythonrecord-linkagesentence-transformerstransformers
  Language:Python 106
• pyJedAI

  AI-team-UoA / pyJedAI

  An open-source library that leverages Python’s data science ecosystem to build powerful end-to-end Entity Resolution workflows.

  deduplicationentity-matchingentity-resolutionpythonlink-discoverydata-matchingfuzzy-matchingmachine-learningdata-disambigationduplicate-detection
  Language:Python 75

• ing-bank / EntityMatchingModel

  Entity Matching Model solves the problem of matching company names between two possibly very large datasets.

  entity-matchingpandasspark
  Language:Python 63

• Senzing / awesome

  Curated list of awesome software and resources for Senzing, The First Real-Time AI for Entity Resolution.

  senzingentity-resolutionentityresolutionrecord-linkageentity-matchingresourceawesomedata-matchingde-duplicatingdedupededuplicationfuzzy-matchingfuzzymatchidentityidentity-resolutiondisambiguationentitiesentity-linkingsenzing-community
  Language:Python 53

• data61 / clkhash

  CLK hash: hash pii for entity matching

  entity-matchinghashingprivacy-enhancing-technologiesprivacy-preserving-record-linkagerecord-linkage
  Language:Python 47

• deweylab / MetaSRA-pipeline

  MetaSRA: normalized sample-specific metadata for the Sequence Read Archive

  ontologiesannotation-processorrna-seqbioinformaticstext-miningbiologybiomedical-informaticsentity-matchingnatural-language-processingdata-mining
  Language:Python 42

• ZJU-DAILY / CollaborEM

  Code for the paper "CollaborEM: A Self-supervised Entity Matching Framework Using Multi-features Collaboration". TKDE 2021.

  entity-matching
  Language:Python 39

• ZJU-DAILY / PromptEM

  Code for the paper "PromptEM: Prompt-tuning for Low-resource Generalized Entity Matching". VLDB 2023.

  prompt-tuningentity-matching
  Language:Python 26

• phymbert / spark-search

  Spark Search - high performance advanced search features based on Apache Lucene

  sparklucenelucenesearchentity-matchingdeduplicationsearchfulltext
  Language:Scala 23

• abcsys / libem

  Compound AI toolchain for fast and accurate entity matching, powered by LLMs.

  entity-matchingentity-resolutionllmpythoncompound-ai-systemsdata-matchinglarge-language-modelsdata-integrationopenaiaidatabasegptllama
  Language:Python 19

• ArjitJ / DIAL

  Implementation of the paper "Deep Indexed Active Learning for Matching Heterogeneous Entity Representations"

  active-learningblockingentity-matchingentity-resolution
  Language:Python 16

• okgreece / Alignment

  Alignment, a collaborative, system aided, user driven ontology/vocabulary matching and validation platform.

  alignmentontologiesmatchingsemantic-weblinked-dataontology-matchingentity-matching
  Language:JavaScript 12

• tshu-w / ComEM

  Code for the paper "Match, Compare, or Select? An Investigation of Large Language Models for Entity Matching"

  compound-ai-systemsdata-integrationdata-intelligenceentity-matchingentity-resolutionlarge-language-modelllm
  Language:Python 8

• wbsg-uni-mannheim / winter

  WInte.r is a Java framework for end-to-end data integration. The WInte.r framework implements well-known methods for data pre-processing, schema matching, identity resolution, data fusion, and result evaluation.

  conflict-resolutionconflict-resolverdata-fusiondata-matchingdeduplicationentity-matchingentity-resolutionlink-discovery
  Language:Java 8

• enricopal / STEM

  dukeentity-matchinglink-discoverymachine-learningsilk
  Language:Java 7

• Evnsn / awsome-entity-resolution

  A collection of awesome resources regarding Record Linkage.

  awesomeawesome-listdata-linkagedata-matchingdatamatchingdmementity-matchingentity-resolutionentityresolutionermachine-learningpythonrecord-linkagerecordlinkage
  7
• WinnER

  Nikoletos-K / WinnER

  A Winner-Take-All Hashing-Based Unsupervised Model for Entity Resolution Problems. [B. Sc. Thesis]

  entity-resolutionnlpjedailocality-sensitive-hashingmachine-learningoptunaprototype-selectionwtablockingdeduplicationentity-matchinglink-discoverypattern-recognitionpython
  Language:Jupyter Notebook 7

• tteofili / certa

  CERTA - Computing Entity Resolution explanations with TriAngles

  data-integrationentity-matchingentity-resolutionexplainable-aimachine-learningpythonrecord-linkagexai
  Language:Python 7

• Gaglia88 / ruler

  Scalable record-level matching rules

  similarity-joindistributed-computingentity-matchingentity-resolution
  Language:Scala 6

• magantoine / JobSkape

  JOBSKAPE: A Framework for Generating Synthetic Job Postings to Enhance Skill Matching

  dataset-generationentity-matchingllm
  Language:Python 5

• tshu-w / EMBer

  Code and data for the paper "Bridging the Gap between Reality and Ideality of Entity Matching: A Revisiting and Benchmark Re-Construction"

  benchmarkentity-matchingentity-resolutionijcai2022
  Language:Python 5

• INCATools / neoplasmer

  Neoplasm Entity Recognition: matching disease names to ontology classes

  nernlpobofoundrymondoncitcancerneoplasmentity-matching
  Language:Prolog 4

• kylegilde / Entity-Matching-in-Online-Retail

  Master's Degree Final Project using Python & NLP

  nlpentity-matching
  Language:Jupyter Notebook 4

• rutgers-db / EntityBlockingBySimilarityJoins

  An end-to-end entity matching system

  data-integrationend-to-endentity-matchingsimilarity-join
  Language:C++ 4

• abcsys / libem-sample-data

  Libem sample datasets.

  compound-ai-systemsdatasetentity-matchingentity-resolutionlarge-language-modelsllm
  Language:Python 3

• diaspora-orm / diaspora

  :coffee: Multi-source ORM for Javascript Client+Server

  promiseentityentity-matchingormmodeldatabaselocalstorage-adaptermvc-helpers
  Language:TypeScript 3

• wbsg-uni-mannheim-students / cross-lingual-product-matching

  cross-lingual-transferentity-matchingnlpproduct-matchingtransformers
  Language:Python 3

• ivan-bilan / Entity-Matching-Tutorial

  entity-matching
  Language:Jupyter Notebook 2

• tteofili / er-utils

  utilities for working with Entity Resolution models

  entity-resolutionentity-matchingdata-managementaideep-learningrecord-linkage
  Language:Python 2

• UIC-InDeXLab / fair_entity_matching

  Fair Entity Matching: A Fairness Suite for Auditing Entity Matching Approaches

  bias-detectiondata-integrationentity-matchingfairnessresearch-paper
  Language:Python 2

• abcsys / libem-notebook

  Libem notebooks.

  entity-matchingentity-resolutionlarge-language-modelsllmlibem
  Language:Jupyter Notebook 1

• catalyst-cooperative / ccai-entity-matching

  An exploration of generalizable approaches to unsupervised entity matching for use in linking tabular public energy data sources.

  autoencodersccaiembeddingsentity-matchingmachine-learningnlppgmrecord-linkagetf-idfword2vec
  Language:Jupyter Notebook 1

• softlab-unimore / landmark

  Entity Matching specific Explanation tool. Landmark generates reliable and coherent explanations through a perturbation analysis.

  entity-matchingexplanationmachine-learningdeep-learning
  Language:Jupyter Notebook 1