weak-supervision

There are 23 repositories under weak-supervision topic.

cleanlab / cleanlab
The standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.
weak-supervision data-cleaning data-quality data-science noisy-labels data-centric-ai out-of-distribution-detection outlier-detection active-learning data-labeling data-profiling data-validation data-analysis labeling data-curation annotation dataops dataquality llms datasets
Language:Python 8606
snorkel-team / snorkel
A system for quickly generating training data with weak supervision
machine-learning ai weak-supervision labeling data-science python snorkel training-data data-augmentation data-slicing
Language:Python 5703
argilla
argilla-io / argilla
Argilla is a collaboration platform for AI engineers and domain experts that require high-quality outputs, full data ownership, and overall efficiency.
human-in-the-loop natural-language-processing mlops developer-tools text-labeling annotation-tool nlp machine-learning active-learning weak-supervision weakly-supervised-learning text-annotation llm ai gpt-4 rlhf langchain
Language:Python 3096
NorskRegnesentral / skweak
skweak: A software toolkit for weak supervision applied to NLP tasks
weak-supervision nlp-machine-learning distant-supervision nlp-library spacy python data-science training-data natural-language-processing
Language:Python 909
cliang1453 / BOND
BOND: BERT-Assisted Open-Domain Name Entity Recognition with Distant Supervision
ner named-entity-recognition distant-supervision roberta open-domain self-training weakly-supervised-learning weak-supervision weakly-supervised bert pre-trained fine-tuning natural-language-processing nlp dataset
Language:Python 290
dataqa / nlp-labelling
Labelling platform for text using weak supervision.
annotation-tool data-labeling data-science learning-with-limited-labeled-data learning-with-noisy-labels natural-language-processing ner nlp nlp-machine-learning pseudo-labeling search-engine text-annotation-tool text-classification text-mining weak-supervision
Language:JavaScript 255
JieyuZ2 / wrench
[NeurIPS 2021] WRENCH: Weak supeRvision bENCHmark
weak-supervision weakly-supervised-learning data-programming data-centric-ai benchmark-framework machine-learning dataset nlp sequence-labeling deep-learning robust-learning
Language:Python 211
yueyu1030 / COSINE
[NAACL 2021] This is the code for our paper `Fine-Tuning Pre-trained Language Model with Weak Supervision: A Contrastive-Regularized Self-Training Approach'.
weak-supervision weakly-supervised-learning language-model fine-tuning self-training text-classification slot-filling sentence-pair-classification learning-with-noisy-labels contrastive-learning roberta agnews roberta-model pseudo-labeling dataset
Language:Python 198
autonise / CRAFT-Remade
Implementation of CRAFT Text Detection
ocr detection text-detection weak-supervision craft pytorch-implementation pytorch
Language:Python 191
JieyuZ2 / Awesome-Weak-Supervision
A curated list of programmatic weak supervision papers and resources
data-programming machine-learning weak-supervision
Language:TeX 170
dmMaze / comic-text-detector
Manga&Comic text detection
scene-text-detection weak-supervision weakly-supervised-segmentation ocr computer-vision manga-translation anime comics deep-learning object-detection
Language:Python 168
microsoft / ASTRA
Self-training with Weak Supervision (NAACL 2021)
weak-supervision nlp machine-learning weakly-supervised-learning
Language:Python 155
autonlab / weasel
Weakly Supervised End-to-End Learning (NeurIPS 2021)
machine-learning deep-learning weak-supervision end-to-end-learning pytorch-lightning multi-source-weak-supervision weakly-supervised-learning
Language:Python 153
AlvaroCavalcante / auto_annotate
Labeling is boring. Use this tool to speed up your next object detection project!
tensorflow labeling-tool object-detection annotation-tool computer-vision dataset-generation pattern-recognition python python3 semi-supervised-learning weak-supervision
Language:Jupyter Notebook 146
NorskRegnesentral / weak-supervision-for-NER
Framework to learn Named Entity Recognition models without labelled data using weak supervision.
nlp weak-supervision named-entity-recognition python hidden-markov-models spacy natural-language-processing domain-adaptation
Language:Jupyter Notebook 124
yaqingwang / WeFEND-AAAI20
Dataset for paper "Weak Supervision for Fake News Detection via Reinforcement Learning" published in AAAI'2020.
fake-news weakly-supervised-learning weak-supervision dataset aaai2020 deep-learning social-media
Language:Jupyter Notebook 111
spear
decile-team / spear
SPEAR: Programmatically label and build training data quickly.
data-programming data-efficient-learning labeling-functions weak-supervision machine-learning unsupervised-learning semi-supervised-learning deep-learning
Language:Jupyter Notebook 103
knodle / knodle
A PyTorch-based open-source framework that provides methods for improving the weakly annotated data and allows researchers to efficiently develop and compare their own methods.
relation-extraction classification python machine-learning knodle weak-supervision natural-language-procressing ai pytorch snorkel denoising-methods weakly-supervised-learning
Language:Python 103
amzn / amazon-weak-ner-needle
Named Entity Recognition with Small Strongly Labeled and Large Weakly Labeled Data
bert biomedical biomedical-named-entity-recognition distant-supervision ner weak-supervision weakly-supervised-learning
Language:Python 99
som-shahlab / trove
Weakly supervised medical named entity classification
weak-supervision weakly-supervised-learning pseudo-labeling bert learning-with-noisy-labels ner text-classification biomedical umls umls-metathesaurus ontology
Language:Python 68
maxent-ai / zeroshot_topics
Topic Inference with Zeroshot models
zeroshot-learning nlp machine-learning data-science transformers huggingface keybert bert keyword-extraction nli text-classification labelled-data labelling text weakly-supervised-learning weak-supervision knowledge-graph taxonomy hypernymy-extraction linguistics
Language:Python 60
awasthiabhijeet / Learning-From-Rules
Implementation of experiments in paper "Learning from Rules Generalizing Labeled Exemplars" to appear in ICLR2020 (https://openreview.net/forum?id=SkeuexBtDr)
weakly-supervised-learning iclr2020 high-level-supervision rule-based-nlp rulebasednlp representation-learning data-augmentation weak-supervision weakly-supervised
Language:Python 49
dmitrykazhdan / concept-based-xai
Library implementing state-of-the-art Concept-based and Disentanglement Learning methods for Explainable AI
vae xai concept explainability interpretability model-explanation explainable-ai concept-extraction concept-explanation disentangled-representations disentanglement weakly-supervised-learning weak-supervision library
Language:Python 48
astra-vision / COARSE3D
COARSE3D: Class-Prototypes for Contrastive Learning in Weakly-Supervised 3D Point Cloud Segmentation (BMVC 2022)
3d contrastive-learning pcl point-cloud pointcloud range-image semantic-segmentation weak-supervision weakly-supervised-learning
Language:Python 43
asrafulashiq / hamnet
PyTorch implementation of AAAI 2021 paper: A Hybrid Attention Mechanism for Weakly-Supervised Temporal Action Localization
activity-recognition attention-mechanism weak-supervision
Language:Python 39
cgnorthcutt / confidentlearning-reproduce
Official data release to reproduce Confident Learning paper results
confident-learning reproducible-research reproducibility machine-learning supervised-learning weak-supervision noisy-labels
Language:Jupyter Notebook 39
BatsResearch / alfred
A system for prompted weak supervision.
annotation-tool data data-annotation llm programmatic-weak-supervision prompting vlm weak-supervision
Language:Python 38
megagonlabs / ruler
Data Programming by Demonstration (DPBD) for Document Classification
data-labeling data-programming data-science machine-learning training-data weak-supervision
Language:Jupyter Notebook 36
megagonlabs / tagruler
Data programming by demonstration for information extraction and span annotation
weak-supervision data-programming data-programming-by-demonstration data-labeling machine-learning
Language:JavaScript 35
rz-zhang / PRBoost
The codes for our ACL'22 paper: PRBOOST: Prompt-Based Rule Discovery and Boosting for Interactive Weakly-Supervised Learning.
weakly-supervised-learning weak-supervision rule-learning rule-discovery online-learning iterative-learning interactive-learning prompt boosting adaptive-learning nlp
34
Yinghao-Li / CHMM-ALT
Code for "BERTifying the Hidden Markov Model for Multi-Source Weakly Supervised Named Entity Recognition"
weakly-supervised-learning weak-supervision nlp ner hmm
Language:Python 32
benbo / interactive-weak-supervision
Interactive Weak Supervision: Learning Useful Heuristics for Data Labeling
weak-supervision data-programming data-labeling active-weak-supervision interactive-weak-supervision machine-learning training-data
Language:Python 30
acadTags / Rare-disease-identification
Rare disease identification from free-text clinical notes with ontologies and weak supervision
ontology ordo weak-supervision rare-disease clinical-notes mimic-iii discharge-summaries umls entity-linking ontology-matching
Language:Python 24
doccano / spacy-partial-tagger
A simple library for training named entity recognition model from partially annotated data
named-entity-recognition natural-language-processing nlp spacy weak weak-supervision weakly-supervised-learning
Language:Jupyter Notebook 19
saran9991 / llm-data-annotation
Use Large Language Models like OpenAI's GPT-3.5 for data annotation and model enhancement. This framework combines human expertise with LLMs, employs Iterative Active Learning for continuous improvement, and integrates CleanLab (Confident Learning) to ensure high-quality datasets and better model performance
bert data-annotation fine-tuning gpt-3-5-turbo llm nlp dvc mlflow active-learning cleanlab confident-learning gpt gpt-4 noisy-labels weak-supervision
Language:Python 16
autonlab / KeyClass
Code for "Classifying Unstructured Clinical Notes via Automatic Weak Supervision", MLHC 2022.
healthcare-application machine-learning text-classification weak-supervision
Language:Python 15

weak-supervision

cleanlab / cleanlab

snorkel-team / snorkel

argilla-io / argilla

NorskRegnesentral / skweak

cliang1453 / BOND

dataqa / nlp-labelling

JieyuZ2 / wrench

yueyu1030 / COSINE

autonise / CRAFT-Remade

JieyuZ2 / Awesome-Weak-Supervision

dmMaze / comic-text-detector

microsoft / ASTRA

autonlab / weasel

AlvaroCavalcante / auto_annotate

NorskRegnesentral / weak-supervision-for-NER

yaqingwang / WeFEND-AAAI20

decile-team / spear

knodle / knodle

amzn / amazon-weak-ner-needle

som-shahlab / trove

maxent-ai / zeroshot_topics

awasthiabhijeet / Learning-From-Rules

dmitrykazhdan / concept-based-xai

astra-vision / COARSE3D

asrafulashiq / hamnet

cgnorthcutt / confidentlearning-reproduce

BatsResearch / alfred

megagonlabs / ruler

megagonlabs / tagruler

rz-zhang / PRBoost

Yinghao-Li / CHMM-ALT

benbo / interactive-weak-supervision

acadTags / Rare-disease-identification

doccano / spacy-partial-tagger

saran9991 / llm-data-annotation

autonlab / KeyClass