FlyingSquid is a new framework for automatically building models from multiple noisy label sources. Users write functions that generate noisy labels for data, and FlyingSquid uses the agreements and disagreements between them to learn a label model of how accurate the labeling functions are. The label model can be used directly for downstream applications, or it can be used to train a powerful end model:
FlyingSquid can be used to build models for all sorts of tasks, including text applications, video analysis, and online learning. Check out our blog post and paper on arXiv for more details!
- Quickly install FlyingSquid
- Check out the examples folder for tutorials and some simple code examples
from flyingsquid.label_model import LabelModel
import numpy as np
L_train = np.load('...')
m = L_train.shape[1]
label_model = LabelModel(m)
label_model.fit(L_train)
preds = label_model.predict(L_train)We recommend using conda to install FlyingSquid:
git clone https://github.com/HazyResearch/flyingsquid.git
cd flyingsquid
conda env create -f environment.yml
conda activate flyingsquid
pip install -e .
cd ..
Alternatively, you can install the dependencies yourself:
And then install the actual package:
git clone https://github.com/HazyResearch/flyingsquid.git
cd flyingsquid
pip install -e .
cd ..
If you use our work or found it useful, please cite our arXiv paper for now:
@article{fu2020fast,
author = {Daniel Y. Fu and Mayee F. Chen and Frederic Sala and Sarah M. Hooper and Kayvon Fatahalian and Christopher R\'e},
title = {Fast and Three-rious: Speeding Up Weak Supervision with Triplet Methods},
journal = {arXiv preprint arXiv:2002.11955},
year = {2020},
}