PixelSSL is a PyTorch-based semi-supervised learning (SSL) codebase for pixel-wise (Pixel) vision tasks.
The purpose of this project is to promote the research and application of semi-supervised learning on pixel-wise vision tasks. PixelSSL provides two major features:
- Interface for implementing new semi-supervised algorithms
- Template for encapsulating diverse computer vision tasks
As a result, the SSL algorithms integrated in PixelSSL are compatible with all task codes inherited from the given template.
In addition, PixelSSL provides the benchmarks for validating semi-supervised learning algorithms for some pixel-level tasks, which now include semantic segmentation.
News
-
[Dec 25 2020] PixelSSL v0.1.4 is Released!
🎄 Merry Christmas! 🎄
v0.1.4 supports the CutMix semi-supervised learning algorithm for pixel-wise classification. -
[Nov 06 2020] PixelSSL v0.1.3 is Released!
v0.1.3 supports the CCT semi-supervised learning algorithm for pixel-wise classification. -
[Oct 28 2020] PixelSSL v0.1.2 is Released!
v0.1.2 supports PSPNet and its SSL results for semantic segmentation task (check here).[More]
Supported Algorithms and Tasks
We are actively updating this project.
The SSL algorithms and demo tasks supported by PixelSSL are summarized in the following table:
| Algorithms / Tasks | Segmentation | Other Tasks |
|---|---|---|
| SupOnly | v0.1.0 | Coming Soon |
| MT [1] | v0.1.0 | Coming Soon |
| AdvSSL [2] | v0.1.0 | Coming Soon |
| S4L [3] | v0.1.1 | Coming Soon |
| CCT [4] | v0.1.3 | Coming Soon |
| GCT [5] | v0.1.0 | Coming Soon |
| CutMix [6] | v0.1.4 | Coming Soon |
[1] Mean Teachers are Better Role Models: Weight-Averaged Consistency Targets Improve Semi-Supervised Deep Learning Results
Antti Tarvainen, and Harri Valpola. NeurIPS 2017.
[2] Adversarial Learning for Semi-Supervised Semantic Segmentation
Wei-Chih Hung, Yi-Hsuan Tsai, Yan-Ting Liou, Yen-Yu Lin, and Ming-Hsuan Yang. BMVC 2018.
[3] S4L: Self-Supervised Semi-Supervised Learning
Xiaohua Zhai, Avital Oliver, Alexander Kolesnikov, and Lucas Beyer. ICCV 2019.
[4] Semi-Supervised Semantic Segmentation with Cross-Consistency Training
Yassine Ouali, Céline Hudelot, and Myriam Tami. CVPR 2020.
[5] Guided Collaborative Training for Pixel-wise Semi-Supervised Learning
Zhanghan Ke, Di Qiu, Kaican Li, Qiong Yan, and Rynson W.H. Lau. ECCV 2020.
[6] Semi-Supervised Semantic Segmentation Needs Strong, Varied Perturbations
Geoff French, Samuli Laine, Timo Aila, Michal Mackiewicz, and Graham Finlayson. BMVC 2020.
Installation
Please refer to the Installation document.
Getting Started
Please follow the Getting Started document to run the provided demo tasks.
Tutorials
We provide the API document and some tutorials for using PixelSSL.
- Tutorial 1 - Implement A New Pixel-wise Semi-Supervised Algorithm
- Tutorial 2 - Implement A New Pixel-wise Task Based on the Task Template
- Tutorial 3 - Dataset Wrappers for Semi-Supervised Learning
- Tutorial 4 - Support More Optimizers and LRSchedulers
License
This project is released under the Apache 2.0 license.
Acknowledgement
We thank City University of Hong Kong and SenseTime for their support to this project.
Citation
This project is extended from our ECCV 2020 paper Guided Collaborative Training for Pixel-wise Semi-Supervised Learning (GCT). If this codebase or our method helps your research, please cite:
@InProceedings{ke2020gct,
author = {Ke, Zhanghan and Qiu, Di and Li, Kaican and Yan, Qiong and Lau, Rynson W.H.},
title = {Guided Collaborative Training for Pixel-wise Semi-Supervised Learning},
booktitle = {European Conference on Computer Vision (ECCV)},
month = {August},
year = {2020},
}Contact
This project is currently maintained by Zhanghan Ke (@ZHKKKe).
If you have any questions, please feel free to contact kezhanghan@outlook.com.