Federated Knowledge Distillation PaperList

About

Reading List of recent published Federated Learning & Knowledge Distillation papers

Reading Priority: Top: 🌟 Second ⭐

⭐Split learning for health: Distributed deep learning without sharing raw patient data [paper]
⭐Group Knowledge Transfer: Federated Learning of Large CNNs at the Edge [paper]

🌟Survey of personalization techniques for federated learning[paper]
⭐Advances and Open Problems in Federated Learning[paper]
⭐Federated Machine Learning: Concept and Applications [paper]
From Federated Learning to Federated Neural Architecture Search: A Survey [paper]
A survey on security and privacy of federated learning [paper]
Federated Learning: Challenges, Methods, and Future Directions[paper]
[IEEE Communications Surveys & Tutorials 2019] Federated learning in mobile edge networks: A comprehensive survey [paper]
[IEEE, 2020] Federated learning: A survey on enabling technologies, protocols, and applications [paper]

⭐Federated model distillation with noise-free differential privacy[paper]
FedBE: Making Bayesian Model Ensemble Applicable to Federated Learning[paper]
⭐FedMD: Heterogenous Federated Learning via Model Distillation[paper][code]
Federated Learning with Heterogeneous Labels and Models for Mobile Activity Monitoring[paper]
⭐Federated Mutual Learning[paper]
Knowledge Federation: A Unified and Hierarchical Privacy-Preserving AI Framework [paper]
Wireless federated distillation for distributed edge learning with heterogeneous data[paper]
Communication-efficient on-device machine learning: Federated distillation and augmentation under non-iid private data[paper]
Performance Optimization for Federated Person Re-identification via Benchmark Analysis[paper] [KD as optimization tool section 5]
KD3A: Unsupervised Multi-Source Decentralized Domain Adaptation via Knowledge Distillation[paper]
Real-Time Decentralized knowledge Transfer at the Edge[paper]

⭐FedED: Federated Learning via Ensemble Distillation for Medical Relation Extraction[paper]
⭐Ensemble distillation for robust model fusion in federated learning[paper]
⭐Improving question answering by commonsense-based pre-training [paper]
⭐Collaborative fairness in federated learning[paper]
CovidNLP: a web application for distilling systemic implications of COVID-19 pandemic with Natural Language processing[paper]
Federated learning for healthcare informatics [paper]
Sentiment detection with FedMD: Federated Learning via Model Distillation[paper]

FL Applications: