adnilsson / leaf

Leaf: A Benchmark for Federated Settings

Leaf: A Benchmark for Federated Settings

Datasets

1. FEMNIST

• Overview: Image Dataset
• Details: 62 different classes (10 digits, 26 lowercase, 26 uppercase), images are 28 by 28 pixels (with option to make them all 128 by 128 pixels), 3500 users
• Task: Image Classification

2. Sentiment140

• Overview: Text Dataset of Tweets
• Details 660120 users
• Task: Sentiment Analysis

3. Shakespeare

• Overview: Text Dataset of Shakespeare Dialogues
• Details: 2288 users
• Task: Next-Character Prediction

Notes

• Install the libraries listed in requirements.txt
  • I.e. with pip: run pip3 install -r requirements.txt
• Go to directory of respective dataset for instructions on generating data
• models directory contains instructions on running baseline reference implementations