leaderj1001 / Bag-of-MLP

Bag of MLP

Bag-of-MLP

Reference

• MLP-Mixer: An all-MLP Architecture for Vision, MLPMixer
  • Organization: Google Research, Brain Team
• ResMLP: Feedforward networks for image classification with data-efficient training, ResMLP
  • Organization: Facebook AI, Sorbonne University, Inria
• gMLP: Pay Attention to MLPs, gMLP
  • Organization: Google Research, Brain Team

Summary

• MLPMixer

- ResMLP

- gMLP

Experiments

Model	Dataset	# of layers	Patch	Hidden	Params (M)	Acc (%)
ResNet50 baseline (ref)	CIFAR10				23.5M	93.62 %
MLPMixer (S/32)	CIFAR10	8	32	512	18.4M	wip
ResMLP	CIFAR10	12	32	512	26.8M	wip
gMLP	CIFAR10	20	16	256	19.7M	85.74 %