izhx / mlp-mixer-nlp

Try MLP-Mixer in NLP tasks.

mlp-mixer-nlp

Try MLP-Mixer in NLP tasks.

Results

1. SST-2: embedding glove.840B.300d
   • LSTM: 86.38, 2 layer, 512 hidden.
   • MLP-Mixer (in timestep and hidden): 82.04, 6 layer, 128 token, 300 hidden.

More codes, trials and results are coming soon!