Achieving a 26.8% reduction in inference time on the test set with a 30% smaller model and without losing out on the cross entropy loss by more than 0.001.
-- Click on Open in Colab Button at the top of notebook
-- Make folder 'wikitext-2' in colab present working directory
-- Upload files present in the wikitext-2 folder in this repository
-- Run > Run All Cells