We are following the Paper Universal Language Model Fine-tuning for Text Classification. We have implemented the STLR and Layer-wise learning rate adaption using PyTorch.
The whole project is organized under PyTorch Lightning framework.
We are following the Paper Universal Language Model Fine-tuning for Text Classification. We have implemented the STLR and Layer-wise learning rate adaption using PyTorch.
The whole project is organized under PyTorch Lightning framework.