percent4 / deep_learning_miscellaneous

some basic knowledge of deep learning and Pretrained Language Model of NLP

本项目用于Deep Learning的知识点学习。

维护者

• Jclian91

References

1. Loss Function

• How To Build Custom Loss Functions In Keras For Any Use Case: https://cnvrg.io/keras-custom-loss-functions/
• Pytorch常用的交叉熵损失函数CrossEntropyLoss()详解: https://zhuanlan.zhihu.com/p/98785902

2. Normalization

• pytorch LayerNorm参数详解，计算过程: https://blog.csdn.net/weixin_39228381/article/details/107939602