MashaKubyshina / ML_Scripts

NLP, Bert, Transformers, PyTorch (Materials from GDG ML Bootcamp)

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

learning_ML

This project is a compilation of exercises done during GDG Cloud Edmonton ML Bootcamp in summer 2021. The bootcamp explored data pipelines, word2vec, NER, Transformers, and Bert ML models. Tutorials were created by the mentors. The excercises were created by our mentors and completed by us individually.

GDG Bootcamp link https://gdg.community.dev/events/details/google-gdg-cloud-edmonton-presents-machine-learning-bootcamp-2021-2021-06-27/

Materials:

Week 1: Word2Vec

Week 2: Transformers

Week 3: Bert_NER, PyTorch DataLoaders

Week 4: Bert_tokenizer

Week 5: Bert_QA

Bert Question Answering task model created by one of the mentors Hasan Badran https://github.com/badran047/ask_me

If you are interested in more ML resources here is a list of articles and videos that were recommended to us during the bootcamp:

Tutorials: PyTorch beginner tutorial https://pytorch.org/tutorials/beginner/blitz/cifar10_tutorial.html

Papers: Attention is all you need https://arxiv.org/pdf/1706.03762.pdf and related video https://www.youtube.com/watch?v=rBCqOTEfxvg

Bert model tutorial https://mccormickml.com/2019/07/22/BERT-fine-tuning/

Articles: Winning the Netflix Prize: A Summary https://blog.echen.me/2011/10/24/winning-the-netflix-prize-a-summary/

About

NLP, Bert, Transformers, PyTorch (Materials from GDG ML Bootcamp)


Languages

Language:Jupyter Notebook 100.0%