Stas Bekman (stas00)

stas00

Geek Repo

Company:Stasosphere Online Inc. / HuggingFace Inc.

Location:Lantzville, BC, Canada

Home Page:https://stasosphere.com/machine-learning/

Twitter:@StasBekman

Github PK Tool:Github PK Tool


Organizations
bigscience-workshop
huggingface

Stas Bekman's repositories

toolbox

Essential guides and programming tools in my toolbox (with focus on ML Training)

Language:PythonLicense:Apache-2.0Stargazers:244Issues:7Issues:1

ipyexperiments

jupyter/ipython experiment containers for GPU and general RAM re-use

Language:Jupyter NotebookLicense:NOASSERTIONStargazers:157Issues:6Issues:5

porting

Helper scripts and notes that were used while porting various nlp models

Language:Jupyter NotebookStargazers:29Issues:2Issues:3

ml-ways

ML/DL Math and Method notes

Language:Jupyter NotebookStargazers:21Issues:2Issues:0

gpt-neo-fine-tuning-example

Fine-Tune EleutherAI GPT-Neo And GPT-J-6B To Generate Netflix Movie Descriptions Using Hugginface And DeepSpeed

Language:PythonLicense:Apache-2.0Stargazers:7Issues:0Issues:0

conda-tools

helper tools for the conda environment

Language:PerlLicense:Apache-2.0Stargazers:6Issues:2Issues:0

transformers

🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0.

Language:PythonLicense:Apache-2.0Stargazers:6Issues:1Issues:0

git-tools

helper git tools

Language:ShellLicense:Apache-2.0Stargazers:4Issues:2Issues:0

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.

Language:PythonLicense:MITStargazers:3Issues:1Issues:0

FlexFlow

A distributed deep learning framework that supports flexible parallelization strategies.

License:Apache-2.0Stargazers:3Issues:0Issues:0

pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

Language:C++License:NOASSERTIONStargazers:3Issues:2Issues:0
License:CC0-1.0Stargazers:3Issues:2Issues:0

datasets

🤗 Fast, efficient, open-access datasets and evaluation metrics for Natural Language Processing and more in PyTorch, TensorFlow, NumPy and Pandas

Language:PythonLicense:Apache-2.0Stargazers:2Issues:1Issues:0

accelerate

A simple way to train and use NLP models with multi-GPU, TPU, mixed-precision

Language:PythonLicense:Apache-2.0Stargazers:1Issues:1Issues:0

apex

A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch

Language:PythonLicense:BSD-3-ClauseStargazers:1Issues:1Issues:0

blog

Public repo for HF blog posts

Language:Jupyter NotebookStargazers:1Issues:1Issues:0

code

Codebase for the project

License:Apache-2.0Stargazers:1Issues:1Issues:0

DeepSpeedExamples

Example models using DeepSpeed

Language:PythonLicense:MITStargazers:1Issues:1Issues:0

functorch

functorch is a prototype of JAX-like composable function transforms for PyTorch.

License:BSD-3-ClauseStargazers:1Issues:0Issues:0

Megatron-DeepSpeed

Ongoing research training transformer language models at scale, including: BERT & GPT-2

Language:PythonLicense:NOASSERTIONStargazers:1Issues:1Issues:0

Megatron-LM

Ongoing research training transformer models at scale

License:NOASSERTIONStargazers:1Issues:0Issues:0

nvidia-system-monitor-qt

Task Manager for Linux for Nvidia graphics cards

Language:C++License:MITStargazers:1Issues:1Issues:0

pytest-monitor

Pytest plugin for analyzing resource usage during test sessions

Language:PythonLicense:MITStargazers:1Issues:1Issues:0

pytorch-tvmisc

Totally Versatile Miscellanea for Pytorch

Language:Jupyter NotebookLicense:MITStargazers:1Issues:1Issues:0

pytorch_memlab

Profiling and inspecting memory in pytorch

License:MITStargazers:1Issues:0Issues:0

tokenizers

đź’ĄFast State-of-the-Art Tokenizers optimized for Research and Production

Language:RustLicense:Apache-2.0Stargazers:1Issues:1Issues:0
Language:PythonLicense:BSD-3-ClauseStargazers:1Issues:2Issues:0

bitsandbytes

8-bit CUDA functions for PyTorch

License:MITStargazers:0Issues:0Issues:0

olm-datasets

Pipeline for pulling and processing online language model pretraining data from the web

Stargazers:0Issues:0Issues:0