finetunej

gpt-neo_dungeon

Colab notebooks to run a basic AI Dungeon clone using gpt-neo-2.7B

transformers

🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0.

gpt-neo_finetune_2.7B

genji-jp-samples

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.

tokenizer-gpt2-genji

huggingface transformers compatible GPT2Tokenizer files for genji-v2 model

gpt_bpe

GPT2 Byte Pair Encoding implementation in Golang

lm-evaluation-harness

A framework for few-shot evaluation of autoregressive language models.

memory-efficient-attention

Memory Efficient Attention (O(sqrt(n)) for Jax and PyTorch

mesh-transformer-jax

Model parallel transformers in JAX and Haiku

misc

onnxruntime

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

sentencepiece

Unsupervised text tokenizer for Neural Network-based text generation.