Kenta Izumi's repositories
flax
Flax is a neural network library for JAX that is designed for flexibility.
Language:PythonApache-2.0000
gpt-fast
Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.
Language:PythonBSD-3-Clause000
Language:PythonMIT000
llama-2-jax
JAX implementation of the Llama 2 model
Language:PythonCC0-1.0000
Language:PythonApache-2.0000
Megatron-LM
Ongoing research training transformer models at scale
Language:PythonNOASSERTION000
mesh-transformer-jax
Model parallel transformers in JAX and Haiku
Language:PythonApache-2.0000
Language:PythonApache-2.0000
Language:TypeScriptMIT000
Language:Python000
zoology
Understand and test language model architectures on synthetic tasks.
000