Giters

Yard1 / swarm-jax

Swarm training framework using Haiku + JAX + Ray for layer parallel transformer language models on unreliable, heterogeneous nodes

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

This repository is not active

About

Swarm training framework using Haiku + JAX + Ray for layer parallel transformer language models on unreliable, heterogeneous nodes

Languages

Language:Python 99.2%Language:Shell 0.8%