pjit

There are 0 repository under pjit topic.

• fattorib / ZeRO-transformer

  Two implementations of ZeRO-1 optimizer sharding in JAX

  deep-learninggptjaxnlppjittransformersxmapzero
  Language:Python 13

• fattorib / transformer_shmap

  Tensor Parallelism with JAX + Shard Map

  gptjaxpjittensor-parallelismtputransformersshmap
  Language:Python 10