Prime Intellect

hivemind

Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.

diloco_simple

torch implementation of diloco

automated-lit-review

llama_index

LlamaIndex (formerly GPT Index) is a data framework for your LLM applications

llm_large_context

Large Context Transformers

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

apex

A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch

cloud-lora

gpt-engineer

Specify what you want it to build, the AI asks for clarification, and then builds it.

parsel

Code for Parsel 🐍 - generate complex programs with language models