dehoyosb

docker-pyinstaller

PyInstaller for Linux, Windows and OSX (Experimental) inside Docker

wait-for-it

Pure bash script to test and wait on the availability of a TCP host and port

runhouse

Write local debuggable Python which traverses your powerful remote infra. Deploy as-is. Unobtrusive, unopinionated, PyTorch-like APIs.

dspy

DSPy: The framework for programming—not prompting—foundation models

consulting-handbook

A guide for technical professionals looking to start consulting

unstructured

Open source libraries and APIs to build custom preprocessing pipelines for labeling, training, or production machine learning pipelines.

awesome-network-embedding

A curated list of network embedding techniques.

openchat

OpenChat: Advancing Open-source Language Models with Imperfect Data

qlora

QLoRA: Efficient Finetuning of Quantized LLMs

recommenders

Best Practices on Recommendation Systems

llm-course

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

locust

Write scalable load tests in plain Python 🚗💨

torchquantum

A PyTorch-based framework for Quantum Classical Simulation, Quantum Machine Learning, Quantum Neural Networks, Parameterized Quantum Circuits with support for easy deployments on real quantum computers.

nougat

Implementation of Nougat Neural Optical Understanding for Academic Documents

streamlit

Streamlit — A faster way to build and share data apps.

llm

An ecosystem of Rust libraries for working with large language models

haystack

:mag: LLM orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.

haystack-search-pipeline-streamlit

🚀 Template Haystack Search Application with Streamlit

API

Documentation and Samples for the Official HN API

Sentence-Simplification-using-BERT-GPT2

DeBERTa

The implementation of DeBERTa

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

llm-numbers

Numbers every LLM developer should know

lit-llama

Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

RedPajama-Data

The RedPajama-Data repository contains code for preparing large datasets for training large language models.

llama

Inference code for Llama models

llm-foundry

LLM training code for Databricks foundation models

Open-Assistant

OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.