dctanner

Flowise

Drag & drop UI to build your customized LLM flow

LLaMA-Factory

Unify Efficient Fine-Tuning of 100+ LLMs

jan

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)

mlc-llm

Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.

onnx

Open standard for machine learning interoperability

onnxruntime

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

dspy

DSPy: The framework for programming—not prompting—foundation models

transformers.js

State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!

litgpt

Pretrain, finetune, deploy 20+ LLMs on your own data. Uses state-of-the-art techniques: flash attention, FSDP, 4-bit, LoRA, and more.

google-indexing-script

Script to get your site indexed on Google in less than 48 hours

ToolBench

[ICLR'24 spotlight] An open platform for training, serving, and evaluating large language model for tool learning.

moondream

tiny vision language model

llm

Access large language models from the command-line

aici

AICI: Prompts as (Wasm) Programs

WeightWatcher

The WeightWatcher tool for predicting the accuracy of Deep Neural Networks

datatrove

Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

nanotron

Minimalistic large language model 3D-parallelism training

aphrodite-engine

PygmalionAI's large-scale inference engine

wishful-search

Natural language search for complex JSON arrays, with AI Quickstart.

deita

Deita: Data-Efficient Instruction Tuning for Alignment [ICLR2024]

ollama-voice-mac

Mac compatible Ollama Voice

cosmopedia

prometheus

[ICLR 2024 & NeurIPS 2023 WS] An Evaluator LM that is open-source, offers reproducible evaluation, and inexpensive to use. Specifically designed for fine-grained evaluation on a customized score rubric, Prometheus is a good alternative for human evaluation and GPT-4 evaluation.

NeuScraper

This is the code repo for our paper "Cleaner Pretraining Corpus Curation with Neural Web Scraping".

min-max-gpt

Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training

101-school

AI generated courses

MiniSearch

Minimalist web-searching app with an AI assistant that runs directly from your browser. Uses Web-LLM, Ratchet-ML, Wllama and SearXNG. Demo: https://felladrin-minisearch.hf.space

Conda-autoactivate-env

Add autoactivate functionality on Conda. (Only Unix-based OS)

vram-calculator

Transformer GPU VRAM estimator

tinyllama

A side project that follows all the acceleration tricks in tinyllama, with the minimal modification to the huggingface transformers code.