rnwang04

ollama

Get up and running with Llama 3.2, Mistral, Gemma 2, and other large language models.

annotated_deep_learning_paper_implementations

🧑‍🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

text-generation-webui

A Gradio web UI for Large Language Models.

LLaMA-Factory

Efficiently Fine-Tune 100+ LLMs in WebUI (ACL 2024)

faiss

A library for efficient similarity search and clustering of dense vectors.

milvus

A cloud-native vector database, storage for next generation AI applications

LLMs-from-scratch

Implementing a ChatGPT-like LLM in PyTorch from scratch, step by step

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

jan

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)

Awesome-pytorch-list

A comprehensive list of pytorch related content on github,such as different models,implementations,helper libraries,tutorials etc.

onnxruntime

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

axolotl

Go ahead and axolotl questions

Qwen2

Qwen2 is the large language model series developed by Qwen team, Alibaba Cloud.

chainlit

Build Conversational AI in minutes ⚡️

gpt-fast

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

koboldcpp

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

llm-numbers

Numbers every LLM developer should know

cortex

Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM, ONNX). Powers 👋 Jan

LLaVA-Med

Large Language-and-Vision Assistant for Biomedicine, built towards multimodal GPT-4 level capabilities.

onnxruntime-inference-examples

Examples for using ONNX Runtime for machine learning inferencing.

quip-sharp

prompt-lookup-decoding

intel-npu-acceleration-library

Intel® NPU Acceleration Library

chatllm.cpp

Pure C++ implementation of several models for real-time chatting on your computer (CPU)

SYCLomatic

level-zero

oneAPI Level Zero Specification Headers and Loader

fp6_llm

An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).

linux-npu-driver

Intel® NPU (Neural Processing Unit) Driver

Data-Paralle-Cpp

个人翻译《Data Parallel C++》

Langchain-Chatchat

Knowledge Base QA using RAG pipeline on Intel CPU and GPU (e.g., local PC with iGPU, discrete GPU such as Arc, Flex and Max) with IPEX-LLM