rnwang04

Data-Paralle-Cpp

个人翻译《Data Parallel C++》

onnxruntime-inference-examples

Examples for using ONNX Runtime for machine learning inferencing.

onnxruntime

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

chatllm.cpp

Pure C++ implementation of several models for real-time chatting on your computer (CPU)

Qwen2

Qwen2 is the large language model series developed by Qwen team, Alibaba Cloud.

gpt-fast

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

LLaVA-Med

Large Language-and-Vision Assistant for Biomedicine, built towards multimodal GPT-4 level capabilities.

koboldcpp

A simple one-file way to run various GGML and GGUF models with a KoboldAI UI

fp6_llm

An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).

LLMs-from-scratch

Implementing a ChatGPT-like LLM in PyTorch from scratch, step by step

level-zero

oneAPI Level Zero Specification Headers and Loader

linux-npu-driver

Intel® NPU (Neural Processing Unit) Driver

chainlit

Build Conversational AI in minutes ⚡️

prompt-lookup-decoding

Langchain-Chatchat

Knowledge Base QA using RAG pipeline on Intel CPU and GPU (e.g., local PC with iGPU, discrete GPU such as Arc, Flex and Max) with IPEX-LLM

milvus

A cloud-native vector database, storage for next generation AI applications

faiss

A library for efficient similarity search and clustering of dense vectors.

cortex

Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM, ONNX). Powers 👋 Jan

jan

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)

annotated_deep_learning_paper_implementations

🧑‍🏫 60 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

ollama

Get up and running with Llama 3, Mistral, Gemma 2, and other large language models.

intel-npu-acceleration-library

Intel® NPU Acceleration Library

SYCLomatic

quip-sharp

text-generation-webui

A Gradio web UI for Large Language Models.

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

llm-numbers

Numbers every LLM developer should know

Awesome-pytorch-list

A comprehensive list of pytorch related content on github,such as different models,implementations,helper libraries,tutorials etc.

LLaMA-Factory

A WebUI for Efficient Fine-Tuning of 100+ LLMs (ACL 2024)

axolotl

Go ahead and axolotl questions