XuexII

dlib

A toolkit for making real world machine learning and data analysis applications in C++

HivisionIDPhotos

⚡️HivisionIDPhotos: a lightweight and efficient AI ID photos tools. 一个轻量级的AI证件照制作算法。

AnyTool

AlphaCodium

Official implementation for the paper: "Code Generation with AlphaCodium: From Prompt Engineering to Flow Engineering""

omegaconf

Flexible Python configuration system. The last one you will ever need.

OLMo

Modeling, training, eval, and inference code for OLMo

tree-of-thought-llm

[NeurIPS 2023] Tree of Thoughts: Deliberate Problem Solving with Large Language Models

ReAct

[ICLR 2023] ReAct: Synergizing Reasoning and Acting in Language Models

AgentTuning

AgentTuning: Enabling Generalized Agent Abilities for LLMs

tutorials

This repository contains tutorials and examples for Triton Inference Server

tensorrtllm_backend

The Triton TensorRT-LLM Backend

backend

Common source, scripts and utilities for creating Triton backends.

server

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

triton

Development repository for the Triton language and compiler

TensorRT

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

AutoGPTQ

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

Qwen

The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.

TensorRT-LLM

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

composer

Supercharge Your Model Training

Llama-X

Open Academic Research on Improving LLaMA to SOTA LLM

LLM-RLHF-Tuning

LLM Tuning with PEFT (SFT+RM+PPO+DPO with LoRA)

ToolLLM

An open platform for training, serving, and evaluating large language model for tool learning.

LLaMA-Factory

Efficiently Fine-Tune 100+ LLMs in WebUI (ACL 2024)

Digital_Life_Server

Yet another voice assistant, but alive.

whisper

Robust Speech Recognition via Large-Scale Weak Supervision

Auto-Synced-Translated-Dubs

Automatically translates the text of a video based on a subtitle file, and also uses AI voice to dub the video, and synced using the subtitle's timings

mitmproxy

An interactive TLS-capable intercepting HTTP proxy for penetration testers and software developers.

MemGPT

Create LLM agents with long-term memory and custom tools 📚🦙

wechat_applet

Open-Shop小程序商城，包括：分销（支持三级）、团购（拼多多模式）、秒杀、优惠券、等功能，前后端全部开源。做全网最开源、最稳定、功能做强大的开源小程序商城。

RisuAI

Make your own story. User-friendly software for LLM roleplaying