FeiGeChuanShu

llamafile

Distribute and run LLMs with a single file.

ChatGLM3

ChatGLM3 series: Open Bilingual Chat LLMs | 开源双语对话语言模型

seamless_communication

Foundational Models for State-of-the-Art Speech and Text Translation

NotepadNext

A cross-platform, reimplementation of Notepad++

TensorRT-LLM

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

colmap

COLMAP - Structure-from-Motion and Multi-View Stereo

yaml-cpp

A YAML parser and emitter in C++

zydis

Fast and lightweight x86/x86-64 disassembler and code generation library

fastllm

纯c++的全平台llm加速库，支持python调用，chatglm-6B级模型单卡可达10000+token / s，支持glm, llama, moss基座，手机端流畅运行

BEVFormer

[ECCV 2022] This is the official implementation of BEVFormer, a camera-only framework for autonomous driving perception, e.g., 3D object detection and semantic map segmentation.

CTranslate2

Fast inference engine for Transformer models

lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

gear-lib

Gear-Lib, C library for IOT Embedded Multimedia and Network

stable-diffusion.cpp

Stable Diffusion in pure C/C++

chatglm.cpp

C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & more LLMs

xbyak

a JIT assembler for x86(IA-32)/x64(AMD64, x86-64) MMX/SSE/SSE2/SSE3/SSSE3/SSE4/FPU/AVX/AVX2/AVX-512 by C++ header

T-Rex

API for T-Rex2: Towards Generic Object Detection via Text-Visual Prompt Synergy

RT-DETR

[CVPR 2024] Official RT-DETR (RTDETR paddle pytorch), Real-Time DEtection TRansformer, DETRs Beat YOLOs on Real-time Object Detection. 🔥 🔥 🔥

Lidar_AI_Solution

A project demonstrating Lidar related AI solutions, including three GPU accelerated Lidar/camera DL networks (PointPillars, CenterPoint, BEVFusion) and the related libs (cuPCL, 3D SparseConvolution, YUV2RGB, cuOSD,).

VanillaNet

tensorrtllm_backend

The Triton TensorRT-LLM Backend

minigpt4.cpp

Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)

nndeploy

nndeploy是一款模型端到端部署框架。以多端推理以及基于有向无环图模型部署为内核，致力为用户提供跨平台、简单易用、高性能的模型部署体验。

HumanArt

[CVPR 2023] The official implementation of CVPR 2023 paper "Human-Art: A Versatile Human-Centric Dataset Bridging Natural and Artificial Scenes"

torchpipe

Boosting DL Service Throughput 1.5-4x by Ensemble Pipeline Serving with Concurrent CUDA Streams for PyTorch/LibTorch Frontend and TensorRT/CVCUDA, etc., Backends

faster-rwkv

Dipoorlet

Offline Quantization Tools for Deploy.

llama2.c-to-ncnn

A converter for llama2.c legacy models to ncnn models.

MSCEqF

A Multi State Constraint Equivariant Filter for Vision-aided Inertial Navigation

inpaint4shadow

We propose the shadow-guided inpainting task to take advantage of the shadow removal and image inpainting.