zzqiuzz

lm-evaluation-harness

A framework for few-shot evaluation of language models.

TensorRT-Model-Optimizer

TensorRT Model Optimizer is a unified library of state-of-the-art model optimization techniques such as quantization and sparsity. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM or TensorRT to optimize inference speed on NVIDIA GPUs.

qlora

QLoRA: Efficient Finetuning of Quantized LLMs

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

flash-attention

Fast and memory-efficient exact attention

openmlsys-zh

《Machine Learning Systems: Design and Implementation》- Chinese Version

llm-action

本项目旨在分享大模型相关技术原理以及实战经验。

MQBench

Model Quantization Benchmark

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

llvm-project

The LLVM Project is a collection of modular and reusable compiler and toolchain technologies.

Awesome-GitHub-Repo

收集整理 GitHub 上高质量、有趣的开源项目。

ColossalAI

Making large AI models cheaper, faster and more accessible

llama.cpp

LLM inference in C/C++

PytorchOCR

基于Pytorch的OCR工具库，支持常用的文字检测和识别算法

PaddleOCR

Awesome multilingual OCR toolkits based on PaddlePaddle (practical ultra lightweight OCR system, support 80+ languages recognition, provide data annotation and synthesis tools, support training and deployment among server, mobile, embedded and IoT devices)

lsq-net

Unofficial implementation of LSQ-Net, a neural network quantization framework

awesome-model-quantization

A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are continuously improving the project. Welcome to PR the works (papers, repositories) that are missed by the repo.

ppq

PPL Quantization Tool (PPQ) is a powerful offline neural network quantization tool.

mmdetection

OpenMMLab Detection Toolbox and Benchmark

QDrop

The official PyTorch implementation of the ICLR2022 paper, QDrop: Randomly Dropping Quantization for Extremely Low-bit Post-Training Quantization

PythonPark

Python 开源项目之「自学编程之路」，保姆级教程：AI实验室、宝藏视频、数据结构、学习指南、机器学习实战、深度学习实战、网络爬虫、大厂面经、程序人生、资源分享。

cropimage

A simple toolkit for detecting and cropping main body from pictures. Support face and saliency detection.

accurate-head-pose

Pytorch code for Hybrid Coarse-fine Classification for Head Pose Estimation

HeadPoseEstimation-WHENet

ICCV2023-Paper-Code-Interpretation

ICCV2021/2019/2017 论文/代码/解读/直播合集，极市团队整理

Microsoft-Activation-Scripts

A Windows and Office activator using HWID / Ohook / KMS38 / Online KMS activation methods, with a focus on open-source code and fewer antivirus detections.

flickr_scraper

Simple Flickr Image Scraper

YOLOv3-model-pruning

在 oxford hand 数据集上对 YOLOv3 做模型剪枝（network slimming）

Lee-SLAM-source

SLAM 开发学习资源与经验分享

YOLOF

You Only Look One-level Feature (YOLOF), CVPR2021, Detectron2