RunningLeon

mmdeploy

MMDeploy is an open-source deep learning model deployment toolset

mmdeploy-testdata

mmdetection

OpenMMLab Detection Toolbox and Benchmark

ppq

PPL Quantization Tool (PPQ) is a powerful offline neural network quantization tool.

lmdeploy

Efficient-AI-Backbones

Efficient AI Backbones including GhostNet, TNT and MLP, developed by Huawei Noah's Ark Lab.

InternLM

InternLM has open-sourced a 7 billion parameter base model, a chat model tailored for practical scenarios and the training system.

llama.cpp

LLM inference in C/C++

llamafile

Distribute and run LLMs with a single file.

mmclassification

OpenMMLab Image Classification Toolbox and Benchmark

mmcv

OpenMMLab Computer Vision Foundation

mmediting

OpenMMLab Image and Video Editing Toolbox

mmocr

OpenMMLab Text Detection, Recognition and Understanding Toolbox

mmpose

OpenMMLab Pose Estimation Toolbox and Benchmark.

mmrazor

OpenMMLab Model Compression Toolbox and Benchmark.

mmyolo

OpenMMLab YOLO series toolbox and benchmark

MobileSAM

This is the official code for MobileSAM project that makes SAM lightweight for mobile applications and beyond!

MQBench

Model Quantization Benchmark

Multimodal-GPT

Multimodal-GPT

MyST-Parser

An extended commonmark compliant parser, with bridges to docutils/sphinx

NART

NART = NART is not A RunTime, a deep learning inference framework.

nni

An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.

nnUNet

onnx

Open standard for machine learning interoperability

onnx-simplifier

Simplify your onnx model

opencompass

OpenCompass is an LLM evaluation platform, supporting a wide range of models (LLaMA, LLaMa2, ChatGLM2, ChatGPT, Claude, etc) over 50+ datasets.

ppl.nn

A primitive library for neural network

TensorRT

NVIDIA® TensorRT™, an SDK for high-performance deep learning inference, includes a deep learning inference optimizer and runtime that delivers low latency and high throughput for inference applications.

TensorRT-LLM

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

xmodaler

X-modaler is a versatile and high-performance codebase for cross-modal analytics.