jphgxq

KunQuant

A compiler, optimizer and executor for financial expressions and factors

MambaOut

MambaOut: Do We Really Need Mamba for Vision?

Knowledge-Distillation-Zoo

Pytorch implementation of various Knowledge Distillation (KD) methods.

Awesome-Quantization-Papers

List of papers related to neural network quantization in recent AI conferences and journals.

awesome-model-quantization

A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are continuously improving the project. Welcome to PR the works (papers, repositories) that are missed by the repo.

Faster-LLM-Survey

grok-1

Grok open release

Efficient-LLMs-Survey

[TMLR 2024] Efficient Large Language Models: A Survey

UER-py

Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo

ET-BERT

The repository of ET-BERT, a network traffic classification model on encrypted traffic. The work has been accepted as The Web Conference (WWW) 2022 accepted paper.

line_profiler

Line-by-line profiling for Python

alpa

Training and serving large-scale neural networks with auto parallelization.

Megatron-LM

Ongoing research training transformer models at scale

ray

Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

gemma

Open weights LLM from Google DeepMind.

Made-With-ML

Learn how to design, develop, deploy and iterate on production-grade ML applications.

SoraReview

The official GitHub page for the review paper "Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Models".

BERT-LoRA-TensorRT

This repository contains a custom implementation of the BERT model, fine-tuned for specific tasks, along with an implementation of Low Rank Approximation (LoRA). The models are optimized for high performance using NVIDIA's TensorRT.

agents

An Open-source Framework for Data-centric, Self-evolving Autonomous Language Agents

KG-MM-Survey

Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Survey

data-centric-AI

A curated, but incomplete, list of data-centric AI resources.

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

smoothquant

[ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models

llm-action

本项目旨在分享大模型相关技术原理以及实战经验。

ann-benchmarks

Benchmarks of approximate nearest neighbor libraries in Python

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

TensorRT-LLM

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

nanoGPT

The simplest, fastest repository for training/finetuning medium-sized GPTs.

PocketFlow

An Automatic Model Compression (AutoMC) framework for developing smaller and faster AI applications.

Awesome-Multimodal-Large-Language-Models

:sparkles::sparkles:Latest Advances on Multimodal Large Language Models