HandH1998

QQQ

QQQ is an innovative and hardware-optimized W4A8 quantization solution.

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

academicpages.github.io

Github Pages template for academic personal websites, forked from mmistakes/minimal-mistakes

books_and_wiki_en_clean_format_and_shard

BUAA_Course

BUAA_Course_Sharing

北京航空航天大学(北航)课程作业资料共享计划——涉密不上网,上网不涉密！！！

manifold_distillation

mct_former

pregenerate_bert_train_corpus

carInsurancePred

easy-scrape

Entity-Relation-Extraction

Entity and Relation Extraction Based on TensorFlow and BERT. 基于TensorFlow和BERT的管道式实体及关系抽取，2019语言与智能技术竞赛信息抽取任务解决方案。Schema based Knowledge Extraction, SKE 2019

HandH1998.github.io

个人主页

Java_learn

JS_learn

lightseq

LightSeq: A High Performance Library for Sequence Processing and Generation

marlin

FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.

matplotlib

Megatron-DeepSpeed

Ongoing research training transformer language models at scale, including: BERT & GPT-2

ML_practice

net2net

NLP-Tutorials

Simple implementations of NLP models. Tutorials are written in Chinese on my website https://mofanpy.com

NN-CUDA-Example

Several simple examples for popular neural network toolkits calling custom CUDA operators.

smoothquant

[ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models

soln-ml

A research framework for fast prototyping of automl algorithms.

test

just for test

tmp_bert_mlkd

zh-NER-TF

A very simple BiLSTM-CRF model for Chinese Named Entity Recognition 中文命名实体识别 (TensorFlow)