tlc-pack / cutlass_fpA_intB_gemm

A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

About

A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer

License:Apache License 2.0


Languages

Language:C++ 83.2%Language:Cuda 15.7%Language:CMake 1.0%