int8

There are 1 repository under int8 topic.

intel / neural-compressor
SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime
low-precision pruning sparsity auto-tuning knowledge-distillation quantization quantization-aware-training post-training-quantization smoothquant large-language-models awq fp4 gptq int4 int8 mxformat sparsegpt
Language:Python 1941
clancylian / retinaface
Reimplement RetinaFace use C++ and TensorRT
retinaface tensorrt int8 caffe mxnet2caffe
Language:C++ 293
intel / neural-speed
An innovative library for efficient LLM inference via low-bit quantization
cpu fp4 fp8 gaudi2 gpu int4 int8 llamacpp llm-fine-tuning llm-inference low-bit mxformat nf4 sparsity
Language:C++ 185
Wulingtian / yolov5_tensorrt_int8_tools
tensorrt int8 量化yolov5 onnx模型
int8 onnx tensorrt yolov5
Language:Python 171
Wulingtian / yolov5_tensorrt_int8
TensorRT int8 量化部署 yolov5s 模型，实测3.3ms一帧！
int8 tensorrt yolov5
Language:C++ 165
Wulingtian / RepVGG_TensorRT_int8
RepVGG TensorRT int8 量化，实测推理不到1ms一帧！
int8 repvgg tensorrt
Language:Python 61
Wulingtian / nanodet_tensorrt_int8
nanodet int8 量化，实测推理2ms一帧！
int8 nanodet tensorrt
Language:C++ 37
xuanandsix / Tensorrt-int8-quantization-pipline
a simple pipline of int8 quantization based on tensorrt.
int8 quantization tensorrt classifaction yolox
Language:Python 30
ppogg / ncnn-yolov4-int8
NCNN+Int8+YOLOv4 quantitative modeling and real-time inference
ncnn yolov4 int8 real-time
Language:C++ 20
whitelok / tensorrt-int8-python-sample
TensorRT Int8 Python version sample. TensorRT Int8 Python 实现例子。TensorRT Int8 Pythonの例です
tensorrt ai deep-learning nvidia inference tensorrt-int8-python python int8-inference int8 machine-learning
Language:Python 14
aahouzi / llama2-chatbot-cpu
A LLaMA2-7b chatbot with memory running on CPU, and optimized using smooth quantization, 4-bit quantization or Intel® Extension For PyTorch with bfloat16.
bfloat16 cpu int8 langchain llama2 optimization streamlit smooth-quantization chatbot huggingface chatbot-memory chatgpt llama meta-ai intel ipex meta numa neural-compression 4-bit-cpu
Language:Python 7
egbertYeah / mt-yolov6_tensorrt
MT-Yolov6 TensorRT Inference with Python.
tensorrt int8 yolov6
Language:Python 6
dasdristanta13 / LLM-Lora-PEFT_accumulate
LLM-Lora-PEFT_accumulate explores optimizations for Large Language Models (LLMs) using PEFT, LORA, and QLORA. Contribute experiments and implementations to enhance LLM efficiency. Join discussions and push the boundaries of LLM optimization. Let's make LLMs more efficient together!
alpaca int8 llm lora peft qlora bitsandbytes falcon llama
Language:Jupyter Notebook 5
yester31 / Quantization_EX
quantization example for pqt & qat
qat quantization-aware-training quantization tensorrt post-training-quantization ptq int8 model-optimization pytorch-quantization
Language:Python 4
psychose-club / IBO
IBO stands for "Internal binary operations" and it is a library for Java to read, write, and handle binary files and data types that aren't available in Java.
binary ibo int16 int32 int64 int8 java uint16 uint32 uint64 uint8 file uint24 int24
Language:Java 3
cbalint13 / rvv-kernels
RISCV Vector Kernel C/LLVM-IR generator
int8 kernel llvm math riscv rvv tvm vector
Language:Python 2
stdlib-js / array-int8
Int8Array.
nodejs javascript stdlib node node-js types data structure array typed typed-array int8array int8 integer int signed byte
Language:JavaScript 2
stdlib-js / constants-int8
8-bit signed integer mathematical constants.
nodejs javascript stdlib node node-js mathematics math standard library lib constants const namespace int8 8-bit 8bit integer int byte signed
Language:Makefile 2
stdlib-js / constants-int8-min
Minimum signed 8-bit integer.
nodejs javascript stdlib node node-js constant const min minimum integer int int8 signed 8-bit
Language:Makefile 2
lbin / gie_int8_sample
int8 gie
Language:C++ 1
RyannnG / gie_int8_sample
int8 tensorrt2
Language:C++ 1
stdlib-js / assert-is-int8array
Test if a value is an Int8Array.
nodejs javascript stdlib node node-js assertion assert utilities utility utils util int8array int8 signed integer int byte octet typed typed-array
Language:Makefile 1
stdlib-js / constants-int8-max
Maximum signed 8-bit integer.
nodejs javascript stdlib node node-js constant const max maximum integer int int8 signed 8-bit
Language:Makefile 1
stdlib-js / constants-int8-num-bytes
Size (in bytes) of an 8-bit signed integer.
nodejs javascript stdlib node node-js constant const mathematics math int8 8-bit 8bit integer int byte signed size sizeof size-of bytes
Language:Makefile 1
stdlib-js / napi-argv-int8array
Convert a Node-API value to a signed 8-bit integer array.
addon array int int8 javascript macros napi native node node-js nodejs stdlib utilities utils
Language:Makefile 1
stdlib-js / napi-argv-strided-int8array
Convert a Node-API value representing a strided array to a signed 8-bit integer array.
addon array int int8 javascript macros napi native ndarray node node-js nodejs stdlib strided utilities utils
Language:Makefile 1
douzsh / mxnet-quantized
mxnet GluonCV quantization binary ternary models
mxnet quantization binary ternary int8 gluoncv
Language:Python 0
MrFMach / Practice-C-types
Practicing C data types using the sizeof function
sizeof c char int8 int16 int32 int64 int128 float double
Language:C
yester31 / Quantization_Framework
development quantization framework
compression infernece int8 optimization quantization
Language:Python

int8

intel / neural-compressor

clancylian / retinaface

intel / neural-speed

Wulingtian / yolov5_tensorrt_int8_tools

Wulingtian / yolov5_tensorrt_int8

Wulingtian / RepVGG_TensorRT_int8

Wulingtian / nanodet_tensorrt_int8

xuanandsix / Tensorrt-int8-quantization-pipline

ppogg / ncnn-yolov4-int8

whitelok / tensorrt-int8-python-sample

aahouzi / llama2-chatbot-cpu

egbertYeah / mt-yolov6_tensorrt

dasdristanta13 / LLM-Lora-PEFT_accumulate

yester31 / Quantization_EX

psychose-club / IBO

cbalint13 / rvv-kernels

stdlib-js / array-int8

stdlib-js / constants-int8

stdlib-js / constants-int8-min

lbin / gie_int8_sample

RyannnG / gie_int8_sample

stdlib-js / assert-is-int8array

stdlib-js / constants-int8-max

stdlib-js / constants-int8-num-bytes

stdlib-js / napi-argv-int8array

stdlib-js / napi-argv-strided-int8array

douzsh / mxnet-quantized

MrFMach / Practice-C-types

yester31 / Quantization_Framework