int8-inference

There are 0 repository under int8-inference topic.

anilsathyan7 / Portrait-Segmentation
Real-time portrait segmentation for mobile devices
android color-harmonization coral-tpu deeplab deeplearning deepstream edge-ai gpu-delegate int8-inference jetson-tx2 keras mediapipe mobilenetv2 opencv-dnn portrait-matting portrait-segmentation tensorflow tensorflow-lite tensorflowjs unet-image-segmentation
Language:Jupyter Notebook 645
BUG1989 / caffe-int8-convert-tools
Generate a quantization parameter file for ncnn framework int8 inference
quantized-neural-networks ncnn int8-inference caffe deeplearning-ai
Language:Python 519
DerryHub / BEVFormer_tensorrt
BEVFormer inference on TensorRT, including INT8 Quantization and Custom TensorRT Plugins (float/half/half2/int8).
bevformer cuda int8-inference pytorch quantization tensorrt-plugins
Language:Python 463
jahongir7174 / YOLOv8-qat
Quantization Aware Training
int8-inference int8-quantization object-detection python pytorch quantization-aware-training yolov8
Language:Python 66
Howell-Yang / onnx2trt
将端上模型部署过程中，常见的问题以及解决办法记录并汇总，希望能给其他人带来一点帮助。
calibrator int8-inference int8-quantization tensorrt python
Language:Python 18
whitelok / tensorrt-int8-python-sample
TensorRT Int8 Python version sample. TensorRT Int8 Python 实现例子。TensorRT Int8 Pythonの例です
tensorrt ai deep-learning nvidia inference tensorrt-int8-python python int8-inference int8 machine-learning
Language:Python 14
ENOT-AutoDL / gpt-j-6B-tensorrt-int8
GPT-J 6B inference on TensorRT with INT-8 precision
gpt-j enot-autodl tensorrt inference quantization gpt-j-6b int8-inference transformers
Language:Python 11
ENOT-AutoDL / ENOT-transformers
inference quantization tensorrt transformers gpt2 int8-inference int8-quantization gptj enot-autodl
7
JohnClaw / chatllm.vb
VB.NET api wrapper for llm-inference chatllm.cpp
api-wrapper bindings chatllm cpu-inference gemma ggml int8 int8-inference int8-quantization llama llm-inference mistral qwen vb-net vbnet
Language:Visual Basic .NET 4
yester31 / TensorRT_ONNX
Generating tensorrt model using onnx
int8-inference int8-quantization onnx onnxruntime post-training-quantization ptq pytorch quantization tensorrt tensorrt-inference
Language:C++ 4
JohnClaw / chatllm.cs
C# api wrapper for llm-inference chatllm.cpp
api-wrapper bindings chatllm csharp gemma ggml int8 int8-inference int8-quantization llama llm-inference mistral qwen cpu-inference inference llm llms
Language:C# 3
akashAD98 / yolov7_vino_with_object_tracking
it has support for openvino converted model of yolov7-int.xml ,yolov7x,
deepsort int8-inference onnx openvino yolov7
Language:Python 1
daniel-rychlewski / cnn-planesnet
Compressed CNNs for airplane classification in satellite images (APoZ-based parameter pruning, INT8 weight quantization)
neural-network python convolutional-neural-networks deep-learning pruning quantization keras tensorflow-gpu tensorflow tflite planes satellite-imagery classification model-compression neural-network-compression image-classification int8-inference epoch batch-size kaggle-dataset
Language:Python 1