mixed-precision

There are 1 repository under mixed-precision topic.

stochasticai / xTuring
Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6
deep-learning fine-tuning gpt-2 gpt-j llama llm lora language-model alpaca finetuning adapter gen-ai generative-ai mistral mixed-precision peft quantization
Language:Python 2514
NVIDIA / OpenSeq2Seq
Toolkit for efficient experimentation with Speech Recognition, Text2Speech and NLP
deep-learning float16 language-model mixed-precision multi-gpu multi-node neural-machine-translation seq2seq sequence-to-sequence speech-recognition speech-synthesis speech-to-text tensorflow text-to-speech
Language:Python 1534
Azure / MS-AMP
Microsoft Automatic Mixed Precision Library
amp deep-learning fp8 gpu mixed-precision pytorch transformer
Language:Python 451
Zhen-Dong / HAWQ
Quantization library for PyTorch. Support low-precision and mixed-precision quantization, with hardware implementation through TVM.
quantization tvm model-compression distillation quantized-neural-networks pytorch hardware-aware mixed-precision efficient-neural-networks 8-bit 4-bit tensorcore hessian
Language:Python 391
mit-han-lab / haq
[CVPR 2019, Oral] HAQ: Hardware-Aware Automated Quantization with Mixed Precision
quantization automl mixed-precision efficient-model
Language:Python 353
hellojialee / Improved-Body-Parts
Simple Pose: Rethinking and Improving a Bottom-up Approach for Multi-Person Pose Estimation
pytorch pose-estimation heatmap focal-l2-loss apex bottom-up tutorial training distributed mixed-precision multi-gpus multi-person
Language:Python 260
moritztng / prism
High Resolution Style Transfer in PyTorch with Color Control and Mixed Precision :art:
controlling-perceptual-factors high-resolution mixed-precision pytorch style-transfer
Language:Python 101
suvojit-0x55aa / mixed-precision-pytorch
Training with FP16 weights in PyTorch
model-weights gradient weight precision mixed-precision nueral-networks deep-learning pytorch computer-vision artificial-intelligence artificial-neural-networks gradients-underflow precision-training overflow
Language:Python 74
verificarlo / verificarlo
A tool for debugging and assessing floating point precision and reproducibility.
floating-point llvm mixed-precision montecarlo-arithmetic mpfr numerical-analysis precision tool
Language:C 61
huanghuidmml / tfbert
基于tensorflow1.x的预训练模型调用，支持单机多卡、梯度累积，XLA加速，混合精度。可灵活训练、验证、预测。
tensorflow bert electra albert trainer xla mixed-precision ernie ernie-gram chinesebert
Language:Python 57
Zhen-Dong / BitPack
BitPack is a practical tool to efficiently save ultra-low precision/mixed-precision quantized models.
quantization mixed-precision pytorch model-compression memory quantized-neural-networks
Language:Python 49
andreped / GradientAccumulator
:dart: Accumulated Gradients for TensorFlow 2
tensorflow accumulated-gradients tensorflow2 tf2 batch-size memory-constraints gradient-accumulation distributed-training float16 mixed-precision deep-learning keras adaptive-gradient-clipping gpu tpu huggingface accumulated-batch-normalization multi-gpu hacktoberfest
Language:Python 47
rickiepark / deep-learning-with-python-2nd
<케라스 창시자에게 배우는 딥러닝 2판> 도서의 코드 저장소
cnn deep-learning gan image-classification image-style-transfer keras neural-network rnn tensorflow text-classification text-generation transformer image-augmentation image-segmentation keras-tuner machine-translation mixed-precision multi-gpu tpu time-series
Language:Jupyter Notebook 47
EEESlab / CMix-NN
CMix-NN: Mixed Low-Precision CNN Library for Memory-Constrained Edge Devices
cnn quantized-neural-networks mixed-precision inference tinyml edge-computing edge-ai iot cmsis-nn cmsis stm32 stm32h7 stm32f7 stm32l4 stm32f4 arm arm-cortex-m4 arm-cortex-m7
Language:C 36
enp1s0 / ozIMMU
FP64 equivalent GEMM via Int8 Tensor Cores using the Ozaki scheme
cuda gemm mixed-precision tensorcore tensorcores
Language:Cuda 36
qleenju / PDPU
PDPU: An Open-Source Posit Dot-Product Unit for Deep Learning Applications
dot-product posit posit-arithmetic posit-arithmetic-generator unum arithmetic-units mixed-precision systemverilog
Language:SystemVerilog 30
tlkh / pycon-sg19-tensorflow-tutorial
PyCon SG 2019 Tutorial: Optimizing TensorFlow Performance
tensorflow keras mixed-precision nvidia deep-learning
Language:Jupyter Notebook 25
wu-kan / HPL-AI
An implementation of HPL-AI Mixed-Precision Benchmark based on hpl-2.3
linpack hpl hpl-ai hpc mpi gmres performance mixed-precision benchmarking
Language:C 24
Andras7 / gpt2-pytorch
Extremely simple and understandable GPT2 implementation with minor tweaks
gpt2 mixed-precision pytorch sentencepiece transformers
Language:Python 18
at-aaims / OpenMxP
This is the open source version of HPL-MXP. The code performance has been verified on Frontier
mixed-precision hpc performance
Language:C++ 13
sayakpaul / Mixed-Precision-Training-in-tf.keras-2.0
This repository contains notebooks showing how to perform mixed precision training in tf.keras 2.0
tensorflow2 nvidia deep-learning mixed-precision
Language:Jupyter Notebook 12
kentaroy47 / pytorch-cifar10-fp16
Let's train CIFAR 10 Pytorch with Half-Precision!
pytorch fp16 cifar10 training cnn mixed-precision mixed-precision-training
Language:Python 11
enp1s0 / cuMpSGEMM
Fast SGEMM emulation on Tensor Cores
cuda gpu fp32 gemm half-precision mixed-precision tensorcore tensorcores
Language:Cuda 7
lnugraha / CG-Mixed-Precision
Hybrid-Precision Analysis on CG Solver (H.A.C.S). Merging single and double precision to generate a fast yet accurate CG solver
lattice-qcd mixed-precision cpp11 cuda conjugate-gradient
Language:C++ 5
mfuntowicz / RNet
PyTorch RNet implementation with Distributed and Mixed-Precision training support.
distributed mixed-precision python pytorch rnet
Language:Python 3
AkashSDas / cassava-leaf-disease-classification
Deep learning solution for Cassava Leaf Disease Classification, a Kaggle's Research Code Competition using Tensorflow.
kaggle kaggle-competition kaggle-dataset cassava-leaf-classifcation image-classification data-augmentation cutmix fmix mixup albumentations cross-validation tpu mixed-precision xla unbalanced-data tensorflow-pipeline tensorflow2
Language:Jupyter Notebook 1
zjykzj / YOLOv1
You Only Look Once: Unified, Real-Time Object Detection
apex distributed-data-parallel imagenet mixed-precision nvidia-apex nvidia-docker pascal-voc python pytorch yolo yolov1 yolov1-loss
Language:Python 1
Ahmad-Shawahna / FxP-QNet
A Post-Training Quantizer for the Design of Mixed Low-Precision DNNs with Dynamic Fixed-Point Representation for Efficient Hardware Acceleration on Edge Devices
neural-networks model-compression deep-learning quantization fixed-point-arithmetic mixed-precision acceleration accuracy efficient-inference resource-constrained-devices
0
hinofafa / torch_accelerator
Experiments to accelerate GPU device for PyTorch training
pytorch gpu-acceleration tensorcore mixed-precision gpu-profiler
Language:Jupyter Notebook 0