gradient-accumulation

There are 0 repository under gradient-accumulation topic.

rentruewang / koila
Prevent PyTorch's `CUDA error: out of memory` in just 1 line of code.
deep-learning gradient-accumulation lazy-evaluation machine-learning memory-management neural-network out-of-memory python pytorch
Language:Python 1814
mvoelk / ssd_detectors
SSD-based object and text detection with Keras, SSD, DSOD, TextBoxes, SegLink, TextBoxes++, CRNN
crnn densnet-seglink densnet-textboxespp distance-iou-loss dsod focal-loss gradient-accumulation keras seglink shrikage-loss ssd textboxes textboxespp virtual-batch-size
Language:Jupyter Notebook 302
andreped / GradientAccumulator
:dart: Accumulated Gradients for TensorFlow 2
tensorflow accumulated-gradients tensorflow2 tf2 batch-size memory-constraints gradient-accumulation distributed-training float16 mixed-precision deep-learning keras adaptive-gradient-clipping gpu tpu huggingface accumulated-batch-normalization multi-gpu hacktoberfest
Language:Python 48
CyberZHG / keras-gradient-accumulation
Gradient accumulation for Keras
keras gradient-accumulation optimizer
Language:Python 35
hkproj / pytorch-transformer-distributed
Distributed training (multi-node) of a Transformer model
collective-communication data-parallelism deep-learning distributed-data-parallel distributed-training gradient-accumulation machine-learning model-parallelism pytorch tutorial
Language:Python 22
deephub-ai / torch-handle
TorchHandle makes your PyTorch development more efficient and make you use PyTorch more comfortable
pytorch cross-validation tensorboard machine-learning deep-learning python gradient-accumulation custom-metrics gpu notebooks deep-learning-library deep-learning-framework
Language:Python 19
gradient-accumulation-tf-estimator
hpandana / gradient-accumulation-tf-estimator
Gradient accumulation on tf.estimator
gradient-accumulation tensorflow-estimator distributed
Language:Python 12
xueyouluo / Multi-Passage-BERT
A simple implementation of Multi-passage BERT
openqa bert multi-passage-bert gradient-accumulation
Language:Python 7
jimth001 / my-tf-framework-for-nlp-tasks
This project aims to help people implement tensorflow model pipelines quickly for different nlp tasks.
nlp-pipeline tensorflow-framework multi-gpu gradient-accumulation
Language:Python 5
shi510 / tensorflow-gradient-accumulation
tensorflow2-keras gradient accumulation
gradient-accumulation tensorflow2
Language:Python 5
TanyaChutani / Gradient-Accumulation-Tensorflow2.x
Gradient Accumulation with Tensorflow2.x
computer-vision gradient-accumulation image-classification keras tensorflow tf2
Language:Python 1
cankocagil / Low-Memory-Transformer-Finetuning
Implementation of Gradient Accumulation for low-memory language modelling transformer fine tuning.
gradient-accumulation transformer language-model
Language:Jupyter Notebook