Project-Splinter / Dataloader.async

An asynchronous pytorch Dataloader for general neural network pipeline accelaration.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Dataloader.async

An asynchronous pytorch Dataloader for general neural network pipeline accelaration. (Tested for torch==2.1.0)

Our dataloader is fully compatible with offical Dataloader, with extension that allows async processors.

Usage:

$ python setup.py install

then

from dataloaderAsync import DataLoader

...
  • Note: Only tested on pytorch 1.3.0. Should be able to compatible with older versions.

About

An asynchronous pytorch Dataloader for general neural network pipeline accelaration.


Languages

Language:Python 100.0%