cudnn support
coreylowman opened this issue · comments
Re thread safety I think if we enforce that the handles are Arc<Mutex<CudnnHandle>>
, we should be fine
or just let each thread spawn a new handle (no data is associated to a handle)
@M1ngXU let's split the cudnn pr into a couple separate PRs, so we just have what we need for dfdx:
- Add sys.rs/bindgen.sh/result.rs & link to cudnn in build.rs (you already have this in the big PR, just need to split it out)
- i think to start we just need to create/destroy handle, cudnnSetStream
- Add tensor descriptors cudnnCreateTensorDescriptor, cudnnDestroyTensorDescriptor, cudnnSetTensorNdDescriptor
- Add reduction support
- Add conv2d support
- Add pool2d support
@M1ngXU let's split the cudnn pr into a couple separate PRs, so we just have what we need for dfdx:
Add sys.rs/bindgen.sh/result.rs & link to cudnn in build.rs (you already have this in the big PR, just need to split it out)
- i think to start we just need to create/destroy handle, cudnnSetStream
Add tensor descriptors cudnnCreateTensorDescriptor, cudnnDestroyTensorDescriptor, cudnnSetTensorNdDescriptor
Add reduction support
Add conv2d support
Add pool2d support
ok, i'll do number one now