NVIDIA / cuCollections

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

[ENHANCEMENT]: Switch to cuda::memory_resource once it is available

sleeepyjack opened this issue · comments

Is your feature request related to a problem? Please describe.

We currently roll our own default cuco::cuda_allocator, which internally calls cudaMalloc/cudaFree.
This approach doesn't leverage the concept of stream-ordered allocations, which might degrade performance for operations such as size() and insert(), where we allocate intermediate storage to retrieve the count.

Describe the solution you'd like

libcu++ v2.0 introduces a new cuda::memory_resource (design, initial PR, final PR).

We should use this facility instead.

Describe alternatives you've considered

No response

Additional context

No response

Will be available once rapidsai/rapids-cmake#399 is resolved