VivekPanyam / carton

Run any ML model from any programming language.

Home Page:https://carton.run

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Implement SHM serialization for Tensors

VivekPanyam opened this issue · comments

Maybe also make Handle serialize differently based on the size of the tensor? For large tensors, it uses shared memory. For small ones it serializes them inline? Make Handle a variant so we can choose dynamically.