Giters

jina-ai / clip-as-service

🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP

Home Page:https://clip-as-service.jina.ai

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Does it support multiple gpu's running simultaneously on one machine? Maximize inference speed

ScottishFold007 opened this issue · comments

commented

Does it support multiple gpu's running simultaneously on one machine? Maximize inference speed

commented

Hi, please refer here for multiple GPU serving 🍻

commented

Please use replicate executor and replicate GPUs, following this: https://docs.jina.ai/concepts/flow/scale-out/