zilliztech / milvus-helm

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

I configured a GPU for Milvus, why is it not used?

luli817 opened this issue · comments

Hi @luli817: I assume you're following https://milvus.io/docs/install_standalone-helm-gpu.md#Install-Milvus-Standalone-with-GPU-Support. You would also need to use Milvus' gpu image, which is not mentioned in this doc.

image:
  all:
    repository: milvusdb/milvus
    tag: v2.3.12-gpu

We will update the doc soon. Thank you for your feedback!

Okay, thank you, I'll give it a try. By the way, it seems that you can't specify runtimeclass in values. I need to modify the deoloyment manually.

好的,谢谢您,我试试,我顺便说一下,你们values里面好像没法指定runtimeclass.我需要手动修改deoloyment

@luli817 thank you again, it's true that runtimeclass is not supported yet. By the way, would you like to make a patch to support it?

I'll translate the words to english for more users to follow.

Adding a patch to set up runtimeclass is actually quite simple, but I don't have experience in collaborative development on GitHub and am not familiar with the process. I would like to add you on WeChat and ask for your advice. Then I would like to explain why I need to add the runtimeclass parameter, because my CNI is Cilium, but Cilium cannot start in NVIDIA runtime, which means I have to configure two runtimes on this node.

image
image

@haorenfsa hi,I have set up the GPU image, but he hasn't used GPC yet.

@LoveEachDay @liliu-z Any idea about this?

Can I have the script you create the GPU index?

@liliu-z I didn't specifically create a GPU index.

@liliu-z I didn't specifically create a GPU index.

Then you need to do so, Plz check MIlvus' doc

@liliu-z I need to create a GPU index first before Milvus can use the GPU, right?

@luli817 I guess yes. does it work?