Giters

SeanLee97 / AnglE

Train and Infer Powerful Sentence Embeddings with AnglE | 🔥 SOTA on STS and MTEB Leaderboard

Home Page:https://arxiv.org/abs/2309.12871

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

是否支持多卡推理或LORA？

Chineselock opened this issue · comments

commented

您好，能否调整API使模型推理时存储在多张显卡上？我现在有多张24G显存的显卡并且我希望能够运行LLama-7B进行embedding