lyogavin / Anima

33B Chinese LLM, DPO QLORA, 100K context, AirLLM 70B inference with single 4GB GPU

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Any CoreML implementation plans?

Proryanator opened this issue · comments

Hey there! Excellent huggingface article and thank you for sharing this with the open source commmunity.

I was curious, any plans on supporting CoreML models? Since apple silicon devices are usually quite RAM limited, especially iphones.