Support for OPT Architecture
varunlmxd opened this issue · comments
Varun Shah commented
Please make the package also support for OPT Architecture LLM's like Galactica.
33B Chinese LLM, DPO QLORA, 100K context, AirLLM 70B inference with single 4GB GPU
varunlmxd opened this issue · comments
Please make the package also support for OPT Architecture LLM's like Galactica.