Will it support qlora?

Question

@lw3259111 We currently have no bandwidth to support qlora, but it would be great if community can help us on this, especially long-context model consumes much more memory.

Dacheng Li · Answer 1 · Thu Jul 13 2023 11:42:46 GMT+0800 (China Standard Time)

@lw3259111 We currently have no bandwidth to support qlora, but it would be great if community can help us on this, especially long-context model consumes much more memory.