Please make a good 1-bit version of Falcon-180B so I can run it on my A6000 :)
KnutJaegersberg opened this issue · comments
The request has been received, and I believe it will be as you wish soon.
GreenBitAI / low_bit_llama
Advanced Ultra-Low Bitrate Compression Techniques for the LLaMA Family of LLMs