Sorry but I have to say it: WOW!
Zibri opened this issue · comments
I am quite new to the A.I. world, and I spent a week testing a lot of different models in very harsh conditions (cpu only and 16 gb of ram)
This is by far the best model of them all.
Who knows me will be suprised because I rarely praise something (anything) in this way.
I wonder how much it would deteriorate by reducing it's size to around 8gb....
I tested a gguf model of 16gb (wizardlm-13b-v1.2.Q4_0.gguf) and the results were amazing.
Impressive. Indeed. This and mistral are my favourites for now.