Great work on this quant.
#2
by
chriswritescode
- opened
I have tested in real world workflows almost all of the quants and variations of this model. Reaped, awq, gptq. int4/int8 mixed. This model performs very well. Just wanted to thank you for taking the time and resources to make this for everyone.