upvote
Which ds4 checkpoint for which model exactly did you test? Don't they have multiple different versions and quantization levels?
reply
deleted
reply
not my experience

the ds4 quants were very good beating the unsloth quants https://github.com/michaelasper/benchmarks/blob/main/deepsee...

reply
That's quite the statement - unsloth quants are amazing.
reply