upvote
I was looking at the qwen-next-flash, and the weights would fill my OEM Spark on their own, before the n-gram. I'm unclear if offloading to disk can work here, is that what you are implying is possible?!
reply
Check out eugr’s TP=1 sparkrun recipe :)

It’s an NVFP4 quant, but it fits, and is surprisingly capable.

reply
do you have a HF link? HF search is not uncovering it for me

(or is it somewhere else)

reply