180b * 1.76 bits per weight = 39.6 gigabytes.
replyBest you could realistically run in 32gb is like 28gb, or a 127B param model
Qwen3.8-Next, thanks to its new architecture, is quite fast even if part of it is streaming from disk
replyBest you could realistically run in 32gb is like 28gb, or a 127B param model