I made this 3D game in a day on the same setup with Qwen Code as agent: https://games.jonathanpage.com/
replyAnd I am not a web developer! It's an extraordinary model.
(Mouse and keyboard required)
Yeah, I'm guessing you have a variant that fits in <128GB with 262k context? I have the unsloth Q8 GGUF of it here in a setup that with full context and ton of extra llama-server "--cache-ram" sits around 200GB RAM usage on a 256GB system, it's probably the best thing I've found for a 256GB class machine. Enough headroom for a rope/yarn extension to 524288 context if I need it.
replyYep, the engrams are on NVMe (the speed penalty was lower than I expected) and it is quantised to fit.
replyIt’s good enough that I’m considering a second spark, or selling this and buying an M5 Ultra with 256GB for it