That’s the exact ram/vram combo of my desktop - what model would you suggest for that gaming pc setup?
replyI would recommend to start withQwen 3.6 35B at maybe Q5, it should be fast in that setup. For intelligence Qwen 3.7 27b, is smarter but will run much more slow. Others also mention gemma 4, which might be worth a try.
reply> Feels like SOTA from maybe a year ago?
replyAgree but only for small projects. SOTA from a year ago still wins on larger projects
"Coding system" "can really do coding locally"
replyVibe coders out here thinking all software development is solved by because they made an (ugly and unoriginal) dashboard for their SaaS clone and their single column with 3x3 feature card landing page thats identical to every other vibe coders "startup"
deleted
replyHow are you using that RAM with the GPU?
replyLlama.cpp with automatic offload to main memory. You can also use Ollama, it is easier, but slower.
replyFor those who want a GUI, LM Studio does this too (with llama.cpp as the backend I think). I'm getting great (albeit slow) results with Qwen3.6-35B MoE on 8GB GPU RAM, 40GB system RAM.
reply