What is your setup like? How much VRAM do you have? I'm curious about what is the minimum configuration that you would need to run this locally.
replyI have 2 DGX Sparks, 256 GB unified RAM, so not a cheap set of hardware. Luckily I bought them before the recent price increase.
replyHowever even with a high tier gaming machine you can run one of the Qwen models and it will be good at coding... like having an intern with boundless energy that will sometimes make mistakes but in general save you a lot of time. And for automating tasks involving scanning documents or creating summaries it will be brilliant.
Not the GP, but in my case 240G VRAM and 256G RAM will run the 3.86 bpw version with a little bit of room to spare and a very nice size context.
reply