I’m using it on a 48GB machine and it causes some lag, so it might be worse on 24, but it should run.
replyUnsloth recommends 18GB of RAM for Qwen3.6-27B (for their version of the model).
I feel you!
replySent from my 8gb M2 Mac mini.
I'm still rocking my nvidia 2060, which I had purchased for $400 at the time.
replyI struggle to imagine purchasing multiple 1k+ cards on my own dime.