Hacker News
new
past
comments
ask
show
jobs
points
by
Aurornis
23 hours ago
|
comments
by
22 hours ago
|
next
[-]
deleted
reply
by
bityard
22 hours ago
|
prev
|
[-]
This would likely run fine in just 96 GB of VRAM, by my estimation. Well within the ability of an enthusiastic hobbyist with a few thousand dollars of disposable income.
Quantizations are already out:
https://huggingface.co/unsloth/Qwen3.6-27B-GGUF
reply