Hacker News
new
past
comments
ask
show
jobs
points
by
karimf
2 hours ago
|
comments
by
Patrick_Devine
1 hours ago
|
[-]
Try it with mxfp8 or bf16. It's a decent model for doing tool calling, but I wouldn't recommend using it with 4 bit quantization.
reply