Is it possible to quantize the model? Don't think I want to run 8 gigs on my local just for decisions but curious about it for sure

Update: Microsoft just announced Microsoft-Decision-1 (a post-trained Qwen3.5-9B) and benchmarked it against H2O-Lightning-4B, among others: https://commandline.microsoft.com/microsoft-decision-1-model...

One note on their speed comparison: the JevBench board shows self-hosted models with an adjusted latency of "2x + 0.15 s (assumption, not measured)". Our measured p50 is 29 ms; the adjusted figure is 0.21 s. They report 85 ms for theirs.