I been using gemma 26b moe model as the system one variant for my own uses and its great and far smarter then any alternatives at around 200ms, bigger is better for these things as long as you dont need lower latencies, only caviat is calibration, if you need calibration better use JEV.
reply