It doesn’t to be a ton bigger, 16k and reliable 8k would be a godsend. (I run at 2k)
replyWhat are the models? I am super curious in these as well
replyProbably Kev and/or the decider models. Kev is trained on one of the 4B qwen models, similar for decider but it ranges from 0.8B through to the 35B-A3B model so far I believe.
reply