If you’re looking into small models for tiny local tasks, you should try Qwen coder 0,5B. It’s more of an experiment, but it can output decent functions given the right context instructions.
reply> [Qwen coder 0,5B] can output decent functions given the right context instructions
replyCan you share a working example?
So… a prompt? I’m not on my laptop but I hooked it to cmp.nvim, gave it a short situational prompt, +- 10 lines, and started typing. Not anywhere near usable but with a little effort you can get something ok for repetitive tasks. Maybe something like spotting one specific code smell pattern. The advantage is the ridiculous T/s you get
replyThe combined (input/output) context window length is 4K. Claude would blow through that even when trying to read and summarize a small file.
replyWith a small/minimalistic harness like Pi maybe it works well?
replyI was thinking about the other way: Could you use this in front of Claude to summarize inputs and so reduce your token counts?
replyproject started with
replytrying to run openclaw with it in ultra token saving mode, did totally not work.
great for shell scripts though (my major use case now)