So theoretically, if you give that model the means to find information, ascertain the quality of said information, it could still reason its way to an proper answer?
replyIs this whole thing than maybe a read vs write optimisation again? Spent more time and effort training more knowledge into the model upfront and get it out in a single question instead of training a small model and needing more steps to answer the same question?
> VibeThinker 3B constitutes extraordinary evidence.. math and logical reasoning
replyAny similar model aimed at coding?
A >10B model for mass spawning/swarming and reporting back to a larger model
To some extent VT 3B is intended as a coding model (see https://old.reddit.com/r/LocalLLaMA/comments/1u7dzdr/scaling... ). It reportedly does well on leetcode-type problems, although I didn't check that myself.
replyI wouldn't use it for anything important without heavy supervision, as it's very weak outside its specialty. Not ideal for instruction-following tasks.