Sounds like its essentially a generalized zero-shot classifier that takes and option set at runtime and works on unstructured inputs.
replyyou pass in your "prompt" and options (described in natural language) that it can respond with, in addition to your input. it gives back that option set with a probability assigned to each one
yes and can do many of those in parallel
replyI would guess a tiny stripped down text diffusion model. It only has 32k context, and for choice mode it can only select from 10 choices.
reply> and for choice mode it can only select from 10 choices.
replyRip there goes my excitement. I have a task that something like this would be great for but the list of options is a zero or two larger than that xd
They said that it works with up to 255 options.
replyyou can still chain them
reply