upvote
What kind of decisions though? jev does not output joint angles, and if it did it also needs to know how. It also does not take in images.
reply
As a proof of concept I've been working on a Jev style vision model that can rapidly answer boolean and choice questions based on images (See [0] but not the point of this comment). One of the reasons I wanted to make this concept is because I was also thinking about exactly what the parent comment suggests. I just haven't gotten around to getting (3d printing) a robot arm yet :)

[0]: https://huggingface.co/MeerDevelopment/Qevi-2B

reply