upvote
> As an aside, I always wondered about decision models. They are so cheap. I can’t help but think that providers must be using them as honeypots for data acquisition:

This one is actually the simplest for me, you can run decision models on your own laptop, and you can see how cheap and fast they are, it's actually amazing how "good" (jev etc is still better) they are.

So instead of thinking of them as a "LLM" for hosting pricing, it's easier to think of them as a API as a service, it's practically "how much can we charge someone for processing in bulk for an action and to get them sticky".

You setup whatever workflow you want for the decision models and then you practically never change it, because why would you, it's dirt cheap (for you and they provider), they (the provider) is making money on your outsourcing for every API action and it's going to be consistent because it's going to be for a long time.

reply
But nobody knows how jev is actually built , what open source decision models? All the ones available kind of jerryrig it on top of a LLM last I looked into it.
reply
IIRC JEV is known to be built on Qwen, you simply ask it questions to that effect. No idea where I saw the thread, but someone did this exhaustively using many variations and the answer was conclusive
reply
Decision models can be cheap because it’s a fundamentally cheaper technology than LLMs. So that part isn’t suspicious at all to me.

That said, if you don’t believe OpenAI when they say they don’t train on your decision API inputs you shouldn’t trust them regarding LLM inputs either.

reply