You’re correct, it’s a great solution for a very narrow set of high volume classification needs that require very low latency. But that’s it.
replyI keep evaluating Jev for my product because of the hype, but the reality is that for my tasks, Luna is more accurate, only a little more expensive, and the latency doesn’t matter. I’d rather spend the extra $50 / month or whatever than have to shoehorn in another API and provider, and also lose the ability to change reasoning level and get reasoning summaries for eval purposes.
Did you look into self-hosted open source decision models because they are quite capable also much faster and much easier to integrate and you don't need to pay anything.
reply