If I have to gather and tag data to fine-tune Jev, I can probably just train an "old school" classifier model and make it even cheaper, faster, and just as accurate.
> Confidence is derived from the probabilities
https://docs.typesafe.ai/confidence
(Why is it much easier to find AI-slop websites quoting this than it is to find the actual documentation?)
My inner Bayesian would like for Jev to provide something resembling “evidence”, although I admit that one might ask Jev questions that are somewhat awkward to treat as typical Bayesian questions. If I ask “will this PR be merged”, it’s kind of strange to contemplate the probability of a PR conditioned in that PR being merged in the future. But I bet there is a way to formalize a prior-free classifier in a way that makes Bayesians and non-Bayesians happy, possibly involving actual learned probabilities and confidence levels. If you read the literature on scoring rules, you will find that classifier scores do somewhat naturally decompose into a few interpretable terms.
We believe entire compliance workflows (even multilingual) could be automated.
Would you like to get a demo ?
It is possible with deterministic decision models, such as At0m, to gauge the probabilities at every decision. This behavior in addition to hard coded logic, it is possible to completely replicate a prompt's logic.
Using Fable 5.1, it is a matter of minutes.
I believe that most of the compliance check documents will be a solved problem, 3-6 months in future.
None of the LLMs can do it.
Hence I asked to the comment poster if he would want to demo, so that I can show it to him, how to do it step by step. By bad, if it came out too strongly.