And that's not really a hard bar to clear if you look at how people write comments online (including places like GitHub).
Anyone that uses punctuation, and capitalises words, probably automatically gets past the 70% confidence line.
It’s not nondeterministic
you can probably do the shannon entropy calculation yourself if you understand what the evaluation algorithm is
That said…if the evaluator is non-deterministic, then there’s no value in the estimate anyway
FWIW, your comment history here does not look like AI at all to me, and I think I have a very (maybe too?) high sensitivity to AI slop.
I really don't see how this can be possible unless they're accepting abysmal recall? Perhaps I'm missing something fundamental here, but the idea that AI and non-AI assisted text can be separated with "nearly 0 false positives" just says to me that it's really just a filter for the weakest, most obvious AI generated text. Is that valuable?
I really doubt those tools are good for anything
the amount of "that is obvious ai slop" comments i see on mine or other people's genuine non-ai writing has discouraged me from sharing anything more than roughly a paragraph for probably the rest of my life.