HN is for conversation between humans[1] (about AI generated blogspam, apparently)
I've been asking for that for some time.
I can only read so many (either pro OR against) ".. IT'S AI! ! !" comments before skipping the thread. I can't be the only one.
How well it would work on this site, I'm not sure.
then we're all screwed I guess. lol
I'm not thrilled with it, but he is obviously using it to improve his writing overall- to communicate some great ideas that are personal and germane. I've decided that being too inflexible serves no one. If it is true slop, I'll not revisit the writer in the future- if they are using AI to polish writing that at its core is a unique voice, I'll accept it and learn to live with it...
* they use quantized models
* they quantize KV cache
* they have a cache tagging mechanism to prevent cache misuse (neat)
The agent can extract numbers without filler prose as well.