undefined

points

[-]

My pet theory is that this was happening, because labs naturally worked to source highest quality data sources they could get. Even if they initially slurped everything indiscriminately, the obvious next step is to sort them by "quality", and bias towards the high end while trimming from low end.

So obviously, government documents, top publications from liberal arts scholars and STEM > Wikipedia > Reddit (and within, r/AskHistorians > r/all, etc.). The first group is the one most likely to (over)use correct / fancy typography.

I have a related pet theory: the telltale sign of AI writing is being too good for the context it's found in, in terms of vocabulary and style as well as structure.

What is jarring about this is precisely the quality - we associate certain styles with important (or self-important) venues, so it's uncanny to suddenly see random shitposts, copywriting spam, or regular chat replies look like work of NYT bestselling authors or legal scholars - it feels wrong in places we expect basic language, grug-brain reasoning, and lots of typos.

Also, what makes the above much more noticeable, is that AI systems don't have cross-session stylistic memory. From the POV of an LLM, that perfectly fitting, masterfully crafted starter is the first and only time it used it. From the user's POV, it's the tenth time they're seeing it in the span of an hour.

by astrange2 hours ago|

parent|

[-]

AI writing style comes from post-training, which is entirely under the control of the labs. It's not copying it from any public sources.

by TeMPOraL2 hours ago|

parent|

[-]

I didn't say it's copying anything. It's learning styles - all of them - in pre-training. Post-training is just about giving it the right defaults.

Doesn't change my point anyway - even if post-training, labs naturally want the LLM to come off as smart (well, except for Grok). Post-training is where they "untrained" em-dashes and such, due to complaints of users.

by xienze38 minutes ago|

parent|

[-]

I'd heard an interesting theory that in training on customer chats there's a lot of interactions like this:

Agent: _wall of text_

User: yeah sounds great, do it

Which has the predictable outcome of biasing towards wall of text responses.

by xd19363 hours ago|

prev|

[-]

Continue to write with em dashes. Be the change you wish to see in the world.

by lackoftactics3 hours ago|

parent|

[-]

I did at the beginning, but there is only so much you can take, and no one cares if you have read books and seen it before. There were a bunch of programmers whom I thought would understand em dashes, but they did not and said no one uses such dashes only normal hyphens.

Em dashes ended up as one of the first victims of llm age

by TeMPOraL2 hours ago|

parent|

[-]

Em dashes were already "doomed" at least half a century ago, because they didn't make it into ASCII character set - which arguably is just because they were seen as redundant on ancient typewriters; that's also why they aren't there on normal keyboards, which was a double whammy: inconvenient for programmers to support, inconvenient for users to type.

In other words, since the very start of computer era, the use of em dashes was always a signal.

by jamie_ca15 minutes ago|

parent|

[-]

At least with a typewriter, if - was sized right you could -- for an emdash.