upvote
Feel free to elucidate if you want to add anything to this thread other than vibes.
reply
after you go from from millions of params to billions+ models start to get weird (depending on training) just look at any number of interpretability research papers. Anthropic has some good ones.
reply
> things start to get weird

> just look at research papers

You didn't add anything other than vibes either.

reply
Interesting, what kind of weird?
reply
Getting weird doesn’t mean calling it text prediction is actually ‘bullshit’? Text prediction isn’t pejorative…
reply