>This isn’t accurate - most of the style comes from the fine tuning and reinforcement learning, not from the original training data.
replyFine tuning, reinforcement, etc are all 'training' in my books. Perhaps this is your confusion over 'people got this idea'
> Fine tuning, reinforcement, etc are all 'training' in my books.
replyThey are but they have nothing to do with how frequent anything is in literature which was your main point.
Agreed. The pre-2025 base models don't write like this.
replySo LLMs have gotten creativity recently?
replyNo, my point has nothing to do with creativity. It's about the fact that their output is taylored to look and sound in a certain way in the later stages of model training, it's not representative of the original text data the base model was trained on.
reply