Compared to the Opus 5 "model card", which read like a standard Anthropic set of alignment principles and safety concerns, this presents a plethora of useful technical details that advances the state of the art.
replySame with DeepSeek papers, they are a joy to read.
replyNot an expert, but looks like they did a lot more work on the RL part (9 expert models, full sandbox access for agentic tasks, etc)?
replymost new effort in training comes in the late phase with RL techniques
replythe pretraining (slurping the internet) only goes so far, the new data being used is from human preferences and agent traces (designed and/or distilled)