To see replies: https://xcancel.com/thsottiaux/status/2076543065045795309
replyThe linked tweet is an unofficial reply to Tibo's official info and Tibo makes a correction in a reply.
[flagged]
replyX.com is not publicly accessible. I wish people would stop using it as a source
replyThen sign up for X instead of circumventing it because you’re a woke leftist upset with Elon.
replyWhy do the woke lefties on HN get so upset and downvote and flag.
[flagged]
replydeleted
replyAm I dumb or does this chart make no sense? Or why does the line only go up even with compaction? Or maybe "overall trajectory size" is hiding some meaning I don't understand?
replyThe chart makes sense and is describing the cumulative cost of a trajectory. Cache tokens are created when a trajectory’s prefix is used more than once. A larger pre-compaction context window means that a greater number of cache tokens are used per turn, and a larger number of turns are completed before compaction runs. So you get a cumulative cost that grows quadratically until the compaction event.
replyThe blue line (200K context) is lower than the red line (300K context).
Indicating that it's cheaper to run blue rather than red over longer cycles.
replyThe Y axis is total cost in USD. For it to go down would mean OpenAI refunding you money.
replyHow can the overall trajectory length be the same across reasoning efforts? I don't see how this is possible even if reasoning is not included in the trajectory length calculation.
replyI think Tibo was just keeping all else fixed and it’s an illustrative example rather than a perfect real-world trajectory.
reply