Also cache write/read cost + cache efficiency.
replyTrue, but it would have to be more than massive (order(s) of magnitude) to offset that gap.
replyWe notice with frontier models like Astra and Fable that one might use a lot less tokens than the other to complete the task thereby being the better deal in spite of the far higher token cost.
reply