upvote
It’s prompt processing so prefill - that’s compute bound not memory.
reply
4x is on Time To First Token it's on the graph.
reply