upvote
Dedicated rollout and trainer nodes, with RDMA transfers between them.
reply