As a World Labs customer, I suspect they are using existing 3D assets when creating their environments. For one thing, a vendor of 3d models for AI mentioned Word Labs as a customer on a webinar.
I don't know if that undercuts what you're saying entirely. But if they're just protecting the splat in real-time based on the camera path through a 3d world, would the model truly understand that it's a floor?
What is the scenario you're thinking about? This is kinda what happens with VLAs, the latent knowledge of an LLM can help in action generation pipelines, but it's also kinda slow.