Things like the red key must be reachable before the red door, and there should be no path that bypasses the red door, etc. written as a set of constraints.
I was working on is because I realized, constraints tend to be similar in nature (graph cut, minimum/maximum shortest path etc.) algorithmically, but its usually quite hard to control designer intent.
The reason I shelved the project, was I asked an LLM a couple years ago, to generate a dungeon room graph, following a similar set of constraints, but stated in plain English, and it did a perfect job.
Which brings me to my final point. LLMs are amazing and flexible constraint solvers, and are woefully underutilized in scenarios like this.
With a hand authored constraint system if the red key is in the wrong place you have a bug in the constraint system that can be deterministically fixed, with a LLM you have to roll the dice on prompting again and go through expensive verification.
Use any image generation tool (or any image) and have a multimodal LLM like Gemini extract individual parts of the image “isolate with a transparent background” - then you can use those images for image-to-3d in those tools.
Don’t forget to use low or “smart” poly features otherwise you get too many vertices to the point you can’t performantly raycast etc.
But yeah - it’s there.
I've found it's actually best to do maximal quality generation and decimate/meshopt to desired budget.
If you're raycasting against your raw art you're doing it wrong anyway, none of the big players do this precisely for the reason you mentioned. And beyond physics meshes, if you're doing anything where performance is a problem you probably want multiple LODs so you have to do this work anyway.
These days you can just ask your agent to build you a LOD pipeline and forget about it rather than sacrificing the art; Claude knows Blender.
Decimating ends up ruining the look of the model to get it down to a game ready size.
Even a simple house model, or humanoid, using Decimate in Blender there is no way that will be even recognizable.
(I agree with you about Blender though, I always hated Blender's simplify)
Some 3D AI providers still leak like that, but Meshy came up with their own binary format that splits the stream up into separate files that are assembled with a response it only gets if you have Premium.
Thought it was cool technology - and wonder if browser games in general are doing stuff like that to protect 3D assets from being easily ripped from the Network tab.
Can you explain more? Can I use Fable 5 to generate a 3d model from a couple of photographs?