undefined

points

[-]

I am working in Mistral robotics team. I confirm this is map-less. The only inputs are the text prompt and the front camera rgb image.

by vga11 hours ago|

parent|

[-]

Please oh please try to make Kärcher adopt your stuff. Even their latest premium cleaning bots are hopeless when they don't know where they are, even when I tell them where they are.

Or, I don't know, make your own vacuums.

by dylan60411 minutes ago|

parent|

[-]

I have no hope for this working. I recently bought a dumb meatbag operated vacuum after tiring of the robot's issues. The constant getting stuck in places drove me crazy. After getting a new vac, I used it in a place where the robot had just "cleaned" that morning. According to the new collector's contents, the robot sucked at its job of sucking.

by digitaltrees37 minutes ago|

parent|

prev|

[-]

Are you interested in working with partners that are collecting training data?

by moffkalast2 hours ago|

parent|

prev|

[-]

So, it has to rely on exact situational step by step commands? I'm wondering how one could conceivably deploy this in a useful way. Usually you'd need to mark areas on the map and then the robot knows where to go, A* is trivial around obstacles once you have that and a lidar. And lidars are an order of magnitude cheaper than something that can run an 8B VLA.

One could maybe autogenerate these text planning commands, but it would require a map and the robot's current location, so it doesn't really solve that, unless it can find a specific thing completely on its own. How much of a planning horizon does it have?

by mike_hearn1 hours ago|

parent|

[-]

You probably don't need a geometric map. Just have someone wander around with a mobile app and feed the video into a more powerful model once, asking it to produce descriptions of the different areas of the office or building and how they connect. Now you have a "text adventure game" map you can use it with a small LLM to produce instructions for the robot to follow, assuming it knows where it currently is.

The advantage over traditional approaches is presumably flexibility. LIDAR isn't going to solve an instruction like "find the man with the pink shirt".

by pj_mukh16 minutes ago|

prev|

[-]

Would be extremely interesting to build an "Exploration" node of sorts. Solve a sort of Semantic SLAM problem as you go.

So if you can give it an instruction to "Find the elevator on this floor", could it walk around and build a map as it goes so it starts doing what a human would do to find the elevator.

As of now, the way these navigation models are setup, it assumes the instruction writer was intimately aware of useful visual navigational landmarks to give, which is not realistic for most use cases.

by ainch2 hours ago|

prev|

[-]

Wouldn't modern SLAM or VSLAM address that problem?