upvote
Being new to a hobby and spending 30k on a robot is crazy, props to your wealth.
reply
Do you think the R1 you got can actually be taught to clean dishes and put them in a dishwasher in their specific sections? I see it doing so in https://www.youtube.com/watch?v=k1JIyXM5qGw
reply
The one in that video is the G1, which is a bit taller and comes with more sensors, but there's a trick and it is the dexterous hands, which can easily cost 10k each.

Based on my very limited knowledge... if you would have dexterous hands with sensitivity on them you could theoretically train a VLA model to do that task, planned by a high-level model like Argon 4, that orchestrates everything. That would as well require in first place a VLA that has similar tasks in its training set and fine-tune it by means of recording hundreds of examples performing teleoperation of the robot hand and arms movements.

Not easy, but definitely getting more and more doable these days.

PS: Didn't spend 20k on hands for my 6k robot, but can confirm it has the cable harness to support them :D

reply
I'd like to do this too.

What's the latency like? Is the llm used to create an instruction set for the robot? How is it interrupted for reflex actions like controlling stumbling?

reply
The LLM right now tells a much lower level neural network controlling the legs, arms and head what and how to move at a ~ 500Hz freq, which controls thing like the stumbling. All motor joints and IMU inputs are given to an ONNX-based RL-trained NN which then outputs motor movements (scary since its works well for the scenarios where its has been trained, but it goes in unexpected ways for untrained scenarios).

In any case latency is acceptable for navigation I guess, but avoiding moving obstacles is definitely a no-go right now.

reply
How much was it?
reply
Around 5.9k euros in Germany for the R1 Pro.

It's 1.23 and weights ~30kg. Even though only the R1 Edu can be in theory programmed, it can be easily modded to enable SSH and root access to deploy custom movement policies and interact with the different on-board daemons to control the movements, grab the video data, etc.

I bought a second-hand Intel DeepSense camera and plugged it on one of the spare USB ports available in the main board to have 3D sensing (even though I really need to play a bit more with it). Right now I am playing with MuJoCo for RL training of new policies, integration with VLAs like NVIDIA Isaac GR00T and integration with LLMs.

I have to say its being a wild ride, and despite the small size of the robot, I have already injured myself with it when playing with the walking policies (If you activate a policy while its hanging, it starts literally kicking and punching you...) I cannot image those owning with the bigger brother of it, the G1...

reply
Thank you, that’s insanely cheap. I might consider getting one.
reply
As a tip from an owner... if you are planning to play around, maybe even the robot dog (Go2) can be a good start and comes with a LIDAR preinstalled. When humanoid robots enter into zero-torque / damping mode, it's 30 kg falling to the floor. I know it might sound stupid, but I didn't realize how heavy and scary this is, at least for me, once you have it in front of you.
reply
[dead]
reply