1User Prompt Natural language goal, e.g. “make coffee.” |
→ | 2Hardware Retrieval Identify current Unitree R1 state (pose, battery, joints, reachability). |
→ | 3Event Confirmation User approval to proceed — consent gate before any motion. |
5Navigation Movement & path planning; get the base where it needs to be. |
Manipulation Arms / hands / grippers; grasp, pour, place. |
Task (Beverage) The coffee procedure: sequence & recipe logic. |
Safety Constraints, limits, collision & hazard rules for every subtask. |
9Sensor Feedback Sensors report real-world results back up the chain. |
→ | 10Result Evaluation Does the outcome match expectation? YES → task complete. NO → correction loop. |
DemonstrationData capture of the user performing the task |
→ | Task ModelingBuild a candidate skill |
→ | First ExecutionR1 attempts it |
→ | User ValidationRight or wrong? |
→ | CorrectionRehash / reprocess if wrong |
→ | Validated SkillConfirmed & versioned |
★ Personal Skill Memory Validated skills stored per user. “make coffee” becomes “make MY coffee.” |
→ | ↻ Loop 2 — Retrieve & adapt On future requests, the Director retrieves the stored skill, adapts it to context, and the R1 executes; sensors re-evaluate and can trigger Loop 1 again. |