Leaderboard
Skill execution · Cross-scene generalization · Long-horizon composition
- Six paper baselines now include all stage, cross-scene and long-horizon scores.
- Cross-scene ± denotes standard deviation across scenes, not confidence intervals.
- These are manuscript baselines; community submission intake is not yet open.
Stage benchmark
Success rate over 50 episodes per stage. Each policy starts from a valid initial state for that stage.
All tracks use the same 0–100% scale.
Compare each method across all three tracks
Success (%), on a shared 0–100 scale.
RLPD
ACT
Diffusion Policy
GR00T
π0.5
Stage performance map
All six methods. Cells show success rate; hover for the exact value.
| Stage | PPO | RLPD | ACT | DP | GR00T | π0.5 |
|---|---|---|---|---|---|---|
| Open Lunch Box | 74.0 | 100.0 | 100.0 | 96.0 | 100.0 | 100.0 |
| Place Bread | 12.0 | 86.0 | 88.0 | 20.0 | 60.0 | 70.0 |
| Scoop Tomato | 0.0 | 0.0 | 44.0 | 0.0 | 12.0 | 32.0 |
| Open Cabinet | 62.0 | 100.0 | 94.0 | 88.0 | 92.0 | 98.0 |
| Pick Bottle | 0.0 | 14.0 | 68.0 | 18.0 | 78.0 | 54.0 |
| Unscrew Cap | 0.0 | 2.0 | 62.0 | 50.0 | 62.0 | 46.0 |
| Pour Beads | 0.0 | 96.0 | 100.0 | 32.0 | 78.0 | 52.0 |
| Open Drawer | 98.0 | 100.0 | 98.0 | 98.0 | 98.0 | 98.0 |
| Pick Charger | 0.0 | 62.0 | 92.0 | 0.0 | 78.0 | 78.0 |
| Insert Plug | 0.0 | 0.0 | 16.0 | 12.0 | 6.0 | 12.0 |
| Pick Bolt | 0.0 | 28.0 | 8.0 | 22.0 | 44.0 | 12.0 |
| Seat Nut | 0.0 | 34.0 | 12.0 | 6.0 | 26.0 | 2.0 |
| Turn Nut | 76.0 | 100.0 | 96.0 | 100.0 | 100.0 | 100.0 |
| Open Laptop | 100.0 | 100.0 | 100.0 | 88.0 | 100.0 | 82.0 |
| Type Keys | 0.0 | 0.0 | 0.0 | 0.0 | 32.0 | 0.0 |
| Click Mouse | 96.0 | 100.0 | 14.0 | 92.0 | 98.0 | 62.0 |
| Lay Flat Panel | 0.0 | 96.0 | 78.0 | 24.0 | 64.0 | 0.0 |
| Insert Rail | 0.0 | 0.0 | 22.0 | 2.0 | 16.0 | 8.0 |
| Fasten Screw | 100.0 | 100.0 | 0.0 | 0.0 | 84.0 | 94.0 |
| Aspirate Liquid | 0.0 | 0.0 | 40.0 | 2.0 | 8.0 | 26.0 |
| Dispense Liquid | 0.0 | 0.0 | 0.0 | 2.0 | 8.0 | 0.0 |
| Open Fridge | 90.0 | 98.0 | 100.0 | 88.0 | 94.0 | 96.0 |
| Apple To Blender | 0.0 | 0.0 | 92.0 | 42.0 | 54.0 | 38.0 |
| Close Fridge | 100.0 | 100.0 | 100.0 | 100.0 | 98.0 | 100.0 |
| Place Lid | 0.0 | 78.0 | 26.0 | 26.0 | 42.0 | 16.0 |
| Press Button | 26.0 | 100.0 | 66.0 | 72.0 | 64.0 | 68.0 |
| Open Package | 2.0 | 92.0 | 44.0 | 2.0 | 64.0 | 58.0 |
| Extract Apple | 0.0 | 42.0 | 88.0 | 22.0 | 100.0 | 82.0 |
| Pick Debris | 0.0 | 0.0 | 0.0 | 2.0 | 0.0 | 0.0 |
| Dump Dustpan | 0.0 | 0.0 | 92.0 | 70.0 | 82.0 | 78.0 |
| Rank | Method | Family | Average success (%) ↑ | Source |
|---|---|---|---|---|
| 1 | GR00T | VLA | 61.4 | Paper baseline ↗ |
| 2 | ACT | Imitation learning | 58.0 | Paper baseline ↗ |
| 3 | RLPD | Demo-guided RL | 54.3 | Paper baseline ↗ |
| 4 | π0.5 | VLA | 52.1 | Paper baseline ↗ |
| 5 | Diffusion Policy | Imitation learning | 39.2 | Paper baseline ↗ |
| 6 | PPO | Demo-guided RL | 27.9 | Paper baseline ↗ |
All 30 stages
Success rates (%). Highlighted cells are the highest result in each row.
| Stage | PPO | RLPD | ACT | Diffusion Policy | GR00T | π0.5 |
|---|---|---|---|---|---|---|
| OpenLunchBox | 74.0 | 100.0 | 100.0 | 96.0 | 100.0 | 100.0 |
| PlaceBread | 12.0 | 86.0 | 88.0 | 20.0 | 60.0 | 70.0 |
| ScoopTomato | 0.0 | 0.0 | 44.0 | 0.0 | 12.0 | 32.0 |
| OpenCabinet | 62.0 | 100.0 | 94.0 | 88.0 | 92.0 | 98.0 |
| PickBottle | 0.0 | 14.0 | 68.0 | 18.0 | 78.0 | 54.0 |
| UnscrewCap | 0.0 | 2.0 | 62.0 | 50.0 | 62.0 | 46.0 |
| PourBeads | 0.0 | 96.0 | 100.0 | 32.0 | 78.0 | 52.0 |
| OpenDrawer | 98.0 | 100.0 | 98.0 | 98.0 | 98.0 | 98.0 |
| PickCharger | 0.0 | 62.0 | 92.0 | 0.0 | 78.0 | 78.0 |
| InsertPlug | 0.0 | 0.0 | 16.0 | 12.0 | 6.0 | 12.0 |
| PickBolt | 0.0 | 28.0 | 8.0 | 22.0 | 44.0 | 12.0 |
| SeatNut | 0.0 | 34.0 | 12.0 | 6.0 | 26.0 | 2.0 |
| TurnNut | 76.0 | 100.0 | 96.0 | 100.0 | 100.0 | 100.0 |
| OpenLaptop | 100.0 | 100.0 | 100.0 | 88.0 | 100.0 | 82.0 |
| TypeKeys | 0.0 | 0.0 | 0.0 | 0.0 | 32.0 | 0.0 |
| ClickMouse | 96.0 | 100.0 | 14.0 | 92.0 | 98.0 | 62.0 |
| LayFlatPanel | 0.0 | 96.0 | 78.0 | 24.0 | 64.0 | 0.0 |
| InsertRail | 0.0 | 0.0 | 22.0 | 2.0 | 16.0 | 8.0 |
| FastenScrew | 100.0 | 100.0 | 0.0 | 0.0 | 84.0 | 94.0 |
| AspirateLiquid | 0.0 | 0.0 | 40.0 | 2.0 | 8.0 | 26.0 |
| DispenseLiquid | 0.0 | 0.0 | 0.0 | 2.0 | 8.0 | 0.0 |
| OpenFridge | 90.0 | 98.0 | 100.0 | 88.0 | 94.0 | 96.0 |
| AppleToBlender | 0.0 | 0.0 | 92.0 | 42.0 | 54.0 | 38.0 |
| CloseFridge | 100.0 | 100.0 | 100.0 | 100.0 | 98.0 | 100.0 |
| PlaceLid | 0.0 | 78.0 | 26.0 | 26.0 | 42.0 | 16.0 |
| PressButton | 26.0 | 100.0 | 66.0 | 72.0 | 64.0 | 68.0 |
| OpenPackage | 2.0 | 92.0 | 44.0 | 2.0 | 64.0 | 58.0 |
| ExtractApple | 0.0 | 42.0 | 88.0 | 22.0 | 100.0 | 82.0 |
| PickDebris | 0.0 | 0.0 | 0.0 | 2.0 | 0.0 | 0.0 |
| DumpDustpan | 0.0 | 0.0 | 92.0 | 70.0 | 82.0 | 78.0 |
| Average | 27.9 | 54.3 | 58.0 | 39.2 | 61.4 | 52.1 |
Cross-scene
Fixed policies, no adaptation. Mean ± standard deviation across three kitchen scenes, with 50 episodes per stage per scene.
All tracks use the same 0–100% scale. Whiskers show standard deviation across three scenes.
Compare each method across all three tracks
Success (%), on a shared 0–100 scale.
PPO
RLPD
ACT
Diffusion Policy
GR00T
π0.5
Stage performance map
All six methods. Cells show scene-average success; hover for mean ± scene standard deviation.
| Stage | PPO | RLPD | ACT | DP | GR00T | π0.5 |
|---|---|---|---|---|---|---|
| Open Lunch Box | 35.3 | 33.3 | 100.0 | 35.3 | 100.0 | 99.3 |
| Place Bread | 10.0 | 0.0 | 40.0 | 8.7 | 24.0 | 71.3 |
| Scoop Tomato | 0.0 | 0.0 | 23.3 | 0.0 | 6.7 | 18.7 |
| Open Cabinet | 8.7 | 63.3 | 93.3 | 84.0 | 78.7 | 97.3 |
| Pick Bottle | 0.0 | 0.0 | 76.0 | 4.0 | 46.0 | 69.3 |
| Unscrew Cap | 0.0 | 0.0 | 4.0 | 1.3 | 9.3 | 33.3 |
| Pour Beads | 0.7 | 0.0 | 42.0 | 6.0 | 16.7 | 36.0 |
| Open Drawer | 97.3 | 95.3 | 82.7 | 4.0 | 90.0 | 100.0 |
| Pick Charger | 0.0 | 5.3 | 88.0 | 0.0 | 64.7 | 88.0 |
| Insert Plug | 0.0 | 0.0 | 0.7 | 0.0 | 2.0 | 1.3 |
| Pick Bolt | 0.7 | 0.0 | 8.7 | 2.0 | 21.3 | 18.0 |
| Seat Nut | 0.0 | 0.0 | 2.7 | 0.7 | 2.0 | 3.3 |
| Turn Nut | 26.7 | 11.3 | 44.0 | 11.3 | 80.0 | 87.3 |
| Open Laptop | 99.3 | 48.0 | 84.7 | 88.7 | 95.3 | 66.7 |
| Type Keys | 0.0 | 0.0 | 0.0 | 0.0 | 17.3 | 0.0 |
| Click Mouse | 98.0 | 6.7 | 12.7 | 68.7 | 100.0 | 64.7 |
| Lay Flat Panel | 0.0 | 0.0 | 54.0 | 0.0 | 34.7 | 0.0 |
| Insert Rail | 0.0 | 0.0 | 0.0 | 0.0 | 6.0 | 9.3 |
| Fasten Screw | 86.0 | 70.7 | 85.3 | 0.0 | 20.0 | 94.0 |
| Aspirate Liquid | 0.0 | 0.0 | 8.7 | 1.3 | 2.0 | 34.0 |
| Dispense Liquid | 0.0 | 0.0 | 0.0 | 0.0 | 2.0 | 4.0 |
| Open Fridge | 65.3 | 78.7 | 92.7 | 68.0 | 70.0 | 96.0 |
| Apple To Blender | 0.7 | 0.0 | 71.3 | 7.3 | 18.0 | 38.7 |
| Close Fridge | 100.0 | 100.0 | 99.3 | 66.0 | 92.0 | 100.0 |
| Place Lid | 0.0 | 0.0 | 18.0 | 1.3 | 28.7 | 16.0 |
| Press Button | 18.0 | 18.7 | 54.0 | 52.7 | 42.7 | 62.0 |
| Open Package | 2.0 | 2.7 | 36.7 | 1.3 | 35.3 | 30.7 |
| Extract Apple | 0.0 | 0.0 | 78.7 | 3.3 | 54.7 | 70.0 |
| Pick Debris | 1.3 | 0.0 | 0.0 | 0.0 | 1.3 | 0.0 |
| Dump Dustpan | 0.7 | 0.0 | 59.3 | 1.3 | 88.7 | 68.0 |
| Rank | Method | Family | Average success (%) ↑ | Source |
|---|---|---|---|---|
| 1 | π0.5 | VLA | 49.2 ± 2.3 | Paper baseline ↗ |
| 2 | ACT | Imitation learning | 45.4 ± 3.6 | Paper baseline ↗ |
| 3 | GR00T | VLA | 41.7 ± 14.2 | Paper baseline ↗ |
| 4 | PPO | Demo-guided RL | 21.7 ± 3.5 | Paper baseline ↗ |
| 5 | RLPD | Demo-guided RL | 17.8 ± 10.9 | Paper baseline ↗ |
| 6 | Diffusion Policy | Imitation learning | 17.2 ± 5.7 | Paper baseline ↗ |
All 30 stages
Success rates (%). Highlighted cells are the highest result in each row.
| Stage | PPO | RLPD | ACT | Diffusion Policy | GR00T | π0.5 |
|---|---|---|---|---|---|---|
| OpenLunchBox | 35.3 ± 14.5 | 33.3 ± 57.7 | 100.0 ± 0.0 | 35.3 ± 31.6 | 100.0 ± 0.0 | 99.3 ± 1.2 |
| PlaceBread | 10.0 ± 3.5 | 0.0 ± 0.0 | 40.0 ± 30.0 | 8.7 ± 4.6 | 24.0 ± 26.2 | 71.3 ± 7.0 |
| ScoopTomato | 0.0 ± 0.0 | 0.0 ± 0.0 | 23.3 ± 9.0 | 0.0 ± 0.0 | 6.7 ± 6.1 | 18.7 ± 3.1 |
| OpenCabinet | 8.7 ± 9.0 | 63.3 ± 54.9 | 93.3 ± 6.4 | 84.0 ± 11.1 | 78.7 ± 17.9 | 97.3 ± 2.3 |
| PickBottle | 0.0 ± 0.0 | 0.0 ± 0.0 | 76.0 ± 8.0 | 4.0 ± 5.3 | 46.0 ± 36.7 | 69.3 ± 6.4 |
| UnscrewCap | 0.0 ± 0.0 | 0.0 ± 0.0 | 4.0 ± 3.5 | 1.3 ± 2.3 | 9.3 ± 14.5 | 33.3 ± 11.0 |
| PourBeads | 0.7 ± 1.2 | 0.0 ± 0.0 | 42.0 ± 22.3 | 6.0 ± 10.4 | 16.7 ± 17.5 | 36.0 ± 5.3 |
| OpenDrawer | 97.3 ± 4.6 | 95.3 ± 4.2 | 82.7 ± 10.1 | 4.0 ± 5.3 | 90.0 ± 10.6 | 100.0 ± 0.0 |
| PickCharger | 0.0 ± 0.0 | 5.3 ± 9.2 | 88.0 ± 5.3 | 0.0 ± 0.0 | 64.7 ± 19.6 | 88.0 ± 0.0 |
| InsertPlug | 0.0 ± 0.0 | 0.0 ± 0.0 | 0.7 ± 1.2 | 0.0 ± 0.0 | 2.0 ± 3.5 | 1.3 ± 1.2 |
| PickBolt | 0.7 ± 1.2 | 0.0 ± 0.0 | 8.7 ± 5.0 | 2.0 ± 3.5 | 21.3 ± 13.3 | 18.0 ± 2.0 |
| SeatNut | 0.0 ± 0.0 | 0.0 ± 0.0 | 2.7 ± 2.3 | 0.7 ± 1.2 | 2.0 ± 3.5 | 3.3 ± 2.3 |
| TurnNut | 26.7 ± 11.0 | 11.3 ± 16.3 | 44.0 ± 19.7 | 11.3 ± 12.7 | 80.0 ± 19.7 | 87.3 ± 5.0 |
| OpenLaptop | 99.3 ± 1.2 | 48.0 ± 50.1 | 84.7 ± 18.1 | 88.7 ± 3.1 | 95.3 ± 8.1 | 66.7 ± 5.0 |
| TypeKeys | 0.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 17.3 ± 17.0 | 0.0 ± 0.0 |
| ClickMouse | 98.0 ± 3.5 | 6.7 ± 11.5 | 12.7 ± 4.6 | 68.7 ± 15.0 | 100.0 ± 0.0 | 64.7 ± 3.1 |
| LayFlatPanel | 0.0 ± 0.0 | 0.0 ± 0.0 | 54.0 ± 27.5 | 0.0 ± 0.0 | 34.7 ± 28.4 | 0.0 ± 0.0 |
| InsertRail | 0.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 6.0 ± 10.4 | 9.3 ± 3.1 |
| FastenScrew | 86.0 ± 24.2 | 70.7 ± 50.8 | 85.3 ± 11.5 | 0.0 ± 0.0 | 20.0 ± 26.2 | 94.0 ± 3.5 |
| AspirateLiquid | 0.0 ± 0.0 | 0.0 ± 0.0 | 8.7 ± 8.1 | 1.3 ± 1.2 | 2.0 ± 2.0 | 34.0 ± 6.9 |
| DispenseLiquid | 0.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 2.0 ± 2.0 | 4.0 ± 0.0 |
| OpenFridge | 65.3 ± 22.0 | 78.7 ± 35.2 | 92.7 ± 9.5 | 68.0 ± 33.3 | 70.0 ± 45.1 | 96.0 ± 3.5 |
| AppleToBlender | 0.7 ± 1.2 | 0.0 ± 0.0 | 71.3 ± 14.2 | 7.3 ± 12.7 | 18.0 ± 2.0 | 38.7 ± 4.2 |
| CloseFridge | 100.0 ± 0.0 | 100.0 ± 0.0 | 99.3 ± 1.2 | 66.0 ± 47.3 | 92.0 ± 8.7 | 100.0 ± 0.0 |
| PlaceLid | 0.0 ± 0.0 | 0.0 ± 0.0 | 18.0 ± 11.1 | 1.3 ± 2.3 | 28.7 ± 12.9 | 16.0 ± 2.0 |
| PressButton | 18.0 ± 5.3 | 18.7 ± 32.3 | 54.0 ± 19.3 | 52.7 ± 40.6 | 42.7 ± 10.1 | 62.0 ± 7.2 |
| OpenPackage | 2.0 ± 0.0 | 2.7 ± 4.6 | 36.7 ± 22.1 | 1.3 ± 2.3 | 35.3 ± 22.1 | 30.7 ± 24.8 |
| ExtractApple | 0.0 ± 0.0 | 0.0 ± 0.0 | 78.7 ± 3.1 | 3.3 ± 3.1 | 54.7 ± 39.5 | 70.0 ± 26.5 |
| PickDebris | 1.3 ± 2.3 | 0.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 1.3 ± 1.2 | 0.0 ± 0.0 |
| DumpDustpan | 0.7 ± 1.2 | 0.0 ± 0.0 | 59.3 ± 17.9 | 1.3 ± 2.3 | 88.7 ± 2.3 | 68.0 ± 4.0 |
| Average | 21.7 ± 3.5 | 17.8 ± 10.9 | 45.4 ± 3.6 | 17.2 ± 5.7 | 41.7 ± 14.2 | 49.2 ± 2.3 |
Long-horizon
End-to-end success over 50 episodes per task. The environment is never reset between stages. π0.5 switches stage policies; GR00T uses one model trained on pooled stage data.
All tracks use the same 0–100% scale.
Compare each method across all three tracks
Success (%), on a shared 0–100 scale.
PPO
RLPD
ACT
Diffusion Policy
GR00T
π0.5
Sequence performance map
All six methods. Cells show success rate; hover for the exact value.
| Task | PPO | RLPD | ACT | DP | GR00T | π0.5 |
|---|---|---|---|---|---|---|
| Meal preparation | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |
| Cabinet and pouring | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 2.0 |
| Drawer and plug | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |
| Nut and bolt | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |
| Office desk | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |
| Furniture assembly | 0.0 | 0.0 | 8.0 | 0.0 | 0.0 | 0.0 |
| Pipette transfer | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |
| Juice preparation | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |
| Package opening | 0.0 | 0.0 | 4.0 | 0.0 | 0.0 | 14.0 |
| Table cleaning | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |
| Rank | Method | Family | Average success (%) ↑ | Source |
|---|---|---|---|---|
| 1 | π0.5 | VLA | 1.6 | Paper baseline ↗ |
| 2 | ACT | Imitation learning | 1.2 | Paper baseline ↗ |
| 3 | PPO | Demo-guided RL | 0.0 | Paper baseline ↗ |
| 4 | RLPD | Demo-guided RL | 0.0 | Paper baseline ↗ |
| 5 | Diffusion Policy | Imitation learning | 0.0 | Paper baseline ↗ |
| 6 | GR00T | VLA | 0.0 | Paper baseline ↗ |
All 10 tasks
Success rates (%). Highlighted cells are the highest result in each row.
| Task | PPO | RLPD | ACT | Diffusion Policy | GR00T | π0.5 |
|---|---|---|---|---|---|---|
| Meal preparation | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |
| Cabinet and pouring | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 2.0 |
| Drawer and plug | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |
| Nut and bolt | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |
| Office desk | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |
| Furniture assembly | 0.0 | 0.0 | 8.0 | 0.0 | 0.0 | 0.0 |
| Pipette transfer | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |
| Juice preparation | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |
| Package opening | 0.0 | 0.0 | 4.0 | 0.0 | 0.0 | 14.0 |
| Table cleaning | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |
| Average | 0.0 | 0.0 | 1.2 | 0.0 | 0.0 | 1.6 |
Source: DexArena manuscript, stage-level and generalization experiment tables and long-horizon appendix table. Download all results (JSON) ↓
Evaluation intake is not open yet.
Submission instructions will be shared when evaluation intake opens.