REVIEW 6 cited by
Robust Autonomy Emerges from Self-Play
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Self-play has powered breakthroughs in two-player and multi-player games. Here we show that self-play is a surprisingly effective strategy in another domain. We show that robust and naturalistic driving emerges entirely from self-play in simulation at unprecedented scale -- 1.6~billion~km of driving. This is enabled by Gigaflow, a batched simulator that can synthesize and train on 42 years of subjective driving experience per hour on a single 8-GPU node. The resulting policy achieves state-of-the-art performance on three independent autonomous driving benchmarks. The policy outperforms the prior state of the art when tested on recorded real-world scenarios, amidst human drivers, without ever seeing human data during training. The policy is realistic when assessed against human references and achieves unprecedented robustness, averaging 17.5 years of continuous driving between incidents in simulation.
Forward citations
Cited by 6 Pith papers
-
Multiple-Frequencies Population-Based Training
MF-PBT combines sub-populations that evolve at different frequencies with asymmetric migration to reduce PBT's short-sightedness and improve long-term RL rewards.
-
TerraTransfer: Learning End-to-End Driving Policies Without Expert Demonstrations
TerraTransfer decouples self-play policy pretraining from vision alignment via KL divergence and low-rank loss to produce end-to-end driving policies without expert demonstrations, matching prior methods on closed-loo...
-
Zero-Human Demonstration End-to-end Autonomous Driving with Trajectory Scorer
A reward-only offline RL method for trajectory planning in end-to-end autonomous driving achieves state-of-the-art on Navhard and competitive closed-loop HUGSIM performance without imitation learning.
-
Do LLM Modules Generalize? A Study on Motion Generation for Autonomous Driving
On Waymo Sim Agents, LLM-style tokenization, positional embeddings, pretraining, RL post-training, and test-time search can be adapted to improve motion generation, but not all transfer without domain-specific changes.
-
Reinforced Refinement with Self-Aware Expansion for End-to-End Autonomous Driving
R2SE refines pretrained end-to-end driving policies on hard cases via residual LoRA reinforcement learning and switches between specialist and generalist policies using GPD-based uncertainty.
-
Is Inter-Seed Cross-Play Enough? Evaluating the Robustness of Zero-Shot Coordination Algorithms to Implementation Details
For Other-Play in Yokai, agents trained with different implementation details coordinate across implementations about as well as across seeds, supporting inter-seed cross-play as a proxy for cross-implementation evaluation.
Discussion (0). Sign in to comment.