REVIEW 4 cited by
Perceive, Interact, Predict: Learning Dynamic and Static Clues for End-to-End Motion Prediction
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Motion prediction is highly relevant to the perception of dynamic objects and static map elements in the scenarios of autonomous driving. In this work, we propose PIP, the first end-to-end Transformer-based framework which jointly and interactively performs online mapping, object detection and motion prediction. PIP leverages map queries, agent queries and mode queries to encode the instance-wise information of map elements, agents and motion intentions, respectively. Based on the unified query representation, a differentiable multi-task interaction scheme is proposed to exploit the correlation between perception and prediction. Even without human-annotated HD map or agent's historical tracking trajectory as guidance information, PIP realizes end-to-end multi-agent motion prediction and achieves better performance than tracking-based and HD-map-based methods. PIP provides comprehensive high-level information of the driving scene (vectorized static map and dynamic objects with motion information), and contributes to the downstream planning and control. Code and models will be released for facilitating further research.
Forward citations
Cited by 4 Pith papers
-
Class-Incremental Motion Forecasting
OMEN is the first end-to-end class-incremental motion forecaster that retains old-class accuracy via VLM-filtered future-detection pseudo-labels and variance-based sequence replay.
-
To New Beginnings: A Survey of Unified Perception in Autonomous Vehicle Software
A taxonomy that classifies unified perception methods in autonomous driving into Early, Late, and Full Unified Perception based on task integration, tracking formulation, and representation flow.
-
GaussianAD: Gaussian-Centric End-to-End Autonomous Driving
GaussianAD uses sparse 3D semantic Gaussians as the intermediate representation for camera-only end-to-end driving, adding Gaussian flow prediction and future-scene supervision to achieve strong open-loop planning res...
-
Joint Perception and Prediction for Autonomous Driving: A Survey
This survey organizes 55 joint perception and prediction methods for autonomous driving into a taxonomy based on input representation, scene context modeling, and output representation, and compares their reported per...
Discussion (0). Continue with ORCID to comment.