REVIEW 8 cited by
UniOcc: Unifying Vision-Centric 3D Occupancy Prediction with Geometric and Semantic Rendering
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
In this technical report, we present our solution, named UniOCC, for the Vision-Centric 3D occupancy prediction track in the nuScenes Open Dataset Challenge at CVPR 2023. Existing methods for occupancy prediction primarily focus on optimizing projected features on 3D volume space using 3D occupancy labels. However, the generation process of these labels is complex and expensive (relying on 3D semantic annotations), and limited by voxel resolution, they cannot provide fine-grained spatial semantics. To address this limitation, we propose a novel Unifying Occupancy (UniOcc) prediction method, explicitly imposing spatial geometry constraint and complementing fine-grained semantic supervision through volume ray rendering. Our method significantly enhances model performance and demonstrates promising potential in reducing human annotation costs. Given the laborious nature of annotating 3D occupancy, we further introduce a Depth-aware Teacher Student (DTS) framework to enhance prediction accuracy using unlabeled data. Our solution achieves 51.27\% mIoU on the official leaderboard with single model, placing 3rd in this challenge.
Forward citations
Cited by 8 Pith papers
-
SparseOcc++: Geometry-Aware Sparse Latent Representation for Semantic Occupancy Prediction
SparseOcc++ decouples geometry completion (via orthogonal SCF regression on sparse anchors) from semantics, improving IoU 2.3 points and running 3.9 imes faster than SparseOcc on nuScenes while 5.9 imes faster than Oc...
-
SDGOCC: Semantic and Depth-Guided Bird's-Eye View Transformation for 3D Multimodal Occupancy Prediction
SDGOCC improves multimodal 3D occupancy prediction by using LiDAR depth and semantic masks to guide camera-to-BEV transformation, achieving state-of-the-art mIoU on Occ3D-nuScenes.
-
TACOcc:Target-Adaptive Cross-Modal Fusion with Volume Rendering for 3D Semantic Occupancy
TACOcc reaches 28.4% mIoU on nuScenes 3D occupancy prediction by learning adaptive fusion neighborhoods and adding 3DGS-based photometric supervision.
-
Rethinking Temporal Fusion with a Unified Gradient Descent View for 3D Semantic Occupancy Prediction
GDFusion fuses scene, motion, and geometry cues through gradient-descent-style RNN updates, improving mIoU by 1.4 to 4.8 points on Occ3D while cutting inference memory by 27 to 72 percent.
-
AutoOcc: Automatic Open-Ended Semantic Occupancy Annotation via Vision-Language Guided Gaussian Splatting
A camera-based pipeline that automatically produces open-ended 3D semantic occupancy labels via vision-language attention maps and Gaussian splatting, outperforming existing auto-labeling methods.
-
Spatiotemporal Decoupling for Efficient Vision-Based Occupancy Forecasting
EfficientOCF forecasts 3D occupancy by decoupling it into 2D BEV occupancy, height, and instance flow, achieving state-of-the-art accuracy and 82.33 ms inference on autonomous driving datasets.
-
FMOcc: TPV-Driven Flow Matching for 3D Occupancy Prediction with Selective State Space Model
FMOcc uses flow matching with tri-perspective view and selective state space layers to improve 3D occupancy prediction from two camera frames.
-
OcRFDet: Object-Centric Radiance Fields for Multi-View 3D Object Detection in Autonomous Driving
Adding object-centric radiance-field rendering and height-aware opacity attention to the DualBEV detector improves camera-only 3D object detection on nuScenes by up to 2.0 mAP points.
Discussion (0). Continue with ORCID to comment.