REVIEW 4 major objections 6 minor 43 references
SliceSemOcc: Vertical Slice Based Multimodal 3D Semantic Occupancy Representation
T0 review · 4 major / 6 minor · reviewed 2026-08-05 · deepseek-v4-flash
Pith's one-line read SliceSemOcc claims that splitting voxel features into global and local vertical slices, fused by cross attention with per-height channel weights, improves 3D semantic occupancy mIoU by 14.2% on SurroundOcc and 13.9% on OpenOccupancy, with t
desk verdict Solid height-aware attention idea, but the reported gains over M-CONet are inflated by an uncontrolled baseline; the real internal gain is about 1.2 mIoU. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The Vertical Slice Fusion (VSF) module and the SEAttention3D module. VSF splits the voxel volume along height into one global slice spanning [-5,3] m and six local slices concentrated where small objects sit, processes each with SEAttention3D, then fuses global and local features through bidirectional cross attention. SEAttention3D replaces SENet-style global pooling with pooling over only the X-Y plane, so it produces one channel-attention vector per height layer instead of one per volume, letting the network weight the same channel differently at different heights.
What would settle it
A decisive check: recompute the slice boundaries from the training split's height histogram only (or use uniform bins) and evaluate on a dataset with a different height profile; if the mIoU advantage over M-CONet collapses or reverses, the vertical-slice benefit is dataset-specific. The paper's own Table 4 gives the comparison point: hand-picked bins score 28.21 mIoU versus 27.67 for uniform 1-meter bins, so the open question is whether that gap survives train-only boundary selection and cross-dataset transfer.
Extended reading notes
Core claim
The paper reports that processing 3D occupancy voxel features with vertical slices rather than treating the volume uniformly improves semantic occupancy prediction. On nuScenes-SurroundOcc, the full SliceSemOcc pipeline raises mean IoU from 24.7% for the M-CONet baseline to 28.2% (a 14.2% relative gain), with the largest per-class gains on small objects: bicycle +53.1%, motorcycle +37.2%, pedestrian +30.0%, barrier +21.3%, traffic cone +20.4%. On nuScenes-OpenOccupancy mIoU rises from 20.1% to 22.9% (a 13.9% relative gain). Ablations attribute the gains to the combination of global and local vertical slices, to choosing local slice boundaries from the class height distribution rather than un
Load-bearing premise
The local slice boundaries were picked by looking at the height distribution of objects in the same dataset the method is then evaluated on, so the reported gains may partly reflect tuning to that dataset's statistics rather than a general principle.
Editorial extensions
If this is right
- On nuScenes-SurroundOcc, SliceSemOcc raises mIoU from 24.7% (M-CONet) to 28.2%, a relative gain of 14.2%.
- Gains are concentrated on small objects: barrier, bicycle, motorcycle, pedestrian, and traffic cone each improve by 20% to 53% relative.
- On nuScenes-OpenOccupancy, mIoU rises from 20.1% to 22.9%, a relative gain of 13.9%.
- Ablations show that height-distribution-based local bins beat uniform bins (28.21 vs 27.67 mIoU), and cross-attention fusion beats simple concatenation (28.21 vs 27.97 mIoU).
- The vertical-slice fusion module costs about 0.6 GB of extra validation GPU memory for a 1.14-point mIoU gain.
Reading between the lines
- The hand-picked slice boundaries are a dataset-specific choice; a learnable slicing mechanism could preserve the gains without retuning per dataset.
- The height-aware channel weighting is not tied to occupancy prediction and could transfer to other voxel-based 3D perception tasks, such as LiDAR-camera 3D detection or scene completion.
- The reported weakness on flat-ground classes suggests height alone cannot separate semantically different but geometrically similar ground classes; injecting LiDAR intensity or surface orientation would be a natural next test.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes SliceSemOcc, a multimodal (camera + LiDAR) 3D semantic occupancy prediction framework. The core ideas are (i) a Vertical Slice Fusion module that extracts features from global and local height slices of the voxel volume, (ii) a per-height channel-attention module (SEAttention3D) that preserves height resolution during pooling, and (iii) a global–local cross-attention fusion. Experiments on nuScenes-SurroundOcc and nuScenes-OpenOccupancy report mIoU of 28.2 and 22.9, respectively, with ablations claiming that each component contributes positively. The paper also reports a memory overhead of 0.6 GB for the full module.
Significance. If the reported internal improvements are robust, the work provides a useful, incremental architectural contribution: height-aware channel attention and dual-scale vertical slicing are intuitive and align with observed height distributions of small objects. The component-wise ablations (Tables 3–4, Section 4.3) are a strength, as is the explicit reporting of memory cost and the candid discussion of degraded flat-ground categories. However, the headline comparison is confounded by an uncontrolled baseline, the slice boundaries are derived from the same dataset on which the method is evaluated, and the second dataset result ties an existing method (OccLoff) without acknowledgement. No code, training hyperparameters, or multiple-seed statistics are provided, making the small reported gains difficult to verify.
major comments (4)
- [§4.2, Tables 1 and 3] The central claim of a 14.2% relative mIoU gain over M-CONet (24.7 → 28.2) is confounded by an uncontrolled baseline. Table 3 shows that the authors' own no-slice baseline achieves 26.98 mIoU, which is 2.28 points above the published M-CONet number. Section 4.1 lists many implementation differences from M-CONet (InverseMatrixVT3D projection, FPN, VoxelNet, focal+Lovasz+affinity losses), so the gap between 26.98 and 24.7 likely reflects training recipe and view-transformation differences, not vertical slicing. The internal contribution of the proposed modules is therefore 26.98 → 28.21, i.e., +1.23 mIoU (~4.6% relative), not 14.2%. The small-object gains in Section 4.2 are also computed relative to M-CONet's published class-wise numbers and inherit the same confound. The paper must either train M-CONet under its own pipeline or present the internal ablation as the primary result.
- [§3.4, Fig. 1, Table 4] The local slice boundaries [-5,-3], [-3,-2], [-2,-1], [-1,0], [0,1], [1,3] m are explicitly chosen based on the object height distribution of nuScenes-SurroundOcc (Fig. 1) and then evaluated on the validation set of the same dataset. The paper never demonstrates that these boundaries were fixed using only the training split, nor does it test transfer to another dataset. Table 4 shows that the boundary choice matters (28.21 vs. 27.67/27.75), so this is not a negligible design detail. The authors should state whether the boundaries were computed from training statistics only, and provide sensitivity/transfer experiments (e.g., applying the same boundaries to nuScenes-OpenOccupancy or reporting dataset-specific boundaries).
- [§4.2, Table 2] On nuScenes-OpenOccupancy, SliceSemOcc reports 22.9 mIoU, which is identical to the 22.9 mIoU of OccLoff [44] listed in the same table. The text says the method 'improves mIoU from 20.1 (M-CONet) to 22.9' and claims 'substantial gains', but it does not acknowledge that this is a tie with the current state-of-the-art OccLoff. This is a fairness and completeness issue: the reader cannot assess whether the proposed method advances the state of the art when the leading comparison is omitted from the narrative. Please revise the discussion to state the tie explicitly and, if possible, add a statistical comparison (multiple seeds) to distinguish the methods.
- [§4.1, §4.3] The empirical claims rest on small differences (e.g., 27.97 vs. 28.21 for fusion strategy; 28.08 vs. 28.21 for SEAttention3D), but the paper reports no multiple-seed runs, error bars, or significance tests. Training hyperparameters (optimizer, learning rate, batch size, number of epochs, voxel size details) are not provided, and no code is released. For a deep-learning paper in a field where single-run differences of 0.1–0.2 mIoU are common, this lack of uncertainty quantification is load-bearing. At minimum, the authors should report the number of runs, mean and std, and provide the training configuration in an appendix.
minor comments (6)
- [Table 4] Typo: 'moudle' should be 'module' in the caption.
- [Fig. 3] The caption appears to contain duplicated 'Inception' text; Fig. 3 shows SEAttention3D, not inception modules. Please clean up the figure/caption.
- [Fig. 1] The height distribution plot has no axis labels or units. Without these, the justification for the chosen slice boundaries cannot be assessed.
- [Table 2 title] The title says 'nuScenes-Occupancy', but the text and the rest of the paper refer to 'nuScenes-OpenOccupancy'. Please unify the name.
- [Eq. (5)] After reducing channels to one with a 3D convolution, A_global and A_local have shape B×1×X×Y×Z; the elementwise multiplication with F_global (B×C×X×Y×Z) requires broadcasting. Please state this explicitly.
- [§3.1] The problem statement says labels are in [0,16], but the evaluation uses 16 semantic classes plus empty. Please clarify whether 0 is empty and classes are 1–16, and whether '16' is inclusive.
Circularity Check
No circular derivation: reported gains are empirical mIoU values; the hand-chosen slice boundaries are a dataset-informed design choice, not a fitted parameter renamed as prediction.
full rationale
The paper's central claims are empirical: SliceSemOcc achieves 28.2 mIoU on nuScenes-SurroundOcc and 22.9 on nuScenes-OpenOccupancy, with ablations isolating the contributions of global/local slices, SEAttention3D, and cross-attention fusion. No equation defines the output in terms of the input, no fitted parameter is renamed as a prediction, and no load-bearing self-citations or imported uniqueness theorems appear. The local-slice intervals ([-5,-3], [-3,-2], [-2,-1], [-1,0], [0,1], [1,3]) are chosen from the object height distribution of nuScenes-SurroundOcc (Section 3.4, Fig. 1) and then evaluated on the same dataset's validation split; Table 4 selects the best-performing partitioning on that validation set. This is a legitimate experimental concern (validation-set-informed architecture selection / multiple testing), but it is not circular in the derivational sense: the reported mIoU is a measured quantity, not constructed from the height-distribution statistics. Similarly, the baseline mismatch with M-CONet (Table 3's no-slice baseline reaches 26.98 mIoU vs. M-CONet's 24.7, with other pipeline differences listed in Section 4.1) undermines the headline comparison as a controlled attribution, but this is an experimental-control issue, not a circular-reasoning issue. Under the stated criteria requiring a specific reduction by construction or a fitted parameter called a prediction, no circular step can be identified.
Assumptions & free parameters
free parameters (4)
- Local slice boundaries for height binning =
[-5,-3],[-3,-2],[-2,-1],[-1,0],[0,1],[1,3] meters
- SEAttention3D reduction ratio r =
Not reported in the paper
- Number and width of local slices =
6 intervals as listed above
- Loss weights in Ltotal =
Implicitly all 1.0 in Eq. 6
assumptions (5)
- domain assumption Ground-truth occupancy labels from OpenOccupancy and SurroundOcc are correct and complete enough to measure mIoU.
- domain assumption The projection method of InverseMatrixVT3D [24] and the VoxelNet [46] backbone produce well-aligned camera and LiDAR voxel features.
- ad hoc to paper The aggregate height distribution in Fig. 1 is representative of both training and validation scenes.
- standard math Focal, Lovasz, and affinity losses are correctly implemented and combined.
- domain assumption Baseline numbers in Tables 1 and 2 are accurately reproduced from the cited sources and are comparable in training settings.
Cite this review
Pith. "Pith review of SliceSemOcc: Vertical Slice Based Multimodal 3D Semantic Occupancy Representation." pith.science (2026). https://pith.science/paper/OM5OAWUW
@misc{pith2026250903999,
author = {Pith},
title = {Pith review of: SliceSemOcc: Vertical Slice Based Multimodal 3D Semantic Occupancy Representation},
year = {2026},
howpublished = {\url{https://pith.science/paper/OM5OAWUW}},
note = {Machine review of arXiv:2509.03999}
}
read the original abstract
Driven by autonomous driving's demands for precise 3D perception, 3D semantic occupancy prediction has become a pivotal research topic. Unlike bird's-eye-view (BEV) methods, which restrict scene representation to a 2D plane, occupancy prediction leverages a complete 3D voxel grid to model spatial structures in all dimensions, thereby capturing semantic variations along the vertical axis. However, most existing approaches overlook height-axis information when processing voxel features. And conventional SENet-style channel attention assigns uniform weight across all height layers, limiting their ability to emphasize features at different heights. To address these limitations, we propose SliceSemOcc, a novel vertical slice based multimodal framework for 3D semantic occupancy representation. Specifically, we extract voxel features along the height-axis using both global and local vertical slices. Then, a global local fusion module adaptively reconciles fine-grained spatial details with holistic contextual information. Furthermore, we propose the SEAttention3D module, which preserves height-wise resolution through average pooling and assigns dynamic channel attention weights to each height layer. Extensive experiments on nuScenes-SurroundOcc and nuScenes-OpenOccupancy datasets verify that our method significantly enhances mean IoU, achieving especially pronounced gains on most small-object categories. Detailed ablation studies further validate the effectiveness of the proposed SliceSemOcc framework.
Figures
Reference graph
Works this paper leans on
- [44]
- [2]
- [4]
- [5]
- [6]
- [7]
- [8]
-
[9]
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: CVPR. pp. 770–778 (2016). https://doi.org/10.1109/CVPR.2016.90
Show all 43 references
- [10]
-
[11]
aeXiv preprint arXiv:2112.11790 (2021)
Huang, J., Huang, G., Zhu, Z., Du, D.: Bevdet: High-performance multi-camera 3d object detection in bird-eye-view. aeXiv preprint arXiv:2112.11790 (2021)
2021 arXiv
-
[12]
In: CVPR
Huang, Y., Zheng, W., Zhang, Y., Zhou, J., Lu, J.: Tri-perspective view for vision- based 3d semantic occupancy prediction. In: CVPR. pp. 9223–9232 (2023)
2023
-
[13]
In: AAAI (2023)
Jiang, Y., Zhang, L., Miao, Z., Zhu, X., Gao, J., Hu, W., Jiang, Y.G.: Polar- former: multi-camera 3d object detection with polar transformer. In: AAAI (2023). https://doi.org/10.1609/aaai.v37i1.25185
2023 doi
-
[14]
In: CVPR (2023) Vertical Slice–Based Multimodal 3D Semantic Occupancy Representation 13
Khurana, T., Hu, P., Held, D., Ramanan, D.: Point cloud forecasting as a proxy for 4d occupancy forecasting. In: CVPR (2023) Vertical Slice–Based Multimodal 3D Semantic Occupancy Representation 13
2023
-
[15]
In: CVPR
Li, J., Han, K., Wang, P., Liu, Y., Yuan, X.: Anisotropic convolutional net- works for 3d semantic scene completion. In: CVPR. pp. 3348–3356 (2020). https://doi.org/10.1109/CVPR42600.2020.00341
2020
-
[16]
In: AAAI
Li, Y., Ge, Z., Yu, G., Yang, J., Wang, Z., Shi, Y., Sun, J., Li, Z.: Bevdepth: Acquisition of reliable depth for multi-view 3d object detection. In: AAAI. vol. 37, pp. 1477–1485 (2023)
2023
-
[17]
In: ECCV
Li, Z., Wang, W., Li, H., Xie, E., Sima, C., Lu, T., Yu, Q., Dai, J.: Bevformer: Learning bird’s-eye-view representation from multi-camera images via spatiotem- poral transformers. In: ECCV. pp. 1–18 (2022). https://doi.org/10.1007/978-3- 031-20077-9 1
2022 doi
-
[18]
In: ECCV
Liang, M., Yang, B., Wang, S., Urtasun, R.: Deep continuous fusion for multi-sensor 3d object detection. In: ECCV. pp. 641–656 (2018)
2018
-
[19]
NeurIPS 35, 10421–10434 (2022)
Liang, T., Xie, H., Yu, K., Xia, Z., Lin, Z., Wang, Y., Tang, T., Wang, B., Tang, Z.: Bevfusion: A simple and robust lidar-camera fusion framework. NeurIPS 35, 10421–10434 (2022)
2022
-
[20]
In: CVPR
Lin, T., Doll´ ar, P., Girshick, R.B., He, K., Hariharan, B., Belongie, S.J.: Feature pyramid networks for object detection. In: CVPR. pp. 936–944. IEEE Computer Society (2017). https://doi.org/10.1109/CVPR.2017.106
2017 doi
-
[21]
In: ICCV
Lin, T., Goyal, P., Girshick, R.B., He, K., Doll´ ar, P.: Focal loss for dense object detection. In: ICCV. pp. 2999–3007. IEEE Computer Society (2017). https://doi.org/10.1109/ICCV.2017.324
2017 doi
-
[22]
arXiv preprint arXiv:2310.11239 (2023)
Liu, X., Gong, M., Fang, Q., Xie, H., Li, Y., Zhao, H., Feng, C.: Lidar-based 4d occupancy completion and forecasting. arXiv preprint arXiv:2310.11239 (2023)
2023 arXiv
-
[23]
In: ICRA
Liu, Z., Tang, H., Amini, A., Yang, X., Mao, H., Rus, D.L., Han, S.: Bevfu- sion: Multi-task multi-sensor fusion with unified bird’s-eye view representation. In: ICRA. pp. 2774–2781 (2023). https://doi.org/10.1109/ICRA48891.2023.10160968
2023
-
[24]
arXiv preprint arXiv:2401.12422 (2024)
Ming, Z., Berrio, J.S., Shan, M., Worrall, S.: Inversematrixvt3d: An efficient projection matrix-based approach for 3d occupancy prediction. arXiv preprint arXiv:2401.12422 (2024)
2024 arXiv
-
[25]
Ming, Z., Berrio, J.S., Shan, M., Worrall, S.: Occfusion: Multi-sensor fu- sion framework for 3d semantic occupancy prediction. TIV pp. 1–13 (2024). https://doi.org/10.1109/TIV.2024.3453293
2024
-
[26]
In: ICCV
Nabati, R., Qi, H.: Centerfusion: Center-based radar and camera fusion for 3d object detection. In: ICCV. pp. 1527–1536 (2021)
2021
-
[27]
IEEE Robotics Autom
Pan, J., Wang, Z., Wang, L.: Co-occ: Coupling explicit feature fusion with volume rendering regularization for multi-modal 3d semantic occu- pancy prediction. IEEE Robotics Autom. Lett. 9(6), 5687–5694 (2024). https://doi.org/10.1109/LRA.2024.3396092
2024
- [28]
-
[29]
In: ECCV
Philion, J., Fidler, S.: Lift, splat, shoot: Encoding images from arbitrary cam- era rigs by implicitly unprojecting to 3d. In: ECCV. pp. 194–210 (2020). https://doi.org/10.1007/978-3-030-58568-6 12
2020 doi
-
[30]
In: ICCV
Qi, C.R., Litany, O., He, K., Guibas, L.J.: Deep hough voting for 3d object detec- tion in point clouds. In: ICCV. pp. 9277–9286 (2019)
2019
-
[31]
In: CVPR
Qi, C.R., Liu, W., Wu, C., Su, H., Guibas, L.J.: Frustum pointnets for 3d object detection from rgb-d data. In: CVPR. pp. 918–927 (2018)
2018
-
[32]
Rold˜ ao, L., de Charette, R., Verroust-Blondet, A.: Lmscnet: Lightweight multiscale 3d semantic completion. In: 3DV. pp. 111–119 (2020). https://doi.org/10.1109/3DV50981.2020.00021 14 H. Huang, H. Sun et al
2020
-
[33]
In: CVPR
Shi, S., Guo, C., Jiang, L., Wang, Z., Shi, J., Wang, X., Li, H.: Pv-rcnn: Point-voxel feature set abstraction for 3d object detection. In: CVPR. pp. 10529–10538 (2020)
2020
-
[34]
In: CVPR
Wang, C., Ma, C., Zhu, M., Yang, X.: Pointaugmenting: Cross-modal aug- mentation for 3d object detection. In: CVPR. pp. 11789–11798 (2021). https://doi.org/10.1109/CVPR46437.2021.01162
2021
-
[36]
In: Conference on Robot Learning
Wang, Y., Guizilini, V.C., Zhang, T., Wang, Y., Zhao, H., Solomon, J.: Detr3d: 3d object detection from multi-view images via 3d-to-2d queries. In: Conference on Robot Learning. pp. 180–191. PMLR (2022)
2022
-
[37]
In: IROS
Wang, Z., Jia, K.: Frustum convnet: Sliding frustums to aggregate local point- wise features for amodal 3d object detection. In: IROS. pp. 1742–1749 (2019). https://doi.org/10.1109/IROS40897.2019.8968513
2019
-
[38]
In: ICCV
Wei, Y., Zhao, L., Zheng, W., Zhu, Z., Zhou, J., Lu, J.: Surroundocc: Multi- camera 3d occupancy prediction for autonomous driving. In: ICCV. pp. 21672– 21683 (2023). https://doi.org/10.1109/ICCV51070.2023.01986
2023
-
[39]
In: AAAI
Yan, X., Gao, J., Li, J., Zhang, R., Li, Z., Huang, R., Cui, S.: Sparse single sweep lidar point cloud segmentation via learning contextual shape priors from scene completion. In: AAAI. vol. 35, pp. 3101–3109 (2021)
2021
-
[40]
Sensors 18(10) (2018)
Yan, Y., Mao, Y., Li, B.: Second: Sparsely embedded convolutional detection. Sensors 18(10) (2018). https://doi.org/10.3390/S18103337
2018 doi
-
[41]
In: CVPR
Yang, Z., Sun, Y., Liu, S., Jia, J.: 3dssd: Point-based 3d single stage object detector. In: CVPR. pp. 11040–11048 (2020)
2020
-
[42]
arXiv preprint arXiv:1812.05276 (2018)
Yang, Z., Sun, Y., Liu, S., Shen, X., Jia, J.: Ipod: Intensive point-based object detector for point cloud. arXiv preprint arXiv:1812.05276 (2018)
2018 arXiv
-
[43]
arXiv preprint arXiv:2111.08318 (2021)
Ye, M., Wan, R., Xu, S., Cao, T., Chen, Q.: Drinet++: Efficient voxel-as-point point cloud segmentation. arXiv preprint arXiv:2111.08318 (2021)
2021 arXiv
-
[45]
arXiv preprint arXiv:2008.01550 (2020)
Zhou, H., Zhu, X., Song, X., Ma, Y., Wang, Z., Li, H., Lin, D.: Cylinder3d: An ef- fective 3d framework for driving-scene lidar semantic segmentation. arXiv preprint arXiv:2008.01550 (2020)
2008 arXiv
-
[46]
In: CVPR
Zhou, Y., Tuzel, O.: Voxelnet: End-to-end learning for point cloud based 3d object detection. In: CVPR. pp. 4490–4499 (2018). https://doi.org/10.1109/CVPR.2018.00472
2018
Reviewed August 5, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.