REVIEW 5 major objections 6 minor 86 references
Pose Optimization for Autonomous Driving Datasets using Neural Rendering Models
T0 review · 5 major / 6 minor · reviewed 2026-08-16 · deepseek-v4-flash
Pith's one-line read NeRF-based pose refinement measurably improves sensor poses in four public driving datasets.
desk verdict A useful and honest application of the authors' own NeRF-based calibration methods to refine poses on four driving datasets, but the claim of 'significant improvements in sensor pose accuracy' overreaches what internal-consistency metrics can show. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing mechanism is a differentiable neural scene representation trained with photometric and LiDAR-geometric losses, through which pose and calibration corrections are back-propagated. The optimized pose of sensor $i$ at time $t$ is written $wT_i(t) = E_{\mathrm{cor}}(i)\,\, {}^iT_r\, T_{\mathrm{cor}}(t)\, T_r(t)$, where $T_r$ is the interpolated reference trajectory, $E_{\mathrm{cor}}(i)$ is a shared per-sensor calibration correction, and $T_{\mathrm{cor}}(t)$ is a continuous trajectory correction learned by a small network over time. The pipeline first removes dynamic objects by masking annotated bounding boxes, splits long sequences into subsequences small enough for a NeRF, optimizes the shared extrinsic correction across many subsequences in parallel, then freezes calibration and optimizes each trajectory. MOISST is the multi-sensor model that fuses cameras and LiDAR under rigid sensor constraints; SOAC is the overlap-aware alternative with separate scene representations per camera; two open-source rendering models, one NeRF-based and one Gaussian-splatting-based, serve as independent baselines and evaluation renderers.
What would settle it
Run the pipeline on a synthetic or motion-capture urban dataset with known ground-truth poses, starting from deliberately perturbed poses; if the optimized poses do not move closer to the ground truth on absolute trajectory error, or if the proxy metrics improve while true pose error grows, the central claim is refuted.
Extended reading notes
Core claim
The paper's central claim is that jointly optimizing sensor poses and extrinsic calibration inside a neural radiance field yields measurably better dataset poses than the ones shipped with four major autonomous driving datasets. Using MOISST as the main model and SOAC as a robustness-focused alternative, with trajectory correction added to both, the authors report that optimized poses reduce reprojection error, lengthen keypoint tracks, improve PSNR, SSIM, and LPIPS across three separate rendering models, and tighten the alignment between image-derived meshes and accumulated LiDAR. The improvements are consistent for MOISST on all four datasets; SOAC improves NuScenes and PandaSet but regresses on KITTI-360 and Waymo. The paper also shows that KITTI-360's original poses are already precise, with relative gains around one to two percent, while NuScenes benefits the most because its published poses are planar and lack a reliable Z-axis component.
Load-bearing premise
The evaluation assumes that the proxy metrics—reprojection error, rendering quality, and mesh-to-LiDAR distance—actually track true pose accuracy, even though the rendering metrics are partly circular because the poses are optimized by training the same kind of model that then scores them.
Editorial extensions
If this is right
- If the optimized poses are accepted, the four datasets become higher-fidelity benchmarks: downstream models are trained and evaluated against geometry closer to the true scene, reducing the risk that reported gains come from overfitting to pose noise.
- Neuro-renderers trained from scratch on the optimized poses render with higher PSNR and SSIM and lower LPIPS, so any task built on novel view synthesis inherits the improvement.
- Mesh-to-LiDAR precision rises under MOISST on all four datasets, indicating better camera-to-LiDAR alignment and therefore better multi-sensor fusion for mapping and localization.
- For NuScenes, where the published poses carry no Z information, trajectory optimization reconstructs a usable vertical component and produces the largest metric gains, with reprojection error dropping from 1.339 to 0.852 pixels.
Reading between the lines
- My inference: if the proxy metrics genuinely track pose error, the released poses could serve as pseudo-ground truth for calibrating and evaluating localization systems on these datasets, but that status would need independent confirmation on a set with known poses first.
- My inference: the method will inherit NeRF's failure modes, such as dark tunnels, repetitive walls, and distant structures, so a natural extension is to swap in a more failure-tolerant renderer, for instance Gaussian splatting with depth priors, and test whether the same pipeline still holds.
- My inference: because the rendering metrics are produced by the same family of models used for optimization, the reprojection and geometric metrics carry most of the evidential weight; a useful next step would be a sign-agreement analysis that excludes rendering metrics to see whether geometry alone recommends the same poses.
- My inference: the shared-calibration step assumes a fixed sensor rig across a dataset, so datasets captured with multiple vehicles, like Waymo, are forced into per-sequence calibration; estimating per-sequence extrinsic priors from odometry would make the pipeline scale to fleet-scale data.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. This paper proposes a NeRF-based optimization pipeline that refines vehicle trajectories and extrinsic sensor calibration for four public autonomous driving datasets (KITTI-360, NuScenes, PandaSet, Waymo). The pipeline builds on the authors' MOISST and SOAC models, adds dynamic-object filtering and subsequence creation, and optimizes an extrinsic-correction embedding and a continuous trajectory-correction MLP. The authors evaluate the corrected poses against the original poses with three families of proxy metrics: COLMAP keypoint reprojection/track length, novel-view-synthesis PSNR/SSIM/LPIPS on NeRF-LiDAR, Nerfacto, and Splatfacto, and Delaunay-mesh-to-LiDAR precision/distance. They report that MOISST generally improves these metrics and release the optimized poses.
Significance. The intended contribution—public corrected sensor poses for widely used driving benchmarks—is potentially valuable to the community, and the paper includes several strengths: evaluation across four datasets, a KISS-ICP baseline for NuScenes, and independent Nerfstudio renderers for the NVS metrics. However, the central claim of 'significant improvements in sensor pose accuracy' overstates what the evidence shows. All reported metrics are internal-consistency measures, and the paper itself acknowledges in Section III-C.2 that NVS improvements are natural because the optimization minimizes the same photometric objective. The results also show regressions for SOAC on KITTI-360 and Waymo and only minimal MOISST gains on KITTI-360, so the claim of consistent improvement is not supported without error bars or significance tests. If the authors re-scope the claims and add an external validation (synthetic ground truth or a high-accuracy reference), the contribution could be solid.
major comments (5)
- [Abstract; Section V (Tables IIa–IIe)] The abstract's claim of 'significant improvements in sensor pose accuracy' is not established because every reported metric is a proxy for internal consistency rather than absolute pose accuracy. The COLMAP reprojection and mesh-to-LiDAR metrics are less circular than the NVS metrics, but they still cannot detect global distortions such as scale drift or datum changes that preserve self-consistency; the optimizer could improve alignment between sensors while moving the trajectory away from the physical one. I recommend adding a synthetic experiment with known pose perturbations (e.g., perturbing a rendered scene or using a simulator with ground-truth poses) and/or comparing against a high-accuracy external reference trajectory to demonstrate that the corrected poses are closer to the true trajectory.
- [Section V-A; Tables IIa and IIe; Fig. 9] The text claims a consistent improvement over original poses, but the data contradict this for SOAC: on KITTI-360, reprojection error worsens from 0.586 to 0.735 and mesh precision drops from 0.589 to 0.582; on Waymo, reprojection error worsens from 1.137 to 1.344 and precision drops from 0.441 to 0.417. For MOISST on KITTI-360, the gains are tiny (0.586 to 0.577 for reprojection; 6.53 to 6.68 for track length), and Fig. 9 shows reprojection improves in only 24 of 50 subsequences. The manuscript should report per-sequence distributions, confidence intervals, and a significance test, and should replace 'consistent improvement' with a more conditional statement.
- [Section III-C.2; Table IIb] The NVS evaluation is partially circular because the NeRF-LiDAR model used for evaluation is from the same MOISST family that produced the poses; PSNR/SSIM/LPIPS gains on this model can reflect better optimization of the same photometric objective rather than pose accuracy. The paper acknowledges this in Section III-C.2, but the related-work discussion in Section II-C promises an unbiased evaluation, which is stronger than the evidence. The Nerfacto and Splatfacto evaluations mitigate the renderer-specific concern, but all NVS metrics still reward photometric consistency. I suggest adding a structure-based evaluation that does not use the optimization objective, for example running a full COLMAP bundle adjustment initialized from the optimized poses and reporting reconstruction statistics, or evaluating a downstream geometric task such as monocular depth alignment.
- [Section V; Table III] The NuScenes comparison is confounded by KISS-ICP preprocessing. The baseline 'Original' lacks Z-axis information, while MOISST and SOAC are applied after KISS-ICP; Table III shows that KISS-ICP alone improves all metrics (e.g., LPIPS 0.465 to 0.418), so part of the reported MOISST/SOAC improvement is attributable to this preprocessing. To isolate the contribution of the NeRF-based optimization, report MOISST/SOAC applied directly to the original SE2 poses, or otherwise quantify the additive effect beyond the KISS-ICP baseline under matched experimental conditions.
- [Section V-E; Fig. 8] The sign-agreement analysis shows that the different metrics agree only moderately (over 0.5 overall, with the lowest agreement on KITTI-360). This means the method does not deliver a single demonstrably accurate pose set but rather candidate poses subject to a user-selected voting rule. The paper should either present a principled selection criterion or weaken the claim that the pipeline outputs improved poses.
minor comments (6)
- [Section IV-B] 'Subsequencies' should be spelled 'subsequences'.
- [Section V-C and Figures 13–16] 'Delauney' should be 'Delaunay' (also in the caption of Table IIe).
- [Figures 17–20] The caption label 'Imgine' appears to be a typo for 'Image'.
- [Section V-A] The text contains visible LaTeX artifacts such as '10%⁄tildelow36%'; please ensure the compiled PDF renders these ranges correctly.
- [Table I] The entries '15 epochsiterations' and '10 epochsNVS iterations' appear to be missing separators; clarify the intended units for epochs and iterations.
- [Section III-C.1] The phrase 'the average point reprojection error' should specify that the average is computed over the matched keypoints used in triangulation.
Circularity Check
NVS metrics mirror the NeRF photometric objective, but COLMAP and geometric metrics give partial independent support; moderate circularity.
-
fitted input called prediction
[Section III-C.2 (Pose accuracy assessment, Novel View Synthesis)]
"As we optimize our poses through NeRF training, it appears natural that the NVS task should provide the most constant improvement in the metrics."
The pose corrections Ecor and Tcor are optimized by backpropagating the NeRF photometric and geometric consistency loss into the poses (Section III-B.1). The NVS metrics (PSNR, SSIM, LPIPS) then measure rendering quality using the same kind of photometric consistency that was minimized during pose optimization. The paper itself concedes that the NVS improvement is 'natural' given the optimization, so presenting these metrics as evidence of improved pose accuracy is partly reporting the training objective under a new name. The held-out-frame split reduces, but does not eliminate, the circularity because the poses were optimized using the full sequence, including the frames later used as NVS evaluation views.
full rationale
The paper's central claim is that its NeRF-based optimization improves sensor pose accuracy, but no ground-truth poses are available. The evaluation therefore relies on proxy metrics. The clearest circular component is the Novel View Synthesis evaluation: the poses are fitted to minimize photometric consistency in a NeRF, and PSNR/SSIM/LPIPS measure photometric consistency in the same framework. The paper explicitly acknowledges this by saying that NVS improvement is 'natural' because the poses are optimized through NeRF training. This makes the NVS results partially self-confirmatory. However, the COLMAP reprojection and track-length metrics use SIFT keypoints and triangulation independent of the NeRF model, and the Delaunay mesh-to-LiDAR metrics compare camera-derived geometry against LiDAR point clouds; these provide partial external evidence that the optimized poses improve multi-view and cross-sensor consistency. The paper also compares against Nerfstudio pose optimization and, for NuScenes, against KISS-ICP, showing that the improvements are not solely an artifact of replacing the original poses with a generic SLAM-like preprocessing step. The lack of any absolute ground-truth trajectory means all metrics remain internal-consistency measures, and a global distortion such as scale drift could go undetected, but that is a correctness limitation rather than a definitional circularity. The self-citations to MOISST and SOAC are used as the optimization backbone, yet the evaluation does not reduce entirely to those prior papers' claims: the COLMAP and geometric metrics would still be meaningful if the optimized poses were worse. Overall, the circularity is moderate and localized mainly to the NVS metrics, so the paper retains independent content in its other evaluation axes.
Assumptions & free parameters
free parameters (3)
- Image downscale factors for MOISST and SOAC =
KITTI-360: MOISST 2, SOAC 4; NuScenes: 4 and 6; PandaSet: 4 and 6; Waymo: 4 and 6
- Subsequence length and selection =
KITTI-360 and Waymo: 50 meters; NuScenes: 30 meters; PandaSet: first 10 sequences with semantic labels
- Optimization iterations =
15 epochs for calibration and trajectory optimization, 10 epochs for NeRF-LiDAR NVS, 30k steps for Nerfstudio models
assumptions (4)
- domain assumption The transformation between sensors remains static across all sequences in a dataset, so a shared extrinsic calibration embedding can be optimized.
- domain assumption Dynamic objects can be removed by reprojecting enlarged bounding boxes, so the remaining scene is static enough for NeRF optimization.
- domain assumption The proxy metrics, especially novel view synthesis metrics, indicate pose accuracy even though they share the objective being optimized.
- domain assumption KISS-ICP provides a reasonable Z-axis initialization for NuScenes before MOISST and SOAC optimization.
Cite this review
Pith. "Pith review of Pose Optimization for Autonomous Driving Datasets using Neural Rendering Models." pith.science (2026). https://pith.science/paper/OHQMCSC5
@misc{pith2026250415776,
author = {Pith},
title = {Pith review of: Pose Optimization for Autonomous Driving Datasets using Neural Rendering Models},
year = {2026},
howpublished = {\url{https://pith.science/paper/OHQMCSC5}},
note = {Machine review of arXiv:2504.15776}
}
read the original abstract
Autonomous driving systems rely on accurate perception and localization of the ego car to ensure safety and reliability in challenging real-world driving scenarios. Public datasets play a vital role in benchmarking and guiding advancement in research by providing standardized resources for model development and evaluation. However, potential inaccuracies in sensor calibration and vehicle poses within these datasets can lead to erroneous evaluations of downstream tasks, adversely impacting the reliability and performance of the autonomous systems. To address this challenge, we propose a robust optimization method based on Neural Radiance Fields (NeRF) to refine sensor poses and calibration parameters, enhancing the integrity of dataset benchmarks. To validate improvement in accuracy of our optimized poses without ground truth, we present a thorough evaluation process, relying on reprojection metrics, Novel View Synthesis rendering quality, and geometric alignment. We demonstrate that our method achieves significant improvements in sensor pose accuracy. By optimizing these critical parameters, our approach not only improves the utility of existing datasets but also paves the way for more reliable autonomous driving models. To foster continued progress in this field, we make the optimized sensor poses publicly available, providing a valuable resource for the research community.
Figures
Figures from the paper (13 more)
Reference graph
Works this paper leans on
-
[1]
Scalability in perception for autonomous driving: Waymo open dataset,
P. Sun, H. Kretzschmar, X. Dotiwalla, A. Chouard, V . Patnaik, P. Tsui, J. Guo, Y . Zhou, Y . Chai, B. Caineet al., “Scalability in perception for autonomous driving: Waymo open dataset,” in IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , 2020, pp. 2446– 2454
2020
-
[2]
KITTI-360: A novel dataset and bench- marks for urban scene understanding in 2d and 3d,
Y . Liao, J. Xie, and A. Geiger, “KITTI-360: A novel dataset and bench- marks for urban scene understanding in 2d and 3d,” IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) , vol. 45, no. 3, pp. 3292–3310, 2022
2022
-
[3]
Pandaset: Advanced sensor suite dataset for autonomous driving,
P. Xiao, Z. Shao, S. Hao, Z. Zhang, X. Chai, J. Jiao, Z. Li, J. Wu, K. Sun, K. Jiang et al. , “Pandaset: Advanced sensor suite dataset for autonomous driving,” in IEEE International Intelligent Transportation Systems Conference (ITSC) , 2021, pp. 3095–3101
2021
-
[4]
nuscenes: A multimodal dataset for autonomous driving,
H. Caesar, V . Bankiti, A. H. Lang, S. V ora, V . E. Liong, Q. Xu, A. Kr- ishnan, Y . Pan, G. Baldan, and O. Beijbom, “nuscenes: A multimodal dataset for autonomous driving,” in IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , 2020, pp. 11 621–11 631
2020
-
[5]
NeRF: Representing scenes as neural radiance fields for view synthesis,
B. Mildenhall, P. P. Srinivasan, M. Tancik, J. T. Barron, R. Ramamoorthi, and R. Ng, “NeRF: Representing scenes as neural radiance fields for view synthesis,” Communications of the ACM , vol. 65, no. 1, pp. 99– 106, 2021
2021
-
[6]
Nerf– : Neural radiance fields without known camera parameters,
Z. Wang, S. Wu, W. Xie, M. Chen, and V . A. Prisacariu, “Nerf– : Neural radiance fields without known camera parameters,” arXiv preprint arXiv:2102.07064, 2021
arXiv 2021
-
[7]
Barf: Bundle- adjusting neural radiance fields,
C.-H. Lin, W.-C. Ma, A. Torralba, and S. Lucey, “Barf: Bundle- adjusting neural radiance fields,” in IEEE/CVF international conference on computer vision (ICCV) , 2021
2021
-
[8]
INF: Implicit Neural Fusion for LiDAR and Camera,
S. Zhou, S. Xie, R. Ishikawa, K. Sakurada, M. Onishi, and T. Oishi, “INF: Implicit Neural Fusion for LiDAR and Camera,” in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) , 2023, pp. 10 918–10 925
work page 2023
Show all 86 references
-
[9]
MOISST: Multimodal Optimization of Implicit Scene for SpatioTemporal calibration,
Q. Herau, N. Piasco, M. Bennehar, L. Rold ˜ao, D. Tsishkou, C. Migniot, P. Vasseur, and C. Demonceaux, “MOISST: Multimodal Optimization of Implicit Scene for SpatioTemporal calibration,” in IEEE/RSJ Interna- tional Conference on Intelligent Robots and Systems (IROS) , 2023, pp...
2023
-
[10]
Soac: Spatio-temporal overlap-aware multi-sensor calibration using neural radiance fields,
Q. Herau, N. Piasco, M. Bennehar, L. Roldao, D. Tsishkou, C. Migniot, P. Vasseur, and C. Demonceaux, “Soac: Spatio-temporal overlap-aware multi-sensor calibration using neural radiance fields,” in IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024, pp....
2024
-
[11]
Unical: Unified neural sensor calibration,
Z. Yang, G. Chen, H. Zhang, K. Ta, I. A. B ˆarsan, D. Murphy, S. Mani- vasagam, and R. Urtasun, “Unical: Unified neural sensor calibration,” in European conference on computer vision (ECCV) , 2025, pp. 327–345
2025
-
[12]
Structure-from-Motion Revisited,
J. L. Sch ¨onberger and J.-M. Frahm, “Structure-from-Motion Revisited,” in IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2016, pp. 4104–4113
2016
-
[13]
Distinctive image features from scale-invariant keypoints,
D. G. Lowe, “Distinctive image features from scale-invariant keypoints,” International journal of computer vision (IJCV) , vol. 60, pp. 91–110, 2004
2004
-
[14]
Visual odometry,
D. Nist ´er, O. Naroditsky, and J. Bergen, “Visual odometry,” in IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, 2004, pp. I–I
2004
-
[15]
When to use what feature? sift, surf, orb, or a-kaze features for monocular visual odometry,
H.-J. Chien, C.-C. Chuang, C.-Y . Chen, and R. Klette, “When to use what feature? sift, surf, orb, or a-kaze features for monocular visual odometry,” in IEEE International Conference on Image and Vision Computing New Zealand (IVCNZ) , 2016, pp. 1–6
2016
-
[16]
Simultaneous localization and map- ping: part i,
H. Durrant-Whyte and T. Bailey, “Simultaneous localization and map- ping: part i,” IEEE robotics & automation magazine , vol. 13, no. 2, pp. 99–110, 2006
2006
-
[17]
Orb-slam: a versatile and accurate monocular slam system,
R. Mur-Artal, J. M. M. Montiel, and J. D. Tardos, “Orb-slam: a versatile and accurate monocular slam system,” IEEE transactions on robotics (T- RO), vol. 31, no. 5, pp. 1147–1163, 2015
2015
-
[18]
Least-squares fitting of two 3-d point sets,
K. S. Arun, T. S. Huang, and S. D. Blostein, “Least-squares fitting of two 3-d point sets,” IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), no. 5, pp. 698–700, 1987
1987
-
[19]
Kiss-icp: In defense of point-to-point icp–simple, accu- rate, and robust registration if done the right way,
I. Vizzo, T. Guadagnino, B. Mersch, L. Wiesmann, J. Behley, and C. Stachniss, “Kiss-icp: In defense of point-to-point icp–simple, accu- rate, and robust registration if done the right way,” IEEE Robotics and Automation Letters (RA-L) , vol. 8, no. 2, pp. 1029–1036, 2023
2023
-
[20]
Loam: Lidar odometry and mapping in real- time,
Z. Zhang and S. Singh, “Loam: Lidar odometry and mapping in real- time,” in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2014, pp. 2171–2176
2014
-
[21]
Lego-loam: Lightweight and ground-optimized lidar odometry and mapping on variable terrain,
T. Shan and B. Englot, “Lego-loam: Lightweight and ground-optimized lidar odometry and mapping on variable terrain,” in IEEE/RSJ Interna- tional Conference on Intelligent Robots and Systems (IROS) , 2018, pp. 4758–4765
2018
-
[22]
F-loam: Fast lidar odometry and mapping,
H. Wang, C. Wang, C.-L. Chen, and L. Xie, “F-loam: Fast lidar odometry and mapping,” in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) , 2021, pp. 4390–4396
2021
-
[23]
Visual-lidar odometry and mapping: Low-drift, robust, and fast,
J. Zhang and S. Singh, “Visual-lidar odometry and mapping: Low-drift, robust, and fast,” in IEEE international conference on robotics and automation (ICRA), 2015, pp. 2174–2181
2015
-
[24]
Limo: Lidar-monocular visual odometry,
J. Graeter, A. Wilczynski, and M. Lauer, “Limo: Lidar-monocular visual odometry,” in IEEE/RSJ international conference on intelligent robots and systems (IROS) , 2018, pp. 7872–7879
2018
-
[25]
Camvox: A low-cost and accurate lidar-assisted visual slam system,
Y . Zhu, C. Zheng, C. Yuan, X. Huang, and X. Hong, “Camvox: A low-cost and accurate lidar-assisted visual slam system,” in IEEE International Conference on Robotics and Automation (ICRA) , 2021, pp. 5049–5055
2021
-
[26]
Efficient and accurate tightly-coupled visual-lidar slam,
C.-C. Chou and C.-F. Chou, “Efficient and accurate tightly-coupled visual-lidar slam,” IEEE Transactions on Intelligent Transportation Systems (ITSC), vol. 23, no. 9, pp. 14 509–14 523, 2021
2021
-
[27]
Lidar-monocular visual odometry using point and line features,
S.-S. Huang, Z.-Y . Ma, T.-J. Mu, H. Fu, and S.-M. Hu, “Lidar-monocular visual odometry using point and line features,” in IEEE international conference on robotics and automation (ICRA) , 2020, pp. 1091–1097
2020
-
[28]
Dvl-slam: Sparse depth enhanced direct visual-lidar slam,
Y .-S. Shin, Y . S. Park, and A. Kim, “Dvl-slam: Sparse depth enhanced direct visual-lidar slam,” Autonomous Robots, vol. 44, no. 2, pp. 115– 130, 2020
2020
-
[29]
Sdv-loam: semi-direct visual–lidar odometry and mapping,
Z. Yuan, Q. Wang, K. Cheng, T. Hao, and X. Yang, “Sdv-loam: semi-direct visual–lidar odometry and mapping,” IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) , vol. 45, no. 9, pp. 11 203–11 220, 2023
2023
-
[30]
Deepvo: Towards end-to- end visual odometry with deep recurrent convolutional neural networks,
S. Wang, R. Clark, H. Wen, and N. Trigoni, “Deepvo: Towards end-to- end visual odometry with deep recurrent convolutional neural networks,” in IEEE international conference on robotics and automation (ICRA) , 2017, pp. 2043–2050
2017
-
[31]
Superpoint: Self- supervised interest point detection and description,
D. DeTone, T. Malisiewicz, and A. Rabinovich, “Superpoint: Self- supervised interest point detection and description,” in IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2018, pp. 224–236
2018
-
[32]
Superglue: Learning feature matching with graph neural networks,
P.-E. Sarlin, D. DeTone, T. Malisiewicz, and A. Rabinovich, “Superglue: Learning feature matching with graph neural networks,” in IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020, pp. 4938–4947
2020
-
[33]
Vggsfm: Visual geometry grounded deep structure from motion,
J. Wang, N. Karaev, C. Rupprecht, and D. Novotny, “Vggsfm: Visual geometry grounded deep structure from motion,” in IEEE/CVF Confer- ence on Computer Vision and Pattern Recognition (CVPR) , 2024, pp. 21 686–21 697
2024
-
[34]
Dust3r: Geometric 3d vision made easy,
S. Wang, V . Leroy, Y . Cabon, B. Chidlovskii, and J. Revaud, “Dust3r: Geometric 3d vision made easy,” in IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , 2024, pp. 20 697–20 709
2024
-
[35]
Grounding image matching in 3d with mast3r,
V . Leroy, Y . Cabon, and J. Revaud, “Grounding image matching in 3d with mast3r,” in European conference on computer vision (ECCV), 2024, pp. 71–91
2024
-
[36]
Efficient 3d deep lidar odometry,
G. Wang, X. Wu, S. Jiang, Z. Liu, and H. Wang, “Efficient 3d deep lidar odometry,” IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), vol. 45, no. 5, pp. 5749–5765, 2022
2022
-
[37]
Deepvcp: An end-to-end deep neural network for point cloud registration,
W. Lu, G. Wan, Y . Zhou, X. Fu, P. Yuan, and S. Song, “Deepvcp: An end-to-end deep neural network for point cloud registration,” in IEEE/CVF international conference on computer vision (ICCV), October 2019
2019
-
[38]
Lvio-fusion: A self-adaptive multi-sensor fusion slam framework using actor-critic method,
Y . Jia, H. Luo, F. Zhao, G. Jiang, Y . Li, J. Yan, Z. Jiang, and Z. Wang, “Lvio-fusion: A self-adaptive multi-sensor fusion slam framework using actor-critic method,” in IEEE/RSJ international conference on intelligent robots and systems (IROS) , 2021, pp. 286–293
2021
-
[39]
Self-supervised visual- lidar odometry with flip consistency,
B. Li, M. Hu, S. Wang, L. Wang, and X. Gong, “Self-supervised visual- lidar odometry with flip consistency,” in IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) , 2021, pp. 3844–3852
2021
-
[40]
Self-calibrating neural radiance fields,
Y . Jeong, S. Ahn, C. Choy, A. Anandkumar, M. Cho, and J. Park, “Self-calibrating neural radiance fields,” in IEEE/CVF international conference on computer vision (ICCV) , 2021, pp. 5741–5751
2021
-
[41]
Nope- nerf: Optimising neural radiance field with no pose prior,
W. Bian, Z. Wang, K. Li, J.-W. Bian, and V . A. Prisacariu, “Nope- nerf: Optimising neural radiance field with no pose prior,” in IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023, pp. 4160–4169
2023
-
[42]
Up-nerf: Unconstrained pose prior- free neural radiance field,
I. Kim, M. Choi, and H. J. Kim, “Up-nerf: Unconstrained pose prior- free neural radiance field,” Advances in neural information processing systems (NeurIPS), vol. 36, 2024. 18
2024
-
[43]
Emerging properties in self-supervised vision transformers,
M. Caron, H. Touvron, I. Misra, H. J ´egou, J. Mairal, P. Bojanowski, and A. Joulin, “Emerging properties in self-supervised vision transformers,” in IEEE/CVF international conference on computer vision (ICCV), 2021, pp. 9650–9660
2021
-
[44]
iMAP: Implicit Mapping and Positioning in Real-Time,
E. Sucar, S. Liu, J. Ortiz, and A. Davison, “iMAP: Implicit Mapping and Positioning in Real-Time,” in IEEE/CVF international conference on computer vision (ICCV) , 2021, pp. 6229–6238
2021
-
[45]
Nice-slam: Neural implicit scalable encoding for slam,
Z. Zhu, S. Peng, V . Larsson, W. Xu, H. Bao, Z. Cui, M. R. Oswald, and M. Pollefeys, “Nice-slam: Neural implicit scalable encoding for slam,” in IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022, pp. 12 786–12 796
2022
-
[46]
Orbeez-slam: A real-time monocular visual slam with orb features and nerf-realized mapping,
C.-M. Chung, Y .-C. Tseng, Y .-C. Hsu, X.-Q. Shi, Y .-H. Hua, J.-F. Yeh, W.-C. Chen, Y .-T. Chen, and W. H. Hsu, “Orbeez-slam: A real-time monocular visual slam with orb features and nerf-realized mapping,” in IEEE International Conference on Robotics and Automation (ICRA) , 2...
2023
-
[47]
Orb-slam2: An open-source slam system for monocular, stereo, and rgb-d cameras,
R. Mur-Artal and J. D. Tard ´os, “Orb-slam2: An open-source slam system for monocular, stereo, and rgb-d cameras,”IEEE transactions on robotics (T-RO), vol. 33, no. 5, pp. 1255–1262, 2017
2017
-
[48]
Nerf-slam: Real-time dense monocular slam with neural radiance fields,
A. Rosinol, J. J. Leonard, and L. Carlone, “Nerf-slam: Real-time dense monocular slam with neural radiance fields,” in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) , 2023, pp. 3437– 3444
2023
-
[49]
Plgslam: Progressive neural scene represenation with local to global bundle adjustment,
T. Deng, G. Shen, T. Qin, J. Wang, W. Zhao, J. Wang, D. Wang, and W. Chen, “Plgslam: Progressive neural scene represenation with local to global bundle adjustment,” in IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , 2024, pp. 19 657–19 666
2024
-
[50]
Shine-mapping: Large- scale 3d mapping using sparse hierarchical implicit neural representa- tions,
X. Zhong, Y . Pan, J. Behley, and C. Stachniss, “Shine-mapping: Large- scale 3d mapping using sparse hierarchical implicit neural representa- tions,” in IEEE International Conference on Robotics and Automation (ICRA), 2023, pp. 8371–8377
2023
-
[51]
Nerf-loam: Neural implicit representation for large-scale incremental lidar odometry and mapping,
J. Deng, Q. Wu, X. Chen, S. Xia, Z. Sun, G. Liu, W. Yu, and L. Pei, “Nerf-loam: Neural implicit representation for large-scale incremental lidar odometry and mapping,” in IEEE/CVF international conference on computer vision (ICCV) , 2023, pp. 8218–8227
2023
-
[52]
Loner: Lidar only neural representations for real-time slam,
S. Isaacson, P.-C. Kung, M. Ramanagopal, R. Vasudevan, and K. A. Skinner, “Loner: Lidar only neural representations for real-time slam,” IEEE Robotics and Automation Letters (RA-L) , 2023
2023
-
[53]
Pin-slam: Lidar slam using a point-based implicit neural repre- sentation for achieving global map consistency,
Y . Pan, X. Zhong, L. Wiesmann, T. Posewsky, J. Behley, and C. Stach- niss, “Pin-slam: Lidar slam using a point-based implicit neural repre- sentation for achieving global map consistency,” IEEE Transactions on Robotics (T-RO), vol. 40, pp. 4045–4064, 2024
2024
-
[54]
Multi- modal neural radiance field for monocular dense slam with a light-weight tof sensor,
X. Liu, Y . Li, Y . Teng, H. Bao, G. Zhang, Y . Zhang, and Z. Cui, “Multi- modal neural radiance field for monocular dense slam with a light-weight tof sensor,” in IEEE/CVF international conference on computer vision (ICCV), 2023, pp. 1–11
2023
-
[55]
Rapid-mapping: Lidar- visual implicit neural representations for real-time dense mapping,
H. Zhang, Y . Zou, Z. Yan, and H. Cheng, “Rapid-mapping: Lidar- visual implicit neural representations for real-time dense mapping,” IEEE Robotics and Automation Letters (RA-L) , 2024
2024
-
[56]
A flexible new technique for camera calibration,
Z. Zhang, “A flexible new technique for camera calibration,” IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) , vol. 22, no. 11, pp. 1330–1334, 2000
2000
-
[57]
Extrinsic calibration of a camera and laser range finder (improves camera calibration),
Q. Zhang and R. Pless, “Extrinsic calibration of a camera and laser range finder (improves camera calibration),” in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) , vol. 3, 2004, pp. 2301–2306
2004
-
[58]
Automatic camera and range sensor calibration using a single shot,
A. Geiger, F. Moosmann, ¨O. Car, and B. Schuster, “Automatic camera and range sensor calibration using a single shot,” in IEEE international conference on robotics and automation (RA-L) , 2012, pp. 3936–3943
2012
-
[59]
Automatic extrinsic calibration for lidar-stereo vehicle sensor setups,
C. Guindel, J. Beltr ´an, D. Mart ´ın, and F. Garc ´ıa, “Automatic extrinsic calibration for lidar-stereo vehicle sensor setups,” in IEEE international conference on intelligent transportation systems (ITSC) , 2017, pp. 1–6
2017
-
[60]
Accurate calibration of LiDAR-camera systems using ordinary boxes,
Z. Pusztai and L. Hajder, “Accurate calibration of LiDAR-camera systems using ordinary boxes,” in IEEE/CVF International Conference on Computer Vision Workshops (ICCVW) , 2017, pp. 394–402
2017
-
[61]
Cross-calibration of push- broom 2d lidars and cameras in natural scenes,
A. Napier, P. Corke, and P. Newman, “Cross-calibration of push- broom 2d lidars and cameras in natural scenes,” in IEEE International Conference on Robotics and Automation (ICRA) , 2013, pp. 3679–3684
2013
-
[62]
Pixel-level extrinsic self cal- ibration of high resolution lidar and camera in targetless environments,
C. Yuan, X. Liu, X. Hong, and F. Zhang, “Pixel-level extrinsic self cal- ibration of high resolution lidar and camera in targetless environments,” IEEE Robotics and Automation Letters (RA-L) , vol. 6, no. 4, pp. 7517– 7524, 2021
2021
-
[63]
Spatio-temporal laser to visual/inertial calibration with applications to hand-held, large scale scanning,
J. Rehder, P. Beardsley, R. Siegwart, and P. Furgale, “Spatio-temporal laser to visual/inertial calibration with applications to hand-held, large scale scanning,” in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) , 2014, pp. 459–465
2014
-
[64]
Spa- tiotemporal camera-LiDAR calibration: A targetless and structureless approach,
C. Park, P. Moghadam, S. Kim, S. Sridharan, and C. Fookes, “Spa- tiotemporal camera-LiDAR calibration: A targetless and structureless approach,” IEEE Robotics and Automation Letters (RA-L) , vol. 5, no. 2, pp. 1556–1563, 2020
2020
-
[65]
Keypoint-based LiDAR-camera online calibration with robust geometric network,
C. Ye, H. Pan, and H. Gao, “Keypoint-based LiDAR-camera online calibration with robust geometric network,” IEEE Transactions on Instrumentation and Measurement (TIM) , vol. 71, pp. 1–11, 2021
2021
-
[66]
Automatic target- less extrinsic calibration of a 3d lidar and camera by maximizing mutual information,
G. Pandey, J. McBride, S. Savarese, and R. Eustice, “Automatic target- less extrinsic calibration of a 3d lidar and camera by maximizing mutual information,” in AAAI Conference on Artificial Intelligence (AAAI) , 2012
2012
-
[67]
Automatic registration of mobile LiDAR and spherical panoramas,
R. Wang, F. P. Ferrie, and J. Macfarlane, “Automatic registration of mobile LiDAR and spherical panoramas,” in IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) , 2012, pp. 33–40
2012
-
[68]
RegNet: Multimodal sensor registration using deep neural networks,
N. Schneider, F. Piewak, C. Stiller, and U. Franke, “RegNet: Multimodal sensor registration using deep neural networks,” in IEEE intelligent vehicles symposium (IV) , 2017, pp. 1803–1810
2017
-
[69]
CalibNet: Geo- metrically supervised extrinsic calibration using 3d spatial transformer networks,
G. Iyer, R. K. Ram, J. K. Murthy, and K. M. Krishna, “CalibNet: Geo- metrically supervised extrinsic calibration using 3d spatial transformer networks,” in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) , 2018, pp. 1110–1117
2018
-
[70]
LCCNet: LiDAR and camera self-calibration using cost volume network,
X. Lv, B. Wang, Z. Dou, D. Ye, and S. Wang, “LCCNet: LiDAR and camera self-calibration using cost volume network,” in IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2021, pp. 2894–2901
2021
-
[71]
DXQ-Net: differ- entiable lidar-camera extrinsic calibration using quality-aware flow,
X. Jing, X. Ding, R. Xiong, H. Deng, and Y . Wang, “DXQ-Net: differ- entiable lidar-camera extrinsic calibration using quality-aware flow,” in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2022, pp. 6235–6241
2022
-
[72]
Batch Differentiable Pose Refinement for In-The-wild Camera/LiDAR Extrinsic Calibration,
L. F. T. Fu and M. Fallon, “Batch Differentiable Pose Refinement for In-The-wild Camera/LiDAR Extrinsic Calibration,” in Conference on Robot Learning (CoRL) , 2023
2023
-
[73]
3dgs-calib: 3d gaussian splatting for multimodal spatiotemporal calibration,
Q. Herau, M. Bennehar, A. Moreau, N. Piasco, L. Roldao, D. Tsishkou, C. Migniot, P. Vasseur, and C. Demonceaux, “3dgs-calib: 3d gaussian splatting for multimodal spatiotemporal calibration,” in IEEE/RSJ Inter- national Conference on Intelligent Robots and Systems (IROS) , 2024...
2024
-
[74]
Viineus: V olumetric initialization for implicit neural surface reconstruction of urban scenes with limited image overlap,
H. Djeghim, N. Piasco, M. Bennehar, L. Rold ˜ao, D. Tsishkou, and D. Sidib´e, “Viineus: V olumetric initialization for implicit neural surface reconstruction of urban scenes with limited image overlap,” 2025. [Online]. Available: https://arxiv.org/abs/2403.10344
2025 arXiv
-
[75]
Oasim: an open and adaptive simulator based on neural rendering for autonomous driving,
G. Yan, J. Pi, J. Guo, Z. Luo, M. Dou, N. Deng, Q. Huang, D. Fu, L. Wen, P. Cai, X. Gao, X. Cai, B. Zhang, X. Yang, Y . Bai, H. Zhou, and B. Shi, “Oasim: an open and adaptive simulator based on neural rendering for autonomous driving,” 2024
2024
-
[76]
Evaluating the performance of map optimiza- tion algorithms,
E. Olson and M. Kaess, “Evaluating the performance of map optimiza- tion algorithms,” in RSS Workshop on Good Experimental Methodology in Robotics, vol. 15, 2009, p. 35
2009
-
[77]
g2o: A general framework for graph optimization,
G. Grisetti, H. Strasdat, K. Konolige, and W. Burgard, “g2o: A general framework for graph optimization,” in IEEE International Conference on Robotics and Automation (ICRA) , vol. 2, 2011, p. 1
2011
-
[78]
The drunkard’s odometry: estimating camera motion in deforming scenes,
D. Recasens Lafuente, M. R. Oswald, M. Pollefeys, and J. Civera, “The drunkard’s odometry: estimating camera motion in deforming scenes,” Advances in neural information processing systems (NeurIPS) , vol. 36, pp. 48 877–48 889, 2023
2023
-
[79]
Nerf in the wild: Neural radiance fields for unconstrained photo collections,
R. Martin-Brualla, N. Radwan, M. S. Sajjadi, J. T. Barron, A. Dosovit- skiy, and D. Duckworth, “Nerf in the wild: Neural radiance fields for unconstrained photo collections,” in IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , 2021, pp. 7210–7219
2021
-
[80]
Scene coordinate reconstruction: Posing of image collections via incremental learning of a relocalizer,
E. Brachmann, J. Wynn, S. Chen, T. Cavallari, ´A. Monszpart, D. Tur- mukhambetov, and V . A. Prisacariu, “Scene coordinate reconstruction: Posing of image collections via incremental learning of a relocalizer,” in European conference on computer vision (ECCV) . Springer, 2024,...
2024
-
[81]
On the limits of pseudo ground truth in visual camera re-localisation,
E. Brachmann, M. Humenberger, C. Rother, and T. Sattler, “On the limits of pseudo ground truth in visual camera re-localisation,” in IEEE/CVF international conference on computer vision (ICCV) , 2021, pp. 6218– 6228
2021
-
[82]
Nerfstudio: A modular framework for neural radiance field development,
M. Tancik, E. Weber, E. Ng, R. Li, B. Yi, T. Wang, A. Kristoffersen, J. Austin, K. Salahi, A. Ahuja et al., “Nerfstudio: A modular framework for neural radiance field development,” in ACM SIGGRAPH Conference Proceedings, 2023, pp. 1–12
2023
-
[83]
Animating rotation with quaternion curves,
K. Shoemake, “Animating rotation with quaternion curves,” in Proceed- ings of the 12th annual conference on Computer graphics and interactive techniques, 1985, pp. 245–254. 19
1985
-
[84]
Continuous pose for monocular cameras in neural implicit representation,
Q. Ma, D. P. Paudel, A. Chhatkuli, and L. Van Gool, “Continuous pose for monocular cameras in neural implicit representation,” in IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024, pp. 5291–5301
2024
-
[85]
3d gaussian splatting for real-time radiance field rendering,
B. Kerbl, G. Kopanas, T. Leimk ¨uhler, and G. Drettakis, “3d gaussian splatting for real-time radiance field rendering,” ACM Transactions on Graphics (ToG), vol. 42, no. 4, 2023
2023
-
[86]
Vision meets robotics: The kitti dataset,
A. Geiger, P. Lenz, C. Stiller, and R. Urtasun, “Vision meets robotics: The kitti dataset,” The International Journal of Robotics Research , vol. 32, no. 11, pp. 1231–1237, 2013
2013
Reviewed August 16, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.