pith. sign in

arxiv: 2210.13641 · v1 · pith:MCWMNFM5new · submitted 2022-10-24 · 💻 cs.CV

NeRF-SLAM: Real-Time Dense Monocular SLAM with Neural Radiance Fields

classification 💻 cs.CV
keywords monocularreal-timeaccuracybetterdensegeometricneuralphotometric
0
0 comments X
read the original abstract

We propose a novel geometric and photometric 3D mapping pipeline for accurate and real-time scene reconstruction from monocular images. To achieve this, we leverage recent advances in dense monocular SLAM and real-time hierarchical volumetric neural radiance fields. Our insight is that dense monocular SLAM provides the right information to fit a neural radiance field of the scene in real-time, by providing accurate pose estimates and depth-maps with associated uncertainty. With our proposed uncertainty-based depth loss, we achieve not only good photometric accuracy, but also great geometric accuracy. In fact, our proposed pipeline achieves better geometric and photometric accuracy than competing approaches (up to 179% better PSNR and 86% better L1 depth), while working in real-time and using only monocular images.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 3 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. A Geometric Algorithm for Blood Vessel Reconstruction from Skeletal Representation

    cs.CV 2024-02 unverdicted novelty 5.0

    A geometric algorithm reconstructs tubular shapes from skeletal points as a TSDF in voxel hashing using direct geometric distance computation without segmentation or matrix solving.

  2. Agent AI: Surveying the Horizons of Multimodal Interaction

    cs.AI 2024-01 unverdicted novelty 4.0

    The paper defines Agent AI as interactive multimodal systems that perceive grounded data and generate embodied actions, arguing this approach can mitigate hallucinations in foundation models.

  3. NeRF: Neural Radiance Field in 3D Vision: A Comprehensive Review (Updated Post-Gaussian Splatting)

    cs.CV 2022-10 unverdicted novelty 2.0

    A literature survey of NeRF and neural field methods from 2020-2025, organized by architecture and application taxonomies with benchmarks and dataset overviews, covering both pre- and post-Gaussian Splatting periods.