Fisheye-GS: Lightweight and Extensible Gaussian Splatting Module for Fisheye Cameras
Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 kernel pith:B62KJWJRrecord.jsonopen to challenge →
read the original abstract
Recently, 3D Gaussian Splatting (3DGS) has garnered attention for its high fidelity and real-time rendering. However, adapting 3DGS to different camera models, particularly fisheye lenses, poses challenges due to the unique 3D to 2D projection calculation. Additionally, there are inefficiencies in the tile-based splatting, especially for the extreme curvature and wide field of view of fisheye lenses, which are crucial for its broader real-life applications. To tackle these challenges, we introduce Fisheye-GS.This innovative method recalculates the projection transformation and its gradients for fisheye cameras. Our approach can be seamlessly integrated as a module into other efficient 3D rendering methods, emphasizing its extensibility, lightweight nature, and modular design. Since we only modified the projection component, it can also be easily adapted for use with different camera models. Compared to methods that train after undistortion, our approach demonstrates a clear improvement in visual quality.
This paper has not been read by Pith yet.
Forward citations
Cited by 5 Pith papers
-
UniTriSplat: A Unified 3D Gaussian Splatting Framework with Uniform Spherical Rasterization for Universal Cameras
UniTriSplat unifies 3D Gaussian Splatting across camera types by performing splatting and optimization on a HEALPix spherical grid with equal-area sampling.
-
UniSHARP: Universal Sharp Monocular View Synthesis
UniSHARP performs universal sharp monocular view synthesis by implicit alignment of diverse camera images in a unified omnidirectional latent space using ray-arranged Gaussian primitives and UniK3D-inspired feature decoding.
-
SaLF: Sparse Local Fields for Multi-Sensor Rendering in Real-Time
SaLF is a sparse voxel-based volumetric representation with local implicit fields that supports fast rasterization and raytracing for unified camera and LiDAR simulation in driving scenes.
-
Palm-sized Omnidirectional Vision-Based UAV Exploration with Sparse Topological Map Guidance
A vision-only system using sparse topological nodes for frontiers enables efficient autonomous exploration on palm-sized UAVs with minimal memory and compute.
-
Bringing a Personal Point of View: Evaluating Dynamic 3D Gaussian Splatting for Egocentric Scene Reconstruction
Dynamic 3DGS models achieve lower PSNR on egocentric videos than exocentric ones, with the gap arising from static content reconstruction.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.