Pith. sign in

REVIEW 4 major objections 6 minor 11 cited by

Wonderland: Navigating 3D Scenes from a Single Image

T0 review · 4 major / 6 minor · reviewed 2026-08-11 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read A single image can generate a wide, navigable 3D scene by reconstructing from video-diffusion latents.

desk verdict Genuinely new latent-space recipe with consistent gains, but the static-scene assumption is unquantified and the wide-scope evaluation is narrow; well worth serious review with revisions. read the letter →

arxiv 2412.12091 v2 pith:ERJAKOTO submitted 2024-12-16 cs.CV

Hanwen Liang , Junli Cao , Vidit Goel , Guocheng Qian , Sergei Korolev , Demetri Terzopoulos , Konstantinos N. Plataniotis , Sergey Tulyakov
show 1 more author
Jian Ren
This is my paper · ORCID
classification cs.CV
keywords single-image3DgenerationvideodiffusionmodelGaussianSplattingnovelviewsynthesiscameratrajectorycontrollatentspacereconstructionfeed-forwardwide-scopescenes
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper claims that a single image is enough to generate a wide, navigable 3D scene by chaining two learned modules: a camera-guided video diffusion model that expands the image into a short video following a specified camera trajectory, and a Latent Large Reconstruction Model (LaLRM) that reads the video's compressed latent, not its decoded frames, and regresses 3D Gaussian Splatting parameters in a feed-forward pass. The claim is that this avoids both requirements of prior work—dense multi-view capture and per-scene optimization—while producing high-quality novel views, and that it outperforms existing single-view scene generation methods on RealEstate10K, DL3DV, and Tanks-and-Temples. A stronger conceptual claim is also made: that a diffusion model's latent space can itself serve as the input representation for 3D reconstruction, so generation and reconstruction share the same compressed, 3D-aware representation.

What carries the argument

The central mechanism is the pairing of a dual-branch camera conditioning module with a latent-space reconstruction transformer. Camera poses are represented as per-pixel Plücker embeddings (6D ray-origin and ray-direction coordinates) and injected into a pretrained video diffusion transformer through two branches: a ControlNet-style branch with a trainable copy of the first transformer blocks, and a LoRA fine-tuning branch, which together make the video follow the requested trajectory while remaining static. The LaLRM then patchifies the video latent and the same camera embeddings into equal-length token sequences, concatenates them, and passes them through transformer blocks to regress a 12-channel Gaussian feature map, which is decoded by a 3D deconvolution into per-pixel 3D Gaussian attributes (RGB, scale, rotation quaternion, opacity, and ray distance). This 3DGS output is rendered and supervised by a combination of MSE and perceptual losses on seen and unseen views.

What would settle it

Generate a video along a trajectory that returns to the starting camera and reconstruct the 3DGS; if the render from the final pose differs substantially from the input image (e.g., LPIPS above the thresholds the paper reports for its own results), the video latent was not 3D-consistent.

Watch

Extended reading notes

Core claim

Wonderland demonstrates that 3D reconstruction can be built directly on the latent space of a video diffusion model. Given one image and a camera trajectory, a fine-tuned video diffusion transformer generates a video whose latent encodes multi-view, 3D-consistent scene structure; the LaLRM then regresses these latents into 3D Gaussian Splatting (3DGS) in a single feed-forward pass. The paper reports that this yields high-quality, wide-scope novel views and outperforms prior single-view methods on benchmark datasets, including out-of-domain images. The central discovery is the alignment of the generation and reconstruction tasks through the video latent space, which provides a 256x spatiotemporal compression that makes dense transformer-based reconstruction of wide scenes computationally tractable.

Load-bearing premise

The load-bearing premise is that the camera-guided video diffusion model, after fine-tuning, will generate static, 3D-consistent videos that faithfully follow the specified camera trajectory; if the generated videos drift, contain motion, or ignore the poses, the LaLRM cannot reconstruct a valid 3D scene, and the authors concede in Appendix E that such motions occasionally occur.

Editorial extensions

If this is right

  • Single-image 3D scene generation becomes a feed-forward process that completes in about five minutes on one A100 GPU, roughly 3.2x faster than the Cat3D baseline and 36x faster than ZeroNVS.
  • Wide-scope and out-of-domain scenes can be reconstructed without multi-view capture, because the generated video supplies the multi-view coverage from a single input image and desired trajectory.
  • Because the reconstructor reads latents rather than decoded pixels, the token count is reduced enough to handle 49-frame, 480x720 clips within a dense transformer's memory budget.
  • The approach is explicitly limited to static scenes; the authors report that motions occasionally appear in generated videos and hamper reconstruction, so dynamic content remains an open problem.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • Testable extension not in the paper: if video latents are the right substrate, then swapping the camera-guidance video backbone for a different pretrained video model may work with only LaLRM retraining, turning LaLRM into a general latent-to-3D module.
  • The dual-branch conditioning design may transfer to other spatial conditions beyond cameras, such as depth or optical flow, since both branches inject token-level conditions without altering the frozen video transformer's weights.
  • The stated latency bottleneck is the video generation stage, not reconstruction; a faster sampler or parallel denoising would make the whole pipeline nearly real-time, whereas the reconstruction stage itself is already feed-forward.
  • A practical safeguard the paper does not discuss: applying a lightweight static-scene consistency check to the generated video before reconstruction would catch the occasional motion failures that degrade results.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 6 minor

Summary. The paper proposes Wonderland, a single-image 3D scene generation pipeline. A camera-guided video diffusion model generates a 49-frame video conditioned on an input image and a desired camera trajectory; the video is encoded to latents by a frozen 3D VAE, and a Latent Large Reconstruction Model (LaLRM) regresses 3D Gaussian Splatting parameters from these latents in a feed-forward manner. The video diffusion model uses a dual-branch conditioning mechanism (ControlNet and LoRA) with Plücker embeddings for precise pose control, and LaLRM is trained progressively on benchmark videos plus 20K self-generated videos. Experiments report state-of-the-art quantitative results on RealEstate10K, DL3DV, and Tanks-and-Temples for both camera-guided video generation and 3D scene generation, along with qualitative in-the-wild comparisons and a latency comparison.

Significance. If the results hold, the paper makes a meaningful contribution by showing that a 3D reconstruction model can be built directly on the latent space of a video diffusion model, enabling feed-forward, memory-efficient reconstruction of wide-scope scenes from a single image. The quantitative gains over ZeroNVS and ViewCrafter are consistent across three datasets, and the ablations in Table 3 support the latent-space design over RGB-based alternatives. The dual-branch camera control with Plücker embeddings is a clean engineering contribution. The paper also ships detailed architectural descriptions and ablations, which strengthen reproducibility. However, the headline 'wide-scope' claim is not actually measured, and the central assumption that generated videos are static and 3D-consistent is admitted but not quantified, which limits the current evidence for the central claim.

major comments (4)
  1. [§4.2, §4.1, and Appendix D.2] The 'wide-scope' claim is not supported by the evaluation protocol. In §4.2, the 3D scene metrics are computed on 'a total of 14 sampled frames and poses subsequent to the conditional image,' and in §4.1 the visual similarity metrics are similarly reported for the first 14 frames of the generated videos (which are 49 frames long for the proposed method). These frames are the ones closest to the input view, where the task is easiest and where prior methods also perform best. Since 'wide-scope' is a central advertised advantage, the paper should report metrics over larger view offsets or over the full generated trajectories, or at least show a plot of error as a function of frame index. Without this, the numbers in Tables 1 and 2 do not quantify wide-scope behavior.
  2. [§3.2 and Appendix E] The load-bearing premise that the camera-guided video diffusion model generates static, 3D-consistent videos is asserted but never measured. Appendix E states 'We occasionally observe motions in the generated videos, which hampers the reconstruction effect,' but 'occasionally' is never quantified: there is no motion score, no failure rate, no per-sample breakdown in Tables 1 and 2, and no correlation analysis between consistency and reconstruction quality. The reported metrics (FID, FVD, Rerr, Terr, PSNR, SSIM, LPIPS) do not measure multi-view geometric consistency; Rerr/Terr only measure whether COLMAP can fit a pose to the generated frames, not whether the views satisfy epipolar or re-projection constraints. Because LaLRM is trained to force any latent into a static 3DGS, mildly inconsistent videos will produce blur or floaters that are averaged into the headline numbers without being reported separately. The paper needs a quantitative consistency measure (e.g., optical flow residual, epipolar error, or a static-scene score) and a per-sample report of how often generated videos are sufficiently consistent for reconstruction.
  3. [§3.3 and Appendix B.1] The fine-tuning of LaLRM on 20K videos generated by the same camera-guided video diffusion model whose latents are later reconstructed at test time introduces a domain-alignment confound. While the paper's Table A3 shows only a small gain from the in-the-wild data on RE10K, the test-time latents always come from the same video model, so LaLRM can learn to decode that model's specific artifacts as if they were valid scene geometry. To isolate this effect, the authors should evaluate LaLRM on latents from an independently trained camera-controlled video model (e.g., a baseline such as ViewCrafter) or on real videos from the RE10K test set encoded with the same 3D VAE, and report the reconstruction metrics separately from those obtained on self-generated latents. Without this control, part of the reported performance may be attributable to training/test distribution alignment rather than to generalizable 3D reconstruction.
  4. [Table 2 and §4.2] The quantitative comparison in Table 2 includes only ZeroNVS and ViewCrafter, yet the abstract and introduction claim 'state-of-the-art' performance in single-view 3D scene generation. Several recent methods that are cited in the paper (e.g., ReconX, CAT3D, Flash3D, Long-LRM, GenEx) are not included in the quantitative benchmark. CAT3D appears only in a qualitative Mip-NeRF comparison (Figure 6), and other concurrent feed-forward or diffusion-based methods are absent entirely. The claim of state-of-the-art performance is therefore not established against the current literature; the authors should either add quantitative comparisons to these methods (using their released models or reported numbers on the same benchmarks) or tone down the claim to 'state-of-the-art among compared methods.'
minor comments (6)
  1. [§3.3] The claimed '256× spatiotemporal reduction' uses rt=4 and rs=8, so the total reduction is 4⋅8⋅8=256; this is not purely 'spatiotemporal' but also spatial. The phrasing could be made precise.
  2. [Figure 2] The figure does not use the notation introduced in the text (octrl, olora) and the two branches are not labeled clearly; annotating the ControlNet and LoRA branches would improve readability.
  3. [Table 3] Each cell in Table 3 contains two numbers (e.g., '0.137/0.126') without a legend explaining which number corresponds to RGB-49 and which to RGB-14; this should be clarified in the caption or in the text.
  4. [Appendix D.2] The main text does not state which camera poses are used for the Table 2 results; Appendix D.2 says both 'conditional camera poses directly' and 'COLMAP-derived poses from the generated videos' were tried, with the latter yielding superior results. The paper should specify which pose source produced the reported numbers.
  5. [§3.2 and Appendix D.2] There are several typographical errors: 'renown' should be 'renowned' (§3.2), 'descent' should be 'decent' (Appendix D.2), and 'Fréchet' appears without the accent in some places.
  6. [§1] The claim that this is 'the first time that a 3D reconstruction model can effectively be built upon the latent space of a diffusion model' is strong given that the paper itself cites concurrent works such as VFusion3D [30] and LiftImage3D [16] that also use video diffusion priors; the novelty claim should be qualified with a discussion of these works.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: evaluation is anchored to external benchmark videos and ground-truth frames, while the self-generated fine-tuning data is a domain-adaptation step rather than a fitted-input-called-prediction.

full rationale

I walked the derivation chain. The video diffusion model is trained on RealEstate10K, ACID, and DL3DV, then evaluated on held-out test clips against ground-truth videos and COLMAP-estimated poses; the LaLRM is trained on benchmark clips plus 20K self-generated videos, then evaluated by rendering 3DGS and comparing to real ground-truth frames from RE10K, DL3DV, and Tanks-and-Temples test sets (Table 2). The use of self-generated videos in fine-tuning does align the input distribution with the downstream model, but it does not constitute circular prediction: the supervision views for those samples are the decoded frames of the same latents, which is an autoencoding-style adaptation, and the headline quantitative results are measured against external ground truth rather than against those training latents. The paper's admission in Appendix E that 'We occasionally observe motions in the generated videos, which hampers the reconstruction effect' is an unquantified limitation of the load-bearing premise that the generated latents are static and 3D-consistent, but that is a correctness/robustness weakness, not a circularity: no equation defines 3D consistency in terms of LaLRM success, and no fitted parameter is renamed as a prediction. Self-citations appear but are contextual and not load-bearing for the central reconstruction claim. Therefore no significant circularity is present.

Assumptions & free parameters 4 free parameters · 5 assumptions · 0 invented entities

No new physical or logical entities are posited; the LaLRM is a learned model, and the dual-branch conditioning is an architectural mechanism, not an entity. The free parameters are standard model hyperparameters and unreported loss weights.

free parameters (4)
  • Number of ControlNet blocks N = 21
    Chosen by ablation (Appendix A.2, Table A2); balances camera control and visual quality. Not derived from theory.
  • LoRA rank = 256
    Hyperparameter for the camera-LoRA branch (Sec 3.2); no sensitivity analysis reported.
  • Loss weights lambda_1 and lambda_2 in L_recon = not reported
    Total reconstruction loss is lambda_1 * L_mse + lambda_2 * L_perc (Sec 3.3); the weights are not given in the paper.
  • Number of supervision views V, V' = V=48, V'=24
    Chosen for training LaLRM (Sec 4, Implementation Details); affects the trade-off between fidelity and generalization.
assumptions (5)
  • domain assumption Video diffusion latents encode multi-view 3D consistency
    Section 3.2/3.3: the whole method depends on the claim that video latents retain 3D-aware information beyond single-image content. No direct probe of the latent is provided.
  • domain assumption Fine-tuned video model generates static scenes
    Section 3.2 and Appendix E: transition from dynamic to static is assumed; authors admit occasional motions hamper reconstruction.
  • domain assumption COLMAP pose estimates on generated videos are reliable
    Section 4.1: camera-control metrics and, at evaluation, reconstruction use COLMAP-derived poses of generated videos; if COLMAP is noisy or biased, both metrics and reconstruction degrade.
  • domain assumption 3D-VAE latents are perceptually equivalent to images and preserve detail
    Section 3.3: LaLRM relies on the frozen VAE's pretraining with perceptual and adversarial losses to justify that the compressed latent retains detail needed for high-quality 3DGS.
  • domain assumption Benchmark camera poses are accurate
    Training and evaluation use RE10K, ACID, DL3DV pose annotations as ground truth; errors in these annotations propagate to the learned reconstruction mapping.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Wonderland: Navigating 3D Scenes from a Single Image." pith.science (2026). https://pith.science/paper/ERJAKOTO

@misc{pith2026241212091,
  author       = {Pith},
  title        = {Pith review of: Wonderland: Navigating 3D Scenes from a Single Image},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/ERJAKOTO}},
  note         = {Machine review of arXiv:2412.12091}
}
read the original abstract

How can one efficiently generate high-quality, wide-scope 3D scenes from arbitrary single images? Existing methods suffer several drawbacks, such as requiring multi-view data, time-consuming per-scene optimization, distorted geometry in occluded areas, and low visual quality in backgrounds. Our novel 3D scene reconstruction pipeline overcomes these limitations to tackle the aforesaid challenge. Specifically, we introduce a large-scale reconstruction model that leverages latents from a video diffusion model to predict 3D Gaussian Splattings of scenes in a feed-forward manner. The video diffusion model is designed to create videos precisely following specified camera trajectories, allowing it to generate compressed video latents that encode multi-view information while maintaining 3D consistency. We train the 3D reconstruction model to operate on the video latent space with a progressive learning strategy, enabling the efficient generation of high-quality, wide-scope, and generic 3D scenes. Extensive evaluations across various datasets affirm that our model significantly outperforms existing single-view 3D scene generation methods, especially with out-of-domain images. Thus, we demonstrate for the first time that a 3D reconstruction model can effectively be built upon the latent space of a diffusion model in order to realize efficient 3D scene generation.

Figures

Figures reproduced from arXiv: 2412.12091 by the authors.

Figure 1
Figure 1. Visual results generated by Wonderland. Given a single image, Wonderland reconstructs 3D scenes from the latent space of a camera-guided video diffusion model in a feed-forward manner. Abstract How can one efficiently generate high-quality, wide-scope 3D scenes from arbitrary single images? Existing methods suffer several drawbacks, such as requiring multi-view data, time-consuming per-scene optimization, distorted … view at source ↗
Figure 2
Figure 2. Overview of Wonderland. Given a single image, a camera-guided video diffusion model follows the camera trajectory and generates a 3D-aware video latent. This is leveraged by the Latent Large Reconstruction Model (LaLRM) to construct the 3D scene in a feed-forward manner. The video diffusion model incorporates dual-branch camera conditioning to achieve precise pose control. The LaLRM operates in the video latent spac… view at source ↗
Figure 3
Figure 3. Qualitative comparison against prior arts in camera-guided video generation. Frame 14 in each sample is shown for comparison, with the first column displaying the conditional image and camera trajectory (bottom-right). Blue bounding boxes denote reference areas to assist comparison and orange bounding boxes highlight low-quality generations. We also show our last frames in the rightmost column. Our method outperform… view at source ↗
Figures from the paper (3 more)
Figure 4
Figure 4. Figure 4: Qualitative comparison of 3D scene generation. Blue bounding boxes show visible regions from conditional images and yellow bounding boxes show low-quality regions. Our approach generates much higher quality novel views from one conditional image. Note that ZeroNVS gene…
Figure 5
Figure 5. Figure 5: Comparison with ViewCrafter (left) and WonderJourney (right) for in-the-wild 3D scene generation from single input images [PITH_FULL_IMAGE:figures/full_fig_p008_5.png]
Figure 6
Figure 6. Figure 6: Comparison of ZeroNVS and Cat3D on the Mip￾Nerf dataset in 3D scene generation from single input images. For each scene, the conditional image is shown in the left column along with renderings from two viewpoints, one at the conditional image (starting) view (upper) an…

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 11 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Rays as Pixels: Learning A Joint Distribution of Videos and Camera Trajectories

    cs.CV 2026-04 unverdicted novelty 7.0 of 10

    Encoding cameras as pixel-aligned raxels lets one video diffusion model jointly denoise video and trajectories, supporting pose estimation, controlled generation, and joint synthesis.

  2. UniWorld-View: Large-Baseline View Synthesis via Video Diffusion Models

    cs.CV 2026-08 conditional novelty 6.0 of 10

    UniWorld-View couples an occlusion-aware point cloud renderer with a dual-stream video diffusion model to synthesize large-baseline novel views from monocular video.

  3. SymphoMotion: Joint Control of Camera Motion and Object Dynamics for Coherent Video Generation

    cs.CV 2026-04 conditional novelty 6.0 of 10

    SymphoMotion jointly controls camera trajectories and depth-aware object dynamics inside one video diffusion model, supported by the new RealCOD-25K real-world paired-motion dataset.

  4. Precise Action-to-Video Generation Through Visual Action Prompts

    cs.CV 2025-08 conditional novelty 6.0 of 10

    Skeleton-based visual action prompts give precise, cross-domain action control for video generation of human and robot interactions.

  5. Learning an Implicit Physics Model for Image-based Fluid Simulation

    cs.CV 2025-08 conditional novelty 6.0 of 10

    Using a simplified physics loss and 3D Gaussians, a neural network animates a single fluid image into videos with novel views, beating earlier methods on quality and motion accuracy.

  6. Cross-Frame Representation Alignment for Fine-Tuning Video Diffusion Models

    cs.CV 2025-06 conditional novelty 6.0 of 10

    CREPA fine-tunes video diffusion models with a loss that pulls each frame's hidden representation toward pretrained features of adjacent frames, improving semantic consistency in generated videos.

  7. DreamDance: Animating Character Art via Inpainting Stable Gaussian Worlds

    cs.CV 2025-05 conditional novelty 6.0 of 10

    DreamDance animates a single character artwork by reconstructing its background as a 3D Gaussian scene and then inpainting the animated character into the rendered video.

  8. SplatFlow: Multi-View Rectified Flow Model for 3D Gaussian Splatting Synthesis

    cs.CV 2024-11 conditional novelty 6.0 of 10

    SplatFlow jointly generates multi-view images, depths, and camera poses with a rectified flow model, then decodes them into editable 3D Gaussian Splatting scenes.

  9. TiP4GEN: Text to Immersive Panorama 4D Scene Generation

    cs.CV 2025-08 conditional novelty 5.0 of 10

    TiP4GEN generates motion-rich, geometry-consistent 360-degree 4D scenes from a global text prompt plus four local perspective prompts, using a dual-branch video diffusion model with bidirectional cross-attention and a...

  10. SpatialDreamer: Self-supervised Stereo Video Synthesis from Monocular Input

    cs.CV 2024-11 conditional novelty 5.0 of 10

    A self-supervised video diffusion pipeline that generates stereo video from a monocular input by training on depth-based pseudo-stereo pairs and conditioning on a stereo deviation strength signal.

  11. From World Action Models to Embodied Brains: A Roadmap for Open-World Physical Intelligence

    cs.RO 2026-07 conditional novelty 4.0 of 10

    Physical intelligence needs an embodied brain that reasons over interventions and emits capability requests, grounded by a physical harness and shared experience contracts rather than direct actuator policies.

Reference graph

Works this paper leans on

119 extracted references · 17 canonical work pages · cited by 11 Pith papers

  1. [1]

    CC3D: Layout- conditioned generation of compositional 3D scenes,

    S. Bahmani, J. J. Park, D. Paschalidou, X. Yan, G. Wet- zstein, L. Guibas, and A. Tagliasacchi, “CC3D: Layout- conditioned generation of compositional 3D scenes,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023, pp. 7171–7181. 3

    2023

  2. [2]

    AC3D: Analyzing and improving 3D cam- era control in video diffusion transformers,

    S. Bahmani, I. Skorokhodov, G. Qian, A. Siarohin, W. Menapace, A. Tagliasacchi, D. B. Lindell, and S. Tulyakov, “AC3D: Analyzing and improving 3D cam- era control in video diffusion transformers,” arXiv preprint arXiv:2411.18673, 2024. 3, 4

    arXiv 2024

  3. [3]

    4D-fy: Text-to-4D generation us- ing hybrid score distillation sampling,

    S. Bahmani, I. Skorokhodov, V . Rong, G. Wetzstein, L. Guibas, P. Wonka, S. Tulyakov, J. J. Park, A. Tagliasac- chi, and D. B. Lindell, “4D-fy: Text-to-4D generation us- ing hybrid score distillation sampling,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024, pp. 7996–8006. 3

    2024

  4. [4]

    VD3D: Taming large video diffu- sion transformers for 3D camera control,

    S. Bahmani, I. Skorokhodov, A. Siarohin, W. Menapace, G. Qian, M. Vasilkovsky, H.-Y . Lee, C. Wang, J. Zou, A. Tagliasacchi et al., “VD3D: Taming large video diffu- sion transformers for 3D camera control,” arXiv preprint arXiv:2407.12781, 2024. 3, 4, 6, 7

    arXiv 2024

  5. [5]

    Mip-NeRF 360: Unbounded anti-aliased neu- ral radiance fields supplemental materials,

    J. T. Barron, B. Mildenhall, D. Verbin, P. P. Srinivasan, and P. Hedman, “Mip-NeRF 360: Unbounded anti-aliased neu- ral radiance fields supplemental materials,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pat- tern Recognition, 2022. 8

    2022

  6. [6]

    Stable video diffusion: Scaling latent video diffusion models to large datasets,

    A. Blattmann, T. Dockhorn, S. Kulal, D. Mendelevitch, M. Kilian, D. Lorenz, Y . Levi, Z. English, V . V oleti, A. Letts et al. , “Stable video diffusion: Scaling latent video diffusion models to large datasets,” arXiv preprint arXiv:2311.15127, 2023. 3, 4, 6

    arXiv 2023

  7. [7]

    Align your latents: High- resolution video synthesis with latent diffusion models,

    A. Blattmann, R. Rombach, H. Ling, T. Dockhorn, S. W. Kim, S. Fidler, and K. Kreis, “Align your latents: High- resolution video synthesis with latent diffusion models,” in Proceedings of the IEEE/CVF Conference on Computer Vi- sion and Pattern Recognition, 2023, pp. 22 563–22 575. 5

    2023

  8. [8]

    Video generation models as world simulators,

    T. Brooks, B. Peebles, C. Holmes, W. DePue, Y . Guo, L. Jing, D. Schnurr, J. Taylor, T. Luhman, E. Luhmanet al., “Video generation models as world simulators,” OpenAI Blog, vol. 1, p. 8, 2024. 3

    2024

Show all 119 references
  1. [9]

    Emerging properties in self-supervised vision transformers,

    M. Caron, H. Touvron, I. Misra, H. J ´egou, J. Mairal, P. Bojanowski, and A. Joulin, “Emerging properties in self-supervised vision transformers,” in Proceedings of the IEEE/CVF International Conference on Computer Vision , 2021, pp. 9650–9660. 4

    2021

  2. [10]

    STAR: Skeleton-aware text-based 4D avatar genera- tion with in-network motion retargeting,

    Z. Chai, C. Tang, Y . Wong, and M. Kankanhalli, “STAR: Skeleton-aware text-based 4D avatar genera- tion with in-network motion retargeting,” arXiv preprint arXiv:2406.04629, 2024. 3

    2024 arXiv

  3. [11]

    Generative novel view synthesis with 3D- aware diffusion models,

    E. R. Chan, K. Nagano, M. A. Chan, A. W. Bergman, J. J. Park, A. Levy, M. Aittala, S. De Mello, T. Karras, and G. Wetzstein, “Generative novel view synthesis with 3D- aware diffusion models,” in Proceedings of the IEEE/CVF International Conference on Computer Vision , 2023, pp...

    2023

  4. [12]

    pixelSplat: 3D Gaussian splats from image pairs for scal- able generalizable 3D reconstruction,

    D. Charatan, S. L. Li, A. Tagliasacchi, and V . Sitzmann, “pixelSplat: 3D Gaussian splats from image pairs for scal- able generalizable 3D reconstruction,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023, pp. 19 457–19 467. 2

    2023

  5. [13]

    VideoCrafter1: Open diffusion models for high-quality video generation,

    H. Chen, M. Xia, Y . He, Y . Zhang, X. Cun, S. Yang, J. Xing, Y . Liu, Q. Chen, X. Wang et al. , “VideoCrafter1: Open diffusion models for high-quality video generation,” arXiv preprint arXiv:2310.19512, 2023. 3

    2023 arXiv

  6. [14]

    PixArt-α: Fast training of diffusion transformer for photorealistic text-to-image syn- thesis,

    J. Chen, J. Yu, C. Ge, L. Yao, E. Xie, Y . Wu, Z. Wang, J. Kwok, P. Luo, H. Lu et al., “PixArt-α: Fast training of diffusion transformer for photorealistic text-to-image syn- thesis,” arXiv preprint arXiv:2310.00426, 2023. 4

    2023 arXiv

  7. [15]

    Fantasia3D: Dis- entangling geometry and appearance for high-quality text- to-3D content creation,

    R. Chen, Y . Chen, N. Jiao, and K. Jia, “Fantasia3D: Dis- entangling geometry and appearance for high-quality text- to-3D content creation,” in Proceedings of the IEEE/CVF International Conference on Computer Vision , 2023, pp. 22 246–22 256. 2

    2023

  8. [16]

    LiftImage3D: Lifting any single image to 3D Gaussians with video generation priors,

    Y . Chen, C. Yang, J. Fang, X. Zhang, L. Xie, W. Shen, W. Dai, H. Xiong, and Q. Tian, “LiftImage3D: Lifting any single image to 3D Gaussians with video generation priors,” arXiv preprint arXiv:2412.09597, 2024. 3

    2024 arXiv

  9. [17]

    MVSplat: Efficient 3D Gaussian splatting from sparse multi-view images,

    Y . Chen, H. Xu, C. Zheng, B. Zhuang, M. Pollefeys, A. Geiger, T.-J. Cham, and J. Cai, “MVSplat: Efficient 3D Gaussian splatting from sparse multi-view images,” inPro- ceedings of the European Conference on Computer Vision,

  10. [18]

    V3D: Video diffusion models are effective 3D generators,

    Z. Chen, Y . Wang, F. Wang, Z. Wang, and H. Liu, “V3D: Video diffusion models are effective 3D generators,” arXiv preprint arXiv:2403.06738, 2024. 3

    2024 arXiv

  11. [19]

    Boosting camera motion control for video diffusion transformers,

    S. Y . Cheong, D. Ceylan, A. Mustafa, A. Gilbert, and C.- H. P. Huang, “Boosting camera motion control for video diffusion transformers,” arXiv preprint arXiv:2410.10802 ,

    arXiv

  12. [20]

    Lucid- Dreamer: Domain-free generation of 3D Gaussian splatting scenes,

    J. Chung, S. Lee, H. Nam, J. Lee, and K. M. Lee, “Lucid- Dreamer: Domain-free generation of 3D Gaussian splatting scenes,” arXiv preprint arXiv:2311.13384, 2023. 2, 3

    2023 arXiv

  13. [21]

    FlashAttention-2: Faster attention with bet- ter parallelism and work partitioning,

    T. Dao, “FlashAttention-2: Faster attention with bet- ter parallelism and work partitioning,” arXiv preprint arXiv:2307.08691, 2023. 6

    2023 arXiv

  14. [22]

    Adam: A method for stochastic optimization,

    P. K. Diederik and J. Ba, “Adam: A method for stochastic optimization,” arXiv preprint arXiv:1412.6980, 2017. 4

    2017 arXiv

  15. [23]

    Generating images with per- ceptual similarity metrics based on deep networks,

    A. Dosovitskiy and T. Brox, “Generating images with per- ceptual similarity metrics based on deep networks,” Ad- vances in Neural Information Processing Systems, vol. 29,

  16. [24]

    GeoGS3D: Single-view 3D reconstruction via geometric-aware dif- fusion model and Gaussian splatting,

    Q. Feng, Z. Xing, Z. Wu, and Y .-G. Jiang, “GeoGS3D: Single-view 3D reconstruction via geometric-aware dif- fusion model and Gaussian splatting,” arXiv preprint arXiv:2403.10242, 2024. 2

    2024 arXiv

  17. [25]

    CAT3D: Cre- ate anything in 3D with multi-view diffusion models,

    R. Gao, A. Holynski, P. Henzler, A. Brussee, R. Martin Bru- alla, P. Srinivasan, J. Barron, and B. Poole, “CAT3D: Cre- ate anything in 3D with multi-view diffusion models,” Ad- vances in Neural Information Processing Systems, vol. 37, pp. 75 468–75 494, 2025. 2, 8, 3

    2025

  18. [26]

    Griffiths and J

    P. Griffiths and J. Harris, Principles of Algebraic Geometry. John Wiley & Sons, 2014. 4

    2014

  19. [27]

    NerfDiff: Single-image view synthesis with NeRF-guided distillation from 3D-aware dif- fusion,

    J. Gu, A. Trevithick, K.-E. Lin, J. M. Susskind, C. Theobalt, L. Liu, and R. Ramamoorthi, “NerfDiff: Single-image view synthesis with NeRF-guided distillation from 3D-aware dif- fusion,” in Proceedings of the International Conference on Machine Learning. PMLR, 2023, pp. 11 808...

    2023

  20. [28]

    SparseNeRF: Distilling depth ranking for few-shot novel view synthesis,

    Guangcong, Z. Chen, C. C. Loy, and Z. Liu, “SparseNeRF: Distilling depth ranking for few-shot novel view synthesis,” in Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2023. 3

    2023

  21. [29]

    AnimateDiff: Animate your personalized text-to- image diffusion models without specific tuning,

    Y . Guo, C. Yang, A. Rao, Y . Wang, Y . Qiao, D. Lin, and B. Dai, “AnimateDiff: Animate your personalized text-to- image diffusion models without specific tuning,” in Pro- ceedings of the International Conference on Learning Rep- resentations, 2024. 3

    2024

  22. [30]

    VFusion3D: Learning scalable 3D generative models from video diffusion mod- els,

    J. Han, F. Kokkinos, and P. Torr, “VFusion3D: Learning scalable 3D generative models from video diffusion mod- els,” in Proceedings of the European Conference on Com- puter Vision. Springer, 2024, pp. 333–350. 3

    2024

  23. [31]

    CameraCtrl: Enabling camera control for text-to- video generation,

    H. He, Y . Xu, Y . Guo, G. Wetzstein, B. Dai, H. Li, and C. Yang, “CameraCtrl: Enabling camera control for text-to- video generation,” arXiv preprint arXiv:2404.02101, 2024. 3, 6, 4

    2024 arXiv

  24. [32]

    CameraCtrl II: Dy- namic scene exploration via camera-controlled video dif- fusion models,

    H. He, C. Yang, S. Lin, Y . Xu, M. Wei, L. Gui, Q. Zhao, G. Wetzstein, L. Jiang, and H. Li, “CameraCtrl II: Dy- namic scene exploration via camera-controlled video dif- fusion models,” arXiv preprint arXiv:2503.10592, 2025. 3

    2025 arXiv

  25. [33]

    Masked autoencoders are scalable vision learners,

    K. He, X. Chen, S. Xie, Y . Li, P. Doll ´ar, and R. Girshick, “Masked autoencoders are scalable vision learners,” inPro- ceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 16 000–16 009. 4

    2022

  26. [34]

    GVGEN: Text-to-3D gen- eration with volumetric representation,

    X. He, J. Chen, S. Peng, D. Huang, Y . Li, X. Huang, C. Yuan, W. Ouyang, and T. He, “GVGEN: Text-to-3D gen- eration with volumetric representation,” in Proceedings of the European Conference on Computer Vision. Springer, 2024, pp. 463–479. 3

    2024

  27. [35]

    GANS trained by a two time-scale update rule converge to a local Nash equilibrium,

    M. Heusel, H. Ramsauer, T. Unterthiner, B. Nessler, and S. Hochreiter, “GANS trained by a two time-scale update rule converge to a local Nash equilibrium,” Advances in Neural Information Processing Systems, vol. 30, 2017. 6

    2017

  28. [36]

    Denoising diffusion proba- bilistic models,

    J. Ho, A. Jain, and P. Abbeel, “Denoising diffusion proba- bilistic models,” Advances in Neural Information Process- ing Systems, vol. 33, pp. 6840–6851, 2020. 2

    2020

  29. [37]

    ViewDiff: 3D- consistent image generation with text-to-image models,

    L. H ¨ollein, A. Bo ˇziˇc, N. M ¨uller, D. Novotny, H.-Y . Tseng, C. Richardt, M. Zollh¨ofer, and M. Nießner, “ViewDiff: 3D- consistent image generation with text-to-image models,” in Proceedings of the IEEE/CVF Conference on Computer Vi- sion and Pattern Recognition, 2024, pp...

    2024

  30. [38]

    LRM: Large recon- struction model for single image to 3D,

    Y . Hong, K. Zhang, J. Gu, S. Bi, Y . Zhou, D. Liu, F. Liu, K. Sunkavalli, T. Bui, and H. Tan, “LRM: Large recon- struction model for single image to 3D,” arXiv preprint arXiv:2311.04400, 2023. 2, 3

    2023 arXiv

  31. [39]

    Training- free camera control for video generation,

    C. Hou, G. Wei, Y . Zeng, and Z. Chen, “Training- free camera control for video generation,” arXiv preprint arXiv:2406.10126, 2024. 3

    2024 arXiv

  32. [40]

    LoRA: Low-rank adaptation of large language models,

    E. J. Hu, Y . Shen, P. Wallis, Z. Allen-Zhu, Y . Li, S. Wang, L. Wang, and W. Chen, “LoRA: Low-rank adaptation of large language models,” arXiv preprint arXiv:2106.09685,

    arXiv

  33. [41]

    MotionMaster: Training-free cam- era motion transfer for video generation,

    T. Hu, J. Zhang, R. Yi, Y . Wang, H. Huang, J. Weng, Y . Wang, and L. Ma, “MotionMaster: Training-free cam- era motion transfer for video generation,” arXiv preprint arXiv:2404.15789, 2024. 3

    2024 arXiv

  34. [42]

    Image-to- image translation with conditional adversarial networks,

    P. Isola, J.-Y . Zhu, T. Zhou, and A. A. Efros, “Image-to- image translation with conditional adversarial networks,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017, pp. 1125–1134. 5

    2017

  35. [43]

    Putting NeRF on a diet: Semantically consistent few-shot view synthesis,

    A. Jain, M. Tancik, and P. Abbeel, “Putting NeRF on a diet: Semantically consistent few-shot view synthesis,” inCVPR, 2021, pp. 5885–5894. 3

    2021

  36. [44]

    An- imate3D: Animating any 3D model with multi-view video diffusion,

    Y . Jiang, C. Yu, C. Cao, F. Wang, W. Hu, and J. Gao, “An- imate3D: Animating any 3D model with multi-view video diffusion,” arXiv preprint arXiv:2407.11398, 2024. 3

    2024 arXiv

  37. [45]

    LVSM: A large view synthesis model with minimal 3D inductive bias,

    H. Jin, H. Jiang, H. Tan, K. Zhang, S. Bi, T. Zhang, F. Luan, N. Snavely, and Z. Xu, “LVSM: A large view synthesis model with minimal 3D inductive bias,” arXiv preprint arXiv:2410.17242, 2024. 2

    2024 arXiv

  38. [46]

    FloVD: Optical flow meets video diffusion model for en- hanced camera-controlled video synthesis,

    W. Jin, Q. Dai, C. Luo, S.-H. Baek, and S. Cho, “FloVD: Optical flow meets video diffusion model for en- hanced camera-controlled video synthesis,” arXiv preprint arXiv:2502.08244, 2025. 3

    2025 arXiv

  39. [47]

    3D Gaussian splatting for real-time radiance field rendering,

    B. Kerbl, G. Kopanas, T. Leimk¨uhler, and G. Drettakis, “3D Gaussian splatting for real-time radiance field rendering,” ACM Transactions on Graphics, vol. 42, no. 4, 2023. 2, 3, 4

    2023

  40. [48]

    NeuralField- LDM: Scene generation with hierarchical latent diffusion models,

    S. W. Kim, B. Brown, K. Yin, K. Kreis, K. Schwarz, D. Li, R. Rombach, A. Torralba, and S. Fidler, “NeuralField- LDM: Scene generation with hierarchical latent diffusion models,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023, pp. 8496–

    2023

  41. [49]

    Tanks and temples: Benchmarking large-scale scene reconstruc- tion,

    A. Knapitsch, J. Park, Q.-Y . Zhou, and V . Koltun, “Tanks and temples: Benchmarking large-scale scene reconstruc- tion,” ACM Transactions on Graphics, vol. 36, no. 4, 2017. 2, 6

    2017

  42. [50]

    Collaborative video diffusion: Con- sistent multi-video generation with camera control,

    Z. Kuang, S. Cai, H. He, Y . Xu, H. Li, L. J. Guibas, and G. Wetzstein, “Collaborative video diffusion: Con- sistent multi-video generation with camera control,” Ad- vances in Neural Information Processing Systems, vol. 37, pp. 16 240–16 271, 2024. 3

    2024

  43. [51]

    Flux: Decentralized computation framework,

    B. F. Labs, “Flux: Decentralized computation framework,” 2023, accessed: 2024-11-14. [Online]. Available: https: //github.com/black-forest-labs/flux 6

    2023

  44. [52]

    Vivid-ZOO: Multi-view video genera- tion with diffusion model,

    B. Li, C. Zheng, W. Zhu, J. Mai, B. Zhang, P. Wonka, and B. Ghanem, “Vivid-ZOO: Multi-view video genera- tion with diffusion model,”Advances in Neural Information Processing Systems, vol. 37, pp. 62 189–62 222, 2024. 3

    2024

  45. [53]

    Instant3D: Fast text-to-3D with sparse-view generation and large reconstruction model,

    J. Li, H. Tan, K. Zhang, Z. Xu, F. Luan, Y . Xu, Y . Hong, K. Sunkavalli, G. Shakhnarovich, and S. Bi, “Instant3D: Fast text-to-3D with sparse-view generation and large reconstruction model,” arXiv preprint arXiv:2311.06214 ,

    arXiv

  46. [54]

    RealCam-I2V: Real-world image-to-video gen- eration with interactive complex camera control,

    T. Li, G. Zheng, R. Jiang, T. Wu, Y . Lu, Y . Lin, X. Li et al. , “RealCam-I2V: Real-world image-to-video gen- eration with interactive complex camera control,” arXiv preprint arXiv:2502.10059, 2025. 3

    2025 arXiv

  47. [55]

    Self-supervised spatiotemporal representation learning by exploiting video continuity,

    H. Liang, N. Quader, Z. Chi, L. Chen, P. Dai, J. Lu, and Y . Wang, “Self-supervised spatiotemporal representation learning by exploiting video continuity,” in Proceedings of the AAAI conference on artificial intelligence, vol. 36, no. 2, 2022, pp. 1564–1573. 2

    2022

  48. [56]

    Diffusion4d: Fast spatial- temporal consistent 4d generation via video diffusion mod- els,

    H. Liang, Y . Yin, D. Xu, H. Liang, Z. Wang, K. N. Pla- taniotis, Y . Zhao, and Y . Wei, “Diffusion4d: Fast spatial- temporal consistent 4d generation via video diffusion mod- els,” Advances in Neural Information Processing Systems , vol. 37, pp. 110 854–110 875, 2024. 3

    2024

  49. [57]

    Feed-forward bullet-time reconstruction of dynamic scenes from monocular videos,

    H. Liang, J. Ren, A. Mirzaei, A. Torralba, Z. Liu, I. Gilitschenski, S. Fidler, C. Oztireli, H. Ling, Z. Go- jcic et al. , “Feed-forward bullet-time reconstruction of dynamic scenes from monocular videos,” arXiv preprint arXiv:2412.03526, 2024. 2

    2024

  50. [58]

    Dl3dv-10k: A large-scale scene dataset for deep learning-based 3D vision,

    L. Ling, Y . Sheng, Z. Tu, W. Zhao, C. Xin, K. Wan, L. Yu, Q. Guo, Z. Yu, Y . Lu et al. , “Dl3dv-10k: A large-scale scene dataset for deep learning-based 3D vision,” in Pro- ceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024, pp. 22 160–22 169...

    2024

  51. [59]

    Infinite nature: Perpetual view generation of natural scenes from a single image,

    A. Liu, R. Tucker, V . Jampani, A. Makadia, N. Snavely, and A. Kanazawa, “Infinite nature: Perpetual view generation of natural scenes from a single image,” in Proceedings of the IEEE/CVF International Conference on Computer Vi- sion, 2021, pp. 14 458–14 467. 5

    2021

  52. [60]

    ReconX: Reconstruct any scene from sparse views with video diffusion model,

    F. Liu, W. Sun, H. Wang, Y . Wang, H. Sun, J. Ye, J. Zhang, and Y . Duan, “ReconX: Reconstruct any scene from sparse views with video diffusion model,” arXiv preprint arXiv:2408.16767, 2024. 2, 3, 4

    2024 arXiv

  53. [61]

    One-2-3-45++: Fast single image to 3D objects with consistent multi-view generation and 3D diffusion,

    M. Liu, R. Shi, L. Chen, Z. Zhang, C. Xu, X. Wei, H. Chen, C. Zeng, J. Gu, and H. Su, “One-2-3-45++: Fast single image to 3D objects with consistent multi-view generation and 3D diffusion,” in Proceedings of the IEEE/CVF Con- ference on Computer Vision and Pattern Recognition,...

    2024

  54. [62]

    Zero-1-to-3: Zero-shot one image to 3D object,

    R. Liu, R. Wu, B. V . Hoorick, P. Tokmakov, S. Zakharov, and C. V ondrick, “Zero-1-to-3: Zero-shot one image to 3D object,” arXiv preprint arXiv:2303.11328, 2023. 2

    2023 arXiv

  55. [63]

    Sora: A review on back- ground, technology, limitations, and opportunities of large vision models,

    Y . Liu, K. Zhang, Y . Li, Z. Yan, C. Gao, R. Chen, Z. Yuan, Y . Huang, H. Sun, J. Gao et al., “Sora: A review on back- ground, technology, limitations, and opportunities of large vision models,” arXiv preprint arXiv:2402.17177, 2024. 3

    2024 arXiv

  56. [64]

    Won- der3D: Single image to 3D using cross-domain diffusion,

    X. Long, Y .-C. Guo, C. Lin, Y . Liu, Z. Dou, L. Liu, Y . Ma, S.-H. Zhang, M. Habermann, C. Theobalt et al. , “Won- der3D: Single image to 3D using cross-domain diffusion,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024, pp. 9970–9980. 3

    2024

  57. [65]

    GenEx: Generating an explorable world,

    T. Lu, T. Shu, J. Xiao, L. Ye, J. Wang, C. Peng, C. Wei, D. Khashabi, R. Chellappa, A. Yuille et al. , “GenEx: Generating an explorable world,” arXiv preprint arXiv:2412.09624, 2024. 3

    2024 arXiv

  58. [66]

    TrackNeRF: Bun- dle adjusting NeRF from sparse and noisy views via fea- ture tracks,

    J. Mai, W. Zhu, S. Rojas, J. Zarzar, A. Hamdi, G. Qian, B. Li, S. Giancola, and B. Ghanem, “TrackNeRF: Bun- dle adjusting NeRF from sparse and noisy views via fea- ture tracks,” in Proceedings of the IEEE/CVF Confer- ence on Computer Vision and Pattern Recognition , vol. abs/2...

    2024 arXiv

  59. [67]

    Snap video: Scaled spatiotemporal transformers for text-to-video synthesis,

    W. Menapace, A. Siarohin, I. Skorokhodov, E. Deyneka, T.-S. Chen, A. Kag, Y . Fang, A. Stoliar, E. Ricci, J. Ren et al., “Snap video: Scaled spatiotemporal transformers for text-to-video synthesis,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recog...

    2024

  60. [68]

    Mixed precision training,

    P. Micikevicius, S. Narang, J. Alben, G. Diamos, E. Elsen, D. Garcia, B. Ginsburg, M. Houston, O. Kuchaiev, G. Venkatesh et al. , “Mixed precision training,” arXiv preprint arXiv:1710.03740, 2017. 6

    2017 arXiv

  61. [69]

    NeRF: Representing scenes as neural radiance fields for view synthesis,

    B. Mildenhall, P. P. Srinivasan, M. Tancik, J. T. Barron, R. Ramamoorthi, and R. Ng, “NeRF: Representing scenes as neural radiance fields for view synthesis,” Communica- tions of the ACM , vol. 65, no. 1, pp. 99–106, 2021. 2, 3, 4

    2021

  62. [70]

    Scalable diffusion models with transformers,

    W. Peebles and S. Xie, “Scalable diffusion models with transformers,” in Proceedings of the IEEE/CVF Interna- tional Conference on Computer Vision , 2023, pp. 4195–

    2023

  63. [71]

    SDXL: Im- proving latent diffusion models for high-resolution image synthesis,

    D. Podell, Z. English, K. Lacey, A. Blattmann, T. Dock- horn, J. M ¨uller, J. Penna, and R. Rombach, “SDXL: Im- proving latent diffusion models for high-resolution image synthesis,” arXiv preprint arXiv:2307.01952, 2023. 8

    2023 arXiv

  64. [72]

    Dream- Fusion: Text-to-3D using 2D diffusion,

    B. Poole, A. Jain, J. T. Barron, and B. Mildenhall, “Dream- Fusion: Text-to-3D using 2D diffusion,” in Proceedings of the International Conference on Learning Representations,

  65. [73]

    Magic123: One image to high-quality 3D ob- ject generation using both 2D and 3D diffusion priors,

    G. Qian, J. Mai, A. Hamdi, J. Ren, A. Siarohin, B. Li, H. Lee, I. Skorokhodov, P. Wonka, S. Tulyakov, and B. Ghanem, “Magic123: One image to high-quality 3D ob- ject generation using both 2D and 3D diffusion priors,” in Proceedings of the International Conference on Learning R...

    2024

  66. [74]

    L4GM: Large 4D Gaussian reconstruction model,

    J. Ren, K. Xie, A. Mirzaei, H. Liang, X. Zeng, K. Kreis, Z. Liu, A. Torralba, S. Fidler, S. W. Kim et al., “L4GM: Large 4D Gaussian reconstruction model,” arXiv preprint arXiv:2406.10324, 2024. 3

    2024 arXiv

  67. [75]

    High-resolution image synthesis with latent diffusion models,

    R. Rombach, A. Blattmann, D. Lorenz, P. Esser, and B. Ommer, “High-resolution image synthesis with latent diffusion models,” in Proceedings of the IEEE/CVF Con- ference on Computer Vision and Pattern Recognition, 2022, pp. 10 684–10 695. 2, 5

    2022

  68. [76]

    ZeroNVS: Zero-shot 360-degree view synthesis from a single image,

    K. Sargent, Z. Li, T. Shah, C. Herrmann, H.-X. Yu, Y . Zhang, E. R. Chan, D. Lagun, L. Fei-Fei, D. Sun, and J. Wu, “ZeroNVS: Zero-shot 360-degree view synthesis from a single image,” arXiv preprint arXiv:2310.17994 ,

    arXiv

  69. [77]

    Structure-from- motion revisited,

    J. L. Sch ¨onberger and J.-M. Frahm, “Structure-from- motion revisited,” in Proceedings of the IEEE Confer- ence on Computer Vision and Pattern Recognition (CVPR),

  70. [78]

    Pixelwise view selection for unstructured multi- view stereo,

    J. L. Sch ¨onberger, E. Zheng, M. Pollefeys, and J.-M. Frahm, “Pixelwise view selection for unstructured multi- view stereo,” in Proceedings of the European Conference on Computer Vision (ECCV), 2016. 6

    2016

  71. [79]

    Generative Gaussian splatting: Generating 3D scenes with video diffu- sion priors,

    K. Schwarz, N. Mueller, and P. Kontschieder, “Generative Gaussian splatting: Generating 3D scenes with video diffu- sion priors,” arXiv preprint arXiv:2503.13272, 2025. 3

    2025 arXiv

  72. [80]

    MV- Dream: Multi-view diffusion for 3D generation,

    Y . Shi, P. Wang, J. Ye, M. Long, K. Li, and X. Yang, “MV- Dream: Multi-view diffusion for 3D generation,” arXiv preprint arXiv:2308.16512, 2023. 2, 3

    2023 arXiv

  73. [81]

    RealmDreamer: Text-driven 3D scene generation with inpainting and depth diffusion,

    J. Shriram, A. Trevithick, L. Liu, and R. Ramamoor- thi, “RealmDreamer: Text-driven 3D scene generation with inpainting and depth diffusion,” arXiv preprint arXiv:2404.07199, 2024. 2, 3

    2024 arXiv

  74. [82]

    Very deep convolutional networks for large- scale image recognition,

    K. Simonyan, “Very deep convolutional networks for large- scale image recognition,” arXiv preprint arXiv:1409.1556,

    arXiv

  75. [83]

    Score-based generative modeling through stochastic differential equations,

    Y . Song, J. Sohl-Dickstein, D. P. Kingma, A. Kumar, S. Ermon, and B. Poole, “Score-based generative modeling through stochastic differential equations,” arXiv preprint arXiv:2011.13456, 2020. 2

    2011 arXiv

  76. [84]

    DimensionX: Create any 3D and 4D scenes from a single image with controllable video diffusion,

    W. Sun, S. Chen, F. Liu, Z. Chen, Y . Duan, J. Zhang, and Y . Wang, “DimensionX: Create any 3D and 4D scenes from a single image with controllable video diffusion,” arXiv preprint arXiv:2411.04928, 2024. 3

    2024 arXiv

  77. [85]

    Flash3D: Feed-forward generalisable 3D scene reconstruction from a single image,

    S. Szymanowicz, E. Insafutdinov, C. Zheng, D. Campbell, J. F. Henriques, C. Rupprecht, and A. Vedaldi, “Flash3D: Feed-forward generalisable 3D scene reconstruction from a single image,” arXiv preprint arXiv:2406.04343, 2024. 2

    2024 arXiv

  78. [86]

    Splatter image: Ultra-fast single-view 3D reconstruction,

    S. Szymanowicz, C. Rupprecht, and A. Vedaldi, “Splatter image: Ultra-fast single-view 3D reconstruction,” in Pro- ceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024, pp. 10 208–10 217. 2

    2024

  79. [87]

    Bolt3D: Generating 3D scenes in seconds,

    S. Szymanowicz, J. Y . Zhang, P. Srinivasan, R. Gao, A. Brussee, A. Holynski, R. Martin-Brualla, J. T. Barron, and P. Henzler, “Bolt3D: Generating 3D scenes in seconds,” arXiv preprint arXiv:2503.14445, 2025. 3

    2025

  80. [88]

    LGM: Large multi-view Gaussian model for high-resolution 3D content creation,

    J. Tang, Z. Chen, X. Chen, T. Wang, G. Zeng, and Z. Liu, “LGM: Large multi-view Gaussian model for high-resolution 3D content creation,” arXiv preprint arXiv:2402.05054, 2024. 2

    2024 arXiv

  81. [89]

    TripoSR: Fast 3D object reconstruction from a single image,

    D. Tochilkin, D. Pankratz, Z. Liu, Z. Huang, A. Letts, Y . Li, D. Liang, C. Laforte, V . Jampani, and Y .-P. Cao, “TripoSR: Fast 3D object reconstruction from a single image,” arXiv preprint arXiv:2403.02151, 2024. 2

    2024 arXiv

  82. [90]

    FVD: A new metric for video generation,

    T. Unterthiner, S. van Steenkiste, K. Kurach, R. Marinier, M. Michalski, and S. Gelly, “FVD: A new metric for video generation,” in Proceedings of the ICLR Workshop on Deep Generative Models for Highly Structured Data, 2019. 6

    2019

  83. [91]

    SV3D: Novel multi-view synthesis and 3D generation from a single image using latent video diffusion,

    V . V oleti, C.-H. Yao, M. Boss, A. Letts, D. Pankratz, D. Tochilkin, C. Laforte, R. Rombach, and V . Jampani, “SV3D: Novel multi-view synthesis and 3D generation from a single image using latent video diffusion,” in Pro- ceedings of the European Conference on Computer Vision....

    2024

  84. [92]

    VistaDream: Sampling multiview consistent im- ages for single-view scene reconstruction,

    H. Wang, Y . Liu, Z. Liu, W. Wang, Z. Dong, and B. Yang, “VistaDream: Sampling multiview consistent im- ages for single-view scene reconstruction,” arXiv preprint arXiv:2410.16892, 2024. 3

    2024 arXiv

  85. [93]

    CPA: Camera-pose-awareness diffusion transformer for video generation,

    Y . Wang, J. Zhang, P. Jiang, H. Zhang, J. Chen, and B. Li, “CPA: Camera-pose-awareness diffusion transformer for video generation,” arXiv preprint arXiv:2412.01429, 2024. 3

    2024 arXiv

  86. [94]

    ProlificDreamer: High-fidelity and diverse text- to-3D generation with variational score distillation,

    Z. Wang, C. Lu, Y . Wang, F. Bao, C. Li, H. Su, and J. Zhu, “ProlificDreamer: High-fidelity and diverse text- to-3D generation with variational score distillation,” Ad- vances in Neural Information Processing Systems, vol. 36, pp. 8406–8441, 2023. 3

    2023

  87. [95]

    Image quality assessment: From error visibility to struc- tural similarity,

    Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, “Image quality assessment: From error visibility to struc- tural similarity,” IEEE Transactions on Image Processing , vol. 13, no. 4, pp. 600–612, 2004. 7, 6

    2004

  88. [96]

    MotionCtrl: A unified and flexible motion controller for video generation,

    Z. Wang, Z. Yuan, X. Wang, Y . Li, T. Chen, M. Xia, P. Luo, and Y . Shan, “MotionCtrl: A unified and flexible motion controller for video generation,” in Proceedings of ACM SIGGRAPH 2024, 2024, pp. 1–11. 3, 6

    2024

  89. [97]

    ReconFusion: 3D reconstruction with diffu- sion priors,

    R. Wu, B. Mildenhall, P. Henzler, K. Park, R. Gao, D. Wat- son, P. P. Srinivasan, D. Verbin, J. T. Barron, B. Poole, and A. Holynski, “ReconFusion: 3D reconstruction with diffu- sion priors,” arXiv preprint arXiv:2312.02981, 2023. 2, 3

    2023 arXiv

  90. [98]

    3DTrajMaster: Mastering 3D trajectory for multi-entity motion in video generation,

    F. Xiao, X. Liu, X. Wang, S. Peng, M. Xia, X. Shi, Z. Yuan, P. Wan, D. Zhang, and D. Lin, “3DTrajMaster: Mastering 3D trajectory for multi-entity motion in video generation,” in Proceedings of the International Conference on Learning Representations, 2024. 3

    2024

  91. [99]

    Trajectory attention for fine-grained video motion control,

    Z. Xiao, W. Ouyang, Y . Zhou, S. Yang, L. Yang, J. Si, and X. Pan, “Trajectory attention for fine-grained video motion control,” arXiv preprint arXiv:2411.19324, 2024. 3

    2024 arXiv

  92. [100]

    SV4D: Dynamic 3D content generation with multi-frame and multi-view consistency,

    Y . Xie, C.-H. Yao, V . V oleti, H. Jiang, and V . Jam- pani, “SV4D: Dynamic 3D content generation with multi-frame and multi-view consistency,” arXiv preprint arXiv:2407.17470, 2024. 3

    2024 arXiv

  93. [101]

    Comp4D: LLM-guided compositional 4D scene generation,

    D. Xu, H. Liang, N. P. Bhatt, H. Hu, H. Liang, K. N. Platan- iotis, and Z. Wang, “Comp4D: LLM-guided compositional 4D scene generation,” arXiv preprint arXiv:2403.16993 ,

    arXiv

  94. [102]

    CamCo: Camera-controllable 3D- consistent image-to-video generation,

    D. Xu, W. Nie, C. Liu, S. Liu, J. Kautz, Z. Wang, and A. Vahdat, “CamCo: Camera-controllable 3D- consistent image-to-video generation,” arXiv preprint arXiv:2406.02509, 2024. 3, 6, 4

    2024 arXiv

  95. [103]

    AGG: Amortized generative 3D Gaussians for single image to 3D,

    D. Xu, Y . Yuan, M. Mardani, S. Liu, J. Song, Z. Wang, and A. Vahdat, “AGG: Amortized generative 3D Gaussians for single image to 3D,” arXiv preprint arXiv:2401.04099,

    arXiv

  96. [104]

    ControLRM: Fast and controllable 3D gen- eration via large reconstruction model,

    H. Xu, W. Chen, Z. Zhou, F. Xiao, B. Sun, M. Z. Shou, and W. Kang, “ControLRM: Fast and controllable 3D gen- eration via large reconstruction model,” arXiv preprint arXiv:2410.09592, 2024. 2

    2024 arXiv

  97. [105]

    GRM: Large Gaussian reconstruction model for efficient 3D reconstruction and generation,

    Y . Xu, Z. Shi, W. Yifan, H. Chen, C. Yang, S. Peng, Y . Shen, and G. Wetzstein, “GRM: Large Gaussian reconstruction model for efficient 3D reconstruction and generation,” in Proceedings of the European Conference on Computer Vi- sion. Springer, 2024, pp. 1–20. 2

    2024

  98. [106]

    Diffusion 2: Dynamic 3D content generation via score composi- tion of orthogonal diffusion models,

    Z. Yang, Z. Pan, C. Gu, and L. Zhang, “Diffusion 2: Dynamic 3D content generation via score composi- tion of orthogonal diffusion models,” arXiv preprint arXiv:2404.02148, 2024. 3

    2024 arXiv

  99. [107]

    CogVideoX: Text-to-video diffusion models with an expert transformer,

    Z. Yang, J. Teng, W. Zheng, M. Ding, S. Huang, J. Xu, Y . Yang, W. Hong, X. Zhang, G. Feng, D. Yin, X. Gu, Y . Zhang, W. Wang, Y . Cheng, T. Liu, B. Xu, Y . Dong, and J. Tang, “CogVideoX: Text-to-video diffusion models with an expert transformer,” arXiv preprint arXiv:2408.06072 ,

    arXiv

  100. [108]

    pixelNeRF: Neural radiance fields from one or few images,

    A. Yu, V . Ye, M. Tancik, and A. Kanazawa, “pixelNeRF: Neural radiance fields from one or few images,” arXiv preprint arXiv:2012.02190, 2021. 3

    2012 arXiv

  101. [109]

    WonderWorld: Interactive 3D scene generation from a single image,

    H.-X. Yu, H. Duan, C. Herrmann, W. T. Freeman, and J. Wu, “WonderWorld: Interactive 3D scene generation from a single image,” arXiv preprint arXiv:2406.09394 ,

    arXiv

  102. [110]

    Won- derJourney: Going from anywhere to everywhere,

    H.-X. Yu, H. Duan, J. Hur, K. Sargent, M. Rubinstein, W. T. Freeman, F. Cole, D. Sun, N. Snavely, J. Wu et al., “Won- derJourney: Going from anywhere to everywhere,” in Pro- ceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024, pp. 6658–6667. 2, 8, 3

    2024

  103. [111]

    Vector-quantized image modeling with improved VQGAN,

    J. Yu, X. Li, J. Y . Koh, H. Zhang, R. Pang, J. Qin, A. Ku, Y . Xu, J. Baldridge, and Y . Wu, “Vector-quantized image modeling with improved VQGAN,” arXiv preprint arXiv:2110.04627, 2021. 5

    2021 arXiv

  104. [112]

    ViewCrafter: Taming video diffusion models for high-fidelity novel view synthe- sis,

    W. Yu, J. Xing, L. Yuan, W. Hu, X. Li, Z. Huang, X. Gao, T.-T. Wong, Y . Shan, and Y . Tian, “ViewCrafter: Taming video diffusion models for high-fidelity novel view synthe- sis,” arXiv preprint arXiv:2409.02048, 2024. 2, 3, 6, 7, 8, 4

    2024 arXiv

  105. [113]

    Generative photography: Scene-consistent camera control for realistic text-to-image synthesis,

    Y . Yuan, X. Wang, Y . Sheng, P. Chennuri, X. Zhang, and S. Chan, “Generative photography: Scene-consistent camera control for realistic text-to-image synthesis,” arXiv preprint arXiv:2412.02168, 2024. 3

    2024 arXiv

  106. [114]

    GS-LRM: Large reconstruction model for 3D Gaussian splatting,

    K. Zhang, S. Bi, H. Tan, Y . Xiangli, N. Zhao, K. Sunkavalli, and Z. Xu, “GS-LRM: Large reconstruction model for 3D Gaussian splatting,” arXiv preprint arXiv:2404.19702,

    arXiv

  107. [115]

    Adding conditional control to text-to-image diffusion models,

    L. Zhang, A. Rao, and M. Agrawala, “Adding conditional control to text-to-image diffusion models,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023, pp. 3836–3847. 3, 4

    2023

  108. [116]

    The unreasonable effectiveness of deep features as a perceptual metric,

    R. Zhang, P. Isola, A. A. Efros, E. Shechtman, and O. Wang, “The unreasonable effectiveness of deep features as a perceptual metric,” inProceedings of the IEEE Confer- ence on Computer Vision and Pattern Recognition , 2018, pp. 586–595. 5, 7, 6

    2018

  109. [117]

    GenXD: Generating any 3D and 4D scenes,

    Y . Zhao, C.-C. Lin, K. Lin, Z. Yan, L. Li, Z. Yang, J. Wang, G. H. Lee, and L. Wang, “GenXD: Generating any 3D and 4D scenes,” arXiv preprint arXiv:2411.02319, 2024. 3

    2024 arXiv

  110. [118]

    Stereo magnification: Learning view synthesis using mul- tiplane images,

    T. Zhou, R. Tucker, J. Flynn, G. Fyffe, and N. Snavely, “Stereo magnification: Learning view synthesis using mul- tiplane images,” arXiv preprint arXiv:1805.09817, 2018. 2, 5, 6

    2018 arXiv

  111. [119]

    Long-LRM: Long-sequence large reconstruction model for wide-coverage Gaussian splats,

    C. Ziwen, H. Tan, K. Zhang, S. Bi, F. Luan, Y . Hong, L. Fuxin, and Z. Xu, “Long-LRM: Long-sequence large reconstruction model for wide-coverage Gaussian splats,” arXiv preprint arXiv:2410.12781, 2024. 2 Wonderland: Navigating 3D Scenes from a Single Image Supplementary Materi...

    2024 arXiv

Pith tools

Reviewed August 11, 2026 · model on record in the stance chip above.