Pith. sign in

REVIEW 3 major objections 5 minor 2 cited by

MVGenMaster: Scaling Multi-View Generation from Any Image via 3D Priors Enhanced Diffusion Model

T0 review · 3 major / 5 minor · reviewed 2026-08-12 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read Feeding a multi-view diffusion model metric-depth-warped RGB and canonical coordinate maps yields enough 3D consistency to synthesize up to 100 novel views in one pass, beating 2D-only and video-based NVS baselines.

desk verdict MVGenMaster is a credible, well-ablated advance in multi-view diffusion NVS, but its headline generalization claim rests on inference-time metric depth that is never quantitatively stress-tested. read the letter →

arxiv 2411.16157 v3 pith:5AUDH4FZ submitted 2024-11-25 cs.CV

Chenjie Cao , Chaohui Yu , Shang Liu , Fan Wang , Xiangyang Xue , Yanwei Fu This is my paper · ORCID
classification cs.CV
keywords novelviewsynthesismulti-viewdiffusion3Dpriorsmetricdepthcanonicalcoordinatemapkey-rescalinglatentmodelGaussiansplatting
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper aims to show that feeding a multi-view diffusion model genuinely geometric guidance—RGB pixels and canonical coordinate maps warped from reference views through metric depth and camera poses—makes novel view synthesis more generalizable and more 3D-consistent than 2D-only multi-view diffusion. The proposed model, MVGenMaster, builds on a CAT3D-style full-attention diffusion backbone, is trained on a new dataset of about 1.6 million scenes with aligned metric depth, and adds a training-free key-rescaling trick that preserves reference guidance when generating long sequences. If the claim holds, a single forward pass produces up to 100 novel views from one or several reference images, and the model outperforms ViewCrafter and the authors' own re-implementation of CAT3D on in-domain and zero-shot benchmarks, with the largest margins on unordered viewpoints and on 3D Gaussian Splatting reconstruction quality. The practical payoff is that consistent multi-view generation becomes a one-shot operation able to feed cheap 3D reconstruction pipelines.

What carries the argument

The load-bearing object is the warped 3D prior pair: warped RGB pixels $I_{i\to j}^{\text{warp}}$ and warped canonical coordinate maps $C_{i\to j}^{\text{warp}}$, produced by the geometric warping relation $x_j \simeq K_j P_{i\to j}\hat{D}_i(x_i)K_i^{-1}x_i$ using metric depth and relative camera pose. The CCM is the per-pixel 3D world coordinate, normalized and Fourier-embedded, giving the model explicit global position and occlusion information that warped color alone cannot supply. Three supporting mechanisms carry the rest: (1) metric depth alignment $\hat{D}=D\cdot r+s$ with a RANSAC-fit scale and shift that lets training monocular depth match SfM scale; (2) a CAT3D-style backbone with full self-attention across all reference and target views plus Plücker-ray pose embedding, so priors fuse pixel-wise through attention; and (3) training-free key-rescaling, which scales reference-view key features by $\gamma\approx 1.2$ in every attention module to counter attention dilution on sequences past 25 views, the mechanism that unlocks 100-view (up to 158-view on an 80GB GPU) generation in a single pass.

What would settle it

A controlled perturbation test would settle the claim: take a fixed single-view input and generate the same target views twice—once with the model's normal metric depth, once with that depth deliberately mis-scaled or mis-shifted while keeping poses, masks, and all other inputs identical—then compare PSNR/LPIPS and a 3DGS reconstruction score. A near-zero gap would mean the 3D priors are not carrying the gains; a large gap would confirm they are and locate the method's ceiling in inference-time depth quality.

Watch

Extended reading notes

Core claim

The central claim is that explicit 3D priors warped from reference views into target views—warped RGB pixels and warped canonical coordinate maps (CCM), computed with metric depth and camera poses—substantially strengthen a multi-view latent diffusion model for novel view synthesis. MVGenMaster conditions the diffusion process on these priors together with Plücker-ray pose embeddings, so that for every target view the model sees where each reference pixel lands in 3D and in the target camera, with occlusion conflicts resolved by keeping the nearest depth. Depth is the enabling variable: in training, monocular depth is aligned to sparse SfM or MVS points by a single RANSAC scale $r$ and shift $s$ via $\hat{D}=D\cdot r+s$, and at inference Depth-Pro or Dust3R supplies metric depth for one or several views. Because the priors are pixel-aligned and injected as full-resolution RGB plus 1/8-resolution coordinate maps, the model learns to consult them through self-attention rather than a separate cross-attention branch. The paper further claims the model handles single-view, two-view interpolation, and arbitrary-reference NVS in one forward pass, and that key-rescaling—multiplying reference-view key features by $\gamma\approx 1.2$ inside self-attention—extends reliable generation from about 25 views to over 100 without iterative anchor generation.

Load-bearing premise

The results stand on the assumption that inference-time metric depth (Depth-Pro for one view, Dust3R for several) is accurate and consistent with the camera poses, because the warped RGB and coordinate-map priors are only truthful scene geometry when the depth is; the paper exhibits one resilient case with wrong depth and reports background artifacts on ambiguous references, but gives no controlled failure-rate numbers.

Editorial extensions

If this is right

  • One-shot NVS: a single forward pass yields up to 100 consistent views from one image, removing anchor-based iterative generation and its artifact accumulation for downstream tasks.
  • Cheaper 3D reconstruction: the generated views feed 3D Gaussian Splatting more consistent geometry, improving reconstruction scores on zero-shot datasets relative to ViewCrafter and CAT3D*.
  • Sparse-view flexibility: increasing reference views from 1 to 3, 5, or 7 monotonically improves NVS quality, and unordered target viewpoints become as easy as ordered trajectories.
  • Training scale is load-bearing: adding datasets up to 1.6 million scenes with metric-depth coverage steadily improves zero-shot generalization, indicating NVS training is data-hungry.
  • The key-rescaling fix transfers: full-attention models trained on short multi-view sequences can extend to long sequences without retraining by amplifying reference key features.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • If metric depth is the true source of the gains, pairing the model with stronger or jointly trained depth estimators should push consistency further; the paper treats depth as an external input and leaves this coupling open.
  • Key-rescaling suggests a general principle for full-attention generative models: beyond the training sequence length, conditioning tokens lose attention share, and a constant key amplification restores them—testable on other attention-based image generators.
  • The design predicts that residual errors should concentrate at occlusion boundaries where warped priors are least reliable; the paper's aggregate benchmarks do not isolate that localization, so a per-pixel error map over target views would test it.
  • Because direct input concatenation of CCM features beat cross-attention injection in the ablations, pixel-aligned geometric conditioning may be generally preferable to learned cross-attention interfaces in geometry-conditioned diffusion models.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 5 minor

Summary. The paper introduces MVGenMaster, a multi-view latent diffusion model for novel view synthesis that conditions on reference images, camera poses (Plücker rays), and geometric 3D priors obtained by warping RGB pixels and canonical coordinate maps (CCMs) using metric depth. Training uses a newly assembled dataset MvD-1M of up to 1.6 million scenes with metric depth obtained by aligning monocular depth to SfM/MVS with a per-scene scale and shift. At inference, depth is predicted by Depth-Pro (single view) or Dust3R (multi-view). The paper also proposes a training-free key-rescaling technique to reduce attention dilution when generating many views in a single forward pass, enabling up to 100 views. The method is evaluated on object-centric and scene-level NVS benchmarks, including zero-shot datasets, and compared against ViewCrafter and a re-implemented CAT3D*; it also evaluates 3DGS reconstruction quality. The central claims are that 3D priors enhance generalization and consistency, that the dataset and training modifications improve scalability, and that key-rescaling extends the supported view count.

Significance. If the results hold, MVGenMaster is a strong empirical contribution: it unifies 3D geometric priors with a multi-view diffusion backbone, demonstrates a scalable data recipe, and shows that a simple attention rescaling can extend generation to many views without retraining. The ablations in Tables 4–7 support the internal claims that 3D priors, dataset scaling, and key-rescaling each help. The promise to release code, models, and data is a concrete asset for reproducibility. However, the headline claims are tempered by the absence of any statistical uncertainty quantification and by the lack of a quantitative robustness analysis of the depth-prior component, which is the key novel ingredient.

major comments (3)
  1. [§3.1, §3.2, Fig. 14] The central claim that 3D priors 'significantly enhance generalization and 3D consistency' rests on inference-time metric depth from Depth-Pro or Dust3R producing warped RGB and CCM priors that are well aligned with the target camera poses. Training depth is aligned to SfM/MVS with a single global scale r and shift s per scene (Eq. 2), and the paper asserts robustness to imperfect depth via dropout and inconsistent multi-view alignment, but the only evidence is one qualitative failure case (Fig. 14). Section 3.3 itself shows that ambiguous priors can mislead the model (the duplicate vases at M=50). Please quantify robustness: report NVS metrics under controlled scale/shift perturbations of the inference depth, compare against an oracle-depth variant on the zero-shot benchmarks, and report the fraction of test scenes where alignment is poor (e.g., via reprojection-error thresholds). Without such numbers, the claimed generalization advantage over CAT3D* cannot be attributed to the depth priors.
  2. [Tables 2, 3, 5–7] All quantitative results are reported as point estimates with no error bars, no number of evaluation scenes per benchmark, and no significance tests. The zero-shot benchmarks (DTU, MipNeRF-360, Tanks-and-Temples, ETH3D) contain only small numbers of scenes, and several comparisons show modest differences (e.g., Table 2, DL3DV+Real10k, 1-view: CAT3D* PSNR 15.476 vs MVGenMaster 15.729, a 0.25 dB gap). Please provide variance across at least three independent evaluation runs or bootstrap confidence intervals, and state how many scenes are used for each benchmark. This is needed to substantiate the state-of-the-art claims.
  3. [§3.3, Tables 12–13] The key-rescaling scale γ is reported as 1.2 based on the detailed ablation in Table 13 of the supplementary, and the main-view-extension ablation in Table 7 is on MipNeRF-360, which is also a zero-shot test dataset in Tables 2 and 3. If γ is selected using the MipNeRF-360 benchmark, this is evaluation leakage that inflates the view-extension and reconstruction results on that dataset. Please either select γ on a validation split that is not used in any reported test table, or demonstrate robustness by reporting results for γ ∈ {1.0, 1.1, 1.2, 1.3} across the full zero-shot suite rather than a single benchmark.
minor comments (5)
  1. [§4.1, after Table 3] The text refers to 'ViewCafter-sparse'; this should be 'ViewCrafter-sparse'.
  2. [Figure 3 caption] The caption 'MVSdepth(maskfiltered)/Colmappoints' is missing spaces and should read 'MVS depth (mask filtered) / Colmap points'.
  3. [§3.1, Eq. (2)] The sentence 'we force the minimal r ≥ 0.1 std(DSf M) std(D)' is ambiguous; it should be written as 'we constrain r ≥ 0.1 · std(DSfM) / std(D)'.
  4. [Table 5] The header layout of Table 5 is confusing: the entries 'conv cross-attn latent pixel' appear to be a single row spanning multiple columns. Please reformat the table so that the prior-type and warp-type conditions are clearly separated.
  5. [§4.1] The phrase 'a single forward process' is used consistently in the abstract and introduction, but the supplementary text says 'once NVS inference'; unify the phrasing.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the 3D-prior gains are measured by a controlled CAT3D* ablation, and no reported result is reconstructed from its own target or from a self-citation chain.

full rationale

MVGenMaster is an empirical systems paper whose derivation chain is a training/evaluation loop rather than a formal proof. The central claim that warped metric-depth RGB and CCM priors improve NVS is tested directly by the CAT3D* ablation, defined in the paper as MVGenMaster re-implemented without 3D priors, so the improvement is measured rather than assumed. The 3D priors are computed from reference images, metric depth, and camera poses; target-view ground truth is never used to build the conditioning inputs, so the prediction target does not feed back into the predictor. The citation of the first author's MVSFormer++ for generating training depth is a data-engineering tool, not a load-bearing proof step, and the paper explicitly treats inconsistent multi-view depth alignment as regularization with a qualitative robustness check, making the inference-depth assumption an empirical robustness concern rather than circular reasoning. The choice of key-rescaling gamma = 1.2 on a benchmark test set is an evaluation-hygiene concern about potential selection on the test set, not a circular derivation. No equation equates a reported prediction to a fitted input, and no uniqueness theorem or prior claim by the same authors is invoked to force the design.

Assumptions & free parameters 4 free parameters · 6 assumptions · 0 invented entities

The method rests on a chain of depth-related assumptions: training depth alignment via RANSAC scale and shift, inference depth from external models, and transfer of the SD2/CAT3D backbone to long multi-view sequences. No new physical entities are postulated; the main hand-tuned inference parameter affecting the headline view-extension result is the key-rescaling scale gamma.

free parameters (4)
  • key-rescaling scale gamma = 1.2 (for 28 < N+M <= 158)
    Multiplicative constant applied to reference-view keys in all self-attention layers (Section 3.3, Figure 4b). Chosen empirically from ablations on MipNeRF-360 (Tables 7 and 12); the view-extension results depend on this hand-set value.
  • CFG scale = 2.0
    Classifier-free guidance scale used for all inference results (Section 4, Implementation Details); not swept in the paper, but it scales the model output and affects every reported metric.
  • Minimum depth alignment scale ratio = r >= 0.1 * std(DSfM) / std(D)
    Constraint on per-scene scale r in Eq. 2 to prevent RANSAC from collapsing to r = 0 during metric depth alignment for training data (Section 3.1, Figure 3).
  • 3D prior and Plucker ray dropout rates = 15% and 10%
    Dropout rates for 3D priors and Plucker ray conditioning used for classifier-free guidance training (Section 4, Implementation Details); selected by hand and used for all experiments.
assumptions (6)
  • domain assumption Per-scene RANSAC alignment of monocular depth to sparse SfM/MVS points produces metric depth (Eq. 2: D_hat = D*r + s).
    All training 3D priors are built from this alignment. If alignment fails, warped priors are wrong; the paper claims robustness via dropout but does not quantify failure rates.
  • domain assumption Depth-Pro (single view) and Dust3R (multi-view) provide metric depth and usable camera poses at inference.
    The inference pipeline depends on these external models; their accuracy on arbitrary images is assumed rather than validated inside this paper.
  • standard math Relative pose Pi->j and intrinsics Ki, Kj correctly model the pinhole geometry in Eq. 1.
    Standard projective geometry, so this is a standard mathematical assumption.
  • domain assumption The contract function based on median depth removes infinite far depth without harming near-field geometry.
    Used to convert unbounded depth to bounded 3D priors (Section 3.1); not separately validated.
  • domain assumption MvD-1M's 12 data domains, combined with dynamic sampling and the domain switcher, provide a balanced and transferable training distribution.
    The dataset-scaling claim (Table 4) depends on the assumption that combining these diverse sources does not introduce harmful distribution shift.
  • domain assumption The SD2 latent diffusion backbone can support 3D full attention across all views without temporal or positional encoding.
    The model drops positional encodings and relies on Plucker rays plus geometric priors for view structure; this is a design choice asserted by the authors.

how reviews work

0 comments
Cite this review

Pith. "Pith review of MVGenMaster: Scaling Multi-View Generation from Any Image via 3D Priors Enhanced Diffusion Model." pith.science (2026). https://pith.science/paper/5AUDH4FZ

@misc{pith2026241116157,
  author       = {Pith},
  title        = {Pith review of: MVGenMaster: Scaling Multi-View Generation from Any Image via 3D Priors Enhanced Diffusion Model},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/5AUDH4FZ}},
  note         = {Machine review of arXiv:2411.16157}
}
read the original abstract

We introduce MVGenMaster, a multi-view diffusion model enhanced with 3D priors to address versatile Novel View Synthesis (NVS) tasks. MVGenMaster leverages 3D priors that are warped using metric depth and camera poses, significantly enhancing both generalization and 3D consistency in NVS. Our model features a simple yet effective pipeline that can generate up to 100 novel views conditioned on variable reference views and camera poses with a single forward process. Additionally, we have developed a comprehensive large-scale multi-view image dataset called MvD-1M, comprising up to 1.6 million scenes, equipped with well-aligned metric depth to train MVGenMaster. Moreover, we present several training and model modifications to strengthen the model with scaled-up datasets. Extensive evaluations across in- and out-of-domain benchmarks demonstrate the effectiveness of our proposed method and data formulation. Models and codes will be released at https://github.com/ewrfcas/MVGenMaster/.

Figures

Figures reproduced from arXiv: 2411.16157 by the authors.

Figure 1
Figure 1. The proposed MVGenMaster handles various NVS scenarios properly as a master, including (a) NVS based on single-view text-to-image conditions, (b) interpolation between two known views, and (c) flexible NVS with variable reference views and arbitrary target views. MVGenMaster enables all tasks above with a single forward process without sophisticated iterative inference and dataset updating. Abstract We introduce MVG… view at source ↗
Figure 2
Figure 2. Overall pipeline of MVGenMaster. Inputs can be categorized into reference views (reference images and related camera poses) and target views (camera poses only). For training, we extract monocular depths from reference views and then align them with SfM to warp CCM and RGB pixels as 3D priors for target views. For inference, we utilize Depth-Pro [9] (single-view) or Dust3R [72] (multi-view) to obtain metric depth. M… view at source ↗
Figure 3
Figure 3. The metric depth alignment process for the training data of MVGenMaster. We achieve the rescale and shift coeffi￾cient by RANSAC, and then leverage them to align the monocular depth to metric one with a simple linear variation. 3D Priors. To obtain metric depth Dˆ in training, we improve the strategy used in [68], which aligns monocular depth D with sparse SfM points with RANSAC as shown in [PITH_FULL_IMAGE:figures… view at source ↗
Figures from the paper (12 more)
Figure 4
Figure 4. Figure 4: Key-rescaling. We employ 3-view references with am￾biguous 3D priors as noisy conditions for long sequential genera￾tion. Key-rescaling enhances the reference guidance and eliminates attention dilution, resulting in better NVS with mass target views. consistent appeara…
Figure 5
Figure 5. Figure 5: Qualitative NVS results compared among CAT3D*, ViewCrafter, and our MVGenMaster. The synthesis is based on (N = 1) reference view and (M = 24) target views. The leftmost column displays the reference view, while the remaining visualizations are uniformly sampled from t…
Figure 6
Figure 6. Figure 6: MVGenMaster handles different NVS downstream tasks with a flexible pipeline. impact on the full training set in [PITH_FULL_IMAGE:figures/full_fig_p007_6.png]
Figure 7
Figure 7. Figure 7: Illustration of (a) warped pixels vs latents, (b) domain switcher. The generated zoom-in number cards are framed in red. extensive and coherent target views without degradation. Dataset Scalability. We explore the impact of the dataset scalability for MVGenMaster train…
Figure 8
Figure 8. Figure 8: Illustration of MvD-1M used in MVGenMaster. o, d indicate the origin and direction of pixel-aligned rays respectively. We clarify that the cross-product result o × d is not scaling invariable due to different scales of o. Since the SfM results of different datasets con…
Figure 10
Figure 10. Figure 10: Limitation. The artifacts in the background caused by unclear and ambiguous background regions in the reference view.Ground truth Warp+Pose Ours (1-view) Ours (3-view) Ground truth Warp+Pose Ours (1-view) Ours (3-view) Reference 1 Reference 2, 3 Reference 1 Reference …
Figure 9
Figure 9. Figure 9: Visualization of the novel views from 3DGS recon￾struction on DTU, MipNeRF-360, and Tanks-and-Temples. 3DGS results are trained with 21 frames, while the other 4 frames are validated. Given the first and last frames, other views are generated by related methods. Refere…
Figure 12
Figure 12. Figure 12: Qualitative NVS results compared among CAT3D*, ViewCrafter, and our MVGenMaster from DL3DV, MVImgNet, and Co3Dv2. The synthesis is based on (N = 1) reference view and (M = 24) target views. The leftmost column displays the reference view, while the remaining visualiza…
Figure 13
Figure 13. Figure 13: Qualitative NVS results compared among CAT3D*, ViewCrafter, and our MVGenMaster from zero-shot datasets. The synthesis is based on (N = 1) reference view and (M = 24) target views. The leftmost column displays the reference view, while the remaining visualizations are…
Figure 14
Figure 14. Figure 14: Visualization of NVS results with inaccurate metric depth. Our method still shows good robustness. (a) 1-view NVS for text-to-image samples (b) 2-view NVS for interpolation [PITH_FULL_IMAGE:figures/full_fig_p019_14.png]
Figure 15
Figure 15. Figure 15: More results of MVGenMaster based on 1-view NVS and 2-view interpolation. 19 [PITH_FULL_IMAGE:figures/full_fig_p019_15.png]
Figure 16
Figure 16. Figure 16: NVS results with varying reference views. 20 [PITH_FULL_IMAGE:figures/full_fig_p020_16.png]

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. EarthCrafter: Scalable 3D Earth Generation via Dual-Sparse Latent Diffusion

    cs.CV 2025-07 conditional novelty 6.0 of 10

    EarthCrafter generates 600-meter-scale 3D Earth scenes using separate latent diffusion models for structure and texture, conditioned on semantics, images, or nothing.

  2. SpatialCrafter: Unleashing the Imagination of Video Diffusion Models for Scene Reconstruction from Limited Observations

    cs.CV 2025-05 conditional novelty 6.0 of 10

    SpatialCrafter generates camera-controlled video from sparse input views and reconstructs a 3D Gaussian scene from the generated video latents, improving novel view synthesis.

Reference graph

Works this paper leans on

91 extracted references · 58 canonical work pages · cited by 2 Pith papers

  1. [1]

    https://www.google.com/earth/ studio/

    Google earth. https://www.google.com/earth/ studio/. 4, 13

  2. [2]

    Large-scale data for multiple-view stereopsis

    Henrik Aanæs, Rasmus Ramsbøl Jensen, George V ogiatzis, Engin Tola, and Anders Bjorholm Dahl. Large-scale data for multiple-view stereopsis. International Journal of Computer Vision, 120:153–168, 2016. 5, 6

    2016

  3. [3]

    Denoising diffusion via image-based rendering

    Titas Anciukevicius, Fabian Manhardt, Federico Tombari, and Paul Henderson. Denoising diffusion via image-based rendering. In International Conference on Learning Repre- sentations, 2024. 2

    2024

  4. [4]

    Mip-nerf 360: Unbounded anti-aliased neural radiance fields

    Jonathan T Barron, Ben Mildenhall, Dor Verbin, Pratul P Srinivasan, and Peter Hedman. Mip-nerf 360: Unbounded anti-aliased neural radiance fields. In Proceedings of the IEEE/CVF conference on computer vision and pattern recog- nition, pages 5470–5479, 2022. 3, 5, 6

    2022

  5. [5]

    Zip-nerf: Anti-aliased grid- based neural radiance fields

    Jonathan T Barron, Ben Mildenhall, Dor Verbin, Pratul P Srinivasan, and Peter Hedman. Zip-nerf: Anti-aliased grid- based neural radiance fields. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 19697– 19705, 2023. 14

    2023

  6. [6]

    Improving image generation with better captions

    James Betker, Gabriel Goh, Li Jing, Tim Brooks, Jianfeng Wang, Linjie Li, Long Ouyang, Juntang Zhuang, Joyce Lee, Yufei Guo, et al. Improving image generation with better captions. Computer Science. https://cdn. openai. com/papers/dall-e-3. pdf, 2(3):8, 2023. 1, 2

    2023

  7. [7]

    Zoedepth: Zero-shot trans- fer by combining relative and metric depth

    Shariq Farooq Bhat, Reiner Birkl, Diana Wofk, Peter Wonka, and Matthias Müller. Zoedepth: Zero-shot trans- fer by combining relative and metric depth. arXiv preprint arXiv:2302.12288, 2023. 3

    arXiv 2023

  8. [8]

    Stable video diffusion: Scaling latent video diffusion models to large datasets

    Andreas Blattmann, Tim Dockhorn, Sumith Kulal, Daniel Mendelevitch, Maciej Kilian, Dominik Lorenz, Yam Levi, Zion English, Vikram V oleti, Adam Letts, et al. Stable video diffusion: Scaling latent video diffusion models to large datasets. arXiv preprint arXiv:2311.15127, 2023. 3

    arXiv 2023

Show all 91 references
  1. [9]

    Depth pro: Sharp monocular metric depth in less than a second

    Aleksei Bochkovskii, Amaël Delaunoy, Hugo Germain, Mar- cel Santos, Yichao Zhou, Stephan R Richter, and Vladlen Koltun. Depth pro: Sharp monocular metric depth in less than a second. arXiv preprint arXiv:2410.02073, 2024. 3, 4, 6

    2024 arXiv

  2. [10]

    Mvsformer++: Re- vealing the devil in transformer’s details for multi-view stereo

    Chenjie Cao, Xinlin Ren, and Yanwei Fu. Mvsformer++: Re- vealing the devil in transformer’s details for multi-view stereo. In International Conference on Learning Representations ,

  3. [11]

    Generative novel view synthesis with 3d-aware diffusion models

    Eric R Chan, Koki Nagano, Matthew A Chan, Alexander W Bergman, Jeong Joon Park, Axel Levy, Miika Aittala, Shalini De Mello, Tero Karras, and Gordon Wetzstein. Generative novel view synthesis with 3d-aware diffusion models. In Proceedings of the IEEE/CVF International Conferenc...

    2023

  4. [12]

    pixelsplat: 3d gaussian splats from image pairs for scalable generalizable 3d reconstruction

    David Charatan, Sizhe Lester Li, Andrea Tagliasacchi, and Vincent Sitzmann. pixelsplat: 3d gaussian splats from image pairs for scalable generalizable 3d reconstruction. In Proceed- ings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 19457–19467, 2024. 2

    2024

  5. [13]

    Fan- tasia3d: Disentangling geometry and appearance for high- quality text-to-3d content creation

    Rui Chen, Yongwei Chen, Ningxin Jiao, and Kui Jia. Fan- tasia3d: Disentangling geometry and appearance for high- quality text-to-3d content creation. In Proceedings of the IEEE/CVF international conference on computer vision , pages 22246–22256, 2023. 2

    2023

  6. [14]

    Mvsplat: Efficient 3d gaussian splatting from sparse multi-view images

    Yuedong Chen, Haofei Xu, Chuanxia Zheng, Bohan Zhuang, Marc Pollefeys, Andreas Geiger, Tat-Jen Cham, and Jianfei Cai. Mvsplat: Efficient 3d gaussian splatting from sparse multi-view images. In European Conference on Computer Vision, 2024. 2, 6, 8

    2024

  7. [15]

    Flashattention-2: Faster attention with better paral- lelism and work partitioning

    Tri Dao. Flashattention-2: Faster attention with better paral- lelism and work partitioning. In International Conference on Learning Representations, 2024. 5

    2024

  8. [16]

    Objaverse-xl: A universe of 10m+ 3d objects

    Matt Deitke, Ruoshi Liu, Matthew Wallingford, Huong Ngo, Oscar Michel, Aditya Kusupati, Alan Fan, Christian Laforte, Vikram V oleti, Samir Yitzhak Gadre, et al. Objaverse-xl: A universe of 10m+ 3d objects. Advances in Neural Information Processing Systems, 2023. 2

    2023

  9. [17]

    Objaverse: A universe of annotated 3d objects

    Matt Deitke, Dustin Schwenk, Jordi Salvador, Luca Weihs, Oscar Michel, Eli VanderBilt, Ludwig Schmidt, Kiana Ehsani, Aniruddha Kembhavi, and Ali Farhadi. Objaverse: A universe of annotated 3d objects. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Rec...

    2023

  10. [18]

    Scaling rectified flow trans- formers for high-resolution image synthesis

    Patrick Esser, Sumith Kulal, Andreas Blattmann, Rahim En- tezari, Jonas Müller, Harry Saini, Yam Levi, Dominik Lorenz, Axel Sauer, Frederic Boesel, et al. Scaling rectified flow trans- formers for high-resolution image synthesis. In Forty-first International Conference on Mach...

    2024

  11. [19]

    Scenescape: Text-driven consistent scene generation

    Rafail Fridman, Amit Abecasis, Yoni Kasten, and Tali Dekel. Scenescape: Text-driven consistent scene generation. Ad- vances in Neural Information Processing Systems, 36, 2023. 3

    2023

  12. [20]

    3d-future: 3d furni- ture shape with texture

    Huan Fu, Rongfei Jia, Lin Gao, Mingming Gong, Binqiang Zhao, Steve Maybank, and Dacheng Tao. 3d-future: 3d furni- ture shape with texture. International Journal of Computer Vision, pages 1–25, 2021. 4, 13

    2021

  13. [21]

    Srinivasan, Jonathan T

    Ruiqi Gao*, Aleksander Holynski*, Philipp Henzler, Arthur Brussee, Ricardo Martin-Brualla, Pratul P. Srinivasan, Jonathan T. Barron, and Ben Poole*. Cat3d: Create any- thing in 3d with multi-view diffusion models. Advances in Neural Information Processing Systems , 37:75468–75494,

  14. [22]

    Emu video: Factorizing text-to- video generation by explicit image conditioning

    Rohit Girdhar, Mannat Singh, Andrew Brown, Quentin Duval, Samaneh Azadi, Sai Saketh Rambhatla, Akbar Shah, Xi Yin, Devi Parikh, and Ishan Misra. Emu video: Factorizing text-to- video generation by explicit image conditioning. In European Conference on Computer Vision, 2024. 3

    2024

  15. [23]

    Animatediff: Animate your person- alized text-to-image diffusion models without specific tuning

    Yuwei Guo, Ceyuan Yang, Anyi Rao, Yaohui Wang, Yu Qiao, Dahua Lin, and Bo Dai. Animatediff: Animate your person- alized text-to-image diffusion models without specific tuning. In International Conference on Learning Representations ,

  16. [24]

    Instruct-nerf2nerf: Editing 3d scenes with instructions

    Ayaan Haque, Matthew Tancik, Alexei A Efros, Aleksander Holynski, and Angjoo Kanazawa. Instruct-nerf2nerf: Editing 3d scenes with instructions. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 19740– 19750, 2023. 2

    2023

  17. [25]

    Query-key normalization for trans- formers

    Alex Henry, Prudhvi Raj Dachapally, Shubham Shantaram Pawar, and Yuxuan Chen. Query-key normalization for trans- formers. In Findings of the Association for Computational 9 Linguistics: EMNLP 2020, pages 4246–4253, Online, 2020. Association for Computational Linguistics. 4

    2020

  18. [26]

    Denoising diffu- sion probabilistic models

    Jonathan Ho, Ajay Jain, and Pieter Abbeel. Denoising diffu- sion probabilistic models. Advances in neural information processing systems, 33:6840–6851, 2020. 2

    2020

  19. [27]

    Video diffusion models

    Jonathan Ho, Tim Salimans, Alexey Gritsenko, William Chan, Mohammad Norouzi, and David J Fleet. Video diffusion models. Advances in Neural Information Processing Systems, 35:8633–8646, 2022. 3

    2022

  20. [28]

    Text2room: Extracting textured 3d meshes from 2d text-to-image models

    Lukas Höllein, Ang Cao, Andrew Owens, Justin Johnson, and Matthias Nießner. Text2room: Extracting textured 3d meshes from 2d text-to-image models. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 7909–7920, 2023. 3

    2023

  21. [29]

    Viewdiff: 3d-consistent image generation with text-to-image models

    Lukas Höllein, Aljaž Božiˇc, Norman Müller, David Novotny, Hung-Yu Tseng, Christian Richardt, Michael Zollhöfer, and Matthias Nießner. Viewdiff: 3d-consistent image generation with text-to-image models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern R...

    2024

  22. [30]

    Lrm: Large reconstruction model for single image to 3d

    Yicong Hong, Kai Zhang, Jiuxiang Gu, Sai Bi, Yang Zhou, Difan Liu, Feng Liu, Kalyan Sunkavalli, Trung Bui, and Hao Tan. Lrm: Large reconstruction model for single image to 3d. In International Conference on Learning Representations,

  23. [31]

    Training- free diffusion model adaptation for variable-sized text-to- image synthesis

    Zhiyu Jin, Xuli Shen, Bin Li, and Xiangyang Xue. Training- free diffusion model adaptation for variable-sized text-to- image synthesis. Advances in Neural Information Processing Systems, 36:70847–70860, 2023. 15

    2023

  24. [32]

    3d gaussian splatting for real-time radiance field rendering

    Bernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, and George Drettakis. 3d gaussian splatting for real-time radiance field rendering. ACM Trans. Graph., 42(4):139–1, 2023. 1, 6, 14

    2023

  25. [33]

    Collaborative score dis- tillation for consistent visual editing

    Subin Kim, Kyungmin Lee, June Suk Choi, Jongheon Jeong, Kihyuk Sohn, and Jinwoo Shin. Collaborative score dis- tillation for consistent visual editing. Advances in Neural Information Processing Systems, 36:73232–73257, 2023. 2

    2023

  26. [34]

    Tanks and temples: Benchmarking large-scale scene reconstruction

    Arno Knapitsch, Jaesik Park, Qian-Yi Zhou, and Vladlen Koltun. Tanks and temples: Benchmarking large-scale scene reconstruction. ACM Transactions on Graphics, 36(4), 2017. 5, 6

    2017

  27. [35]

    Dreamscene: 3d gaussian-based text-to-3d scene generation via formation pattern sampling

    Haoran Li, Haolin Shi, Wenli Zhang, Wenjun Wu, Yong Liao, Lin Wang, Lik-hang Lee, and Pengyuan Zhou. Dreamscene: 3d gaussian-based text-to-3d scene generation via formation pattern sampling. In European conference on computer vision,

  28. [36]

    Sweet- dreamer: Aligning geometric priors in 2d diffusion for con- sistent text-to-3d

    Weiyu Li, Rui Chen, Xuelin Chen, and Ping Tan. Sweet- dreamer: Aligning geometric priors in 2d diffusion for con- sistent text-to-3d. In International Conference on Learning Representations, 2024. 2, 3, 13

    2024

  29. [37]

    Direc- tor3d: Real-world camera trajectory and 3d scene generation from text

    Xinyang Li, Zhangyu Lai, Linning Xu, Yansong Qu, Liujuan Cao, Shengchuan Zhang, Bo Dai, and Rongrong Ji. Direc- tor3d: Real-world camera trajectory and 3d scene generation from text. Advances in Neural Information Processing Sys- tems, 2024. 1

    2024

  30. [38]

    Luciddreamer: Towards high-fidelity text-to-3d generation via interval score matching

    Yixun Liang, Xin Yang, Jiantao Lin, Haodong Li, Xiaogang Xu, and Yingcong Chen. Luciddreamer: Towards high-fidelity text-to-3d generation via interval score matching. In Proceed- ings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 6517–6526, 2024. 2, 3

    2024

  31. [39]

    Magic3d: High-resolution text- to-3d content creation

    Chen-Hsuan Lin, Jun Gao, Luming Tang, Towaki Takikawa, Xiaohui Zeng, Xun Huang, Karsten Kreis, Sanja Fidler, Ming- Yu Liu, and Tsung-Yi Lin. Magic3d: High-resolution text- to-3d content creation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognit...

    2023

  32. [40]

    Com- mon diffusion noise schedules and sample steps are flawed

    Shanchuan Lin, Bingchen Liu, Jiashi Li, and Xiao Yang. Com- mon diffusion noise schedules and sample steps are flawed. In Proceedings of the IEEE/CVF winter conference on appli- cations of computer vision, pages 5404–5411, 2024. 4

    2024

  33. [41]

    Dl3dv-10k: A large-scale scene dataset for deep learning- based 3d vision

    Lu Ling, Yichen Sheng, Zhi Tu, Wentian Zhao, Cheng Xin, Kun Wan, Lantao Yu, Qianyu Guo, Zixun Yu, Yawen Lu, et al. Dl3dv-10k: A large-scale scene dataset for deep learning- based 3d vision. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, p...

    2024

  34. [42]

    Infinite nature: Perpetual view generation of natural scenes from a single image

    Andrew Liu, Richard Tucker, Varun Jampani, Ameesh Maka- dia, Noah Snavely, and Angjoo Kanazawa. Infinite nature: Perpetual view generation of natural scenes from a single image. In Proceedings of the IEEE/CVF International Con- ference on Computer Vision, pages 14458–14467, 20...

    2021

  35. [43]

    Re- conx: Reconstruct any scene from sparse views with video diffusion model

    Fangfu Liu, Wenqiang Sun, Hanyang Wang, Yikai Wang, Haowen Sun, Junliang Ye, Jun Zhang, and Yueqi Duan. Re- conx: Reconstruct any scene from sparse views with video diffusion model. arXiv preprint arXiv:2408.16767, 2024. 3, 5, 14

    2024 arXiv

  36. [44]

    Zero-1-to-3: Zero-shot one image to 3d object

    Ruoshi Liu, Rundi Wu, Basile Van Hoorick, Pavel Tokmakov, Sergey Zakharov, and Carl V ondrick. Zero-1-to-3: Zero-shot one image to 3d object. In Proceedings of the IEEE/CVF international conference on computer vision , pages 9298– 9309, 2023. 1, 2

    2023

  37. [45]

    Syncdreamer: Gener- ating multiview-consistent images from a single-view image

    Yuan Liu, Cheng Lin, Zijiao Zeng, Xiaoxiao Long, Lingjie Liu, Taku Komura, and Wenping Wang. Syncdreamer: Gener- ating multiview-consistent images from a single-view image. In International Conference on Learning Representations ,

  38. [46]

    Wonder3d: Single im- age to 3d using cross-domain diffusion

    Xiaoxiao Long, Yuan-Chen Guo, Cheng Lin, Yuan Liu, Zhiyang Dou, Lingjie Liu, Yuexin Ma, Song-Hai Zhang, Marc Habermann, Christian Theobalt, et al. Wonder3d: Single im- age to 3d using cross-domain diffusion. In Proceedings of the IEEE/CVF Conference on Computer Vision and Patt...

    2024

  39. [47]

    Im-3d: Iterative multiview diffusion and recon- struction for high-quality 3d generation

    Luke Melas-Kyriazi, Iro Laina, Christian Rupprecht, Na- talia Neverova, Andrea Vedaldi, Oran Gafni, and Filippos Kokkinos. Im-3d: Iterative multiview diffusion and recon- struction for high-quality 3d generation. arXiv preprint arXiv:2402.08682, 2024. 3, 5, 14

    2024 arXiv

  40. [48]

    Nerf: Representing scenes as neural radiance fields for view synthesis

    B Mildenhall, PP Srinivasan, M Tancik, JT Barron, R Ra- mamoorthi, and R Ng. Nerf: Representing scenes as neural radiance fields for view synthesis. In European conference on computer vision, 2020. 1

    2020

  41. [49]

    Instant neural graphics primitives with a multires- 10 olution hash encoding

    Thomas Müller, Alex Evans, Christoph Schied, and Alexan- der Keller. Instant neural graphics primitives with a multires- 10 olution hash encoding. ACM Trans. Graph., 41(4):102:1– 102:15, 2022. 13

    2022

  42. [50]

    Scalable diffusion models with transformers

    William Peebles and Saining Xie. Scalable diffusion models with transformers. In Proceedings of the IEEE/CVF Inter- national Conference on Computer Vision, pages 4195–4205,

  43. [51]

    SDXL: Improving latent diffusion models for high-resolution image synthesis

    Dustin Podell, Zion English, Kyle Lacey, Andreas Blattmann, Tim Dockhorn, Jonas Müller, Joe Penna, and Robin Rombach. SDXL: Improving latent diffusion models for high-resolution image synthesis. In International Conference on Learning Representations, 2024. 1

    2024

  44. [52]

    Dreamfusion: Text-to-3d using 2d diffusion

    Ben Poole, Ajay Jain, Jonathan T Barron, and Ben Mildenhall. Dreamfusion: Text-to-3d using 2d diffusion. In International Conference on Learning Representations, 2023. 2

    2023

  45. [53]

    Com- mon objects in 3d: Large-scale learning and evaluation of real-life 3d category reconstruction

    Jeremy Reizenstein, Roman Shapovalov, Philipp Henzler, Luca Sbordone, Patrick Labatut, and David Novotny. Com- mon objects in 3d: Large-scale learning and evaluation of real-life 3d category reconstruction. In Proceedings of the IEEE/CVF International Conference on Computer Vision ,

  46. [54]

    High-resolution image synthesis with latent diffusion models

    Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Björn Ommer. High-resolution image synthesis with latent diffusion models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 10684–10695, 2022. 1, 2, 3, 4

    2022

  47. [55]

    Zeronvs: Zero-shot 360- degree view synthesis from a single image

    Kyle Sargent, Zizhang Li, Tanmay Shah, Charles Herrmann, Hong-Xing Yu, Yunzhi Zhang, Eric Ryan Chan, Dmitry La- gun, Li Fei-Fei, Deqing Sun, et al. Zeronvs: Zero-shot 360- degree view synthesis from a single image. In Proceedings of the IEEE/CVF Conference on Computer Vision a...

    2024

  48. [56]

    Pixelwise view selection for unstruc- tured multi-view stereo

    Johannes Lutz Schönberger, Enliang Zheng, Marc Pollefeys, and Jan-Michael Frahm. Pixelwise view selection for unstruc- tured multi-view stereo. In European conference on computer vision, 2016. 2, 4

    2016

  49. [57]

    A multi-view stereo benchmark with high- resolution images and multi-camera videos

    Thomas Schops, Johannes L Schonberger, Silvano Galliani, Torsten Sattler, Konrad Schindler, Marc Pollefeys, and An- dreas Geiger. A multi-view stereo benchmark with high- resolution images and multi-camera videos. In Proceedings of the IEEE conference on computer vision and pa...

    2017

  50. [58]

    Genwarp: Single image to novel views with semantic-preserving generative warping

    Junyoung Seo, Kazumi Fukuda, Takashi Shibuya, Takuya Narihira, Naoki Murata, Shoukang Hu, Chieh-Hsin Lai, Se- ungryong Kim, and Yuki Mitsufuji. Genwarp: Single image to novel views with semantic-preserving generative warping. Advances in Neural Information Processing Systems, ...

    2024

  51. [59]

    Matchable image retrieval by learning from surface reconstruction

    Tianwei Shen, Zixin Luo, Lei Zhou, Runze Zhang, Siyu Zhu, Tian Fang, and Long Quan. Matchable image retrieval by learning from surface reconstruction. In The Asian Confer- ence on Computer Vision (ACCV, 2018. 4, 13

    2018

  52. [60]

    Zero123++: a single image to consistent multi-view diffusion base model

    Ruoxi Shi, Hansheng Chen, Zhuoyang Zhang, Minghua Liu, Chao Xu, Xinyue Wei, Linghao Chen, Chong Zeng, and Hao Su. Zero123++: a single image to consistent multi-view diffusion base model. arXiv preprint arXiv:2310.15110, 2023. 2, 4

    2023 arXiv

  53. [61]

    Mvdream: Multi-view diffusion for 3d gener- ation

    Yichun Shi, Peng Wang, Jianglong Ye, Long Mai, Kejie Li, and Xiao Yang. Mvdream: Multi-view diffusion for 3d gener- ation. In International Conference on Learning Representa- tions, 2024. 2

    2024

  54. [62]

    Realmdreamer: Text-driven 3d scene gener- ation with inpainting and depth diffusion

    Jaidev Shriram, Alex Trevithick, Lingjie Liu, and Ravi Ra- mamoorthi. Realmdreamer: Text-driven 3d scene gener- ation with inpainting and depth diffusion. arXiv preprint arXiv:2404.07199, 2024. 2, 3

    2024 arXiv

  55. [63]

    Denoising diffusion implicit models

    Jiaming Song, Chenlin Meng, and Stefano Ermon. Denoising diffusion implicit models. In International Conference on Learning Representations, 2021. 2

    2021

  56. [64]

    Score-based generative modeling through stochastic differential equations

    Yang Song, Jascha Sohl-Dickstein, Diederik P Kingma, Ab- hishek Kumar, Stefano Ermon, and Ben Poole. Score-based generative modeling through stochastic differential equations

  57. [65]

    Flash3d: Feed-forward generalisable 3d scene reconstruction from a single image

    Stanislaw Szymanowicz, Eldar Insafutdinov, Chuanxia Zheng, Dylan Campbell, João F Henriques, Christian Rupprecht, and Andrea Vedaldi. Flash3d: Feed-forward generalisable 3d scene reconstruction from a single image. arXiv preprint arXiv:2406.04343, 2024. 3

    2024 arXiv

  58. [66]

    Lgm: Large multi-view gaussian model for high-resolution 3d content creation

    Jiaxiang Tang, Zhaoxi Chen, Xiaokang Chen, Tengfei Wang, Gang Zeng, and Ziwei Liu. Lgm: Large multi-view gaussian model for high-resolution 3d content creation. In European Conference on Computer Vision, pages 1–18. Springer, 2024. 2

    2024

  59. [67]

    Dreamgaussian: Generative gaussian splatting for efficient 3d content creation

    Jiaxiang Tang, Jiawei Ren, Hang Zhou, Ziwei Liu, and Gang Zeng. Dreamgaussian: Generative gaussian splatting for efficient 3d content creation. In International Conference on Learning Representations, 2024. 2

    2024

  60. [68]

    Megascenes: Scene-level view synthesis at scale

    Joseph Tung, Gene Chou, Ruojin Cai, Guandao Yang, Kai Zhang, Gordon Wetzstein, Bharath Hariharan, and Noah Snavely. Megascenes: Scene-level view synthesis at scale. In European conference on computer vision, 2024. 3, 4, 13, 15, 16

    2024

  61. [69]

    Attention is all you need

    Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszko- reit, Llion Jones, Aidan N Gomez, Lukasz Kaiser, and Illia Polosukhin. Attention is all you need. Advances in Neural Information Processing Systems, 2017. 3

    2017

  62. [70]

    Sv3d: Novel multi-view syn- thesis and 3d generation from a single image using latent video diffusion

    Vikram V oleti, Chun-Han Yao, Mark Boss, Adam Letts, David Pankratz, Dmitry Tochilkin, Christian Laforte, Robin Rombach, and Varun Jampani. Sv3d: Novel multi-view syn- thesis and 3d generation from a single image using latent video diffusion. In European Conference on Computer...

    2024

  63. [71]

    Imagedream: Image-prompt multi-view diffusion for 3d generation

    Peng Wang and Yichun Shi. Imagedream: Image-prompt multi-view diffusion for 3d generation. arXiv preprint arXiv:2312.02201, 2023. 2

    2023 arXiv

  64. [72]

    Dust3r: Geometric 3d vision made easy

    Shuzhe Wang, Vincent Leroy, Yohann Cabon, Boris Chidlovskii, and Jerome Revaud. Dust3r: Geometric 3d vision made easy. In Proceedings of the IEEE/CVF Con- ference on Computer Vision and Pattern Recognition, pages 20697–20709, 2024. 3, 4, 6, 14

    2024

  65. [73]

    Prolificdreamer: High-fidelity and diverse text-to-3d generation with variational score distilla- tion

    Zhengyi Wang, Cheng Lu, Yikai Wang, Fan Bao, Chongxuan Li, Hang Su, and Jun Zhu. Prolificdreamer: High-fidelity and diverse text-to-3d generation with variational score distilla- tion. Advances in Neural Information Processing Systems, 36,

  66. [74]

    Mo- tionctrl: A unified and flexible motion controller for video 11 generation

    Zhouxia Wang, Ziyang Yuan, Xintao Wang, Yaowei Li, Tian- shui Chen, Menghan Xia, Ping Luo, and Ying Shan. Mo- tionctrl: A unified and flexible motion controller for video 11 generation. In ACM SIGGRAPH 2024 Conference Papers, pages 1–11, 2024. 3

    2024

  67. [75]

    Reconfusion: 3d reconstruction with diffusion priors

    Rundi Wu, Ben Mildenhall, Philipp Henzler, Keunhong Park, Ruiqi Gao, Daniel Watson, Pratul P Srinivasan, Dor Verbin, Jonathan T Barron, Ben Poole, et al. Reconfusion: 3d reconstruction with diffusion priors. In Proceedings of the IEEE/CVF Conference on Computer Vision and Patt...

    2024

  68. [76]

    Dynamicrafter: Animating open- domain images with video diffusion priors

    Jinbo Xing, Menghan Xia, Yong Zhang, Haoxin Chen, Wangbo Yu, Hanyuan Liu, Gongye Liu, Xintao Wang, Ying Shan, and Tien-Tsin Wong. Dynamicrafter: Animating open- domain images with video diffusion priors. In European Conference on Computer Vision, pages 399–417. Springer,

  69. [77]

    Dmv3d: Denoising multi-view diffu- sion using 3d large reconstruction model

    Yinghao Xu, Hao Tan, Fujun Luan, Sai Bi, Peng Wang, Jiahao Li, Zifan Shi, Kalyan Sunkavalli, Gordon Wetzstein, Zexiang Xu, and Kai Zhang. Dmv3d: Denoising multi-view diffu- sion using 3d large reconstruction model. In International Conference on Learning Representations, 2024....

    2024

  70. [78]

    Depth anything v2

    Lihe Yang, Bingyi Kang, Zilong Huang, Zhen Zhao, Xiao- gang Xu, Jiashi Feng, and Hengshuang Zhao. Depth anything v2. Advances in Neural Information Processing Systems ,

  71. [79]

    Scannet++: A high-fidelity dataset of 3d indoor scenes

    Chandan Yeshwanth, Yueh-Cheng Liu, Matthias Nießner, and Angela Dai. Scannet++: A high-fidelity dataset of 3d indoor scenes. In Proceedings of the International Conference on Computer Vision (ICCV), 2023. 4, 13

    2023

  72. [80]

    Metric3d: Towards zero-shot metric 3d prediction from a single image

    Wei Yin, Chi Zhang, Hao Chen, Zhipeng Cai, Gang Yu, Kaix- uan Wang, Xiaozhi Chen, and Chunhua Shen. Metric3d: Towards zero-shot metric 3d prediction from a single image. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 9043–9053, 2023. 3

    2023

  73. [81]

    pixelnerf: Neural radiance fields from one or few images

    Alex Yu, Vickie Ye, Matthew Tancik, and Angjoo Kanazawa. pixelnerf: Neural radiance fields from one or few images. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 4578–4587, 2021. 2

    2021

  74. [82]

    Wonderworld: Interactive 3d scene generation from a single image

    Hong-Xing Yu, Haoyi Duan, Charles Herrmann, William T Freeman, and Jiajun Wu. Wonderworld: Interactive 3d scene generation from a single image. arXiv preprint arXiv:2406.09394, 2024. 2, 3

    2024 arXiv

  75. [83]

    Wonderjourney: Going from anywhere to everywhere

    Hong-Xing Yu, Haoyi Duan, Junhwa Hur, Kyle Sargent, Michael Rubinstein, William T Freeman, Forrester Cole, De- qing Sun, Noah Snavely, Jiajun Wu, et al. Wonderjourney: Going from anywhere to everywhere. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern R...

    2024

  76. [84]

    Viewcrafter: Taming video diffusion models for high-fidelity novel view synthesis

    Wangbo Yu, Jinbo Xing, Li Yuan, Wenbo Hu, Xiaoyu Li, Zhipeng Huang, Xiangjun Gao, Tien-Tsin Wong, Ying Shan, and Yonghong Tian. Viewcrafter: Taming video diffusion models for high-fidelity novel view synthesis. arXiv preprint arXiv:2409.02048, 2024. 2, 3, 5, 6, 8, 14

    2024 arXiv

  77. [85]

    Mvimgnet: A large-scale dataset of multi-view images

    Xianggang Yu, Mutian Xu, Yidan Zhang, Haolin Liu, Chongjie Ye, Yushuang Wu, Zizheng Yan, Tianyou Liang, Guanying Chen, Shuguang Cui, and Xiaoguang Han. Mvimgnet: A large-scale dataset of multi-view images. In Proceedings of the IEEE/CVF conference on computer vision and patter...

    2023

  78. [86]

    The unreasonable effectiveness of deep features as a perceptual metric

    Richard Zhang, Phillip Isola, Alexei A Efros, Eli Shechtman, and Oliver Wang. The unreasonable effectiveness of deep features as a perceptual metric. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 586–595, 2018. 14

    2018

  79. [87]

    3d- scenedreamer: Text-driven 3d-consistent scene generation

    Songchun Zhang, Yibo Zhang, Quan Zheng, Rui Ma, Wei Hua, Hujun Bao, Weiwei Xu, and Changqing Zou. 3d- scenedreamer: Text-driven 3d-consistent scene generation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 10170–10180, 2024. 2

    2024

  80. [88]

    Stereo magnification: learning view syn- thesis using multiplane images

    Tinghui Zhou, Richard Tucker, John Flynn, Graham Fyffe, and Noah Snavely. Stereo magnification: learning view syn- thesis using multiplane images. ACM Trans. Graph., 37(4),

  81. [89]

    Hifa: High-fidelity text-to-3d generation with advanced diffusion guidance, 2023

    Junzhe Zhu and Peiye Zhuang. Hifa: High-fidelity text-to-3d generation with advanced diffusion guidance, 2023. 2

    2023

  82. [90]

    Triplane meets gaussian splatting: Fast and generalizable single-view 3d reconstruction with transformers

    Zi-Xin Zou, Zhipeng Yu, Yuan-Chen Guo, Yangguang Li, Ding Liang, Yan-Pei Cao, and Song-Hai Zhang. Triplane meets gaussian splatting: Fast and generalizable single-view 3d reconstruction with transformers. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern...

    2024

  83. [2024]

    1, 2, 4, 5, 6, 8, 14

Pith tools

Reviewed August 12, 2026 · model on record in the stance chip above.