REVIEW 4 major objections 6 minor 1 cited by
Towards Multi-View Consistent Style Transfer with One-Step Diffusion via Vision Conditioning
T0 review · 4 major / 6 minor · reviewed 2026-08-12 · deepseek-v4-flash
Pith's one-line read OSDiffST uses a one-step diffusion model with a CLIP-based vision condition and LoRA adapters to stylize multi-view images of 3D scenes, preserving structure and cross-view consistency without any 3D information.
desk verdict Plausible one-step diffusion style transfer for multi-view images, but the 'diverse styles' claim is untested and the metrics partly encode the training losses. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The carrying mechanism is the combination of an image-conditioned generative backbone and two geometry/color-consistency losses. The backbone is SD-Turbo, a one-step text-to-image diffusion model, frozen except for LoRA adapters in every convolutional and linear layer; the vision condition module maps a style image through a CLIP image encoder (256 local tokens plus the global token) and a small trainable MLP 'vision-language projector' that converts the CLIP-style embedding into the text-embedding space SD-Turbo expects, so the pre-trained text-to-image model can be driven by an image instead of text. The training objective adds a Gram-matrix style loss, a VGG content loss, a structure loss computed from Sobel, Laplacian, and Canny edge maps, and a HistoGAN-style color-histogram alignment loss. This lets a per-scene, single-reference training run (about 30 minutes on one RTX 3090, ~9M trainable parameters) yield stylized views that keep edges and colors aligned across viewpoints.
What would settle it
Take a trained OSDiffST model and, at inference, feed it a style image that was not used during training (a different painting or a different artistic style) while keeping the same content scene; measure CHD and DSD and inspect the output. If the stylized image does not follow the new style — for instance, if it reverts to the training style or produces artifacts — the vision condition module has memorized the training style and the claimed arbitrary-style rendering is false.
Extended reading notes
Core claim
The central claim is that a single-step diffusion model can render diverse artistic styles across many viewpoints of a 3D scene while preserving both the scene's structure and its multi-view consistency, without ever building a 3D representation. The evidence is quantitative: on three scenes (Train, Playground, Palace) with six styles, OSDiffST obtains the lowest Color Histogram Distance (CHD) and DINO Structure Distance (DSD) in nearly every comparison against AdaIN, StyleFormer, MuVieCAST, and InST, and it achieves this with a 9M-parameter trainable delta over a frozen 2B-parameter backbone, at inference times comparable to CNN-based methods and far below the multi-step diffusion baseline InST. The authors further show that removing the color-alignment loss or the structure loss degrades quality and cross-view flow consistency, and that the model transfers to a different scene (though not to a different style).
Load-bearing premise
The vision condition module is trained on a single style per scene and is assumed to generalize to arbitrary new styles at inference, a generalization the paper never tests.
Editorial extensions
If this is right
- Per-scene stylization of 3D scenes becomes practical on consumer hardware: about 30 minutes of training and 0.063 s per 256×256 image, versus 4+ s for the multi-step diffusion baseline.
- The method needs no depth maps, meshes, or radiance fields, so it works directly from the image set of a scene.
- Because the backbone is a one-step diffusion model, the stylized images inherit the generative prior of SD-Turbo while remaining fast enough for interactive use.
- The structure and color losses, not the diffusion prior alone, are what enforce multi-view consistency: ablations show flow L1 distance rises from 1.66 to 4.44 without the structure loss and CHD rises from 0.01 to 0.40 without the color loss.
- A model trained on one scene transfers to another scene and remains multi-view consistent, suggesting the adaptation captures scene-agnostic style rendering.
Reading between the lines
- The paper's strongest claim is actually style generalization, and it is not tested: every model is trained with a single reference style per scene, and the cross-scene experiment reuses the same style. A fair test would present an unseen style image at inference and measure whether the vision condition module injects it without retraining.
- The 'no 3D information' claim is limited to not using explicit 3D representations; the method still assumes a static scene captured from multiple views and uses pairwise consistency signals (optical-flow L1) rather than true multi-view geometry. Large viewpoint changes or occlusions could expose drift that flow-based metrics underestimate.
- The color-alignment loss is a strong constraint that may do much of the style work; an ablation with a style that has similar colors but very different texture to the content would reveal whether the diffusion prior is adding texture or just recoloring.
- The vision-language projector could be replaced by a learned per-style embedding; if the projector merely memorizes the single training style, the method reduces to a per-style generator rather than a general style-transfer model.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes OSDiffST, a one-step diffusion-based style transfer method for multi-view images of 3D scenes that does not require 3D information. The method adapts SD-Turbo with LoRA, introduces a vision condition module (CLIP image encoder plus a trainable MLP projector) to extract style embeddings from a reference style image, and trains with a hybrid loss combining content, style, structure, and color alignment terms. Experiments on three Tanks and Temples scenes with six styles report that OSDiffST outperforms AdaIN, StyleFormer, MuVieCAST, and InST on CHD and DSD metrics, forward-flow consistency, and a user study, while also being faster than multi-step diffusion baselines.
Significance. If the claims hold, OSDiffST would be a practically attractive method: it achieves style transfer in a single diffusion step with only 9M trainable parameters, avoids explicit 3D reconstruction, and is supported by released code. The paper makes a plausible architectural contribution in coupling a one-step diffusion backbone with a CLIP-based vision condition module. However, the current evaluation has significant weaknesses: the style loss appears ill-defined, the primary CHD metric is the exact objective of the color alignment loss, the generalization to new styles is untested, and the quantitative evaluation is performed on training scenes. These issues collectively mean that the central claims of diverse style transfer and superior quality are not yet firmly established.
major comments (4)
- [3.4, Eq. (3)] The style loss as written compares Gram matrices of the stylized image I_cs and the content image I_c, not the reference style image I_s. This omits the style reference from the style loss, leaving the objective ill-defined as a style matching term. Please clarify whether the second Gram matrix should be computed on I_s; if the manuscript is what was implemented, the training objective may not encourage style matching at all.
- [4.2 and Eq. (5)] The primary quantitative metric CHD is the Hellinger distance between color histograms of the stylized image and the reference style image, which is precisely the quantity minimized by the color alignment loss L_CA in Eq. (5). Reporting CHD improvements therefore largely reflects the training objective and does not provide an independent assessment of style transfer quality. The DSD metric similarly measures structural preservation that Eq. (4) explicitly optimizes. Please add metrics that are not directly tied to the training losses, such as a perceptual style metric or a user study on held-out styles, or at least acknowledge and contextualize this circularity.
- [4.1 and 4.3] The paper claims the method can render 'diverse styles' through the vision condition module, but this is not tested. Section 4.1 states that OSDiffST is trained on each individual scene with a single reference style image, and the only cross-scene generalization experiment (T2P/P2T in Section 4.3, Fig. 6) changes the scene while keeping the same style. To substantiate the central novelty, the authors should test the model on a held-out style image at inference, e.g., train on Style 1 and test on Style 2, and compare against training from scratch. Without such a test, the vision condition module may simply memorize the training style embedding.
- [4.1 and 4.2] The quantitative evaluation appears to be performed on the same images used for training. After training on each scene, the paper reports transferring 'all images in each scene' to the target style and computing CHD/DSD. There is no held-out view split within a scene, so the reported improvements may be inflated by overfitting. Please report metrics on held-out views, or on novel scenes with the same fixed training procedure, to support the generalization claims.
minor comments (6)
- [3.3] The CLIP image encoder is cited as [41] in Section 3.3, but reference [41] is the LAION-5B dataset paper; the correct CLIP citation appears to be reference [36].
- [4.1] The dataset name is written as 'Tanks and Templates' but should be 'Tanks and Temples'.
- [Figure 1 and 3.2] Figure 1 states 'Freeze (Parameters: 2B)' while Section 3.2 says SD-Turbo v2.1 has approximately 1.3 billion parameters; please reconcile these numbers.
- [4.2] The user study reports average scores but does not state the number of participants or their demographics; include this information for reproducibility.
- [4.3, Fig. 5] The ablation of the vision condition module (Config 1 vs Config 2) is supported only by a visual comparison; adding quantitative metrics (e.g., CHD, DSD, or user study scores) would strengthen the claim.
- [3.4] In Eq. (3), the notation G^ℓ_c is used inconsistently with G^ℓ_{I_c} in the surrounding text; please unify the notation.
Circularity Check
CHD evaluation duplicates the L_CA training objective, so the reported color-histogram wins are enforced by construction; DSD and the user study remain independent, and the style-generalization gap is a weakness but not circularity.
-
fitted input called prediction
[Sec. 3.4 Eq. (5); Sec. 4.2 metric definition; Table 1]
"To ensure the color style of the translated image closely matches the reference style images, we propose using a color alignment loss LCA based on HistoGAN [1], which is defined as follows: LCA = 1√2 || H(Ics)1/2 − H(Is)1/2 ||2 ... CHD calculates the Hellinger distance of the color histogram between the stylized image and the reference style image."
CHD is exactly the Hellinger distance (1/√2)||√H(Ics)−√H(Is)||₂, the same expression minimized as LCA in Eq. (5). Since OSDiffST is trained per scene on the same images later evaluated in Table 1, its near-zero CHD values (e.g., 0.02–0.07 vs. 0.13–0.46 for baselines) are a direct consequence of the training loss, not an independent prediction of style quality. The color-match 'win' therefore reduces by construction to the objective the model was optimized on. DSD, forward-flow L1, and the user study are not identical to any training loss and remain independent evidence.
full rationale
Only one load-bearing comparison reduces by construction: CHD is identical to LCA. The L_CA loss in Eq. (5) minimizes the Hellinger distance between the color histograms of Ics and Is, and Sec. 4.2 defines CHD as exactly that Hellinger distance. Training with LCA therefore forces low CHD on the training scenes used in Table 1, so the color-histogram 'superiority' is a restatement of the objective rather than a prediction. The other reported evidence is not circular: DSD is a DINO-based structure distance, not equal to the Sobel/Laplacian/Canny structure loss; the forward-flow L1 check is not any term in Eq. (6); and the user study is external human judgment. The generalization experiment tests new scenes but keeps the same style, so the 'diverse styles' claim is under-supported, but that is a generalization gap rather than a circular reduction. Eq. (3)'s notation (G_Ics vs G_Ic and text saying 'style image Ics') is an apparent typo, but it affects clarity, not circularity. No load-bearing self-citation chain appears.
Assumptions & free parameters
free parameters (5)
- lambda_content =
1e3
- lambda_style =
1e8
- lambda_structure =
2e4
- lambda_CA =
1e4
- LoRA rank and alpha
assumptions (5)
- domain assumption SD-Turbo one-step diffusion provides a sufficient generative prior for style transfer after LoRA fine-tuning.
- domain assumption CLIP image embeddings plus a small MLP align style image content to the text-conditioning space of SD-Turbo.
- standard math VGG-19 feature statistics (Gram matrices) and edge/color descriptors capture the relevant notions of style, content, and structure.
- domain assumption Forward optical flow via GMFlow is a valid proxy for multi-view consistency.
- ad hoc to paper Evaluation on the same scene images used for training yields unbiased quality estimates.
Cite this review
Pith. "Pith review of Towards Multi-View Consistent Style Transfer with One-Step Diffusion via Vision Conditioning." pith.science (2026). https://pith.science/paper/IERSULOG
@misc{pith2026241110130,
author = {Pith},
title = {Pith review of: Towards Multi-View Consistent Style Transfer with One-Step Diffusion via Vision Conditioning},
year = {2026},
howpublished = {\url{https://pith.science/paper/IERSULOG}},
note = {Machine review of arXiv:2411.10130}
}
read the original abstract
The stylization of 3D scenes is an increasingly attractive topic in 3D vision. Although image style transfer has been extensively researched with promising results, directly applying 2D style transfer methods to 3D scenes often fails to preserve the structural and multi-view properties of 3D environments, resulting in unpleasant distortions in images from different viewpoints. To address these issues, we leverage the remarkable generative prior of diffusion-based models and propose a novel style transfer method, OSDiffST, based on a pre-trained one-step diffusion model (i.e., SD-Turbo) for rendering diverse styles in multi-view images of 3D scenes. To efficiently adapt the pre-trained model for multi-view style transfer on small datasets, we introduce a vision condition module to extract style information from the reference style image to serve as conditional input for the diffusion model and employ LoRA in diffusion model for adaptation. Additionally, we consider color distribution alignment and structural similarity between the stylized and content images using two specific loss functions. As a result, our method effectively preserves the structural information and multi-view consistency in stylized images without any 3D information. Experiments show that our method surpasses other promising style transfer methods in synthesizing various styles for multi-view images of 3D scenes. Stylized images from different viewpoints generated by our method achieve superior visual quality, with better structural integrity and less distortion. The source code is available at https://github.com/YushenZuo/OSDiffST.
Figures
Figures from the paper (4 more)
Forward citations
Cited by 1 Pith paper
-
See In Detail: Enhancing Sparse-view 3D Gaussian Splatting with Local Depth and Semantic Regularization
SIDGaussian adds DINO-based semantic consistency and local Pearson-correlation depth regularization to sparse-view 3DGS, reaching 20.71 dB PSNR on LLFF, 0.4 dB above FSGS.
Reference graph
Works this paper leans on
-
[1]
In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition
Afifi, M., Brubaker, M.A., Brown, M.S.: Histogan: Controlling colors of gan- generated and real images via color histograms. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. pp. 7941–7950 (2021)
work page 2021
-
[2]
In: 2023 IEEE International Conference on Multimedia and Expo Workshops (ICMEW)
Bae, E., Kim, J., Lee, S.: Point cloud-based free viewpoint artistic style trans- fer. In: 2023 IEEE International Conference on Multimedia and Expo Workshops (ICMEW). pp. 302–307. IEEE (2023)
work page 2023
-
[3]
In: Proceedings of the IEEE/CVF international conference on computer vision
Barron, J.T., Mildenhall, B., Tancik, M., Hedman, P., Martin-Brualla, R., Srini- vasan, P.P.: Mip-nerf: A multiscale representation for anti-aliasing neural radiance fields. In: Proceedings of the IEEE/CVF international conference on computer vision. pp. 5855–5864 (2021)
2021
-
[4]
In: Proceedings of the IEEE/CVF International Conference on Computer Vision
Cao, T., Kreis, K., Fidler, S., Sharp, N., Yin, K.: Texfusion: Synthesizing 3d tex- tures with text-guided image diffusion models. In: Proceedings of the IEEE/CVF International Conference on Computer Vision. pp. 4169–4181 (2023)
work page 2023
-
[5]
In: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer vision
Cao, X., Wang, W., Nagao, K., Nakamura, R.: Psnet: A style transfer network for point cloud stylization on geometry and color. In: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer vision. pp. 3337–3345 (2020)
work page 2020
-
[6]
In: European conference on computer vision
Chen, A., Xu, Z., Geiger, A., Yu, J., Su, H.: Tensorf: Tensorial radiance fields. In: European conference on computer vision. pp. 333–350. Springer (2022)
work page 2022
-
[7]
In: Proceedings of the IEEE/CVF International Conference on Computer Vision
Chen, D.Z., Siddiqui, Y., Lee, H.Y., Tulyakov, S., Nießner, M.: Text2tex: Text- driven texture synthesis via diffusion models. In: Proceedings of the IEEE/CVF International Conference on Computer Vision. pp. 18558–18568 (2023)
work page 2023
-
[8]
Neurocomputing358, 275–284 (2019)
Chen, S., Chen, S., Guo, Z., Zuo, Y.: Low-resolution palmprint image denoising by generative adversarial networks. Neurocomputing358, 275–284 (2019)
work page 2019
Show all 57 references
-
[9]
NeurlPS Workshop (2016)
Chen, T.Q., Schmidt, M.: Fast patch-based style transfer of arbitrary style. NeurlPS Workshop (2016)
2016
-
[10]
IEEE Transactions on Visualization and Computer Graphics (2024)
Chen, Y., Yuan, Q., Li, Z., Liu, Y., Wang, W., Xie, C., Wen, X., Yu, Q.: Upst-nerf: Universal photorealistic style transfer of neural radiance fields for 3d scene. IEEE Transactions on Visualization and Computer Graphics (2024)
2024
-
[11]
In: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision
Chiang, P.Z., Tsai, M.S., Tseng, H.Y., Lai, W.S., Chiu, W.C.: Stylizing 3d scene via implicit representation and hypernetwork. In: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision. pp. 1475–1484 (2022)
2022
-
[12]
In: 2009 IEEE conference on computer vision and pattern recognition
Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: Imagenet: A large- scale hierarchical image database. In: 2009 IEEE conference on computer vision and pattern recognition. pp. 248–255. Ieee (2009)
2009
-
[13]
In: European Conference on Computer Vision (2022)
Fan, Z., Jiang, Y., Wang, P., Gong, X., Xu, D., Wang, Z.: Unified implicit neural stylization. In: European Conference on Computer Vision (2022)
2022
-
[14]
arXiv preprint arXiv:2208.01618 (2022)
Gal, R., Alaluf, Y., Atzmon, Y., Patashnik, O., Bermano, A.H., Chechik, G., Cohen-Or, D.: An image is worth one word: Personalizing text-to-image gener- ation using textual inversion. arXiv preprint arXiv:2208.01618 (2022)
2022 arXiv
-
[15]
In: Proceedings of the IEEE conference on computer vision and pattern recognition
Gatys, L.A., Ecker, A.S., Bethge, M.: Image style transfer using convolutional neural networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp. 2414–2423 (2016)
2016
-
[16]
In: Proceedings of the IEEE conference on computer vision and pattern recognition
Gu, S., Chen, C., Liao, J., Yuan, L.: Arbitrary style transfer with deep feature reshuffle. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp. 8222–8231 (2018)
2018
-
[17]
In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition
Höllein, L., Johnson, J., Nießner, M.: Stylemesh: Style transfer for indoor 3d scene reconstructions. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 6198–6208 (2022) 16 Yushen Zuo et al
2022
-
[18]
arXiv preprint arXiv:2106.09685 (2021)
Hu, E.J., Shen, Y., Wallis, P., Allen-Zhu, Z., Li, Y., Wang, S., Wang, L., Chen, W.: Lora: Low-rank adaptation of large language models. arXiv preprint arXiv:2106.09685 (2021)
2021 arXiv
-
[19]
In: Proceedings of the IEEE international conference on computer vision
Huang, X., Belongie, S.: Arbitrary style transfer in real-time with adaptive instance normalization. In: Proceedings of the IEEE international conference on computer vision. pp. 1501–1510 (2017)
2017
-
[20]
In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition
Huang, Y.H., He, Y., Yuan, Y.J., Lai, Y.K., Gao, L.: Stylizednerf: consistent 3d scene stylization as stylized nerf via 2d-3d mutual learning. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 18342– 18352 (2022)
2022
-
[21]
In: 2024 International Conference on 3D Vision (3DV)
Ibrahimli, N., Kooij, J.F., Nan, L.: Muviecast: Multi-view consistent artistic style transfer. In: 2024 International Conference on 3D Vision (3DV). pp. 1136–1145. IEEE (2024)
2024
-
[22]
In: Proceedings of the IEEE/CVF International Conference on Computer Vision
Irshad, M.Z., Zakharov, S., Liu, K., Guizilini, V., Kollar, T., Gaidon, A., Kira, Z., Ambrus, R.: Neo 360: Neural fields for sparse view synthesis of outdoor scenes. In: Proceedings of the IEEE/CVF International Conference on Computer Vision. pp. 9187–9198 (2023)
2023
-
[23]
In: Proceedings of the 1st Workshop on Photorealistic Image and Environment Synthesis for Multimedia Experiments
Jin, B., Tian, B., Zhao, H., Zhou, G.: Language-guided semantic style transfer of 3d indoor scenes. In: Proceedings of the 1st Workshop on Photorealistic Image and Environment Synthesis for Multimedia Experiments. pp. 11–17 (2022)
2022
-
[24]
In: Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11-14, 2016, Proceedings, Part II 14
Johnson, J., Alahi, A., Fei-Fei, L.: Perceptual losses for real-time style transfer and super-resolution. In: Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11-14, 2016, Proceedings, Part II 14. pp. 694–711. Springer (2016)
2016
-
[25]
In: International Conference on Learning Representations (ICLR)
Kingma, D., Ba, J.: Adam: A method for stochastic optimization. In: International Conference on Learning Representations (ICLR). San Diega, CA, USA (2015)
2015
-
[26]
ACM Transactions on Graphics36(4) (2017)
Knapitsch, A., Park, J., Zhou, Q.Y., Koltun, V.: Tanks and temples: Benchmarking large-scale scene reconstruction. ACM Transactions on Graphics36(4) (2017)
2017
-
[27]
Advances in neural information processing systems30 (2017)
Li,Y.,Fang,C.,Yang,J.,Wang,Z.,Lu,X.,Yang,M.H.:Universalstyletransfervia feature transforms. Advances in neural information processing systems30 (2017)
2017
-
[28]
In: Computer Vision– ECCV 2014: 13th European Conference, Zurich, Switzerland, September 6-12, 2014, Proceedings, Part V 13
Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., Zitnick, C.L.: Microsoft coco: Common objects in context. In: Computer Vision– ECCV 2014: 13th European Conference, Zurich, Switzerland, September 6-12, 2014, Proceedings, Part V 13. pp. 740–755...
2014
-
[29]
In: Pro- ceedings of the IEEE conference on computer vision and pattern recognition
Luan, F., Paris, S., Shechtman, E., Bala, K.: Deep photo style transfer. In: Pro- ceedings of the IEEE conference on computer vision and pattern recognition. pp. 4990–4998 (2017)
2017
-
[30]
In: ECCV (2020)
Mildenhall, B., Srinivasan, P.P., Tancik, M., Barron, J.T., Ramamoorthi, R., Ng, R.: Nerf: Representing scenes as neural radiance fields for view synthesis. In: ECCV (2020)
2020
-
[31]
In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition
Mu,F.,Wang,J.,Wu,Y.,Li,Y.:3dphotostylization:Learningtogeneratestylized novel views from a single image. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 16273–16282 (2022)
2022
-
[32]
ACM transactions on graphics (TOG)41(4), 1–15 (2022)
Müller,T.,Evans,A.,Schied,C.,Keller,A.:Instantneuralgraphicsprimitiveswith a multiresolution hash encoding. ACM transactions on graphics (TOG)41(4), 1–15 (2022)
2022
-
[33]
ICML (2022) OSDiffST 17
Nichol, A., Dhariwal, P., Ramesh, A., Shyam, P., Mishkin, P., McGrew, B., Sutskever, I., Chen, M.: Glide: Towards photorealistic image generation and editing with text-guided diffusion models. ICML (2022) OSDiffST 17
2022
-
[34]
In: 2023 IEEE/CVF International Conference on Computer Vision (ICCV)
Pang, H.W., Hua, B.S., Yeung, S.K.: Locally stylized neural radiance fields. In: 2023 IEEE/CVF International Conference on Computer Vision (ICCV). pp. 307–
2023
-
[35]
Advances in Neural Information Processing Systems (2023)
Qin, C., Zhang, S., Yu, N., Feng, Y., Yang, X., Zhou, Y., Wang, H., Niebles, J.C., Xiong, C., Savarese, S., et al.: Unicontrol: A unified diffusion model for controllable visual generation in the wild. Advances in Neural Information Processing Systems (2023)
2023
-
[36]
In: International conference on machine learning
Radford, A., Kim, J.W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al.: Learning transferable visual models from natural language supervision. In: International conference on machine learning. pp. 8748–8763. PMLR (2021)
2021
-
[37]
arXiv preprint arXiv:2204.06125 1(2), 3 (2022)
Ramesh, A., Dhariwal, P., Nichol, A., Chu, C., Chen, M.: Hierarchical text- conditional image generation with clip latents. arXiv preprint arXiv:2204.06125 1(2), 3 (2022)
2022 arXiv
-
[38]
In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition
Rombach, R., Blattmann, A., Lorenz, D., Esser, P., Ommer, B.: High-resolution image synthesis with latent diffusion models. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. pp. 10684–10695 (2022)
2022
-
[39]
Advances in neural information processing systems35, 36479–36494 (2022)
Saharia, C., Chan, W., Saxena, S., Li, L., Whang, J., Denton, E.L., Ghasemipour, K., Gontijo Lopes, R., Karagol Ayan, B., Salimans, T., et al.: Photorealistic text- to-image diffusion models with deep language understanding. Advances in neural information processing systems35,...
2022
-
[40]
arXiv preprint arXiv:2311.17042 (2023)
Sauer, A., Lorenz, D., Blattmann, A., Rombach, R.: Adversarial diffusion distilla- tion. arXiv preprint arXiv:2311.17042 (2023)
2023 arXiv
-
[41]
In: Thirty-sixth Conference on Neural Information Processing Systems Datasets and Benchmarks Track (2022),https://openreview.net/forum?id=M3Y74vmsMcY
Schuhmann, C., Beaumont, R., Vencu, R., Gordon, C.W., Wightman, R., Cherti, M., Coombes, T., Katta, A., Mullis, C., Wortsman, M., Schramowski, P., Kun- durthy, S.R., Crowson, K., Schmidt, L., Kaczmarczyk, R., Jitsev, J.: LAION-5b: An open large-scale dataset for training next ...
2022
-
[42]
arXiv preprint arXiv:1409.1556 (2014)
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)
2014 arXiv
-
[43]
In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition
Tumanyan, N., Bar-Tal, O., Bagon, S., Dekel, T.: Splicing vit features for semantic appearance transfer. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 10748–10757 (2022)
2022
-
[44]
In: Proceedings of the IEEE/CVF International Conference on Computer Vision
Wu, X., Hu, Z., Sheng, L., Xu, D.: Styleformer: Real-time arbitrary style transfer via parametric style composition. In: Proceedings of the IEEE/CVF International Conference on Computer Vision. pp. 14618–14627 (2021)
2021
-
[45]
In: Proceedings of the AAAI Con- ference on Artificial Intelligence
Wu, Z., Song, C., Zhou, Y., Gong, M., Huang, H.: Efanet: Exchangeable feature alignment network for arbitrary style transfer. In: Proceedings of the AAAI Con- ference on Artificial Intelligence. vol. 34, pp. 12305–12312 (2020)
2020
-
[46]
In: Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
Xiao, J., Jia, W., Lam, K.M.: Feature redundancy mining: Deep light-weight im- age super-resolution model. In: Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). pp. 1620–1624 (2021)
2021
-
[47]
IEEE Trans- actions on Multimedia25, 8972–8987 (2023)
Xiao, J., Jiang, X., Zheng, N., Yang, H., Yang, Y., Yang, Y., Li, D., Lam, K.M.: Online video super-resolution with convolutional kernel bypass grafts. IEEE Trans- actions on Multimedia25, 8972–8987 (2023)
2023
-
[48]
In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition
Xiao, J., Lyu, Z., Zhang, C., Ju, Y., Shui, C., Lam, K.M.: Towards progres- sive multi-frequency representation for image warping. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 2995– 3004 (2024) 18 Yushen Zuo et al
2024
-
[49]
In: 2023 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) (2023)
Xie, H., Huang, Z., Leung, F.H.F., Ju, Y., Zheng, Y.P., Ling, S.H.: A structure- affinity dual attention-based network to segment spine for scoliosis assessment. In: 2023 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) (2023)
2023
-
[50]
In: 2024 IEEE International Symposium on Biomedical Imaging (ISBI) (2024)
Xie, H., Huang, Z., Leung, F.H.F., Law, N.F., Ju, Y., Zheng, Y.P., Ling, S.H.: Satr: A structure-affinity attention-based transformer encoder for spine segmentation. In: 2024 IEEE International Symposium on Biomedical Imaging (ISBI) (2024)
2024
-
[51]
In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition
Xu, H., Zhang, J., Cai, J., Rezatofighi, H., Tao, D.: Gmflow: Learning optical flow via global matching. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 8121–8130 (2022)
2022
-
[52]
In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition
Yoo, S., Kim, K., Kim, V.G., Sung, M.: As-plausible-as-possible: Plausibility-aware mesh deformation using 2d diffusion priors. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 4315–4324 (2024)
2024
-
[53]
In: Proceedings of the IEEE/CVF International Conference on Computer Vision
Zhang, L., Rao, A., Agrawala, M.: Adding conditional control to text-to-image diffusion models. In: Proceedings of the IEEE/CVF International Conference on Computer Vision. pp. 3836–3847 (2023)
2023
-
[54]
In: Proceedings of the IEEE/CVF con- ference on computer vision and pattern recognition
Zhang, Y., Huang, N., Tang, F., Huang, H., Ma, C., Dong, W., Xu, C.: Inversion- based style transfer with diffusion models. In: Proceedings of the IEEE/CVF con- ference on computer vision and pattern recognition. pp. 10146–10156 (2023)
2023
-
[55]
Zhao, S., Chen, D., Chen, Y.C., Bao, J., Hao, S., Yuan, L., Wong, K.Y.K.: Uni- controlnet:All-in-onecontroltotext-to-imagediffusionmodels.AdvancesinNeural Information Processing Systems36 (2024)
2024
-
[56]
ACM Transactions on Graphics (TOG) 43(4), 1–12 (2024)
Zhuang, J., Kang, D., Cao, Y.P., Li, G., Lin, L., Shan, Y.: Tip-editor: An accurate 3d editor following both text-prompts and image-prompts. ACM Transactions on Graphics (TOG) 43(4), 1–12 (2024)
2024
-
[316]
IEEE Computer Society (2023)
2023
Reviewed August 12, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.