Pith. sign in

REVIEW 5 major objections 6 minor 62 references

FICGen: Frequency-Inspired Contextual Disentanglement for Layout-driven Degraded Image Generation

T0 review · 5 major / 6 minor · reviewed 2026-08-05 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read Separating high-frequency instance detail from low-frequency context in the Fourier domain, and injecting both into a frozen diffusion model, fixes layout-to-image generation in degraded scenes and improves downstream detection.

desk verdict FICGen's frequency-disentanglement story is appealing and the experiments are broad, but the prototype dictionary pulls real training instances into every generated image, so the headline gains are not yet cleanly attributable to the method. read the letter →

arxiv 2509.01107 v1 pith:QJAYFBNU submitted 2025-09-01 cs.CV

Wenzhuang Wang , Yifan Zhao , Mingcan Ma , Ming Liu , Zhonglin Jiang , Yong Chen , Jia Li This is my paper
classification cs.CV
keywords layout-to-imagegenerationdegradedimagesynthesisfrequencydisentanglementlatentdiffusionmodelscontextualillusiondilemmalow-lightandunderwaterimagingprototypesdata-centricobjectdetection
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper targets layout-to-image (L2I) generation in degraded scenes — low light, underwater, aerial, adverse weather, blur — where prior generators entangle foreground objects with their surroundings and produce wrong object counts, positions, or interactions, a failure it names the 'contextual illusion dilemma.' Its explanation is spectral: degraded images attenuate the high-frequency detail that defines objects while low-frequency context dominates, so FICGen splits the two in the Fourier domain and feeds both back into a frozen latent diffusion model as conditioning tokens. The design combines frequency prototypes extracted from training exemplars, a learnable dual-query resampler, a visual-frequency enhanced attention with an instance coherence map, and an adaptive spatial-frequency aggregation module. Across five degraded benchmarks the paper reports that FICGen surpasses existing L2I methods in fidelity (FID), layout alignment (detection AP), and downstream trainability, including a ~2.0 mAP gain when synthetic images are added to detector training. The reader should care because a plug-and-play adapter that produces on-demand degraded training data would relieve the severe data scarcity in extreme-condition perception.

What carries the argument

The load-bearing object is the frequency prototype pair (p↑, p↓): training-set instance features are transformed into the Fourier domain and split by a single fixed binary mask whose parameter γ sets the passband, encoding the premise that instance detail lives in high frequencies and context in low frequencies. Around it sit three mechanisms: a learnable dual-query mechanism whose HF and LF frequency perceiver resamplers turn prototypes into frequency-aware tokens; visual-frequency enhanced attention injecting those tokens into the frozen latent-diffusion U-Net, with an instance coherence map (a hard per-box 0/1 mask) blocking feature leakage between instances and background; and the adapti

What would settle it

Swap the two prototype channels in a trained model — route the high-frequency instance prototypes into the context branch and the low-frequency context prototype into the instance branch — and measure detector alignment on the same synthetic test sets; if scores do not drop sharply, the claimed instance/context frequency assignment is not what carries the gain. A complementary check: sweep the mask parameter γ of Eq. 3 over a wide range, including per-class masks; if alignment stays flat, the binary spectral split is not the operative mechanism.

Watch

Extended reading notes

Core claim

FICGen's diagnosis: in degraded scenes, high-frequency object detail is attenuated while low-frequency context dominates, so layout generators entangle instances with surroundings and hallucinate wrong counts, positions, and interactions — the 'contextual illusion dilemma.' Its answer: extract high-frequency instance and low-frequency context prototypes with a binary Fourier mask, refine them through dual-query resamplers, and inject them into a frozen Stable Diffusion U-Net via visual-frequency attention, an instance-coherence mask, and adaptive spatial-frequency aggregation. Across five degraded benchmarks FICGen beats prior L2I methods — 27.6 vs 23.6 mAP over CC-Diff on DIOR-H — and gives

Load-bearing premise

The whole pipeline rests on the assumption that one fixed frequency-filtering setting cleanly separates object detail from background across every object class and every degradation type at once — a single binary mask in the Fourier domain whose parameter γ is never reported, varied, or checked against real image statistics.

Editorial extensions

If this is right

  • One adapter trained once on a frozen diffusion backbone covers multiple degradations — the same FICGen weights are reported to beat per-scenario baselines on low-light, underwater, aerial, weather, and blur benchmarks.
  • Synthetic degraded images can serve as auxiliary training data: mixing them into detector training yields ~2.0 mAP overall and larger per-class gains (e.g., +5.7 AP for 'bus' on DAWN), directly addressing data scarcity.
  • Because the design leaves the pretrained diffusion model frozen, FICGen is claimed to be a plug-and-play component for other diffusion-based generators.
  • Layout control extends beyond the training distribution: flipped, translated, and oriented boxes still generate coherent scenes, so annotated layouts can be augmented to create labeled data on demand.
  • On ExDARK the synthetic images align with their layouts better than the real test set does (AP 42.5 vs 37.2 oracle), implying synthetic data can be not merely a proxy but a closer match to the layout condition.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The fixed mask parameter γ is never reported, ablated, or validated against image statistics; a natural test the authors left open is to learn or sweep the mask per class and per degradation, which would reveal whether the binary spectral split — rather than the added parameters — carries the gain.
  • The spectral premise implies a testable ranking: gains should be largest where instance and background spectra are most separated (small crisp objects on flat, low-texture backgrounds) and smallest where blur or textured backgrounds smear frequencies; the paper's own per-class tables could be re-analysed to check this prediction.
  • If the mechanism is degradation-agnostic as described, it should transfer beyond the five benchmarks to haze, night-vision, medical, or industrial imaging — an extension the paper does not run.
  • The paper's acknowledged failure case (tiny vehicles lost to latent downsampling) indicates Fourier prototypes cannot restore detail destroyed by the autoencoder, pointing to a companion high-resolution or super-resolution latent branch as the next logical step.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

5 major / 6 minor

Summary. The paper proposes FICGen, a layout-to-image (L2I) generation method targeting degraded scenes (low-light, underwater, aerial, weather, blur). It is built on a frozen Stable Diffusion v1.5 latent diffusion model and injects frequency prototypes into the denoising process through a dual-query frequency perceiver resampler, a visual-frequency enhanced attention module, an instance coherence map, and an adaptive spatial-frequency aggregation module. The authors evaluate FID fidelity, layout alignment via off-the-shelf detectors, and downstream detector trainability on five degraded benchmarks plus natural VOC 2012, and report consistent improvements over MIGC and CC-Diff, along with robustness to unseen layouts and occlusion levels.

Significance. If the reported gains are truly attributable to the proposed frequency-inspired contextual disentanglement, FICGen would be a practical plug-and-play data-augmentation tool for degraded-scene object detection using a frozen LDM. The empirical surface is broad: five degraded datasets, four detector families, multiple trainability protocols, occlusion-level breakdowns, and efficiency comparisons. The method also includes ablations of its three main modules. However, the central attribution of the gains is compromised by the prototype construction in Sec. 3.2, which injects real training-set instance crops into every generated image, and by an unvalidated fixed frequency-mask hyperparameter. These issues must be resolved before the headline claims can be accepted.

major comments (5)
  1. [§3.2, §4.2.1, Table 1] The prototype construction confounds the central claim. FICGen builds class-specific dictionaries by collecting same-class instances from the training set, samples a real degraded instance for each bbox, and derives the HF/LF prototypes used in Eqs. (5)–(6) from those real crops. At inference and in the trainability protocol, these prototypes are drawn from the training split and injected into the frozen LDM. Synthetic test images therefore contain real training instances. This explains suspicious results such as FICGen exceeding the Oracle on ExDARK (42.5 vs. 37.2 mAP in Table 1) and inflates the trainability comparison, since the generated set is built from the same real instances used for training the detector, effectively doubling exposure. The paper does not compare with a copy-paste baseline (simply pasting sampled real crops into the layout) nor ablate the prototype source. Withou
  2. [§3.2, Eq. (3)] The frequency-disentanglement mechanism depends on a single fixed binary Fourier mask parameterized by γ, but γ is never reported, ablated, or validated. The same mask is applied to all classes and all degradation types, even though the paper argues that degradation alters the HF/LF balance (Fig. 2). If blur spreads high frequencies, backgrounds are textured, or objects themselves are low-frequency blobs, the prototypes encode the wrong cues and the claimed benefit disappears. Please report γ for each dataset, ablate it, and provide a quantitative check that the HF/LF split tracks instance/context (e.g., overlap between HF prototypes and instance masks).
  3. [Abstract, Table 1, Table 8] The abstract claims FICGen 'consistently surpasses existing L2I methods in terms of generative fidelity.' The paper's own FID numbers contradict this. On DIOR-H (Table 1) FICGen achieves FID 31.25 vs. CC-Diff 30.88, and on natural VOC 2012 (Table 8) FICGen achieves 48.93 vs. CC-Diff 48.70. Thus in two of the reported settings FICGen is worse on fidelity than the closest baseline. The fidelity claim should be qualified, or a fidelity-improving variant should be added.
  4. [§4.2.1, Table 4] The most practically relevant trainability setting in Table 4, 'Train with Real & Synthetic Data,' does not support the claim that FICGen consistently achieves the highest gains. In that block FICGen obtains mAP 50.5, below MIGC (51.7) and CC-Diff (50.9). The text instead highlights per-class gains and states 'the last three rows' of Table 4 demonstrate the benefit, which is misleading. The claims need to be reconciled with the full table, and the authors should explain why FICGen underperforms in the mixed real+synthetic protocol while leading in other protocols.
  5. [§4.2.1, Tables 1–5] No error bars, multiple seeds, or statistical tests are reported. Several headline differences are small (e.g., Table 5 DAWN mAP 25.9 vs. 25.8; Table 4 VOC mAP differences of less than 1 point). With no code or configuration files released and no seed variability, it is impossible to assess whether these differences are significant. At minimum, report standard deviations over at least three seeds for the main fidelity/alignment/trainability tables.
minor comments (6)
  1. [§3.3] The text refers to the visual-frequency enhanced attention module as '(Fig.3(c))', but Fig. 3(c) is the Adaptive Spatial-Frequency Aggregation module; the attention module appears to be Fig. 3(b). Please correct the reference.
  2. [§4.2.1] The phrase 'As shown in the last three rows of Tab. 4' is ambiguous because Table 4 has four blocks (Full Real Data, Pure Synthetic, Synthetic + Finetune, Real & Synthetic), each with different row counts. Please refer to the specific rows by setting name.
  3. [Eq. (3)] The logical combination of the two coordinate conditions in the binary mask is unclear: is MF=1 when both u and v are outside the central band, or when either is outside? Also, the text says '|v| and |u| denote the width and height of normalised frequencies,' which is confusing; please define the coordinates precisely.
  4. [Supp. B] FID scores are computed with different Inception variants (standard vs. RSICD-finetuned for remote sensing). This detail is only in the supplement; the main text should state that cross-dataset FID comparisons are not meaningful.
  5. [§1] The paper claims FICGen 'can be seamlessly integrated as a plug-and-play component to enhance other diffusion-based generative models,' but only SDv1.5 is used as the base model. This claim is not demonstrated and should be either supported or removed.
  6. [General] No code or configuration files are released. Given the number of hyperparameters (γ, N=15, classifier-free guidance scale, training schedule), reproducibility would benefit from releasing the exact settings, especially the unreported γ value.

Circularity Check

0 steps flagged · score 1.0 of 10

No significant circularity: FICGen's headline numbers come from external benchmark comparisons with fixed baselines and off-the-shelf detectors; the frequency-prototype conditioning is an experimental design choice, not a fitted prediction of the evaluation metrics.

full rationale

The paper's central claims are empirical and self-contained against external benchmarks. FID and detection AP are computed on synthetic test images using off-the-shelf detectors (Faster R-CNN, Cascade R-CNN, YOLOv8, Deformable-DETR), and the comparison baselines (MIGC, CC-Diff, AeroGen, GLIGEN, etc.) are external methods with reported numbers reproduced under similar settings. The frequency prototypes are constructed by collecting real same-class instances from the training set (§3.2: 'we first build a class-specific dictionary by collecting same-class instances from the training set. A degraded instance is then sampled and assigned to the i-th bbox based on its position'), but this is a conditioning mechanism, not a fitted parameter that is later renamed a prediction. The training objective (Eq. 15) is the standard latent-diffusion MSE with the LDM frozen and only FICGen parameters trained; it does not optimize FID or AP. The trainability protocol follows GeoDiffusion [3] and mixes real and synthetic images; using ground-truth boxes from the training split to synthesize extra data is an experimental design that can be questioned for retrieval leakage, and the absence of a copy-paste baseline is a validity concern, but it is not an input-output identity or a fitted-input-called-prediction step. The fixed frequency mask γ (Eq. 3) is an explicit hyperparameter/assumption, not an equation that reduces to the evaluation metrics. The only self-citation is [45] in Related Work, used as background for data-centric synthesis; nothing load-bearing depends on it. The stated limitation about small objects in high-resolution remote sensing (Fig. 14) is an honest performance caveat, not a circular dependency. Therefore, no circular step meets the required quoted-reduction bar.

Assumptions & free parameters 4 free parameters · 5 assumptions · 0 invented entities

The central claim rests mostly on three assumptions: the frequency-domain separation in Eq. 3, transferability of training-set frequency prototypes to test layouts, and validity of detection AP on synthetic images as an alignment measure. The paper relies on a pretrained Stable Diffusion model but freezes it, so it does not need to justify diffusion training from scratch. No physical entity or new conserved quantity is introduced.

free parameters (4)
  • gamma = not reported
    Binary mask boundary in Eq. 3; hand-set and never ablated. It controls how much of the spectrum is treated as high-frequency instance detail versus low-frequency context.
  • max objects per image N = 15
    Supplementary Section B restricts generated images to at most 15 objects following AeroGen. Performance on denser or sparser layouts is not characterized.
  • classifier-free guidance scale = 7.5
    Inference hyperparameter that affects the fidelity-alignment trade-off; not swept in the paper.
  • training schedule = 300 epochs, AdamW lr 1e-4, batch 320
    Fixed uniformly across datasets, with no sensitivity analysis or comparison to shorter schedules.
assumptions (5)
  • domain assumption A fixed binary Fourier mask (Eq. 3) separates high-frequency instance cues from low-frequency context cues in degraded images.
    All modules consume prototypes produced by this split. The paper motivates it with Fig. 2 but gives no quantitative validation and never reports gamma.
  • domain assumption Class-specific frequency prototypes built from training-set instances transfer to test layouts, including unseen layouts.
    Section 3.2 collects same-class instances in a dictionary and assigns them by position; the generalization experiments assume this transfer.
  • domain assumption A frozen Stable Diffusion v1.5 latent U-Net can absorb frequency tokens through injected attention without retraining the base model.
    Section 3.5 keeps the pretrained parameters fixed and trains only FICGen. If the frozen U-Net cannot represent degraded-domain distributions, the method fails.
  • domain assumption Detection AP on synthetic images generated from ground-truth boxes measures layout alignment.
    Tables 1-3 evaluate alignment by running off-the-shelf detectors. Synthetic images that are easier for detectors than real ones can inflate AP without improving true visual fidelity.
  • standard math Discrete Fourier transform and inverse DFT are well-defined and information-preserving for the feature maps in Eqs. 2-4.
    The prototype extraction pipeline relies on DFT/inverse DFT as a linear, invertible transform.

how reviews work

0 comments
Cite this review

Pith. "Pith review of FICGen: Frequency-Inspired Contextual Disentanglement for Layout-driven Degraded Image Generation." pith.science (2026). https://pith.science/paper/QJAYFBNU

@misc{pith2026250901107,
  author       = {Pith},
  title        = {Pith review of: FICGen: Frequency-Inspired Contextual Disentanglement for Layout-driven Degraded Image Generation},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/QJAYFBNU}},
  note         = {Machine review of arXiv:2509.01107}
}
read the original abstract

Layout-to-image (L2I) generation has exhibited promising results in natural domains, but suffers from limited generative fidelity and weak alignment with user-provided layouts when applied to degraded scenes (i.e., low-light, underwater). We primarily attribute these limitations to the "contextual illusion dilemma" in degraded conditions, where foreground instances are overwhelmed by context-dominant frequency distributions. Motivated by this, our paper proposes a new Frequency-Inspired Contextual Disentanglement Generative (FICGen) paradigm, which seeks to transfer frequency knowledge of degraded images into the latent diffusion space, thereby facilitating the rendering of degraded instances and their surroundings via contextual frequency-aware guidance. To be specific, FICGen consists of two major steps. Firstly, we introduce a learnable dual-query mechanism, each paired with a dedicated frequency resampler, to extract contextual frequency prototypes from pre-collected degraded exemplars in the training set. Secondly, a visual-frequency enhanced attention is employed to inject frequency prototypes into the degraded generation process. To alleviate the contextual illusion and attribute leakage, an instance coherence map is developed to regulate latent-space disentanglement between individual instances and their surroundings, coupled with an adaptive spatial-frequency aggregation module to reconstruct spatial-frequency mixed degraded representations. Extensive experiments on 5 benchmarks involving a variety of degraded scenarios-from severe low-light to mild blur-demonstrate that FICGen consistently surpasses existing L2I methods in terms of generative fidelity, alignment and downstream auxiliary trainability.

Figures

Figures reproduced from arXiv: 2509.01107 by the authors.

Figure 1
Figure 1. Visualizations of degraded image generation by our FICGen. FICGen achieves superior quality compared to existing L2I methods and demonstrates strong robustness to OOD layouts. Moreover, it shows excellent trainability for boosting object detectors, i.e., Faster R-CNN (R50) [32]. The alignment and trainability are evaluated on the ExDARK [19] and DIOR-H [15], respectively. Abstract Layout-to-image (L2I) generation ha… view at source ↗
Figure 2
Figure 2. Frequency spectrum comparison between natural and [PITH_FULL_IMAGE:figures/full_fig_p002_2.png] view at source ↗
Figure 3
Figure 3. The overview pipeline of our FICGen, consisting of (a) Frequency Perceiver Resamplers, (b) Visual-Frequency Enhanced Attention, and (c) Adaptive Spatial-Frequency Aggregation. where F −1 denotes the inverse DFT. The result X ↑ repre￾sents the enhanced HF feature map. A similar process is applied to the complementary region using 1−MF , yielding the LF feature map X ↓ . Inspired by the prototypical learning, we adopt… view at source ↗
Figures from the paper (15 more)
Figure 4
Figure 4. Figure 4: Qualitative comparison of degraded images generated by different L2I methods across various scenarios. Zoom in for better details. [PITH_FULL_IMAGE:figures/full_fig_p006_4.png]
Figure 5
Figure 5. Figure 5: Visualization results generated by our FICGen on unseen [PITH_FULL_IMAGE:figures/full_fig_p007_5.png]
Figure 6
Figure 6. Figure 6: Performance convergence curves when generated de [PITH_FULL_IMAGE:figures/full_fig_p008_6.png]
Figure 7
Figure 7. Figure 7: Generalization results of FICGen on mildly blurred and [PITH_FULL_IMAGE:figures/full_fig_p008_7.png]
Figure 8
Figure 8. Figure 8: Qualitative comparison of natural images (VOC 2012 [ [PITH_FULL_IMAGE:figures/full_fig_p014_8.png]
Figure 9
Figure 9. Figure 9: Further qualitative comparison with CC-Diff on ExDARK [PITH_FULL_IMAGE:figures/full_fig_p014_9.png]
Figure 11
Figure 11. Figure 11: Visualization results of the continuous generation of [PITH_FULL_IMAGE:figures/full_fig_p015_11.png]
Figure 10
Figure 10. Figure 10: Visualization results generated by FICGen conditioned [PITH_FULL_IMAGE:figures/full_fig_p015_10.png]
Figure 12
Figure 12. Figure 12: Architectural details of the proposed Adaptive Spatial [PITH_FULL_IMAGE:figures/full_fig_p017_12.png]
Figure 14
Figure 14. Figure 14: Failure cases of FICGen, where red dashed boxes denote [PITH_FULL_IMAGE:figures/full_fig_p018_14.png]
Figure 15
Figure 15. Figure 15: Visualization results generated by our FICGen under the mild blur (blurred VOC 2012), with geometric layouts and corresponding [PITH_FULL_IMAGE:figures/full_fig_p019_15.png]
Figure 16
Figure 16. Figure 16: Visualization results generated by our FICGen under low-light conditions (ExDARK [ [PITH_FULL_IMAGE:figures/full_fig_p019_16.png]
Figure 17
Figure 17. Figure 17: Visualization results generated by our FICGen under the underwater scene (RUOD [ [PITH_FULL_IMAGE:figures/full_fig_p020_17.png]
Figure 18
Figure 18. Figure 18: Visualization results generated by our FICGen under the remote sensing scene (DIOR [ [PITH_FULL_IMAGE:figures/full_fig_p020_18.png]
Figure 19
Figure 19. Figure 19: Visualization results generated by our FICGen under the adverse weather condition (DAWN [ [PITH_FULL_IMAGE:figures/full_fig_p021_19.png]

Discussion (0). Sign in to comment.

Reference graph

Works this paper leans on

62 extracted references · 44 canonical work pages

  1. [1]

    Cascade r-cnn: Delving into high quality object detection

    Zhaowei Cai and Nuno Vasconcelos. Cascade r-cnn: Delving into high quality object detection. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 6154–6162, 2018. 5, 6, 12, 13

    work page 2018

  2. [2]

    Mmdetec- tion: Openmmlab detection toolbox and benchmark, 2019

    Kai Chen, Jiaqi Wang, Jiangmiao Pang, and et al. Mmdetec- tion: Openmmlab detection toolbox and benchmark, 2019. 12

    work page 2019

  3. [3]

    Geodiffusion: Text- prompted geometric control for object detection data gen- eration

    Kai Chen, Enze Xie, Zhe Chen, Yibo Wang, Lanqing Hong, Zhenguo Li, and Dit-Yan Yeung. Geodiffusion: Text- prompted geometric control for object detection data gen- eration. arXiv preprint arXiv:2306.04607, 2023. 3, 4, 5, 6, 12, 13

    arXiv 2023

  4. [4]

    Anchor-free oriented proposal generator for object detection

    Gong Cheng, Jiabao Wang, Ke Li, Xingxing Xie, Chunbo Lang, Yanqing Yao, and Junwei Han. Anchor-free oriented proposal generator for object detection. IEEE Transactions on Geoscience and Remote Sensing, 60:1–11, 2022. 7, 14

    work page 2022

  5. [5]

    Layoutdiffuse: Adapting foundational dif- fusion models for layout-to-image generation

    Jiaxin Cheng, Xiao Liang, Xingjian Shi, Tong He, Tianjun Xiao, and Mu Li. Layoutdiffuse: Adapting foundational dif- fusion models for layout-to-image generation. arXiv preprint arXiv:2302.08908, 2023. 4

    arXiv 2023

  6. [6]

    The pascal visual object classes (voc) challenge

    Mark Everingham, Luc Van Gool, Christopher KI Williams, John Winn, and Andrew Zisserman. The pascal visual object classes (voc) challenge. International journal of computer vision, 88:303–338, 2010. 2, 5, 7, 12, 13, 14

    work page 2010

  7. [7]

    Rethinking general underwater object detection: Datasets, challenges, and solutions

    Chenping Fu, Risheng Liu, Xin Fan, Puyang Chen, Hao Fu, Wanqi Yuan, Ming Zhu, and Zhongxuan Luo. Rethinking general underwater object detection: Datasets, challenges, and solutions. Neurocomputing, 517:243–256, 2023. 2, 5, 6, 12, 13, 16, 20

    work page 2023

  8. [8]

    Make-a-scene: Scene-based text-to-image generation with human priors

    Oran Gafni, Adam Polyak, Oron Ashual, Shelly Sheynin, Devi Parikh, and Yaniv Taigman. Make-a-scene: Scene-based text-to-image generation with human priors. In European Conference on Computer Vision , pages 89–106. Springer,

    work page

Show all 62 references
  1. [9]

    Roictrl: Boosting instance control for visual generation.arXiv preprint arXiv:2411.17949, 2024

    Yuchao Gu, Yipin Zhou, Yunfan Ye, Yixin Nie, Licheng Yu, Pingchuan Ma, Kevin Qinghong Lin, and Mike Zheng Shou. Roictrl: Boosting instance control for visual generation.arXiv preprint arXiv:2411.17949, 2024. 2, 3

    2024 arXiv

  2. [10]

    Gans trained by a two time-scale update rule converge to a local nash equilibrium

    Martin Heusel, Hubert Ramsauer, Thomas Unterthiner, Bern- hard Nessler, and Sepp Hochreiter. Gans trained by a two time-scale update rule converge to a local nash equilibrium. Advances in neural information processing systems, 30, 2017. 6

    2017

  3. [11]

    Classifier-free diffusion guidance

    Jonathan Ho and Tim Salimans. Classifier-free diffusion guidance. arXiv preprint arXiv:2207.12598, 2022. 5

    2022 arXiv

  4. [12]

    Denoising diffu- sion probabilistic models

    Jonathan Ho, Ajay Jain, and Pieter Abbeel. Denoising diffu- sion probabilistic models. Advances in neural information processing systems, 33:6840–6851, 2020. 3

    2020

  5. [13]

    Elucidating the design space of diffusion-based generative models

    Tero Karras, Miika Aittala, Timo Aila, and Samuli Laine. Elucidating the design space of diffusion-based generative models. Advances in neural information processing systems, 35:26565–26577, 2022. 5

    2022

  6. [14]

    Dawn: vehicle detection in adverse weather nature dataset

    Mourad A Kenk and Mahmoud Hassaballah. Dawn: vehicle detection in adverse weather nature dataset. arXiv preprint arXiv:2008.05402, 2020. 2, 5, 7, 12, 13, 16, 21

    2008 arXiv

  7. [15]

    Object detection in optical remote sensing images: A survey and a new benchmark

    Ke Li, Gang Wan, Gong Cheng, Liqiu Meng, and Junwei Han. Object detection in optical remote sensing images: A survey and a new benchmark. ISPRS journal of photogrammetry and remote sensing, 159:296–307, 2020. 1, 2, 5, 7, 12, 13, 16, 20

    2020

  8. [16]

    Gligen: Open-set grounded text-to-image generation

    Yuheng Li, Haotian Liu, Qingyang Wu, Fangzhou Mu, Jian- wei Yang, Jianfeng Gao, Chunyuan Li, and Yong Jae Lee. Gligen: Open-set grounded text-to-image generation. In Pro- ceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 22511–22521, 2023. 2...

    2023

  9. [17]

    Microsoft coco: Common objects in context

    Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Doll´ar, and C Lawrence Zitnick. Microsoft coco: Common objects in context. In Computer vision–ECCV 2014: 13th European conference, zurich, Switzerland, September 6-12, 2014, proceeding...

    2014

  10. [18]

    Focal loss for dense object detection

    Tsung-Yi Lin, Priya Goyal, Ross Girshick, Kaiming He, and Piotr Doll´ar. Focal loss for dense object detection. In Pro- ceedings of the IEEE international conference on computer vision, pages 2980–2988, 2017. 7

    2017

  11. [19]

    Getting to know low- light images with the exclusively dark dataset

    Yuen Peng Loh and Chee Seng Chan. Getting to know low- light images with the exclusively dark dataset. Computer Vision and Image Understanding, 178:30–42, 2019. 1, 2, 5, 6, 7, 12, 13, 16, 19

    2019

  12. [20]

    Decoupled weight decay regularization

    I Loshchilov. Decoupled weight decay regularization. arXiv preprint arXiv:1711.05101, 2017. 5

    2017 arXiv

  13. [21]

    Exploring models and data for remote sensing image caption generation

    Xiaoqiang Lu, Binqiang Wang, Xiangtao Zheng, and Xuelong Li. Exploring models and data for remote sensing image caption generation. IEEE Transactions on Geoscience and Remote Sensing, 56(4):2183–2195. 12

  14. [22]

    Place: Adaptive layout-semantic fusion for semantic image synthesis

    Zhengyao Lv, Yuxiang Wei, Wangmeng Zuo, and Kwan- Yee K Wong. Place: Adaptive layout-semantic fusion for semantic image synthesis. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 9264–9274, 2024. 2

    2024

  15. [23]

    Boosting broader receptive fields for salient object detection

    Mingcan Ma, Changqun Xia, Chenxi Xie, Xiaowu Chen, and Jia Li. Boosting broader receptive fields for salient object detection. IEEE Transactions on Image Processing, 32:1026– 1038, 2023. 2

    2023

  16. [24]

    T2i-adapter: Learning adapters to dig out more controllable ability for text-to-image diffusion models

    Chong Mou, Xintao Wang, Liangbin Xie, Yanze Wu, Jian Zhang, Zhongang Qi, and Ying Shan. T2i-adapter: Learning adapters to dig out more controllable ability for text-to-image diffusion models. In Proceedings of the AAAI conference on artificial intelligence, pages 4296–4304, 2024. 3

    2024

  17. [25]

    Glide: Towards photorealistic image generation and editing with text-guided diffusion models

    Alex Nichol, Prafulla Dhariwal, Aditya Ramesh, Pranav Shyam, Pamela Mishkin, Bob McGrew, Ilya Sutskever, and Mark Chen. Glide: Towards photorealistic image generation and editing with text-guided diffusion models. arXiv preprint arXiv:2112.10741, 2021. 3

    2021 arXiv

  18. [26]

    High-fidelity performance metrics for generative models in pytorch, 2020

    Anton Obukhov, Maximilian Seitzer, Po-Wei Wu, Semen Zhydenko, Jonathan Kyl, and Elvis Yu-Jing Lin. High-fidelity performance metrics for generative models in pytorch, 2020. Version: 0.3.0, DOI: 10.5281/zenodo.4957738. 12

    2020 doi

  19. [27]

    Sdxl: Improving latent diffusion models for high-resolution image synthesis

    Dustin Podell, Zion English, Kyle Lacey, Andreas Blattmann, Tim Dockhorn, Jonas M¨uller, Joe Penna, and Robin Rombach. Sdxl: Improving latent diffusion models for high-resolution image synthesis. arXiv preprint arXiv:2307.01952, 2023. 3

    2023 arXiv

  20. [28]

    Learning transferable visual models from natural language supervi- sion

    Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. Learning transferable visual models from natural language supervi- sion. In International conference on machine learning, ...

    2021

  21. [29]

    Zero-shot text-to-image generation

    Aditya Ramesh, Mikhail Pavlov, Gabriel Goh, Scott Gray, Chelsea V oss, Alec Radford, Mark Chen, and Ilya Sutskever. Zero-shot text-to-image generation. In International confer- ence on machine learning , pages 8821–8831. Pmlr, 2021. 3

    2021

  22. [30]

    Hierarchical text-conditional image genera- tion with clip latents

    Aditya Ramesh, Prafulla Dhariwal, Alex Nichol, Casey Chu, and Mark Chen. Hierarchical text-conditional image genera- tion with clip latents. arXiv preprint arXiv:2204.06125, 1(2): 3, 2022. 2, 3

    2022 arXiv

  23. [31]

    Generative adver- sarial text to image synthesis

    Scott Reed, Zeynep Akata, Xinchen Yan, Lajanugen Lo- geswaran, Bernt Schiele, and Honglak Lee. Generative adver- sarial text to image synthesis. In International conference on machine learning, pages 1060–1069. PMLR, 2016. 3

    2016

  24. [32]

    Faster r-cnn: Towards real-time object detection with region proposal networks

    Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun. Faster r-cnn: Towards real-time object detection with region proposal networks. Advances in neural information process- ing systems, 28, 2015. 1, 5, 6, 7, 12, 13, 15, 16

    2015

  25. [33]

    High-resolution image synthesis with latent diffusion models

    Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Bj ¨orn Ommer. High-resolution image synthesis with latent diffusion models. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 10684–10695, 2022. 3, 12

    2022

  26. [34]

    U- net: Convolutional networks for biomedical image segmen- tation

    Olaf Ronneberger, Philipp Fischer, and Thomas Brox. U- net: Convolutional networks for biomedical image segmen- tation. In Medical image computing and computer-assisted intervention–MICCAI 2015: 18th international conference, Munich, Germany, October 5-9, 2015, proceedings, pa...

    2015

  27. [35]

    Pho- torealistic text-to-image diffusion models with deep language understanding

    Chitwan Saharia, William Chan, Saurabh Saxena, Lala Li, Jay Whang, Emily L Denton, Kamyar Ghasemipour, Raphael Gontijo Lopes, Burcu Karagol Ayan, Tim Salimans, et al. Pho- torealistic text-to-image diffusion models with deep language understanding. Advances in neural informati...

    2022

  28. [36]

    Improved handling of motion blur in online object detection

    Mohamed Sayed and Gabriel Brostow. Improved handling of motion blur in online object detection. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 1706–1716, 2021. 12

    2021

  29. [37]

    Ros-sam: High-quality interactive segmentation for remote sensing moving object

    Zhe Shan, Yang Liu, Lei Zhou, Cheng Yan, Heng Wang, and Xia Xie. Ros-sam: High-quality interactive segmentation for remote sensing moving object. In Proceedings of the Computer Vision and Pattern Recognition Conference, pages 3625–3635, 2025. 2

    2025

  30. [38]

    Denoising diffusion implicit models

    Jiaming Song, Chenlin Meng, and Stefano Ermon. Denoising diffusion implicit models. arXiv preprint arXiv:2010.02502,

    2010 arXiv

  31. [39]

    Image synthesis from reconfigurable layout and style

    Wei Sun and Tianfu Wu. Image synthesis from reconfigurable layout and style. In Proceedings of the IEEE/CVF Interna- tional Conference on Computer Vision, pages 10531–10540,

  32. [40]

    Frequency-spatial entanglement learning for camou- flaged object detection

    Yanguang Sun, Chunyan Xu, Jian Yang, Hanyu Xuan, and Lei Luo. Frequency-spatial entanglement learning for camou- flaged object detection. In European Conference on Computer Vision, pages 343–360. Springer, 2024. 17

    2024

  33. [41]

    Aerogen: enhancing remote sensing object detec- tion with diffusion-driven data generation

    Datao Tang, Xiangyong Cao, Xuan Wu, Jialin Li, Jing Yao, Xueru Bai, Dongsheng Jiang, Yin Li, and Deyu Meng. Aerogen: enhancing remote sensing object detec- tion with diffusion-driven data generation. arXiv preprint arXiv:2411.15497, 2024. 3, 6, 12, 13, 16

    2024 arXiv

  34. [42]

    Ultralytics yolov8

    Ultralytics. Ultralytics yolov8. https://github.com/ ultralytics/ultralytics, 2023. 6

    2023

  35. [43]

    Attention is all you need

    A Vaswani. Attention is all you need. Advances in Neural Information Processing Systems, 2017. 4

    2017

  36. [44]

    Pyra- mid vision transformer: A versatile backbone for dense predic- tion without convolutions

    Wenhai Wang, Enze Xie, Xiang Li, Deng-Ping Fan, Kaitao Song, Ding Liang, Tong Lu, Ping Luo, and Ling Shao. Pyra- mid vision transformer: A versatile backbone for dense predic- tion without convolutions. In Proceedings of the IEEE/CVF international conference on computer vision...

  37. [45]

    Freegen: Bridging visual- linguistic discrepancies towards diffusion-based pixel-level data synthesis

    Wenzhuang Wang, Mingcan Ma, Yong Chen, Changqun Xia, Zhenbao Liang, and Jia Li. Freegen: Bridging visual- linguistic discrepancies towards diffusion-based pixel-level data synthesis. In Proceedings of the AAAI Conference on Artificial Intelligence, pages 7916–7924, 2025. 2

    2025

  38. [46]

    Instancediffusion: Instance- level control for image generation

    Xudong Wang, Trevor Darrell, Sai Saketh Rambhatla, Ro- hit Girdhar, and Ishan Misra. Instancediffusion: Instance- level control for image generation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 6232–6242, 2024. 3

    2024

  39. [47]

    Ifadapter: Instance feature con- trol for grounded text-to-image generation

    Yinwei Wu, Xianpan Zhou, Bing Ma, Xuefeng Su, Kai Ma, and Xinchao Wang. Ifadapter: Instance feature con- trol for grounded text-to-image generation. arXiv preprint arXiv:2409.08240, 2024. 3, 5

    2024 arXiv

  40. [48]

    Aggregated residual transformations for deep neural networks

    Saining Xie, Ross Girshick, Piotr Doll´ar, Zhuowen Tu, and Kaiming He. Aggregated residual transformations for deep neural networks. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 1492–1500,

  41. [49]

    Attngan: Fine- grained text to image generation with attentional generative adversarial networks

    Tao Xu, Pengchuan Zhang, Qiuyuan Huang, Han Zhang, Zhe Gan, Xiaolei Huang, and Xiaodong He. Attngan: Fine- grained text to image generation with attentional generative adversarial networks. In Proceedings of the IEEE confer- ence on computer vision and pattern recognition, pag...

    2018

  42. [50]

    Txt2img-mhn: Remote sensing image generation from text using modern hopfield networks

    Yonghao Xu, Weikang Yu, Pedram Ghamisi, Michael Kopp, and Sepp Hochreiter. Txt2img-mhn: Remote sensing image generation from text using modern hopfield networks. IEEE Transactions on Image Processing, 32:5737–5750, 2023. 12

    2023

  43. [51]

    Freestyle layout-to-image synthesis

    Han Xue, Zhiwu Huang, Qianru Sun, Li Song, and Wenjun Zhang. Freestyle layout-to-image synthesis. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 14256–14266, 2023. 2

    2023

  44. [52]

    Reco: Region-controlled text-to-image generation

    Zhengyuan Yang, Jianfeng Wang, Zhe Gan, Linjie Li, Kevin Lin, Chenfei Wu, Nan Duan, Zicheng Liu, Ce Liu, Michael Zeng, et al. Reco: Region-controlled text-to-image generation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 14246–142...

    2023

  45. [53]

    Ip- adapter: Text compatible image prompt adapter for text-to- image diffusion models

    Hu Ye, Jun Zhang, Sibo Liu, Xiao Han, and Wei Yang. Ip- adapter: Text compatible image prompt adapter for text-to- image diffusion models. arXiv preprint arXiv:2308.06721,

    arXiv

  46. [54]

    Scaling autoregressive mod- els for content-rich text-to-image generation

    Jiahui Yu, Yuanzhong Xu, Jing Yu Koh, Thang Luong, Gun- jan Baid, Zirui Wang, Vijay Vasudevan, Alexander Ku, Yinfei Yang, Burcu Karagol Ayan, et al. Scaling autoregressive mod- els for content-rich text-to-image generation. arXiv preprint arXiv:2206.10789, 2(3):5, 2022. 3

    2022 arXiv

  47. [55]

    Stack- gan: Text to photo-realistic image synthesis with stacked generative adversarial networks

    Han Zhang, Tao Xu, Hongsheng Li, Shaoting Zhang, Xiao- gang Wang, Xiaolei Huang, and Dimitris N Metaxas. Stack- gan: Text to photo-realistic image synthesis with stacked generative adversarial networks. In Proceedings of the IEEE international conference on computer vision , p...

    2017

  48. [56]

    Cross-modal contrastive learning for text- to-image generation

    Han Zhang, Jing Yu Koh, Jason Baldridge, Honglak Lee, and Yinfei Yang. Cross-modal contrastive learning for text- to-image generation. In Proceedings of the IEEE/CVF con- ference on computer vision and pattern recognition , pages 833–842, 2021. 3

    2021

  49. [57]

    Joint- net: Extending text-to-image diffusion for dense distribution modeling

    Jingyang Zhang, Shiwei Li, Yuanxun Lu, Tian Fang, David McKinnon, Yanghai Tsin, Long Quan, and Yao Yao. Joint- net: Extending text-to-image diffusion for dense distribution modeling. arXiv preprint arXiv:2310.06347, 2023. 2

    2023 arXiv

  50. [58]

    Cc-diff: Enhancing contextual coherence in remote sens- ing image synthesis

    Mu Zhang, Yunfan Liu, Yue Liu, Hongtian Yu, and Qixiang Ye. Cc-diff: Enhancing contextual coherence in remote sens- ing image synthesis. arXiv preprint arXiv:2412.08464, 2024. 3, 5, 6, 7, 12, 13, 15, 16

    2024 arXiv

  51. [59]

    Layoutdiffusion: Controllable diffusion model for layout-to-image generation

    Guangcong Zheng, Xianpan Zhou, Xuewei Li, Zhongang Qi, Ying Shan, and Xi Li. Layoutdiffusion: Controllable diffusion model for layout-to-image generation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 22490–22499, 2023. 2, 3, 6

    2023

  52. [60]

    Migc: Multi-instance generation controller for text-to-image synthesis

    Dewei Zhou, You Li, Fan Ma, Xiaoting Zhang, and Yi Yang. Migc: Multi-instance generation controller for text-to-image synthesis. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 6818–6828,

  53. [61]

    torch-fidelity

    Xizhou Zhu, Weijie Su, Lewei Lu, Bin Li, Xiaogang Wang, and Jifeng Dai. Deformable detr: Deformable trans- formers for end-to-end object detection. arXiv preprint arXiv:2010.04159, 2020. 6 FICGen: Frequency-Inspired Contextual Disentanglement for Layout-driven Degraded Image G...

    2010 arXiv

  54. [2024]

    2, 3, 4, 5, 6, 7, 12, 13, 15, 16

Pith tools

Reviewed August 5, 2026 · model on record in the stance chip above.