Pith. sign in

REVIEW 3 major objections 3 minor 41 references

SC-Diff: Semantically Calibrated Diffusion for Visible-to-Infrared Image Translation

T0 review · 3 major / 3 minor · reviewed 2026-08-14 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read This paper claims that semantic priors placed inside self-attention, not just at the input, yield structurally faithful visible-to-infrared translation.

desk verdict A genuine but modest mechanism that improves vis-to-IR translation and detection-oriented augmentation; the main risk is the unvalidated SAM3 masks, but empirically SGSC holds up — deserves a real referee. read the letter →

arxiv 2608.08555 v1 pith:XKQBDCVV submitted 2026-08-09 cs.CV

Junyin Zhang , Siyu Huang , Jianxiong Ye , Haowei Gong , Ruicheng Zhang , Deyu Meng , Chenqiang Gao This is my paper · ORCID
classification cs.CV
keywords visible-to-infraredimagetranslationlatentdiffusionmodelsemantic-guidedself-attentioncalibrationSAM3infraredobjectdetectiondataaugmentationcross-categoryinterference
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper is trying to establish that visible-to-infrared translation improves when semantic information is used not only to condition the diffusion model, but also to regulate which tokens attend to which inside the denoising network. It proposes SC-Diff, a latent diffusion model in which a pretrained SAM3 model with text prompts produces category masks that are merged into a semantic map, fused with the visible image as input, and converted into token-level labels for a Semantic-Guided Self-Attention Calibration (SGSC) module. SGSC adds adaptive positive biases to same-category query-key pairs, with the bias scaled by how dispersed the query's attention is across categories and how much it already favors its own category, so cross-category attention is reduced but not eliminated. If this claim is right, synthetic infrared images inherit the visible scene's object locations, shapes, and layouts, making annotations from visible images reusable for infrared object detection. The paper's experiments report the best LPIPS and FID on three paired benchmarks and higher downstream detection mAP when translated images are added to training sets.

What carries the argument

The load-bearing object is the Semantic-Guided Self-Attention Calibration (SGSC) module placed inside the denoising U-Net. It converts the SAM3 semantic map into token-level labels $\ell^{(l)}$ at the attention resolution, then rewrites the attention logits as $\tilde{A}^{(l)}_{t,ij}=\mathrm{Softmax}\bigl(S^{(l)}_{t,ij}+\lambda\,\beta^{(l)}_{t,i}\,G^{(l)}_{t,ij}\bigr)$, where $\beta^{(l)}_{t,i}=H^{(l)}_{t,i}\bigl(1-\hat{P}^{(l)}_{t,i,\ell^{(l)}_i}\bigr)$ is a query-wise calibration strength combining semantic-category attention entropy with under-attention to the query's own category, and $G^{(l)}_{t,ij}=A^{(l)}_{t,ij}M^{(l)}_{ij}/\max_r A^{(l)}_{t,ir}M^{(l)}_{ir}$ scales the bias by the original attention to same-category keys. The same-category indicator $M^{(l)}_{ij}$ ensures only tokens with equal nonzero labels are boosted. This mechanism carries the argument because it turns external semantic knowledge into an internal, query-dependent reweighting of token interactions while leaving nonzero attention mass to other categories.

What would settle it

Take a visible image in which SAM3 misses a small object, such as a distant cyclist, and compare SC-Diff with SGSC disabled. If the missed object's queries do not show reduced cross-category attention after calibration, or if LPIPS/FID do not degrade when SGSC is removed, the claim that SGSC reduces cross-category interference is not supported. A direct check is to visualize $A^{(l)}_t$ and $\tilde{A}^{(l)}_t$ at the $64\times64$ and $32\times32$ layers for that query.

Watch

Extended reading notes

Core claim

The central claim is that semantic priors should act twice in visible-to-infrared translation: once as an external condition fused with the visible image, and once as token-level labels that recalibrate self-attention inside the denoising U-Net. The recalibration, called SGSC, adds a positive logit bias to query-key pairs whose tokens carry the same semantic label, with the bias strength governed by the entropy of the query's attention across categories and by the attention the query already assigns to its own category, and the bias is further modulated by the original attention weights so that same-category keys with stronger responses receive larger boosts. This soft scheme is supposed to suppress cross-category leakage without hard masking, preserving global context while protecting object boundaries and small structures. In the reported experiments, SC-Diff achieves the best LPIPS and FID on M3FD, FLIR, and KAIST, the lowest FID on Cityscapes-to-infrared transfer, and the highest detection mAP when Cityscapes images translated by SC-Diff are added to the M3FD and FLIR training sets.

Load-bearing premise

SC-Diff assumes the pretrained SAM3 masks label the visible image correctly enough that, after resizing to the $64\times64$ and $32\times32$ attention grids, the same-category token pairs it boosts really are same-category in the target infrared image; if masks mislabel or miss objects, the calibration strengthens the wrong attention links instead of reducing cross-category interference.

Editorial extensions

If this is right

  • Generated infrared images preserve object locations, shapes, and semantic layouts from the visible input, so detection annotations inherited from visible images remain usable.
  • Augmenting real infrared training sets with SC-Diff-translated Cityscapes images improves overall mAP on M3FD and FLIR over vanilla training and over PID/F-ViTA augmentation.
  • SC-Diff reports the best LPIPS and FID on M3FD, FLIR, and KAIST among compared GAN and diffusion translators, at competitive PSNR/SSIM.
  • For out-of-distribution translation from Cityscapes, SC-Diff achieves lower FID against each target infrared distribution than PID and F-ViTA.
  • Self-attention visualizations show that SGSC reduces cross-category responses while keeping nonzero attention mass to other categories, which is the mechanism the paper attributes the improvement to.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • Editorial inference: The SGSC operation is not tied to infrared modality; any conditional diffusion task with a semantic map, such as depth- or edge-guided synthesis, could use token-level attention biases to preserve layout, so the method likely generalizes beyond thermal translation.
  • Editorial inference: The calibration strength depends on SAM3 masks surviving resizing to $64\times64$ and $32\times32$, so small-object categories are the natural failure point; deliberately corrupting or dropping masks would map how quickly the reported gains degrade.
  • Editorial inference: SC-Diff's progressive classifier-free guidance separates visible-layout guidance from semantic-map guidance, which suggests a per-category knob for $c_s$ that could emphasize rare categories; the paper does not explore this.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 3 minor

Summary. The manuscript introduces SC-Diff, a latent diffusion framework for visible-to-infrared image translation. The method uses a pretrained SAM3 model with text prompts to produce category masks from the visible image; these masks are fused with the visible latent as a clean condition, and the same masks provide token-level semantic labels that calibrate self-attention in the denoising U-Net through a Semantic-Guided Self-Attention Calibration (SGSC) module (Eqs. 12–17). SGSC adds a query-dependent positive bias to same-category query–key pairs, where the bias is scaled by the entropy of the attention distribution across categories and by the original attention weight. Experiments on M3FD, FLIR, and KAIST report the best LPIPS and FID among compared methods (Table II), and augmenting the training set with translated Cityscapes images improves infrared detector mAP on M3FD and FLIR (Table IV). The paper also reports ablations of the condition-encoding and SGSC components (Table V) and visualizations of attention maps (Fig. 7).

Significance. If the results hold, SC-Diff is a useful contribution to detection-oriented visible-to-infrared translation: the idea of using semantic priors to regulate internal self-attention rather than only external conditioning is interesting, and the reported gains are consistent across three datasets and four detectors. The paper's strengths include explicit formulas for the calibration, clean ablations, and an out-of-distribution evaluation on Cityscapes. However, the significance of the central mechanism is qualified by the unvalidated reliability of the SAM3 masks at the attention resolutions used, the absence of error bars, and the tuning of key hyperparameters on the FLIR test set. These issues are addressable but require additional experiments.

major comments (3)
  1. [Section IV.A, Eq. (17)] The SGSC mechanism depends entirely on token-level semantic labels ℓ^(l) at 64×64 and 32×32 being correct for the generated infrared image. The paper asserts that these resolutions 'can still provide sufficiently reliable region guidance' (Section IV.A), but no quantitative mask-quality evaluation is provided. If a label is wrong, Eq. (14) will treat the query as well aligned with a category it does not belong to, and with λ=10 the positive bias in Eq. (17) can strengthen the very cross-category interference the method claims to suppress. The ablations in Table V use the same automatic labels for both with-SGSC and without-SGSC conditions, so they do not distinguish 'SGSC helps' from 'SGSC helps when the labels are correct.' I request: (i) report mask quality (e.g., IoU or pixel accuracy of SAM3 masks vs. ground-truth semantic labels on a subset, and after downsampling to 64×64 and 32×32); (ii) add an ablation using ground-truth semantic maps (available, e.g., on Cityscapes) to bound the benefit of SGSC under perfect labels; and (iii) report per-category detection AP, since small-object degradation would be hidden in the aggregate mAP.
  2. [Section IV.E, Table VI] The default values of λ, c_s, and c_v are selected by FID on the FLIR test set (λ is set to 10 before Eq. (17), and c_s=2.0, c_v=1.5 are chosen in Table VI). Consequently, the reported FLIR FID of 57.66 partly reflects tuning, and the paper provides no error bars or multiple-seed runs for any dataset or table. To support the claim that SC-Diff improves perceptual quality, the authors should report means and standard deviations over at least three seeds for the main tables, and should either use a validation split for hyperparameter selection or, at minimum, show the sensitivity of the main comparisons to λ and the CFG scales on M3FD and KAIST.
  3. [Table II] Some baseline scores are quoted from prior publications (†) and were not reproduced under the paper's evaluation pipeline. Because the headline claim is that SC-Diff achieves the best LPIPS and FID on all three datasets, the comparison is only meaningful if all numbers are computed with the same preprocessing, resizing, and evaluation code. Please specify exactly which rows are quoted, and either reproduce these baselines with the paper's pipeline or clearly separate quoted from reproduced results in the abstract and tables. The same applies to the detection augmentation table (Table IV), where the 'overall' columns appear to be averages over four detectors; this should be stated explicitly.
minor comments (3)
  1. [Section III.B, Eq. (13)] The definition of n^(l) as 'the number of prompted semantic categories present at layer l' is ambiguous: it should be clarified whether this is the number of categories that actually appear in the resized label map, and how categories with zero attention mass are handled.
  2. [Fig. 7] The attention-map visualization is qualitative; a quantitative measure of cross-category attention (e.g., the fraction of attention mass assigned to non-same-category keys before and after SGSC, averaged over queries) would support the claim that SGSC reduces cross-category interference.
  3. [Table IV] It is not stated how the 'Overall' columns are computed; presumably they are averaged over the four detectors, but this should be specified in the table caption or the main text.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: SC-Diff's SGSC mechanism is fully specified from SAM3 labels and attention scores, and its gains are measured against external baselines rather than derived from its own fit.

full rationale

The paper's central derivation is self-contained. SGSC (Eqs. 11-17) is defined directly from the SAM3-derived token-level semantic labels, the original self-attention logits, and the same-category indicator; the adaptive bias and modulation are computed from these quantities, not from the reported FID, LPIPS, or detection numbers. The claimed benefit of reducing cross-category attention mass is a direct mathematical consequence of adding positive logits to same-category key positions in Eq. 17, while the further assertion that this improves translation quality is an empirical claim checked against PID, F-ViTA, DiffV2IR, and GAN baselines on M3FD, FLIR, KAIST, and Cityscapes. The hyperparameters lambda=10, c_s=2.0, and c_v=1.5 are chosen on FLIR and could mildly favor FLIR results, but this is conventional hyperparameter selection, not a fitted parameter renamed as a prediction. No load-bearing self-citation appears: SAM3 is an external pretrained model, and the compared methods PID and DiffV2IR are prior work by other author groups. The unvalidated reliability of SAM3 masks at 64x64 and 32x32 resolutions is a correctness and robustness concern, not a circularity, because the mechanism's equations do not presuppose the empirical results they are used to explain.

Assumptions & free parameters 4 free parameters · 4 assumptions · 0 invented entities

The central experiment depends on several external models and hand-set hyperparameters: SAM3 for masks, SD v1.5 VAE for latents, and lambda/c_s/c_v chosen on FLIR. No new physical entities are introduced.

free parameters (4)
  • lambda (SGSC calibration magnitude) = 10
    Hand-set scalar in Eq. (17) controlling the size of the positive logit bias; not tuned per dataset but chosen once.
  • c_s (semantic CFG scale) = 2.0 (default)
    Selected based on FID on FLIR in Table VI; default applied to all datasets.
  • c_v (visible CFG scale) = 1.5 (default)
    Selected based on FID on FLIR in Table VI; default applied to all datasets.
  • DDIM sampling steps = 30
    Chosen as a tradeoff between quality and cost in Table VII; affects all reported generation results.
assumptions (4)
  • domain assumption SAM3 with text prompts returns reliable per-category masks on visible images (Eq. 9).
    The whole SGSC mechanism depends on mask quality; mask errors directly misdirect the attention bias.
  • domain assumption The SD v1.5 VAE latent space faithfully encodes infrared images (Eq. 1).
    Infrared latents are encoded with a pretrained visible-image autoencoder; if the VAE reconstructs thermal images poorly, the translation quality ceiling drops.
  • domain assumption Same-category tokens in the visible semantic map should attend more strongly to each other during infrared denoising (Eqs. 14-17).
    This is the design premise of SGSC: that category alignment between RGB and IR is meaningful for preserving structure.
  • ad hoc to paper Resizing semantic labels to 64x64 and 32x32 preserves reliable category information (Section IV.A).
    The authors choose to apply SGSC only at these two resolutions; small or thin objects may be mislabeled after downsampling, and the paper provides no analysis of this effect.

how reviews work

0 comments
Cite this review

Pith. "Pith review of SC-Diff: Semantically Calibrated Diffusion for Visible-to-Infrared Image Translation." pith.science (2026). https://pith.science/paper/XKQBDCVV

@misc{pith2026260808555,
  author       = {Pith},
  title        = {Pith review of: SC-Diff: Semantically Calibrated Diffusion for Visible-to-Infrared Image Translation},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/XKQBDCVV}},
  note         = {Machine review of arXiv:2608.08555}
}
read the original abstract

Visible-to-infrared image translation provides a practical way to expand infrared training data using abundant visible images. Diffusion models are promising for this task because of their strong generative performance. However, existing diffusion-based methods typically use semantic priors only as external conditions, without explicitly regulating token interactions within the denoising network. Consequently, they struggle to preserve object locations, shapes, and semantic layouts required for reliable annotation reuse. We propose SC-Diff, a semantically calibrated latent diffusion framework that uses semantic priors for both conditional guidance and internal self-attention calibration. A pretrained SAM3 model with predefined text prompts first extracts category-specific semantic masks from visible images. These masks are merged into a semantic map and fused with the visible image as the input condition. The same map is converted into token-level semantic labels to calibrate self-attention in the denoising network. Based on these labels, we introduce Semantic-Guided Self-Attention Calibration (SGSC), which adaptively applies positive biases to query-key pairs of the same category. The query-wise calibration strength depends on the dispersion of attention across semantic categories and the attention assigned to the query's own category. The original attention scores further modulate the bias, giving greater calibration to same-category keys with stronger responses. This soft calibration reduces cross-category interference while retaining global contextual interactions, thereby improving semantic consistency in generated infrared images. Extensive experiments show that SC-Diff improves perceptual quality and produces more effective synthetic training data for downstream infrared object detection.

Figures

Figures reproduced from arXiv: 2608.08555 by the authors.

Figure 1
Figure 1. Comparison between PID [1], a recent representative diffusion [PITH_FULL_IMAGE:figures/full_fig_p001_1.png] view at source ↗
Figure 2
Figure 2. Overall architecture of the proposed SC-Diff. The visible image and semantic map are encoded as clean conditions to provide spatially aligned guidance [PITH_FULL_IMAGE:figures/full_fig_p004_2.png] view at source ↗
Figure 3
Figure 3. Qualitative comparison under the standard generation setting on three datasets. Each row presents one representative example from a different dataset, [PITH_FULL_IMAGE:figures/full_fig_p006_3.png] view at source ↗
Figures from the paper (4 more)
Figure 4
Figure 4. Figure 4: Out-of-distribution generation results on Cityscapes images. Visible images are translated into the infrared styles of M [PITH_FULL_IMAGE:figures/full_fig_p007_4.png]
Figure 5
Figure 5. Figure 5: Qualitative comparison of YOLOv8 detection results on M [PITH_FULL_IMAGE:figures/full_fig_p009_5.png]
Figure 7
Figure 7. Figure 7: Visualization of self-attention maps from the final U-Net layer. Red [PITH_FULL_IMAGE:figures/full_fig_p010_7.png]
Figure 8
Figure 8. Figure 8: Visualization of intermediate results during inference. Both PID and [PITH_FULL_IMAGE:figures/full_fig_p010_8.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

41 extracted references · 35 canonical work pages

  1. [1]

    PID: Physics-informed diffusion model for infrared image generation,

    F. Mao, J. Mei, S. Lu, F. Liu, L. Chen, F. Zhao, and Y . Hu, “PID: Physics-informed diffusion model for infrared image generation,”Pat- tern Recognition, vol. 169, pp. 111816, 2026

    work page 2026

  2. [2]

    Free flir thermal dataset for algorithm training,

    FLIR Team, “Free flir thermal dataset for algorithm training,” https: //www.flir.com/oem/adas/adas-dataset-form/

    work page

  3. [3]

    OV-DINO: Unified open-vocabulary detection with language-aware selective fusion,

    H. Wang, P. Ren, Z. Jie, X. Dong, C. Feng, Y . Qian, L. Ma, D. Jiang, Y . Wang, X. Lanet al., “OV-DINO: Unified open-vocabulary detection with language-aware selective fusion,”arXiv preprint arXiv:2407.07844, 2024

    arXiv 2024

  4. [4]

    Multiscale cross-modal homogeneity enhancement and confidence-aware fusion for multispectral pedestrian detection,

    R. Li, J. Xiang, F. Sun, Y . Yuan, L. Yuan, and S. Gou, “Multiscale cross-modal homogeneity enhancement and confidence-aware fusion for multispectral pedestrian detection,”IEEE Transactions on Multimedia, vol. 26, pp. 852–863, 2023

    work page 2023

  5. [5]

    Mmi-det: Exploring multi-modal integration for visible and infrared object detection,

    Y . Zeng, T. Liang, Y . Jin, and Y . Li, “Mmi-det: Exploring multi-modal integration for visible and infrared object detection,”IEEE Transactions on Circuits and Systems for Video Technology, vol. 34, no. 11, pp. 11 198–11 213, 2024

    2024

  6. [6]

    Ei²det: Edge-guided illumination-aware interactive learning for visible-infrared object detec- tion,

    K. Hu, Y . He, Y . Li, J. Zhao, S. Chen, and Y . Kang, “Ei²det: Edge-guided illumination-aware interactive learning for visible-infrared object detec- tion,”IEEE Transactions on Circuits and Systems for Video Technology, vol. 35, no. 7, pp. 7101–7115, 2025

    work page 2025

  7. [7]

    Detail-preserving and diverse image translation for adverse visual object detection,

    G. Sun, Z. Xiong, and Y . Yuan, “Detail-preserving and diverse image translation for adverse visual object detection,”IEEE Transactions on Circuits and Systems for Video Technology, vol. 34, no. 10, pp. 9139– 9152, 2024

    work page 2024

  8. [8]

    SAM3: Segment anything with concepts,

    N. Carion, L. Gustafson, Y .-T. Hu, S. Debnath, R. Hu, D. Suris, C. Ryali, K. V . Alwala, H. Khedr, A. Huanget al., “SAM3: Segment anything with concepts,” inProceedings of the International Conference on Learning Representations, 2026

    work page 2026

Show all 41 references
  1. [9]

    Image-to-image translation with conditional adversarial networks,

    P. Isola, J.-Y . Zhu, T. Zhou, and A. A. Efros, “Image-to-image translation with conditional adversarial networks,” inProceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1125– 1134, 2017

    2017

  2. [10]

    Unpaired image-to-image translation using cycle-consistent adversarial networks,

    J.-Y . Zhu, T. Park, P. Isola, and A. A. Efros, “Unpaired image-to-image translation using cycle-consistent adversarial networks,” inProceedings of the IEEE International Conference on Computer Vision, pp. 2223– 2232, 2017

    2017

  3. [11]

    StegoGAN: Leveraging steganography for non-bijective image-to-image translation,

    S. Wu, Y . Chen, S. Mermet, L. Hurni, K. Schindler, N. Gonthier, and L. Landrieu, “StegoGAN: Leveraging steganography for non-bijective image-to-image translation,” inProceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7922–7931, 2024

    2024

  4. [12]

    Panoptic-level image-to-image translation for object recognition and visual odometry enhancement,

    L. Zhang, P. Ratsamee, Z. Luo, Y . Uranishi, M. Higashida, and H. Take- mura, “Panoptic-level image-to-image translation for object recognition and visual odometry enhancement,”IEEE Transactions on Circuits and Systems for Video Technology, vol. 34, no. 2, pp. 938–954, 2024

    2024

  5. [13]

    Denoising diffusion probabilistic models,

    J. Ho, A. Jain, and P. Abbeel, “Denoising diffusion probabilistic models,” Advances in Neural Information Processing Systems, pp. 6840–6851, 2020

    2020

  6. [14]

    High- resolution image synthesis with latent diffusion models,

    R. Rombach, A. Blattmann, D. Lorenz, P. Esser, and B. Ommer, “High- resolution image synthesis with latent diffusion models,” inProceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 10 684–10 695, 2022

    2022

  7. [15]

    Adding conditional control to text- to-image diffusion models,

    L. Zhang, A. Rao, and M. Agrawala, “Adding conditional control to text- to-image diffusion models,” inProceedings of the IEEE International Conference on Computer Vision, pp. 3836–3847, 2023

    2023

  8. [16]

    BBDM: Image-to-image transla- tion with brownian bridge diffusion models,

    B. Li, K. Xue, B. Liu, and Y .-K. Lai, “BBDM: Image-to-image transla- tion with brownian bridge diffusion models,” inProceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1952– 1961, 2023

    1952

  9. [17]

    A diffusion model translator for efficient image-to-image translation,

    M. Xia, Y . Zhou, R. Yi, Y .-J. Liu, and W. Wang, “A diffusion model translator for efficient image-to-image translation,”IEEE Trans. Pattern Anal. Mach. Intell., vol. 46, no. 12, pp. 10 272–10 283, 2024

    2024

  10. [18]

    Adanoise: Cycle-consistent image translation with domain-adaptive noise perturbation,

    X. Yang, H. Shi, F. Gao, and N. Wang, “Adanoise: Cycle-consistent image translation with domain-adaptive noise perturbation,”IEEE Trans- actions on Circuits and Systems for Video Technology, pp. 1–1, 2026

    2026

  11. [19]

    ThermalGAN: Multimodal color-to-thermal image translation for person re-identification in multispectral dataset,

    V . V . Kniaz, V . A. Knyaz, J. Hladuvka, W. G. Kropatsch, and V . Mizgi- nov, “ThermalGAN: Multimodal color-to-thermal image translation for person re-identification in multispectral dataset,” inProceedings of the European Conference on Computer Vision Workshops, 2018

    2018

  12. [20]

    InfraGAN: A GAN architecture to transfer visible images to infrared domain,

    M. A. ¨Ozkano˘glu and S. Ozer, “InfraGAN: A GAN architecture to transfer visible images to infrared domain,”Pattern Recognition Letters, pp. 69–76, 2022

    2022

  13. [21]

    Edge-guided multi-domain RGB-to-TIR image translation for training vision tasks with challeng- ing labels,

    D. G. Lee, M. H. Jeon, Y . Cho, and A. Kim, “Edge-guided multi-domain RGB-to-TIR image translation for training vision tasks with challeng- ing labels,” inProceedings of the IEEE International Conference on Robotics and Automation, pp. 8291–8298, 2023

    2023

  14. [22]

    F-vita: Foundation model guided visible to infrared translation,

    J. N. Paranjape, C. M. De Melo, and V . M. Patel, “F-vita: Foundation model guided visible to infrared translation,” inProceedings of the IEEE Winter Conference on Applications of Computer Vision, pp. 5633–5642, 2026

    2026

  15. [23]

    Grounding DINO: Marrying DINO with grounded pre- training for open-set object detection,

    S. Liu, Z. Zeng, T. Ren, F. Li, H. Zhang, J. Yang, Q. Jiang, C. Li, J. Yang, H. Suet al., “Grounding DINO: Marrying DINO with grounded pre- training for open-set object detection,” inProceedings of the European Conference on Computer Vision, pp. 38–55, 2024

    2024

  16. [24]

    Segment anything,

    A. Kirillov, E. Mintun, N. Ravi, H. Mao, C. Rolland, L. Gustafson, T. Xiao, S. Whitehead, A. C. Berg, W.-Y . Loet al., “Segment anything,” inProceedings of the IEEE International Conference on Computer Vision, pp. 4015–4026, 2023

    2023

  17. [25]

    DiffV2IR: Visible- to-infrared diffusion model via vision-language understanding,

    L. Ran, L. Wang, G. Wang, P. Wang, and Y . Zhang, “DiffV2IR: Visible- to-infrared diffusion model via vision-language understanding,”arXiv preprint arXiv:2503.19012, 2025

    2025 arXiv

  18. [26]

    Thera: Thermal-aware visual-language prompting for controllable rgb- to-thermal infrared translation,

    D.-G. Lee, T. H. Rhee, H. Jang, Y .-S. Shin, U. Shin, and A. Kim, “Thera: Thermal-aware visual-language prompting for controllable rgb- to-thermal infrared translation,” inProceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2026

    2026

  19. [27]

    ThermalGen: Style-disentangled flow-based generative models for RGB-to-thermal image translation,

    J. Xiao, R. Nayak, N. Zhang, D. Tortei, and G. Loianno, “ThermalGen: Style-disentangled flow-based generative models for RGB-to-thermal image translation,”Advances in Neural Information Processing Systems, vol. 38, 2025

    2025

  20. [28]

    Denoising diffusion implicit models,

    J. Song, C. Meng, and S. Ermon, “Denoising diffusion implicit models,” arXiv preprint arXiv:2010.02502, 2020

    2010 arXiv

  21. [29]

    Classifier-free diffusion guidance,

    J. Ho and T. Salimans, “Classifier-free diffusion guidance,”arXiv preprint arXiv:2207.12598, 2022

    2022 arXiv

  22. [30]

    T2V-DDPM: Thermal to visible face trans- lation using denoising diffusion probabilistic models,

    N. G. Nair and V . M. Patel, “T2V-DDPM: Thermal to visible face trans- lation using denoising diffusion probabilistic models,” inProceedings of the IEEE International Conference on Automatic Face and Gesture Recognition, pp. 1–7, 2023

    2023

  23. [31]

    Target-aware dual adversarial learning and a multi-scenario multi- modality benchmark to fuse infrared and visible for object detection,

    J. Liu, X. Fan, Z. Huang, G. Wu, R. Liu, W. Zhong, and Z. Luo, “Target-aware dual adversarial learning and a multi-scenario multi- modality benchmark to fuse infrared and visible for object detection,” inProceedings of the IEEE Conference on Computer Vision and Pattern Recogni...

    2022

  24. [32]

    Multispectral pedestrian detection: Benchmark dataset and baseline,

    S. Hwang, J. Park, N. Kim, Y . Choi, and I. S. Kweon, “Multispectral pedestrian detection: Benchmark dataset and baseline,” inProceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1037–1045, 2015

    2015

  25. [33]

    The cityscapes dataset for semantic urban scene understanding,

    M. Cordts, M. Omran, S. Ramos, T. Rehfeld, M. Enzweiler, R. Be- nenson, U. Franke, S. Roth, and B. Schiele, “The cityscapes dataset for semantic urban scene understanding,” inProceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3213– 3223, 2016

    2016

  26. [34]

    Image quality assessment: From error visibility to structural similarity,

    Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, “Image quality assessment: From error visibility to structural similarity,”IEEE Transactions on Image Processing, pp. 600–612, 2004

    2004

  27. [35]

    The unreasonable effectiveness of deep features as a perceptual metric,

    R. Zhang, P. Isola, A. A. Efros, E. Shechtman, and O. Wang, “The unreasonable effectiveness of deep features as a perceptual metric,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 586–595, 2018

    2018

  28. [36]

    GANs trained by a two time-scale update rule converge to a local nash equilibrium,

    M. Heusel, H. Ramsauer, T. Unterthiner, B. Nessler, and S. Hochreiter, “GANs trained by a two time-scale update rule converge to a local nash equilibrium,”Advances in Neural Information Processing Systems, 2017

    2017

  29. [37]

    Microsoft COCO: Common objects in context,

    T.-Y . Lin, M. Maire, S. Belongie, J. Hays, P. Perona, D. Ramanan, P. Doll ´ar, and C. L. Zitnick, “Microsoft COCO: Common objects in context,” inProceedings of the European Conference on Computer Vision, pp. 740–755, 2014. 12

    2014

  30. [38]

    DETRs beat YOLOs on real-time object detection,

    Y . Zhao, W. Lv, S. Xu, J. Wei, G. Wang, Q. Dang, Y . Liu, and J. Chen, “DETRs beat YOLOs on real-time object detection,” inProceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 16 965–16 974, 2024

    2024

  31. [39]

    Ultralytics YOLO

    G. Jocher, J. Qiu, and A. Chaurasia, “Ultralytics YOLO.” [Online]. Available: https://github.com/ultralytics/ultralytics Jan. 2023

    2023

  32. [40]

    FCOS: Fully convolutional one-stage object detection,

    Z. Tian, C. Shen, H. Chen, and T. He, “FCOS: Fully convolutional one-stage object detection,” inProceedings of the IEEE International Conference on Computer Vision, pp. 9627–9636, 2019

    2019

  33. [41]

    Faster R-CNN: Towards real- time object detection with region proposal networks,

    S. Ren, K. He, R. Girshick, and J. Sun, “Faster R-CNN: Towards real- time object detection with region proposal networks,”IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 39, no. 6, pp. 1137– 1149, 2016. Junyin Zhangreceived the B.S. degree in digital media...

    2016

Pith tools

Reviewed August 14, 2026 · model on record in the stance chip above.