Pith. sign in

REVIEW 4 major objections 4 minor 102 references

WaveMamba: Wavelet-Driven Mamba Fusion for RGB-Infrared Object Detection

T0 review · 4 major / 4 minor · reviewed 2026-08-06 · deepseek-v4-flash

Pith's one-line read WaveMamba claims that fusing RGB and infrared imagery in the wavelet domain — using a Mamba-based block for low-frequency structure and an absolute-maximum selection for high-frequency detail — yields state-of-the-art object detection…

desk verdict WaveMamba is a competent engineering paper with a plausible frequency-domain story and large reported gains, but the headline 4.5-point mAP lead is not established because the comparison is against literature numbers and no code or error bars are provided. read the letter →

arxiv 2507.18173 v1 pith:KVYD5B4H submitted 2025-07-24 cs.CV cs.MM

classification cs.CVcs.MM
keywords RGB-infraredobjectdetectionmulti-spectralfusiondiscretewavelettransformMambastatespacemodelfeatureYOLOv8low-light
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper argues that visible (RGB) and infrared (IR) images complement each other in the frequency domain, not just spatially: IR carries more information in the low-frequency sub-band, while RGB carries more in the high-frequency detail sub-bands. Building on that observation, WaveMamba decomposes both modalities with a discrete wavelet transform, fuses the low-frequency parts with a Mamba-based block that swaps channels and applies gated attention, and fuses the high-frequency parts by keeping whichever pixel has the larger absolute value. An inverse-wavelet detection head reconstructs the final features. On four public RGB-IR benchmarks (M3FD, DroneVehicle, LLVIP, FLIR-Aligned), the paper reports state-of-the-art mAP50 and mAP numbers, with an average gain of 4.5 points over the second-best method. If the comparisons hold up, this offers a general fusion recipe that works across three different backbones and improves detection in low light, bad weather, and dense small-target scenes.

What carries the argument

The load-bearing mechanism is the WaveMamba Fusion Block (WMFB), which consists of the Low-frequency Mamba Fusion Block (LMFB) and the High-Frequency Enhancement (HFE) strategy. LMFB first performs a channel-swapping operation between the RGB and IR low-frequency sub-bands, passes each through Vision State Space (VSS) blocks, then runs a gated-attention deep fusion that alternates the modalities as primary and auxiliary and uses the Selective Scan 2D (SS2D) module — the core of Mamba — to propagate global information. HFE does no learned fusion at all: it builds a binary mask from the sign of the difference between the absolute values of the two modalities' high-frequency sub-images, keeping the larger-magnitude pixel from either RGB or IR and suppressing the other. Around these blocks, a discrete Haar wavelet transform splits features at multiple network depths into four sub-bands (LL, LH, HL, HH) and an inverse transform in the YOLOv8 head reconstructs the features for detection. Together they realize the argument that fusion should be frequency-aware — structure from IR, detail from RGB, selected rather than averaged.

What would settle it

Re-run the compared methods (for example DMM, ICAFusion, CrossFormer, and the YOLOv8 single-modality baselines) in the same codebase, hyperparameters, and data splits used for WaveMamba on M3FD and DroneVehicle; if the best re-run baseline closes the gap to well below 4.5% or changes the ranking, the headline claim fails. A second check: measure low- and high-frequency information entropy on each new dataset — the motivational premise that IR dominates low frequency and RGB dominates high frequency is directly testable.

Watch

Extended reading notes

Core claim

The central claim, on the paper's own terms, is that modality-specific frequency decomposition is the right organizing principle for RGB-IR fusion. The authors show by information-entropy measurement that IR dominates the LL sub-band and RGB dominates the LH/HL/HH sub-bands, then exploit this by routing low-frequency features through the WaveMamba Fusion Block and high-frequency features through an absolute-maximum selection mask. The Mamba-based low-frequency path (a shallow channel-swapping stage followed by a gated-attention selective-scan stage) is designed to use the global modeling strength of state space models on structure-rich low-frequency content, while the absolute-maximum rule preserves the sharpest edges and textures from either modality. Recombining via IDWT instead of standard upsampling is claimed to cut information loss and also shrink parameter count. The result is a claimed state-of-the-art performance across four benchmarks with an average mAP improvement of about 4.5 points over the previous best.

Load-bearing premise

The 4.5% average improvement is measured against numbers the paper takes from earlier publications, without re-running those methods under its own training, split, and augmentation settings.

Editorial extensions

If this is right

  • On M3FD the YOLOv8-based WaveMamba reports 92.1 mAP50 and 64.4 mAP, gains of 5.5 and 5.1 points over the previous best, with the YOLOv5 and ResNet50 versions also leading their backbone groups.
  • On DroneVehicle the YOLOv8 variant reaches 79.8 mAP50 and 60.5 mAP with no remote-sensing-specific design, suggesting the frequency-fusion recipe transfers to dense small-target drone imagery.
  • On LLVIP pedestrian detection, the YOLOv8 model reports 98.3 mAP50 and 66.0 mAP, the best among compared fusion and single-modality methods.
  • On FLIR-Aligned, WaveMamba beats the compared methods in precision, recall, F1, mAP50, and mAP while using fewer parameters (e.g., 45.6M vs 340.0M for CrossFormer) and lower inference time.
  • The ablations attribute the gains to the design: removing SFM or DFM costs about 2 points of mAP, and the HFE+LMFB combination outperforms averaging fusion in the wavelet domain.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The frequency-entropy argument suggests the approach could extend to other modality pairs with complementary spectral content, such as RGB-depth or RGB-event streams, but the paper does not test this.
  • Because the reported gains are computed against published baseline numbers rather than re-run baselines, the 4.5% headline figure may shift under a unified training protocol; a fair head-to-head re-run is the natural next check.
  • The wavelet-basis ablation shows less than 0.4% sensitivity to the choice of wavelet, hinting that other multiresolution decompositions might behave similarly; that robustness is a testable conjecture, not a paper claim.
  • The IDWT head improves accuracy while cutting 7.6M parameters versus the standard YOLOv8 head, which suggests the lossless up/down-sampling benefit may apply to single-modality detectors as well.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 4 minor

Summary. WaveMamba is a dual-stream RGB-infrared object detector built on a YOLOv8 framework. The authors apply a Haar discrete wavelet transform (DWT) to backbone features, fuse the low-frequency sub-bands with a Mamba-based Low-frequency Mamba Fusion Block (channel swapping plus a gated-attention deep fusion module), fuse high-frequency sub-bands with an 'absolute maximum' strategy, and use an inverse DWT in a modified detection head. Experiments are reported on M3FD, DroneVehicle, LLVIP, and FLIR-Aligned in the main text, with additional results on VEDAI and KAIST in the supplement. The paper claims an average mAP improvement of 4.5% over the second-best state-of-the-art method. Ablations on M3FD support the contribution of the improved head, the SFM and DFM modules, and the HFE/LMFB combination.

Significance. The frequency-complementarity motivation is clean, and the proposed modules are simple enough that the approach could be practically useful if the reported gains are real. The paper covers six datasets and three backbones, and the ablation tables show that each module contributes to the final result. However, the headline numerical claim is not yet established at the level expected for a journal publication: the comparisons are against literature-reported baseline numbers without a controlled re-run under one protocol, the final architecture was selected using the same M3FD benchmark that appears in the headline comparison, and no code or error bars are provided. Because the central claim is purely empirical, these protocol issues determine whether the 4.5% figure is meaningful.

major comments (4)
  1. [4.1; Tables 1-4; Table 7] The 4.5% average gain is computed by comparing WaveMamba's numbers with baseline numbers taken from prior publications, but the manuscript does not state that those methods were re-run under WaveMamba's protocol (640x640 input, 250 epochs, batch size 16, SGD, default YOLOv8 augmentation). The sensitivity of the comparison to protocol is visible in Table 7, where the authors' own average-fusion dual-stream YOLOv8 baseline reaches only 83.2 mAP50 / 55.1 mAP on M3FD, while the cited MRD-YOLO value on the same YOLOv8 backbone is 86.6 / 59.3. If the prior baselines were trained with different splits, image sizes, epochs, or augmentation, the per-dataset gaps in Tables 1-4, and therefore the claimed 4.5% average, could change materially. A controlled re-run of at least the closest competitors under one protocol is needed before the headline claim can be accepted.
  2. [Supplementary E.2; Tables 5-7] The final architecture (improved head, three WMFBs, positions {P2,P3,P5}, Haar basis) was selected by maximizing mAP on M3FD, and M3FD is also one of the four datasets used to compute the 4.5% headline gain. This means the M3FD row of Table 1 is partly a product of tuning on that benchmark. The authors should either fix all design choices before evaluation, select hyperparameters on a held-out validation split and then report test performance, or show that the same choices are also optimal on DroneVehicle, LLVIP, and FLIR-Aligned.
  3. [3.2] The description of the WMFB placement is internally inconsistent. The architecture is introduced as containing 'three WaveMamba Fusion Blocks,' and the text says the first two backbone layers produce f^2 features that undergo DWT, but it then says DWT and WMFB are applied to the fused features at the 3rd and 5th layers. The supplementary ablation (Table C) uses positions {P2,P3,P5}. This inconsistency must be corrected because the exact fusion locations are essential for reproducing the method.
  4. [4.1; Supplementary Tables C-E] No error bars or multiple-seed results are reported. Several design comparisons differ by only 0.1-0.4 mAP (e.g., wavelet bases in Table E), which is within typical run-to-run variation for YOLO training; without repeated runs, the claim that the chosen configurations are optimal is not statistically supported. Reporting mean and standard deviation over at least three seeds would also help quantify the reliability of the headline differences.
minor comments (4)
  1. [3.1] There is a typo in 'genetate outputs' that should read 'generate outputs.'
  2. [4.2, DroneVehicle] The sentence 'surpassing the fourth-place method by 2.6% and 3.6%' is confusing because WaveMamba is first in the table; the intended meaning is presumably 'the next-best method' or a specific ranked baseline.
  3. [References] The reference list contains duplicate entries: [67] and [68] are the same paper, and [75] and [76] are also the same paper; these should be merged.
  4. [3.3.2, Eq. (6)] In the HFE formula, if the RGB and IR coefficients have exactly equal absolute values, both masks are zero and the fused coefficient is set to zero; the authors should state whether this edge case occurs in practice or modify the mask to break ties.

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity: WaveMamba's claims are empirical and its components are defined by explicit forward equations; benchmark tuning and baseline-protocol concerns are not circularity.

full rationale

WaveMamba makes no first-principles claim; its headline assertions are empirical mAP measurements. The method is specified by forward equations (Haar DWT in Eqs. (1)-(2); channel swapping in Eq. (3); VSS in Eq. (4); DFM in Eq. (5); max-absolute high-frequency selection in Eq. (6); IDWT-based head in Sec. 3.4). None of these equations is defined in terms of the benchmark mAP values it is later used to report, so no result is equivalent to its input by construction. The reported 4.5% average gain is taken from Tables 1-4 against literature baselines; if those baselines were obtained under different training protocols the comparison may be under-specified, but that is an experimental-validity issue rather than circularity. The ablations in Tables 5-7 and Supplementary Tables C-E choose block positions, block count, and wavelet basis using M3FD mAP, so the M3FD portion of the headline is partly in-sample; however, this is model selection on a benchmark, not a definitional or statistically forced prediction, and the gains on DroneVehicle, LLVIP, and FLIR-Aligned are out-of-sample. No load-bearing self-citation or imported uniqueness theorem appears: Mamba [15], VSS [40], channel swapping [17], and DWT/IDWT [11] are external component references, and the paper does not rely on the authors' own prior results. Consequently there are no circular steps.

Assumptions & free parameters 3 free parameters · 3 assumptions · 0 invented entities

No new physical entities or mediators are introduced; the wavelet sub-bands and fusion modules are architectural constructs, not independently postulated entities.

free parameters (3)
  • WMFB placement = stages P2, P3, P5
    Selected by ablation on M3FD (Supplementary Table C); the paper's split defines no validation set, so this selection uses the test benchmark.
  • Number of WMFBs = 3
    Chosen via ablation on M3FD (Supplementary Table D); 3 blocks gives the best mAP.
  • Wavelet basis = Haar
    Selected after comparing MEYR, SYM3, COIF3, DB3 on M3FD (Supplementary Table E); differences are small but Haar is chosen as default.
assumptions (3)
  • domain assumption RGB high-frequency sub-bands and IR low-frequency sub-bands carry complementary information for object detection
    Motivated by entropy analysis of M3FD in Fig. 1(a) and used to justify separate fusion strategies for low and high frequency in Sec. 3.3.
  • domain assumption Larger absolute values in high-frequency sub-bands indicate more informative detail
    Basis of the HFE max-absolute fusion in Eq. 6; no learning or validation supports this beyond final accuracy gains.
  • domain assumption Haar DWT followed by IDWT is a lossless representation and preserves information better than learned downsampling or upsampling
    Used for the head in Sec. 3.4; Haar wavelets are orthonormal so the transform itself is invertible, but the claim that it reduces information loss in a CNN pipeline is an assumption.

how reviews work

0 comments
Cite this review

Pith. "Pith review of WaveMamba: Wavelet-Driven Mamba Fusion for RGB-Infrared Object Detection." pith.science (2026). https://pith.science/paper/KVYD5B4H

@misc{pith2026250718173,
  author       = {Pith},
  title        = {Pith review of: WaveMamba: Wavelet-Driven Mamba Fusion for RGB-Infrared Object Detection},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/KVYD5B4H}},
  note         = {Machine review of arXiv:2507.18173}
}
read the original abstract

Leveraging the complementary characteristics of visible (RGB) and infrared (IR) imagery offers significant potential for improving object detection. In this paper, we propose WaveMamba, a cross-modality fusion method that efficiently integrates the unique and complementary frequency features of RGB and IR decomposed by Discrete Wavelet Transform (DWT). An improved detection head incorporating the Inverse Discrete Wavelet Transform (IDWT) is also proposed to reduce information loss and produce the final detection results. The core of our approach is the introduction of WaveMamba Fusion Block (WMFB), which facilitates comprehensive fusion across low-/high-frequency sub-bands. Within WMFB, the Low-frequency Mamba Fusion Block (LMFB), built upon the Mamba framework, first performs initial low-frequency feature fusion with channel swapping, followed by deep fusion with an advanced gated attention mechanism for enhanced integration. High-frequency features are enhanced using a strategy that applies an ``absolute maximum" fusion approach. These advancements lead to significant performance gains, with our method surpassing state-of-the-art approaches and achieving average mAP improvements of 4.5% on four benchmarks.

Figures

Figures reproduced from arXiv: 2507.18173 by the authors.

Figure 1
Figure 1. (a) shows the averaged normalized information entropy [PITH_FULL_IMAGE:figures/full_fig_p001_1.png] view at source ↗
Figure 2
Figure 2. Illustrative diagram of the complete network and sub-modules. (a) shows the overall architecture of proposed WaveMamba [PITH_FULL_IMAGE:figures/full_fig_p004_2.png] view at source ↗
Figure 3
Figure 3. Heatmap visualization of several cross-modality object [PITH_FULL_IMAGE:figures/full_fig_p007_3.png] view at source ↗
Figures from the paper (1 more)
Figure 4
Figure 4. Figure 4: Detection results’ visualization of several cross-modality object detection methods on [PITH_FULL_IMAGE:figures/full_fig_p008_4.png]

Discussion (0). Sign in to comment.

Reference graph

Works this paper leans on

102 extracted references · 71 canonical work pages

  1. [1]

    Daff: Dual attentive feature fusion for multispectral pedestrian detection

    Afnan Althoupety, Li-Yun Wang, Wu-Chi Feng, and Ba- nafsheh Rekabdar. Daff: Dual attentive feature fusion for multispectral pedestrian detection. InCVPRW, pages 2997– 3006, 2024. 3

  2. [2]

    Dual-yolo architecture from infrared and visible images for object detection

    Chun Bao, Jie Cao, Qun Hao, Yang Cheng, Yaqian Ning, and Tianhua Zhao. Dual-yolo architecture from infrared and visible images for object detection. Sensors, 2023. 6, 3

  3. [3]

    Multimodal object detection by channel switch- ing and spatial attention

    Yue Cao, Junchi Bin, Jozsef Hamari, Erik Blasch, and Zheng Liu. Multimodal object detection by channel switch- ing and spatial attention. In CVPRW, 2023. 3, 7, 5

  4. [4]

    Weakly misalignment-free adaptive feature alignment for uavs- based multimodal object detection

    Chen Chen, Jiahao Qi, Xingyue Liu, Kangcheng Bin, Ruigang Fu, Xikun Hu, and Ping Zhong. Weakly misalignment-free adaptive feature alignment for uavs- based multimodal object detection. In CVPR, 2024. 6

  5. [5]

    Rgb-ir yolo combining modality-specific reconstruction and information integration

    Yishuo Chen, Boran Wang, Wenbin Zhu, and Jing Yuan. Rgb-ir yolo combining modality-specific reconstruction and information integration. In YAC, 2024. 6

  6. [6]

    Multimodal object detec- tion via-probabilistic ensembling

    Yi-Ting Chen, Jinghao Shi, Zelin Ye, Christoph Mertz, Deva Ramanan, and Shu Kong. Multimodal object detec- tion via-probabilistic ensembling. In ECCV, 2022. 3

  7. [7]

    Slbaf-net: Super- lightweight bimodal adaptive fusion network for uav de- tection in low recognition environment

    Xiaolong Cheng, Keke Geng, Ziwei Wang, Jinhu Wang, Yuxiao Sun, and Pengbo Ding. Slbaf-net: Super- lightweight bimodal adaptive fusion network for uav de- tection in low recognition environment. Multimedia Tools Appl., 2023. 6, 7

  8. [8]

    Borrow from anywhere: Pseudo multi-modal object detection in thermal imagery

    Chaitanya Devaguptapu, Ninad Akolekar, Manuj M Sharma, and Vineeth N Balasubramanian. Borrow from anywhere: Pseudo multi-modal object detection in thermal imagery. In CVPRW, pages 0–0, 2019. 3

Show all 102 references
  1. [10]

    Acdf-yolo: Attentive and cross-differential fusion network for multimodal remote

    Xuan Fei, Mengyao Guo, Yan Li, Renping Yu, and Le Sun. Acdf-yolo: Attentive and cross-differential fusion network for multimodal remote. sens. object detection. Remote. Sens., 2024. 7

  2. [11]

    Finder, Roy Amoyal, Eran Treister, and Oren Freifeld

    Shahaf E. Finder, Roy Amoyal, Eran Treister, and Oren Freifeld. Wavelet convolutions for large receptive fields. arXiv:2407.05848, 2024. 3, 4, 7

  3. [12]

    Free teledyne flir thermal dataset for algorithm training

    TELEDYNE FLIR. Free teledyne flir thermal dataset for algorithm training. Online, 2024. 2

  4. [13]

    Lraf-net: Long- range attention fusion network for visible–infrared object detection

    Haolong Fu, Shixun Wang, Puhong Duan, Changyan Xiao, Renwei Dian, Shutao Li, and Zhiyong Li. Lraf-net: Long- range attention fusion network for visible–infrared object detection. TNNLS, 35(10):13232–13245, 2024. 3

  5. [14]

    Mambast: A plug-and-play cross-spectral spatial-temporal fuser for efficient pedestrian detection

    Xiangbo Gao, Asiegbu Miracle Kanu-Asiegbu, and Xi- aoxiao Du. Mambast: A plug-and-play cross-spectral spatial-temporal fuser for efficient pedestrian detection. arXiv:2408.01037, 2024. 2

  6. [15]

    Mamba: Linear-time sequence modeling with selective state spaces

    Albert Gu and Tri Dao. Mamba: Linear-time sequence modeling with selective state spaces. arXiv:2312.00752,

  7. [16]

    Damsdet: Dynamic adaptive multispectral de- tection transformer with competitive query selection and adaptive feature fusion

    Junjie Guo, Chenqiang Gao, Fangcen Liu, Deyu Meng, and Xinbo Gao. Damsdet: Dynamic adaptive multispectral de- tection transformer with competitive query selection and adaptive feature fusion. In ECCV, pages 464–481, 2024. 6

  8. [17]

    Pan-mamba: Effective pan-sharpening with state space model

    Xuanhua He, Ke Cao, Jie Zhang, Keyu Yan, Yingying Wang, Rui Li, Chengjun Xie, Danfeng Hong, and Man Zhou. Pan-mamba: Effective pan-sharpening with state space model. CoRR’24, 2024. 4

  9. [18]

    Fire detection in video surveillances using con- volutional neural networks and wavelet transform

    Lida Huang, Gang Liu, Yan Wang, Hongyong Yuan, and Tao Chen. Fire detection in video surveillances using con- volutional neural networks and wavelet transform. EAAI, 110:104737, 2022. 3

  10. [19]

    Cross-modality interaction for few-shot multispectral object detection with semantic knowledge

    Lian Huang, Zongju Peng, Fen Chen, Shaosheng Dai, Ziqiang He, and Kesheng Liu. Cross-modality interaction for few-shot multispectral object detection with semantic knowledge. Neural Networks, 2024. 2

  11. [20]

    Multispectral pedestrian detection: Benchmark dataset and baseline

    Soonmin Hwang, Jaesik Park, Namil Kim, Yukyung Choi, and In So Kweon. Multispectral pedestrian detection: Benchmark dataset and baseline. In CVPR, pages 1037– 1045, 2015. 5, 2

  12. [21]

    Llvip: A visible-infrared paired dataset for low-light vision

    Xinyu Jia, Chuang Zhu, Minzhen Li, Wenqi Tang, and Wenli Zhou. Llvip: A visible-infrared paired dataset for low-light vision. In ICCVW, 2021. 5, 2

  13. [22]

    M2fnet: Multi-modal fusion network for ob- ject detection from visible and thermal infrared images.Int

    Chenchen Jiang, Huazhong Ren, Hong Yang, Hongtao Huo, Pengfei Zhu, Zhaoyuan Yao, Jing Li, Min Sun, and Shihao Yang. M2fnet: Multi-modal fusion network for ob- ject detection from visible and thermal infrared images.Int. J. Appl. Earth Obs. Geoinf., 2024. 6

  14. [23]

    Tsjnet: A multi-modality target and semantic awareness joint-driven image fusion network

    Yuchan Jie, Yushen Xu, Xiaosong Li, and Haishu Tan. Tsjnet: A multi-modality target and semantic awareness joint-driven image fusion network. arXiv:2402.01212,

  15. [24]

    Global–local feature fusion network for visible–infrared vehicle detec- tion

    Xudong Kang, Hui Yin, and Puhong Duan. Global–local feature fusion network for visible–infrared vehicle detec- tion. IEEE Geosci. Remote Sens. Lett., 2024. 6

  16. [25]

    Uncertainty-guided cross-modal learning for robust multi- spectral pedestrian detection

    Jung Uk Kim, Sungjune Park, and Yong Man Ro. Uncertainty-guided cross-modal learning for robust multi- spectral pedestrian detection. TCSVT, 2022. 1

  17. [26]

    Cross- former: Cross-guided attention for multi-modal object de- tection

    Seungik Lee, Jaehyeong Park, and Jinsun Park. Cross- former: Cross-guided attention for multi-modal object de- tection. Pattern Recognit. Lett., 2024. 8, 5

  18. [27]

    Cross-modality attention and multimodal fusion trans- former for pedestrian detection

    Wei-Yu Lee, Ljubomir Jovanov, and Wilfried Philips. Cross-modality attention and multimodal fusion trans- former for pedestrian detection. In ECCVW, 2023. 2

  19. [28]

    A novel semantic infor- mation perception architecture for extreme targets detection in complex traffic scenarios

    Ang Li, Ziwei Wang, Fanxun Wang, Zhichao Liu, Guodong Yin, Ruiqi Fang, and Keke Geng. A novel semantic infor- mation perception architecture for extreme targets detection in complex traffic scenarios. IEEE Trans. Intell. Veh., 2024. 7

  20. [29]

    Illumination-aware faster r-cnn for robust multispectral pedestrian detection

    Chengyang Li, Dan Song, Ruofeng Tong, and Min Tang. Illumination-aware faster r-cnn for robust multispectral pedestrian detection. PR, 2019. 3

  21. [30]

    Learning a graph neural network with cross modality inter- action for image fusion

    Jiawei Li, Jiansheng Chen, Jinyuan Liu, and Huimin Ma. Learning a graph neural network with cross modality inter- action for image fusion. In ACMMM, 2023. 6

  22. [31]

    Confidence-aware fusion using dempster- shafer theory for multispectral pedestrian detection

    Qing Li, Changqing Zhang, Qinghua Hu, Huazhu Fu, and Pengfei Zhu. Confidence-aware fusion using dempster- shafer theory for multispectral pedestrian detection. IEEE Trans. Multimed., 2023. 3

  23. [32]

    Stabilizing multispectral pedes- trian detection with evidential hybrid fusion

    Qing Li, Changqing Zhang, Qinghua Hu, Pengfei Zhu, Huazhu Fu, and Lei Chen. Stabilizing multispectral pedes- trian detection with evidential hybrid fusion. TCSVT, 2024. 3

  24. [33]

    Multiscale cross-modal homo- geneity enhancement and confidence-aware fusion for mul- tispectral pedestrian detection

    Ruimin Li, Jiajun Xiang, Feixiang Sun, Ye Yuan, Longwu Yuan, and Shuiping Gou. Multiscale cross-modal homo- geneity enhancement and confidence-aware fusion for mul- tispectral pedestrian detection. IEEE Trans. Multimed. ,

  25. [34]

    M2fnet: Mask-guided multi-level fusion for rgb-t pedestrian detection

    Xiangyang Li, Shiguo Chen, Chunna Tian, Heng Zhou, and Zhenxi Zhang. M2fnet: Mask-guided multi-level fusion for rgb-t pedestrian detection. IEEE Trans. Multimed., 2024. 3

  26. [35]

    Explicit attention-enhanced fusion for rgb-thermal perception tasks

    Mingjian Liang, Junjie Hu, Chenyu Bao, Hua Feng, Fuqin Deng, and Tin Lun Lam. Explicit attention-enhanced fusion for rgb-thermal perception tasks. IEEE Robot. Autom. Lett.,

  27. [36]

    Jingjing Liu, Shaoting Zhang, Shu Wang, and Dimitris N. Metaxas. Multispectral deep neural networks for pedestrian detection. In BMVC, 2016. 2

  28. [37]

    Multispectral deep neural networks for pedestrian detection

    Jingjing Liu, Shaoting Zhang, Shu Wang, and Dimitris N Metaxas. Multispectral deep neural networks for pedestrian detection. arXiv preprint arXiv:1611.02644, 2016. 2

  29. [38]

    Target- aware dual adversarial learning and a multi-scenario multi- modality benchmark to fuse infrared and visible for object detection

    Jinyuan Liu, Xin Fan, Zhanbo Huang, Guanyao Wu, Risheng Liu, Wei Zhong, and Zhongxuan Luo. Target- aware dual adversarial learning and a multi-scenario multi- modality benchmark to fuse infrared and visible for object detection. In CVPR, 2022. 5, 6, 7, 2

  30. [39]

    Multi- focus image fusion with a deep convolutional neural net- work

    Yu Liu, Xun Chen, Hu Peng, and Zengfu Wang. Multi- focus image fusion with a deep convolutional neural net- work. Inf. Fusion, 36:191–207, 2017. 5

  31. [40]

    Vmamba: Visual state space model.arXiv preprint arXiv:2401.10166,

    Yue Liu, Yunjie Tian, Yuzhong Zhao, Hongtian Yu, Lingxi Xie, Yaowei Wang, Qixiang Ye, and Yunfan Liu. Vmamba: Visual state space model.arXiv preprint arXiv:2401.10166,

  32. [41]

    S4fusion: Saliency-aware selective state space model for infrared visible image fu- sion, 2024

    Haolong Ma, Hui Li, Chunyang Cheng, Gaoang Wang, Xi- aoning Song, and Xiaojun Wu. S4fusion: Saliency-aware selective state space model for infrared visible image fu- sion, 2024. 2

  33. [42]

    Tinyvim: Frequency decoupling for tiny hybrid vision mamba

    Xiaowen Ma, Zhenliang Ni, and Xinghao Chen. Tinyvim: Frequency decoupling for tiny hybrid vision mamba. arXiv preprint arXiv:2411.17473, 2024. 2

  34. [43]

    Cross-modal feature fusion and interaction strategy for cnn- transformer-based object detection in visual and infrared re- mote sensing imagery

    Jinyan Nie, He Sun, Xu Sun, Li Ni, and Lianru Gao. Cross-modal feature fusion and interaction strategy for cnn- transformer-based object detection in visual and infrared re- mote sensing imagery. IEEE Geoscience and Remote. Sens. Letters, 21:1–5, 2024. 3

  35. [44]

    Cross-modality attentive feature fusion for object detection in multispectral remote

    Fang Qingyun and Wang Zhaokui. Cross-modality attentive feature fusion for object detection in multispectral remote. sens. imagery. PR, 2022. 2

  36. [45]

    Cross- modality fusion transformer for multispectral object detec- tion

    Fang Qingyun, Han Dapeng, and Wang Zhaokui. Cross- modality fusion transformer for multispectral object detec- tion. arXiv preprint arXiv:2111.00273, 2021. 3

  37. [46]

    Vehicle detec- tion in aerial imagery: A small target detection benchmark

    Sebastien Razakarivony and Frederic Jurie. Vehicle detec- tion in aerial imagery: A small target detection benchmark. JVCIR, 34:187–203, 2016. 5, 2

  38. [47]

    Selvaraju, Michael Cogswell, Abhishek Das, Ramakrishna Vedantam, Devi Parikh, and Dhruv Ba- tra

    Ramprasaath R. Selvaraju, Michael Cogswell, Abhishek Das, Ramakrishna Vedantam, Devi Parikh, and Dhruv Ba- tra. Grad-cam: Visual explanations from deep networks via gradient-based localization. In ICCV, pages 618–626,

  39. [48]

    Icafusion: Iterative cross-attention guided feature fusion for multispectral object detection

    Jifeng Shen, Yifei Chen, Yue Liu, Xin Zuo, Heng Fan, and Wankou Yang. Icafusion: Iterative cross-attention guided feature fusion for multispectral object detection. PR, 2024. 2, 5, 7, 3

  40. [49]

    Mrd-yolo: A multispectral object de- tection algorithm for complex road scenes

    Chaoyue Sun, Yajun Chen, Xiaoyang Qiu, Rongzhen Li, and Longxiang You. Mrd-yolo: A multispectral object de- tection algorithm for complex road scenes. Sensors, 2024. 6

  41. [50]

    Low-rank multimodal remote

    Xu Sun, Yinhui Yu, and Qing Cheng. Low-rank multimodal remote. sens. object detection with frequency filtering ex- perts. IEEE Trans. Geosci. Remote Sens., 2024. 6

  42. [51]

    Adaptive multimodal feature fusion with frequency domain gate for remote

    Xu Sun, Yinhui Yu, and Qing Cheng. Adaptive multimodal feature fusion with frequency domain gate for remote. sens. object detection. Remote Sens. Lett., 2024. 6

  43. [52]

    Det- fusion: A detection-driven infrared and visible image fu- sion network

    Yiming Sun, Bing Cao, Pengfei Zhu, and Qinghua Hu. Det- fusion: A detection-driven infrared and visible image fu- sion network. In ACMMM, page 4003–4011, 2022. 6

  44. [53]

    Drone-based rgb-infrared cross-modality vehicle detection via uncertainty-aware learning

    Yiming Sun, Bing Cao, Pengfei Zhu, and Qinghua Hu. Drone-based rgb-infrared cross-modality vehicle detection via uncertainty-aware learning. TCSVT, 2022. 5, 2, 3

  45. [54]

    Superfusion: A versatile image registration and fusion network with semantic awareness

    Linfeng Tang, Yuxin Deng, Yong Ma, Jun Huang, and Ji- ayi Ma. Superfusion: A versatile image registration and fusion network with semantic awareness. IEEE/CAA J. Au- tom. Sin., 2022. 3, 6, 7

  46. [55]

    Divfusion: Darkness-free infrared and visible image fusion

    Linfeng Tang, Xinyu Xiang, Hao Zhang, Meiqi Gong, and Jiayi Ma. Divfusion: Darkness-free infrared and visible image fusion. Inf. Fusion, 2023. 7

  47. [56]

    Multi-stage im- age denoising with the wavelet transform

    Chunwei Tian, Menghua Zheng, Wangmeng Zuo, Bob Zhang, Yanning Zhang, and David Zhang. Multi-stage im- age denoising with the wavelet transform. PR, 134:109050,

  48. [57]

    Cross-modality proposal-guided feature min- ing for unregistered rgb-thermal pedestrian detection.IEEE Trans

    Chao Tian, Zikun Zhou, Yuqing Huang, Gaojun Li, and Zhenyu He. Cross-modality proposal-guided feature min- ing for unregistered rgb-thermal pedestrian detection.IEEE Trans. Multimed., 2024. 3

  49. [58]

    Iv-yolo: A lightweight dual-branch object detection network

    Dan Tian, Xin Yan, Dong Zhou, Chen Wang, and Wenshuai Zhang. Iv-yolo: A lightweight dual-branch object detection network. Sensors, 2024. 2, 6, 3

  50. [59]

    A dynamic cascade cross- modal coassisted network for aav image object detection

    Shu Tian, Li Wang, Lin Cao, Lihong Kang, Xian Sun, Jing Tian, Xiangwei Xing, Bo Shen, Chunzhuo Fan, Kangning Du, Chong Fu, and Ye Zhang. A dynamic cascade cross- modal coassisted network for aav image object detection. J-STARS, 18:2749–2765, 2025. 3

  51. [60]

    Yolov8: A novel object detection algorithm with enhanced performance and robust- ness

    Rejin Varghese and Sambath M. Yolov8: A novel object detection algorithm with enhanced performance and robust- ness. In ADICS, 2024. 5, 6, 7, 8, 2, 3

  52. [61]

    Kcdnet: Multimodal object detection in modal in- formation imbalance scenes

    Haoyu Wang, Shiyuan Qu, Zhenzhuang Qiao, and Xiaomin Liu. Kcdnet: Multimodal object detection in modal in- formation imbalance scenes. IEEE Trans. Instrum. Meas.,

  53. [62]

    Yolofiv: Object detection algorithm for around-the- clock aerial remote

    Huiying Wang, Chunping Wang, Qiang Fu, Binqiang Si, Dongdong Zhang, Renke Kou, Ying Yu, and Changfeng Feng. Yolofiv: Object detection algorithm for around-the- clock aerial remote. sens. images by fusing infrared and vis- ible features. IEEE J. Sel. Top. Appl. Earth Obs. Remot...

  54. [63]

    Cross-modal oriented object detection of uav aerial images based on im- age feature

    Huiying Wang, Chunping Wang, Qiang Fu, Dongdong Zhang, Renke Kou, Ying Yu, and Jian Song. Cross-modal oriented object detection of uav aerial images based on im- age feature. IEEE Trans. Geosci. Remote Sens., 2024. 6

  55. [64]

    Multi-modal object detection method based on dual-branch asymmetric attention backbone and feature fu- sion pyramid network

    Jinpeng Wang, Nan Su, Chunhui Zhao, Yiming Yan, and Shou Feng. Multi-modal object detection method based on dual-branch asymmetric attention backbone and feature fu- sion pyramid network. Remote. Sens., 2024. 6

  56. [65]

    Multimodal object detection of uav remote sensing based on joint rep- resentation optimization and specific information enhance- ment

    Jinpeng Wang, Congan Xu, Chunhui Zhao, Long Gao, Jun- feng Wu, Yiming Yan, Shou Feng, and Nan Su. Multimodal object detection of uav remote sensing based on joint rep- resentation optimization and specific information enhance- ment. J-STARS, 17:12364–12373, 2024. 6

  57. [66]

    Learning adaptive fusion bank for multi-modal salient object detection

    Kunpeng Wang, Zhengzheng Tu, Chenglong Li, Cheng Zhang, and Bin Luo. Learning adaptive fusion bank for multi-modal salient object detection. TCSVT, 2024. 1

  58. [67]

    Improving rgb-infrared object detec- tion by reducing cross-modality redundancy.Remote

    Qingwang Wang, Yongke Chi, Tao Shen, Jian Song, Zifeng Zhang, and Yan Zhu. Improving rgb-infrared object detec- tion by reducing cross-modality redundancy.Remote. Sens., 14, 2022. 2, 3

  59. [68]

    Improving rgb-infrared object detec- tion by reducing cross-modality redundancy.Remote

    Qingwang Wang, Yongke Chi, Tao Shen, Jian Song, Zifeng Zhang, and Yan Zhu. Improving rgb-infrared object detec- tion by reducing cross-modality redundancy.Remote. Sens., 14(9):2020, 2022. 3

  60. [69]

    Image restoration qual- ity assessment based on regional differential information entropy

    Zhiyu Wang, Jiayan Zhuang, Ningyuan Xu, Sichao Ye, Jiangjian Xiao, and Chengbin Peng. Image restoration qual- ity assessment based on regional differential information entropy. arxiv2107.03642, 2022. 2

  61. [70]

    Dc- fusion: A dual-frequency cross-enhanced fusion network for infrared and visible image fusion

    Dan Wu, Mina Han, Yang Yang, Shan Zhao, Yujing Rao, Hao Li, Lin Xing, Chengjiang Zhou, and Haicheng Bai. Dc- fusion: A dual-frequency cross-enhanced fusion network for infrared and visible image fusion. IEEE Trans. Instrum. Meas., 2023. 2

  62. [71]

    Dcfnet: Infrared and visible image fusion network based on discrete wavelet transform and convolu- tional neural network

    Dan Wu, Yanzhi Wang, Haoran Wang, Fei Wang, and Guowang Gao. Dcfnet: Infrared and visible image fusion network based on discrete wavelet transform and convolu- tional neural network. Sensors, 2024. 3

  63. [72]

    Wavelet transformation of functional data for hyperspectral image classification

    Guangrun Xiao, Xiaobo Wang, and Dezheng Liu. Wavelet transformation of functional data for hyperspectral image classification. In 2019 International Conference on Inter- net of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and...

  64. [73]

    YOLO-MS: multispectral object detection via feature inter- action and self-attention guided fusion

    Yumin Xie, Langwen Zhang, Xiaoyuan Yu, and Wei Xie. YOLO-MS: multispectral object detection via feature inter- action and self-attention guided fusion. IEEE Trans. Cogn. Dev. Syst., 2023. 2

  65. [74]

    Cross- modality double bidirectional interaction and fusion net- work for RGB-T salient object detection

    Zhengxuan Xie, Feng Shao, Gang Chen, Hangwei Chen, Qiuping Jiang, Xiangchao Meng, and Yo-Sung Ho. Cross- modality double bidirectional interaction and fusion net- work for RGB-T salient object detection. TCSVT, 2023. 1

  66. [75]

    Enhanced spectral–spatial fusion net- work for multispectral object detection in ground-aerial im- ages

    Fengxiang Xu, Tingfa Xu, Lang Hong, Peiran Peng, Jiaxin Guo, and Jianan Li. Enhanced spectral–spatial fusion net- work for multispectral object detection in ground-aerial im- ages. IEEE Geoscience and Remote. Sens. Letters, 2024. 8, 5

  67. [76]

    Enhanced spectral-spatial fusion net- work for multispectral object detection in ground-aerial im- ages

    Fengxiang Xu, Tingfa Xu, Lang Hong, Peiran Peng, Jiaxin Guo, and Jianan Li. Enhanced spectral-spatial fusion net- work for multispectral object detection in ground-aerial im- ages. IEEE Geoscience and Remote. Sens. Letters, 2024. 3

  68. [77]

    Rfnet: Unsupervised network for mutually reinforc- ing multi-modal image registration and fusion

    Han Xu, Jiayi Ma, Jiteng Yuan, Zhuliang Le, and Wei Liu. Rfnet: Unsupervised network for mutually reinforc- ing multi-modal image registration and fusion. In CVPR,

  69. [78]

    Cross-modal adaptive fusion object detec- tion based on illumination-awareness

    Junwei Xu, Bo Mo, Jie Zhao, Chunbo Zhao, Yimeng Tao, and Shuo Han. Cross-modal adaptive fusion object detec- tion based on illumination-awareness. In YAC, 2024. 6

  70. [79]

    Multi- dimensional fusion network for multispectral object detec- tion

    Fan Yang, Binbin Liang, Wei Li, and Jianwei Zhang. Multi- dimensional fusion network for multispectral object detec- tion. TCSVT, 2024. 6

  71. [80]

    A dual-modality pedestrian detection method based on multi-scale feature fusion

    Huanyu Yang, Weiwei Bian, Jun Wang, Yuming Bo, and Ying Mi. A dual-modality pedestrian detection method based on multi-scale feature fusion. In ICHMS, 2024. 7

  72. [81]

    Mul- tispectral sample augmentation and illumination guidance for RGB-T object detection by mm detection framework

    Jinqi Yang, Xin Yang, Yizhao Liao, Jinxiang Huang, Hongyu He, Erfan Zhang, Ya Zhou, and Yong Song. Mul- tispectral sample augmentation and illumination guidance for RGB-T object detection by mm detection framework. In LOPET, 2024. 6

  73. [82]

    Wave-vit: Unifying wavelet and transformers for visual representation learning

    Ting Yao, Yingwei Pan, Yehao Li, Chong-Wah Ngo, and Tao Mei. Wave-vit: Unifying wavelet and transformers for visual representation learning. In ECCV, 2022. 3, 7

  74. [83]

    Text-if: Leveraging semantic text guidance for degradation-aware and interactive image fusion

    Xunpeng Yi, Han Xu, Hao Zhang, Linfeng Tang, and Ji- ayi Ma. Text-if: Leveraging semantic text guidance for degradation-aware and interactive image fusion. In CVPR,

  75. [84]

    C²former: Calibrated and complementary transformer for rgb-infrared object de- tection

    Maoxun Yuan and Xingxing Wei. C²former: Calibrated and complementary transformer for rgb-infrared object de- tection. IEEE Trans. Geosci. Remote Sens., 2024. 2, 6, 7

  76. [85]

    Transla- tion, scale and rotation: Cross-modal alignment meets rgb- infrared vehicle detection

    Maoxun Yuan, Yinyan Wang, and Xingxing Wei. Transla- tion, scale and rotation: Cross-modal alignment meets rgb- infrared vehicle detection. In ECCV, 2022. 6

  77. [86]

    Sdnet: A versatile squeeze-and- decomposition network for real-time image fusion

    Hao Zhang and Jiayi Ma. Sdnet: A versatile squeeze-and- decomposition network for real-time image fusion. IJCV,

  78. [87]

    Multispectral fusion for object detection with cyclic fuse-and-refine blocks

    Heng Zhang, ´Elisa Fromont, S´ebastien Lef`evre, and Bruno Avignon. Multispectral fusion for object detection with cyclic fuse-and-refine blocks. In ICIP, 2020. 5, 2

  79. [88]

    Guided attentive feature fusion for multispectral pedestrian detection

    Heng Zhang, Elisa Fromont, Sebastien Lefevre, and Bruno Avignon. Guided attentive feature fusion for multispectral pedestrian detection. In WACV, pages 72–80, 2021. 3

  80. [89]

    Efficient cross-modality feature inter- action for multispectral armored vehicle detection

    Jie Zhang, Tian qing Chang, Li yang Zhao, Jin dun Ma, Bin Han, and Lei Zhang. Efficient cross-modality feature inter- action for multispectral armored vehicle detection. Appl. Soft Comput, 163:111971, 2024. 3

  81. [90]

    Cross-modality interactive attention network for multispectral pedestrian detection

    Lu Zhang, Zhiyong Liu, Shifeng Zhang, Xu Yang, Hong Qiao, Kaizhu Huang, and Amir Hussain. Cross-modality interactive attention network for multispectral pedestrian detection. Inf. Fusion, 2019. 2

  82. [91]

    Weakly aligned cross-modal learn- ing for multispectral pedestrian detection

    Lu Zhang, Xiangyu Zhu, Xiangyu Chen, Xu Yang, Zhen Lei, and Zhiyong Liu. Weakly aligned cross-modal learn- ing for multispectral pedestrian detection. In ICCV, pages 5127–5137, 2019. 2

  83. [92]

    Esm-yolo: Enhanced small target detection based on visi- ble and infrared multi-modal fusion

    Qianqian Zhang, Linwei Qiu, Li Zhou, and Junshe An. Esm-yolo: Enhanced small target detection based on visi- ble and infrared multi-modal fusion. InACCV, pages 1454– 1469, 2024. 3

  84. [93]

    Wavelet-based fourier information interaction with fre- quency diffusion adjustment for underwater image restora- tion

    Chen Zhao, Weiling Cai, Chenyu Dong, and Chengwei Hu. Wavelet-based fourier information interaction with fre- quency diffusion adjustment for underwater image restora- tion. In CVPR, 2024. 3

  85. [94]

    Object detection in mul- tispectral remote

    Pujie Zhao, Xia Ye, and Ziang Du. Object detection in mul- tispectral remote. sens. images based on cross-modal cross- attention. Sensors, 2024. 7

  86. [95]

    Removal then selection: A coarse-to- fine fusion perspective for rgb-infrared object detection

    Tianyi Zhao, Maoxun Yuan, Feng Jiang, Nan Wang, and Xingxing Wei. Removal then selection: A coarse-to- fine fusion perspective for rgb-infrared object detection. arXiv:2401.10731, 2024. 7, 2

  87. [96]

    Didfuse: Deep image de- composition for infrared and visible image fusion

    Zixiang Zhao, Shuang Xu, Chunxia Zhang, Junmin Liu, Jiangshe Zhang, and Pengfei Li. Didfuse: Deep image de- composition for infrared and visible image fusion. InIJCAI,

  88. [97]

    Efficient and model-based infrared and visible image fusion via algo- rithm unrolling

    Zixiang Zhao, Shuang Xu, Jiangshe Zhang, Chengyang Liang, Chunxia Zhang, and Junmin Liu. Efficient and model-based infrared and visible image fusion via algo- rithm unrolling. TCSVT, 2022. 7

  89. [98]

    Cddfuse: Correlation-driven dual-branch feature decompo- sition for multi-modality image fusion

    Zixiang Zhao, Haowen Bai, Jiangshe Zhang, Yulun Zhang, Shuang Xu, Zudi Lin, Radu Timofte, and Luc Van Gool. Cddfuse: Correlation-driven dual-branch feature decompo- sition for multi-modality image fusion. In CVPR, 2023. 3, 6

  90. [99]

    Equivariant multi-modality image fu- sion

    Zixiang Zhao, Haowen Bai, Jiangshe Zhang, Yulun Zhang, Kai Zhang, Shuang Xu, Dongdong Chen, Radu Timofte, and Luc Van Gool. Equivariant multi-modality image fu- sion. In CVPR, 2024. 6

  91. [100]

    Dmm: Disparity-guided multispectral mamba for oriented object detection in remote

    Minghang Zhou, Tianyu Li, Chaofan Qiao, Dongyu Xie, Guoqing Wang, Ningjuan Ruan, Lin Mei, and Yang Yang. Dmm: Disparity-guided multispectral mamba for oriented object detection in remote. sens. arXiv:2407.08132, 2024. 2, 3, 6

  92. [101]

    Cross teaching-enhanced multispectral re- mote sensing object detection with transformer

    Jiahe Zhu, Huan Zhang, Simin Li, Shengjin Wang, and Hongbing Ma. Cross teaching-enhanced multispectral re- mote sensing object detection with transformer. J-STARS, 18:2401–2413, 2025. 3

  93. [102]

    Multi-modal feature pyramid transformer for rgb-infrared object detection

    Yaohui Zhu, Xiaoyu Sun, Miao Wang, and Hua Huang. Multi-modal feature pyramid transformer for rgb-infrared object detection. IEEE Trans. Intell. Transport. Syst. , 24 (9):9984–9995, 2023. 8

  94. [103]

    { P1, P2, P3}

    Wenbin Zou, Mingchao Jiang, Yunchen Zhang, Liang Chen, Zhiyong Lu, and Yi Wu. Sdwnet: A straight dilated network with wavelet transformation for image deblurring. In ICCVW, 2021. 3 WaveMamba: Wavelet-Driven Mamba Fusion for RGB-Infrared Object Detection Supplementary Material ...

Pith tools

Reviewed August 6, 2026 · model on record in the stance chip above.