REVIEW 4 major objections 4 minor 102 references
WaveMamba: Wavelet-Driven Mamba Fusion for RGB-Infrared Object Detection
T0 review · 4 major / 4 minor · reviewed 2026-08-06 · deepseek-v4-flash
Pith's one-line read WaveMamba claims that fusing RGB and infrared imagery in the wavelet domain — using a Mamba-based block for low-frequency structure and an absolute-maximum selection for high-frequency detail — yields state-of-the-art object detection…
desk verdict WaveMamba is a competent engineering paper with a plausible frequency-domain story and large reported gains, but the headline 4.5-point mAP lead is not established because the comparison is against literature numbers and no code or error bars are provided. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing mechanism is the WaveMamba Fusion Block (WMFB), which consists of the Low-frequency Mamba Fusion Block (LMFB) and the High-Frequency Enhancement (HFE) strategy. LMFB first performs a channel-swapping operation between the RGB and IR low-frequency sub-bands, passes each through Vision State Space (VSS) blocks, then runs a gated-attention deep fusion that alternates the modalities as primary and auxiliary and uses the Selective Scan 2D (SS2D) module — the core of Mamba — to propagate global information. HFE does no learned fusion at all: it builds a binary mask from the sign of the difference between the absolute values of the two modalities' high-frequency sub-images, keeping the larger-magnitude pixel from either RGB or IR and suppressing the other. Around these blocks, a discrete Haar wavelet transform splits features at multiple network depths into four sub-bands (LL, LH, HL, HH) and an inverse transform in the YOLOv8 head reconstructs the features for detection. Together they realize the argument that fusion should be frequency-aware — structure from IR, detail from RGB, selected rather than averaged.
What would settle it
Re-run the compared methods (for example DMM, ICAFusion, CrossFormer, and the YOLOv8 single-modality baselines) in the same codebase, hyperparameters, and data splits used for WaveMamba on M3FD and DroneVehicle; if the best re-run baseline closes the gap to well below 4.5% or changes the ranking, the headline claim fails. A second check: measure low- and high-frequency information entropy on each new dataset — the motivational premise that IR dominates low frequency and RGB dominates high frequency is directly testable.
Extended reading notes
Core claim
The central claim, on the paper's own terms, is that modality-specific frequency decomposition is the right organizing principle for RGB-IR fusion. The authors show by information-entropy measurement that IR dominates the LL sub-band and RGB dominates the LH/HL/HH sub-bands, then exploit this by routing low-frequency features through the WaveMamba Fusion Block and high-frequency features through an absolute-maximum selection mask. The Mamba-based low-frequency path (a shallow channel-swapping stage followed by a gated-attention selective-scan stage) is designed to use the global modeling strength of state space models on structure-rich low-frequency content, while the absolute-maximum rule preserves the sharpest edges and textures from either modality. Recombining via IDWT instead of standard upsampling is claimed to cut information loss and also shrink parameter count. The result is a claimed state-of-the-art performance across four benchmarks with an average mAP improvement of about 4.5 points over the previous best.
Load-bearing premise
The 4.5% average improvement is measured against numbers the paper takes from earlier publications, without re-running those methods under its own training, split, and augmentation settings.
Editorial extensions
If this is right
- On M3FD the YOLOv8-based WaveMamba reports 92.1 mAP50 and 64.4 mAP, gains of 5.5 and 5.1 points over the previous best, with the YOLOv5 and ResNet50 versions also leading their backbone groups.
- On DroneVehicle the YOLOv8 variant reaches 79.8 mAP50 and 60.5 mAP with no remote-sensing-specific design, suggesting the frequency-fusion recipe transfers to dense small-target drone imagery.
- On LLVIP pedestrian detection, the YOLOv8 model reports 98.3 mAP50 and 66.0 mAP, the best among compared fusion and single-modality methods.
- On FLIR-Aligned, WaveMamba beats the compared methods in precision, recall, F1, mAP50, and mAP while using fewer parameters (e.g., 45.6M vs 340.0M for CrossFormer) and lower inference time.
- The ablations attribute the gains to the design: removing SFM or DFM costs about 2 points of mAP, and the HFE+LMFB combination outperforms averaging fusion in the wavelet domain.
Reading between the lines
- The frequency-entropy argument suggests the approach could extend to other modality pairs with complementary spectral content, such as RGB-depth or RGB-event streams, but the paper does not test this.
- Because the reported gains are computed against published baseline numbers rather than re-run baselines, the 4.5% headline figure may shift under a unified training protocol; a fair head-to-head re-run is the natural next check.
- The wavelet-basis ablation shows less than 0.4% sensitivity to the choice of wavelet, hinting that other multiresolution decompositions might behave similarly; that robustness is a testable conjecture, not a paper claim.
- The IDWT head improves accuracy while cutting 7.6M parameters versus the standard YOLOv8 head, which suggests the lossless up/down-sampling benefit may apply to single-modality detectors as well.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. WaveMamba is a dual-stream RGB-infrared object detector built on a YOLOv8 framework. The authors apply a Haar discrete wavelet transform (DWT) to backbone features, fuse the low-frequency sub-bands with a Mamba-based Low-frequency Mamba Fusion Block (channel swapping plus a gated-attention deep fusion module), fuse high-frequency sub-bands with an 'absolute maximum' strategy, and use an inverse DWT in a modified detection head. Experiments are reported on M3FD, DroneVehicle, LLVIP, and FLIR-Aligned in the main text, with additional results on VEDAI and KAIST in the supplement. The paper claims an average mAP improvement of 4.5% over the second-best state-of-the-art method. Ablations on M3FD support the contribution of the improved head, the SFM and DFM modules, and the HFE/LMFB combination.
Significance. The frequency-complementarity motivation is clean, and the proposed modules are simple enough that the approach could be practically useful if the reported gains are real. The paper covers six datasets and three backbones, and the ablation tables show that each module contributes to the final result. However, the headline numerical claim is not yet established at the level expected for a journal publication: the comparisons are against literature-reported baseline numbers without a controlled re-run under one protocol, the final architecture was selected using the same M3FD benchmark that appears in the headline comparison, and no code or error bars are provided. Because the central claim is purely empirical, these protocol issues determine whether the 4.5% figure is meaningful.
major comments (4)
- [4.1; Tables 1-4; Table 7] The 4.5% average gain is computed by comparing WaveMamba's numbers with baseline numbers taken from prior publications, but the manuscript does not state that those methods were re-run under WaveMamba's protocol (640x640 input, 250 epochs, batch size 16, SGD, default YOLOv8 augmentation). The sensitivity of the comparison to protocol is visible in Table 7, where the authors' own average-fusion dual-stream YOLOv8 baseline reaches only 83.2 mAP50 / 55.1 mAP on M3FD, while the cited MRD-YOLO value on the same YOLOv8 backbone is 86.6 / 59.3. If the prior baselines were trained with different splits, image sizes, epochs, or augmentation, the per-dataset gaps in Tables 1-4, and therefore the claimed 4.5% average, could change materially. A controlled re-run of at least the closest competitors under one protocol is needed before the headline claim can be accepted.
- [Supplementary E.2; Tables 5-7] The final architecture (improved head, three WMFBs, positions {P2,P3,P5}, Haar basis) was selected by maximizing mAP on M3FD, and M3FD is also one of the four datasets used to compute the 4.5% headline gain. This means the M3FD row of Table 1 is partly a product of tuning on that benchmark. The authors should either fix all design choices before evaluation, select hyperparameters on a held-out validation split and then report test performance, or show that the same choices are also optimal on DroneVehicle, LLVIP, and FLIR-Aligned.
- [3.2] The description of the WMFB placement is internally inconsistent. The architecture is introduced as containing 'three WaveMamba Fusion Blocks,' and the text says the first two backbone layers produce f^2 features that undergo DWT, but it then says DWT and WMFB are applied to the fused features at the 3rd and 5th layers. The supplementary ablation (Table C) uses positions {P2,P3,P5}. This inconsistency must be corrected because the exact fusion locations are essential for reproducing the method.
- [4.1; Supplementary Tables C-E] No error bars or multiple-seed results are reported. Several design comparisons differ by only 0.1-0.4 mAP (e.g., wavelet bases in Table E), which is within typical run-to-run variation for YOLO training; without repeated runs, the claim that the chosen configurations are optimal is not statistically supported. Reporting mean and standard deviation over at least three seeds would also help quantify the reliability of the headline differences.
minor comments (4)
- [3.1] There is a typo in 'genetate outputs' that should read 'generate outputs.'
- [4.2, DroneVehicle] The sentence 'surpassing the fourth-place method by 2.6% and 3.6%' is confusing because WaveMamba is first in the table; the intended meaning is presumably 'the next-best method' or a specific ranked baseline.
- [References] The reference list contains duplicate entries: [67] and [68] are the same paper, and [75] and [76] are also the same paper; these should be merged.
- [3.3.2, Eq. (6)] In the HFE formula, if the RGB and IR coefficients have exactly equal absolute values, both masks are zero and the fused coefficient is set to zero; the authors should state whether this edge case occurs in practice or modify the mask to break ties.
Circularity Check
No circularity: WaveMamba's claims are empirical and its components are defined by explicit forward equations; benchmark tuning and baseline-protocol concerns are not circularity.
full rationale
WaveMamba makes no first-principles claim; its headline assertions are empirical mAP measurements. The method is specified by forward equations (Haar DWT in Eqs. (1)-(2); channel swapping in Eq. (3); VSS in Eq. (4); DFM in Eq. (5); max-absolute high-frequency selection in Eq. (6); IDWT-based head in Sec. 3.4). None of these equations is defined in terms of the benchmark mAP values it is later used to report, so no result is equivalent to its input by construction. The reported 4.5% average gain is taken from Tables 1-4 against literature baselines; if those baselines were obtained under different training protocols the comparison may be under-specified, but that is an experimental-validity issue rather than circularity. The ablations in Tables 5-7 and Supplementary Tables C-E choose block positions, block count, and wavelet basis using M3FD mAP, so the M3FD portion of the headline is partly in-sample; however, this is model selection on a benchmark, not a definitional or statistically forced prediction, and the gains on DroneVehicle, LLVIP, and FLIR-Aligned are out-of-sample. No load-bearing self-citation or imported uniqueness theorem appears: Mamba [15], VSS [40], channel swapping [17], and DWT/IDWT [11] are external component references, and the paper does not rely on the authors' own prior results. Consequently there are no circular steps.
Assumptions & free parameters
free parameters (3)
- WMFB placement =
stages P2, P3, P5
- Number of WMFBs =
3
- Wavelet basis =
Haar
assumptions (3)
- domain assumption RGB high-frequency sub-bands and IR low-frequency sub-bands carry complementary information for object detection
- domain assumption Larger absolute values in high-frequency sub-bands indicate more informative detail
- domain assumption Haar DWT followed by IDWT is a lossless representation and preserves information better than learned downsampling or upsampling
Cite this review
Pith. "Pith review of WaveMamba: Wavelet-Driven Mamba Fusion for RGB-Infrared Object Detection." pith.science (2026). https://pith.science/paper/KVYD5B4H
@misc{pith2026250718173,
author = {Pith},
title = {Pith review of: WaveMamba: Wavelet-Driven Mamba Fusion for RGB-Infrared Object Detection},
year = {2026},
howpublished = {\url{https://pith.science/paper/KVYD5B4H}},
note = {Machine review of arXiv:2507.18173}
}
read the original abstract
Leveraging the complementary characteristics of visible (RGB) and infrared (IR) imagery offers significant potential for improving object detection. In this paper, we propose WaveMamba, a cross-modality fusion method that efficiently integrates the unique and complementary frequency features of RGB and IR decomposed by Discrete Wavelet Transform (DWT). An improved detection head incorporating the Inverse Discrete Wavelet Transform (IDWT) is also proposed to reduce information loss and produce the final detection results. The core of our approach is the introduction of WaveMamba Fusion Block (WMFB), which facilitates comprehensive fusion across low-/high-frequency sub-bands. Within WMFB, the Low-frequency Mamba Fusion Block (LMFB), built upon the Mamba framework, first performs initial low-frequency feature fusion with channel swapping, followed by deep fusion with an advanced gated attention mechanism for enhanced integration. High-frequency features are enhanced using a strategy that applies an ``absolute maximum" fusion approach. These advancements lead to significant performance gains, with our method surpassing state-of-the-art approaches and achieving average mAP improvements of 4.5% on four benchmarks.
Figures
Reference graph
Works this paper leans on
-
[1]
Daff: Dual attentive feature fusion for multispectral pedestrian detection
Afnan Althoupety, Li-Yun Wang, Wu-Chi Feng, and Ba- nafsheh Rekabdar. Daff: Dual attentive feature fusion for multispectral pedestrian detection. InCVPRW, pages 2997– 3006, 2024. 3
2024
-
[2]
Dual-yolo architecture from infrared and visible images for object detection
Chun Bao, Jie Cao, Qun Hao, Yang Cheng, Yaqian Ning, and Tianhua Zhao. Dual-yolo architecture from infrared and visible images for object detection. Sensors, 2023. 6, 3
2023
-
[3]
Multimodal object detection by channel switch- ing and spatial attention
Yue Cao, Junchi Bin, Jozsef Hamari, Erik Blasch, and Zheng Liu. Multimodal object detection by channel switch- ing and spatial attention. In CVPRW, 2023. 3, 7, 5
2023
-
[4]
Weakly misalignment-free adaptive feature alignment for uavs- based multimodal object detection
Chen Chen, Jiahao Qi, Xingyue Liu, Kangcheng Bin, Ruigang Fu, Xikun Hu, and Ping Zhong. Weakly misalignment-free adaptive feature alignment for uavs- based multimodal object detection. In CVPR, 2024. 6
2024
-
[5]
Rgb-ir yolo combining modality-specific reconstruction and information integration
Yishuo Chen, Boran Wang, Wenbin Zhu, and Jing Yuan. Rgb-ir yolo combining modality-specific reconstruction and information integration. In YAC, 2024. 6
2024
-
[6]
Multimodal object detec- tion via-probabilistic ensembling
Yi-Ting Chen, Jinghao Shi, Zelin Ye, Christoph Mertz, Deva Ramanan, and Shu Kong. Multimodal object detec- tion via-probabilistic ensembling. In ECCV, 2022. 3
2022
-
[7]
Slbaf-net: Super- lightweight bimodal adaptive fusion network for uav de- tection in low recognition environment
Xiaolong Cheng, Keke Geng, Ziwei Wang, Jinhu Wang, Yuxiao Sun, and Pengbo Ding. Slbaf-net: Super- lightweight bimodal adaptive fusion network for uav de- tection in low recognition environment. Multimedia Tools Appl., 2023. 6, 7
2023
-
[8]
Borrow from anywhere: Pseudo multi-modal object detection in thermal imagery
Chaitanya Devaguptapu, Ninad Akolekar, Manuj M Sharma, and Vineeth N Balasubramanian. Borrow from anywhere: Pseudo multi-modal object detection in thermal imagery. In CVPRW, pages 0–0, 2019. 3
2019
Show all 102 references
-
[10]
Acdf-yolo: Attentive and cross-differential fusion network for multimodal remote
Xuan Fei, Mengyao Guo, Yan Li, Renping Yu, and Le Sun. Acdf-yolo: Attentive and cross-differential fusion network for multimodal remote. sens. object detection. Remote. Sens., 2024. 7
2024
-
[11]
Finder, Roy Amoyal, Eran Treister, and Oren Freifeld
Shahaf E. Finder, Roy Amoyal, Eran Treister, and Oren Freifeld. Wavelet convolutions for large receptive fields. arXiv:2407.05848, 2024. 3, 4, 7
2024 arXiv
-
[12]
Free teledyne flir thermal dataset for algorithm training
TELEDYNE FLIR. Free teledyne flir thermal dataset for algorithm training. Online, 2024. 2
2024
-
[13]
Lraf-net: Long- range attention fusion network for visible–infrared object detection
Haolong Fu, Shixun Wang, Puhong Duan, Changyan Xiao, Renwei Dian, Shutao Li, and Zhiyong Li. Lraf-net: Long- range attention fusion network for visible–infrared object detection. TNNLS, 35(10):13232–13245, 2024. 3
2024
-
[14]
Mambast: A plug-and-play cross-spectral spatial-temporal fuser for efficient pedestrian detection
Xiangbo Gao, Asiegbu Miracle Kanu-Asiegbu, and Xi- aoxiao Du. Mambast: A plug-and-play cross-spectral spatial-temporal fuser for efficient pedestrian detection. arXiv:2408.01037, 2024. 2
2024 arXiv
-
[15]
Mamba: Linear-time sequence modeling with selective state spaces
Albert Gu and Tri Dao. Mamba: Linear-time sequence modeling with selective state spaces. arXiv:2312.00752,
-
[16]
Damsdet: Dynamic adaptive multispectral de- tection transformer with competitive query selection and adaptive feature fusion
Junjie Guo, Chenqiang Gao, Fangcen Liu, Deyu Meng, and Xinbo Gao. Damsdet: Dynamic adaptive multispectral de- tection transformer with competitive query selection and adaptive feature fusion. In ECCV, pages 464–481, 2024. 6
2024
-
[17]
Pan-mamba: Effective pan-sharpening with state space model
Xuanhua He, Ke Cao, Jie Zhang, Keyu Yan, Yingying Wang, Rui Li, Chengjun Xie, Danfeng Hong, and Man Zhou. Pan-mamba: Effective pan-sharpening with state space model. CoRR’24, 2024. 4
2024
-
[18]
Fire detection in video surveillances using con- volutional neural networks and wavelet transform
Lida Huang, Gang Liu, Yan Wang, Hongyong Yuan, and Tao Chen. Fire detection in video surveillances using con- volutional neural networks and wavelet transform. EAAI, 110:104737, 2022. 3
2022
-
[19]
Cross-modality interaction for few-shot multispectral object detection with semantic knowledge
Lian Huang, Zongju Peng, Fen Chen, Shaosheng Dai, Ziqiang He, and Kesheng Liu. Cross-modality interaction for few-shot multispectral object detection with semantic knowledge. Neural Networks, 2024. 2
2024
-
[20]
Multispectral pedestrian detection: Benchmark dataset and baseline
Soonmin Hwang, Jaesik Park, Namil Kim, Yukyung Choi, and In So Kweon. Multispectral pedestrian detection: Benchmark dataset and baseline. In CVPR, pages 1037– 1045, 2015. 5, 2
2015
-
[21]
Llvip: A visible-infrared paired dataset for low-light vision
Xinyu Jia, Chuang Zhu, Minzhen Li, Wenqi Tang, and Wenli Zhou. Llvip: A visible-infrared paired dataset for low-light vision. In ICCVW, 2021. 5, 2
2021
-
[22]
M2fnet: Multi-modal fusion network for ob- ject detection from visible and thermal infrared images.Int
Chenchen Jiang, Huazhong Ren, Hong Yang, Hongtao Huo, Pengfei Zhu, Zhaoyuan Yao, Jing Li, Min Sun, and Shihao Yang. M2fnet: Multi-modal fusion network for ob- ject detection from visible and thermal infrared images.Int. J. Appl. Earth Obs. Geoinf., 2024. 6
2024
-
[23]
Tsjnet: A multi-modality target and semantic awareness joint-driven image fusion network
Yuchan Jie, Yushen Xu, Xiaosong Li, and Haishu Tan. Tsjnet: A multi-modality target and semantic awareness joint-driven image fusion network. arXiv:2402.01212,
-
[24]
Global–local feature fusion network for visible–infrared vehicle detec- tion
Xudong Kang, Hui Yin, and Puhong Duan. Global–local feature fusion network for visible–infrared vehicle detec- tion. IEEE Geosci. Remote Sens. Lett., 2024. 6
2024
-
[25]
Uncertainty-guided cross-modal learning for robust multi- spectral pedestrian detection
Jung Uk Kim, Sungjune Park, and Yong Man Ro. Uncertainty-guided cross-modal learning for robust multi- spectral pedestrian detection. TCSVT, 2022. 1
2022
-
[26]
Cross- former: Cross-guided attention for multi-modal object de- tection
Seungik Lee, Jaehyeong Park, and Jinsun Park. Cross- former: Cross-guided attention for multi-modal object de- tection. Pattern Recognit. Lett., 2024. 8, 5
2024
-
[27]
Cross-modality attention and multimodal fusion trans- former for pedestrian detection
Wei-Yu Lee, Ljubomir Jovanov, and Wilfried Philips. Cross-modality attention and multimodal fusion trans- former for pedestrian detection. In ECCVW, 2023. 2
2023
-
[28]
A novel semantic infor- mation perception architecture for extreme targets detection in complex traffic scenarios
Ang Li, Ziwei Wang, Fanxun Wang, Zhichao Liu, Guodong Yin, Ruiqi Fang, and Keke Geng. A novel semantic infor- mation perception architecture for extreme targets detection in complex traffic scenarios. IEEE Trans. Intell. Veh., 2024. 7
2024
-
[29]
Illumination-aware faster r-cnn for robust multispectral pedestrian detection
Chengyang Li, Dan Song, Ruofeng Tong, and Min Tang. Illumination-aware faster r-cnn for robust multispectral pedestrian detection. PR, 2019. 3
2019
-
[30]
Learning a graph neural network with cross modality inter- action for image fusion
Jiawei Li, Jiansheng Chen, Jinyuan Liu, and Huimin Ma. Learning a graph neural network with cross modality inter- action for image fusion. In ACMMM, 2023. 6
2023
-
[31]
Confidence-aware fusion using dempster- shafer theory for multispectral pedestrian detection
Qing Li, Changqing Zhang, Qinghua Hu, Huazhu Fu, and Pengfei Zhu. Confidence-aware fusion using dempster- shafer theory for multispectral pedestrian detection. IEEE Trans. Multimed., 2023. 3
2023
-
[32]
Stabilizing multispectral pedes- trian detection with evidential hybrid fusion
Qing Li, Changqing Zhang, Qinghua Hu, Pengfei Zhu, Huazhu Fu, and Lei Chen. Stabilizing multispectral pedes- trian detection with evidential hybrid fusion. TCSVT, 2024. 3
2024
-
[33]
Multiscale cross-modal homo- geneity enhancement and confidence-aware fusion for mul- tispectral pedestrian detection
Ruimin Li, Jiajun Xiang, Feixiang Sun, Ye Yuan, Longwu Yuan, and Shuiping Gou. Multiscale cross-modal homo- geneity enhancement and confidence-aware fusion for mul- tispectral pedestrian detection. IEEE Trans. Multimed. ,
-
[34]
M2fnet: Mask-guided multi-level fusion for rgb-t pedestrian detection
Xiangyang Li, Shiguo Chen, Chunna Tian, Heng Zhou, and Zhenxi Zhang. M2fnet: Mask-guided multi-level fusion for rgb-t pedestrian detection. IEEE Trans. Multimed., 2024. 3
2024
-
[35]
Explicit attention-enhanced fusion for rgb-thermal perception tasks
Mingjian Liang, Junjie Hu, Chenyu Bao, Hua Feng, Fuqin Deng, and Tin Lun Lam. Explicit attention-enhanced fusion for rgb-thermal perception tasks. IEEE Robot. Autom. Lett.,
-
[36]
Jingjing Liu, Shaoting Zhang, Shu Wang, and Dimitris N. Metaxas. Multispectral deep neural networks for pedestrian detection. In BMVC, 2016. 2
2016
-
[37]
Multispectral deep neural networks for pedestrian detection
Jingjing Liu, Shaoting Zhang, Shu Wang, and Dimitris N Metaxas. Multispectral deep neural networks for pedestrian detection. arXiv preprint arXiv:1611.02644, 2016. 2
2016 arXiv
-
[38]
Target- aware dual adversarial learning and a multi-scenario multi- modality benchmark to fuse infrared and visible for object detection
Jinyuan Liu, Xin Fan, Zhanbo Huang, Guanyao Wu, Risheng Liu, Wei Zhong, and Zhongxuan Luo. Target- aware dual adversarial learning and a multi-scenario multi- modality benchmark to fuse infrared and visible for object detection. In CVPR, 2022. 5, 6, 7, 2
2022
-
[39]
Multi- focus image fusion with a deep convolutional neural net- work
Yu Liu, Xun Chen, Hu Peng, and Zengfu Wang. Multi- focus image fusion with a deep convolutional neural net- work. Inf. Fusion, 36:191–207, 2017. 5
2017
-
[40]
Vmamba: Visual state space model.arXiv preprint arXiv:2401.10166,
Yue Liu, Yunjie Tian, Yuzhong Zhao, Hongtian Yu, Lingxi Xie, Yaowei Wang, Qixiang Ye, and Yunfan Liu. Vmamba: Visual state space model.arXiv preprint arXiv:2401.10166,
-
[41]
S4fusion: Saliency-aware selective state space model for infrared visible image fu- sion, 2024
Haolong Ma, Hui Li, Chunyang Cheng, Gaoang Wang, Xi- aoning Song, and Xiaojun Wu. S4fusion: Saliency-aware selective state space model for infrared visible image fu- sion, 2024. 2
2024
-
[42]
Tinyvim: Frequency decoupling for tiny hybrid vision mamba
Xiaowen Ma, Zhenliang Ni, and Xinghao Chen. Tinyvim: Frequency decoupling for tiny hybrid vision mamba. arXiv preprint arXiv:2411.17473, 2024. 2
2024
-
[43]
Cross-modal feature fusion and interaction strategy for cnn- transformer-based object detection in visual and infrared re- mote sensing imagery
Jinyan Nie, He Sun, Xu Sun, Li Ni, and Lianru Gao. Cross-modal feature fusion and interaction strategy for cnn- transformer-based object detection in visual and infrared re- mote sensing imagery. IEEE Geoscience and Remote. Sens. Letters, 21:1–5, 2024. 3
2024
-
[44]
Cross-modality attentive feature fusion for object detection in multispectral remote
Fang Qingyun and Wang Zhaokui. Cross-modality attentive feature fusion for object detection in multispectral remote. sens. imagery. PR, 2022. 2
2022
-
[45]
Cross- modality fusion transformer for multispectral object detec- tion
Fang Qingyun, Han Dapeng, and Wang Zhaokui. Cross- modality fusion transformer for multispectral object detec- tion. arXiv preprint arXiv:2111.00273, 2021. 3
2021 arXiv
-
[46]
Vehicle detec- tion in aerial imagery: A small target detection benchmark
Sebastien Razakarivony and Frederic Jurie. Vehicle detec- tion in aerial imagery: A small target detection benchmark. JVCIR, 34:187–203, 2016. 5, 2
2016
-
[47]
Selvaraju, Michael Cogswell, Abhishek Das, Ramakrishna Vedantam, Devi Parikh, and Dhruv Ba- tra
Ramprasaath R. Selvaraju, Michael Cogswell, Abhishek Das, Ramakrishna Vedantam, Devi Parikh, and Dhruv Ba- tra. Grad-cam: Visual explanations from deep networks via gradient-based localization. In ICCV, pages 618–626,
-
[48]
Icafusion: Iterative cross-attention guided feature fusion for multispectral object detection
Jifeng Shen, Yifei Chen, Yue Liu, Xin Zuo, Heng Fan, and Wankou Yang. Icafusion: Iterative cross-attention guided feature fusion for multispectral object detection. PR, 2024. 2, 5, 7, 3
2024
-
[49]
Mrd-yolo: A multispectral object de- tection algorithm for complex road scenes
Chaoyue Sun, Yajun Chen, Xiaoyang Qiu, Rongzhen Li, and Longxiang You. Mrd-yolo: A multispectral object de- tection algorithm for complex road scenes. Sensors, 2024. 6
2024
-
[50]
Low-rank multimodal remote
Xu Sun, Yinhui Yu, and Qing Cheng. Low-rank multimodal remote. sens. object detection with frequency filtering ex- perts. IEEE Trans. Geosci. Remote Sens., 2024. 6
2024
-
[51]
Adaptive multimodal feature fusion with frequency domain gate for remote
Xu Sun, Yinhui Yu, and Qing Cheng. Adaptive multimodal feature fusion with frequency domain gate for remote. sens. object detection. Remote Sens. Lett., 2024. 6
2024
-
[52]
Det- fusion: A detection-driven infrared and visible image fu- sion network
Yiming Sun, Bing Cao, Pengfei Zhu, and Qinghua Hu. Det- fusion: A detection-driven infrared and visible image fu- sion network. In ACMMM, page 4003–4011, 2022. 6
2022
-
[53]
Drone-based rgb-infrared cross-modality vehicle detection via uncertainty-aware learning
Yiming Sun, Bing Cao, Pengfei Zhu, and Qinghua Hu. Drone-based rgb-infrared cross-modality vehicle detection via uncertainty-aware learning. TCSVT, 2022. 5, 2, 3
2022
-
[54]
Superfusion: A versatile image registration and fusion network with semantic awareness
Linfeng Tang, Yuxin Deng, Yong Ma, Jun Huang, and Ji- ayi Ma. Superfusion: A versatile image registration and fusion network with semantic awareness. IEEE/CAA J. Au- tom. Sin., 2022. 3, 6, 7
2022
-
[55]
Divfusion: Darkness-free infrared and visible image fusion
Linfeng Tang, Xinyu Xiang, Hao Zhang, Meiqi Gong, and Jiayi Ma. Divfusion: Darkness-free infrared and visible image fusion. Inf. Fusion, 2023. 7
2023
-
[56]
Multi-stage im- age denoising with the wavelet transform
Chunwei Tian, Menghua Zheng, Wangmeng Zuo, Bob Zhang, Yanning Zhang, and David Zhang. Multi-stage im- age denoising with the wavelet transform. PR, 134:109050,
-
[57]
Cross-modality proposal-guided feature min- ing for unregistered rgb-thermal pedestrian detection.IEEE Trans
Chao Tian, Zikun Zhou, Yuqing Huang, Gaojun Li, and Zhenyu He. Cross-modality proposal-guided feature min- ing for unregistered rgb-thermal pedestrian detection.IEEE Trans. Multimed., 2024. 3
2024
-
[58]
Iv-yolo: A lightweight dual-branch object detection network
Dan Tian, Xin Yan, Dong Zhou, Chen Wang, and Wenshuai Zhang. Iv-yolo: A lightweight dual-branch object detection network. Sensors, 2024. 2, 6, 3
2024
-
[59]
A dynamic cascade cross- modal coassisted network for aav image object detection
Shu Tian, Li Wang, Lin Cao, Lihong Kang, Xian Sun, Jing Tian, Xiangwei Xing, Bo Shen, Chunzhuo Fan, Kangning Du, Chong Fu, and Ye Zhang. A dynamic cascade cross- modal coassisted network for aav image object detection. J-STARS, 18:2749–2765, 2025. 3
2025
-
[60]
Yolov8: A novel object detection algorithm with enhanced performance and robust- ness
Rejin Varghese and Sambath M. Yolov8: A novel object detection algorithm with enhanced performance and robust- ness. In ADICS, 2024. 5, 6, 7, 8, 2, 3
2024
-
[61]
Kcdnet: Multimodal object detection in modal in- formation imbalance scenes
Haoyu Wang, Shiyuan Qu, Zhenzhuang Qiao, and Xiaomin Liu. Kcdnet: Multimodal object detection in modal in- formation imbalance scenes. IEEE Trans. Instrum. Meas.,
-
[62]
Yolofiv: Object detection algorithm for around-the- clock aerial remote
Huiying Wang, Chunping Wang, Qiang Fu, Binqiang Si, Dongdong Zhang, Renke Kou, Ying Yu, and Changfeng Feng. Yolofiv: Object detection algorithm for around-the- clock aerial remote. sens. images by fusing infrared and vis- ible features. IEEE J. Sel. Top. Appl. Earth Obs. Remot...
2024
-
[63]
Cross-modal oriented object detection of uav aerial images based on im- age feature
Huiying Wang, Chunping Wang, Qiang Fu, Dongdong Zhang, Renke Kou, Ying Yu, and Jian Song. Cross-modal oriented object detection of uav aerial images based on im- age feature. IEEE Trans. Geosci. Remote Sens., 2024. 6
2024
-
[64]
Multi-modal object detection method based on dual-branch asymmetric attention backbone and feature fu- sion pyramid network
Jinpeng Wang, Nan Su, Chunhui Zhao, Yiming Yan, and Shou Feng. Multi-modal object detection method based on dual-branch asymmetric attention backbone and feature fu- sion pyramid network. Remote. Sens., 2024. 6
2024
-
[65]
Multimodal object detection of uav remote sensing based on joint rep- resentation optimization and specific information enhance- ment
Jinpeng Wang, Congan Xu, Chunhui Zhao, Long Gao, Jun- feng Wu, Yiming Yan, Shou Feng, and Nan Su. Multimodal object detection of uav remote sensing based on joint rep- resentation optimization and specific information enhance- ment. J-STARS, 17:12364–12373, 2024. 6
2024
-
[66]
Learning adaptive fusion bank for multi-modal salient object detection
Kunpeng Wang, Zhengzheng Tu, Chenglong Li, Cheng Zhang, and Bin Luo. Learning adaptive fusion bank for multi-modal salient object detection. TCSVT, 2024. 1
2024
-
[67]
Improving rgb-infrared object detec- tion by reducing cross-modality redundancy.Remote
Qingwang Wang, Yongke Chi, Tao Shen, Jian Song, Zifeng Zhang, and Yan Zhu. Improving rgb-infrared object detec- tion by reducing cross-modality redundancy.Remote. Sens., 14, 2022. 2, 3
2022
-
[68]
Improving rgb-infrared object detec- tion by reducing cross-modality redundancy.Remote
Qingwang Wang, Yongke Chi, Tao Shen, Jian Song, Zifeng Zhang, and Yan Zhu. Improving rgb-infrared object detec- tion by reducing cross-modality redundancy.Remote. Sens., 14(9):2020, 2022. 3
2020
-
[69]
Image restoration qual- ity assessment based on regional differential information entropy
Zhiyu Wang, Jiayan Zhuang, Ningyuan Xu, Sichao Ye, Jiangjian Xiao, and Chengbin Peng. Image restoration qual- ity assessment based on regional differential information entropy. arxiv2107.03642, 2022. 2
2022 arXiv
-
[70]
Dc- fusion: A dual-frequency cross-enhanced fusion network for infrared and visible image fusion
Dan Wu, Mina Han, Yang Yang, Shan Zhao, Yujing Rao, Hao Li, Lin Xing, Chengjiang Zhou, and Haicheng Bai. Dc- fusion: A dual-frequency cross-enhanced fusion network for infrared and visible image fusion. IEEE Trans. Instrum. Meas., 2023. 2
2023
-
[71]
Dcfnet: Infrared and visible image fusion network based on discrete wavelet transform and convolu- tional neural network
Dan Wu, Yanzhi Wang, Haoran Wang, Fei Wang, and Guowang Gao. Dcfnet: Infrared and visible image fusion network based on discrete wavelet transform and convolu- tional neural network. Sensors, 2024. 3
2024
-
[72]
Wavelet transformation of functional data for hyperspectral image classification
Guangrun Xiao, Xiaobo Wang, and Dezheng Liu. Wavelet transformation of functional data for hyperspectral image classification. In 2019 International Conference on Inter- net of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and...
2019
-
[73]
YOLO-MS: multispectral object detection via feature inter- action and self-attention guided fusion
Yumin Xie, Langwen Zhang, Xiaoyuan Yu, and Wei Xie. YOLO-MS: multispectral object detection via feature inter- action and self-attention guided fusion. IEEE Trans. Cogn. Dev. Syst., 2023. 2
2023
-
[74]
Cross- modality double bidirectional interaction and fusion net- work for RGB-T salient object detection
Zhengxuan Xie, Feng Shao, Gang Chen, Hangwei Chen, Qiuping Jiang, Xiangchao Meng, and Yo-Sung Ho. Cross- modality double bidirectional interaction and fusion net- work for RGB-T salient object detection. TCSVT, 2023. 1
2023
-
[75]
Enhanced spectral–spatial fusion net- work for multispectral object detection in ground-aerial im- ages
Fengxiang Xu, Tingfa Xu, Lang Hong, Peiran Peng, Jiaxin Guo, and Jianan Li. Enhanced spectral–spatial fusion net- work for multispectral object detection in ground-aerial im- ages. IEEE Geoscience and Remote. Sens. Letters, 2024. 8, 5
2024
-
[76]
Enhanced spectral-spatial fusion net- work for multispectral object detection in ground-aerial im- ages
Fengxiang Xu, Tingfa Xu, Lang Hong, Peiran Peng, Jiaxin Guo, and Jianan Li. Enhanced spectral-spatial fusion net- work for multispectral object detection in ground-aerial im- ages. IEEE Geoscience and Remote. Sens. Letters, 2024. 3
2024
-
[77]
Rfnet: Unsupervised network for mutually reinforc- ing multi-modal image registration and fusion
Han Xu, Jiayi Ma, Jiteng Yuan, Zhuliang Le, and Wei Liu. Rfnet: Unsupervised network for mutually reinforc- ing multi-modal image registration and fusion. In CVPR,
-
[78]
Cross-modal adaptive fusion object detec- tion based on illumination-awareness
Junwei Xu, Bo Mo, Jie Zhao, Chunbo Zhao, Yimeng Tao, and Shuo Han. Cross-modal adaptive fusion object detec- tion based on illumination-awareness. In YAC, 2024. 6
2024
-
[79]
Multi- dimensional fusion network for multispectral object detec- tion
Fan Yang, Binbin Liang, Wei Li, and Jianwei Zhang. Multi- dimensional fusion network for multispectral object detec- tion. TCSVT, 2024. 6
2024
-
[80]
A dual-modality pedestrian detection method based on multi-scale feature fusion
Huanyu Yang, Weiwei Bian, Jun Wang, Yuming Bo, and Ying Mi. A dual-modality pedestrian detection method based on multi-scale feature fusion. In ICHMS, 2024. 7
2024
-
[81]
Mul- tispectral sample augmentation and illumination guidance for RGB-T object detection by mm detection framework
Jinqi Yang, Xin Yang, Yizhao Liao, Jinxiang Huang, Hongyu He, Erfan Zhang, Ya Zhou, and Yong Song. Mul- tispectral sample augmentation and illumination guidance for RGB-T object detection by mm detection framework. In LOPET, 2024. 6
2024
-
[82]
Wave-vit: Unifying wavelet and transformers for visual representation learning
Ting Yao, Yingwei Pan, Yehao Li, Chong-Wah Ngo, and Tao Mei. Wave-vit: Unifying wavelet and transformers for visual representation learning. In ECCV, 2022. 3, 7
2022
-
[83]
Text-if: Leveraging semantic text guidance for degradation-aware and interactive image fusion
Xunpeng Yi, Han Xu, Hao Zhang, Linfeng Tang, and Ji- ayi Ma. Text-if: Leveraging semantic text guidance for degradation-aware and interactive image fusion. In CVPR,
-
[84]
C²former: Calibrated and complementary transformer for rgb-infrared object de- tection
Maoxun Yuan and Xingxing Wei. C²former: Calibrated and complementary transformer for rgb-infrared object de- tection. IEEE Trans. Geosci. Remote Sens., 2024. 2, 6, 7
2024
-
[85]
Transla- tion, scale and rotation: Cross-modal alignment meets rgb- infrared vehicle detection
Maoxun Yuan, Yinyan Wang, and Xingxing Wei. Transla- tion, scale and rotation: Cross-modal alignment meets rgb- infrared vehicle detection. In ECCV, 2022. 6
2022
-
[86]
Sdnet: A versatile squeeze-and- decomposition network for real-time image fusion
Hao Zhang and Jiayi Ma. Sdnet: A versatile squeeze-and- decomposition network for real-time image fusion. IJCV,
-
[87]
Multispectral fusion for object detection with cyclic fuse-and-refine blocks
Heng Zhang, ´Elisa Fromont, S´ebastien Lef`evre, and Bruno Avignon. Multispectral fusion for object detection with cyclic fuse-and-refine blocks. In ICIP, 2020. 5, 2
2020
-
[88]
Guided attentive feature fusion for multispectral pedestrian detection
Heng Zhang, Elisa Fromont, Sebastien Lefevre, and Bruno Avignon. Guided attentive feature fusion for multispectral pedestrian detection. In WACV, pages 72–80, 2021. 3
2021
-
[89]
Efficient cross-modality feature inter- action for multispectral armored vehicle detection
Jie Zhang, Tian qing Chang, Li yang Zhao, Jin dun Ma, Bin Han, and Lei Zhang. Efficient cross-modality feature inter- action for multispectral armored vehicle detection. Appl. Soft Comput, 163:111971, 2024. 3
2024
-
[90]
Cross-modality interactive attention network for multispectral pedestrian detection
Lu Zhang, Zhiyong Liu, Shifeng Zhang, Xu Yang, Hong Qiao, Kaizhu Huang, and Amir Hussain. Cross-modality interactive attention network for multispectral pedestrian detection. Inf. Fusion, 2019. 2
2019
-
[91]
Weakly aligned cross-modal learn- ing for multispectral pedestrian detection
Lu Zhang, Xiangyu Zhu, Xiangyu Chen, Xu Yang, Zhen Lei, and Zhiyong Liu. Weakly aligned cross-modal learn- ing for multispectral pedestrian detection. In ICCV, pages 5127–5137, 2019. 2
2019
-
[92]
Esm-yolo: Enhanced small target detection based on visi- ble and infrared multi-modal fusion
Qianqian Zhang, Linwei Qiu, Li Zhou, and Junshe An. Esm-yolo: Enhanced small target detection based on visi- ble and infrared multi-modal fusion. InACCV, pages 1454– 1469, 2024. 3
2024
-
[93]
Wavelet-based fourier information interaction with fre- quency diffusion adjustment for underwater image restora- tion
Chen Zhao, Weiling Cai, Chenyu Dong, and Chengwei Hu. Wavelet-based fourier information interaction with fre- quency diffusion adjustment for underwater image restora- tion. In CVPR, 2024. 3
2024
-
[94]
Object detection in mul- tispectral remote
Pujie Zhao, Xia Ye, and Ziang Du. Object detection in mul- tispectral remote. sens. images based on cross-modal cross- attention. Sensors, 2024. 7
2024
-
[95]
Removal then selection: A coarse-to- fine fusion perspective for rgb-infrared object detection
Tianyi Zhao, Maoxun Yuan, Feng Jiang, Nan Wang, and Xingxing Wei. Removal then selection: A coarse-to- fine fusion perspective for rgb-infrared object detection. arXiv:2401.10731, 2024. 7, 2
2024
-
[96]
Didfuse: Deep image de- composition for infrared and visible image fusion
Zixiang Zhao, Shuang Xu, Chunxia Zhang, Junmin Liu, Jiangshe Zhang, and Pengfei Li. Didfuse: Deep image de- composition for infrared and visible image fusion. InIJCAI,
-
[97]
Efficient and model-based infrared and visible image fusion via algo- rithm unrolling
Zixiang Zhao, Shuang Xu, Jiangshe Zhang, Chengyang Liang, Chunxia Zhang, and Junmin Liu. Efficient and model-based infrared and visible image fusion via algo- rithm unrolling. TCSVT, 2022. 7
2022
-
[98]
Cddfuse: Correlation-driven dual-branch feature decompo- sition for multi-modality image fusion
Zixiang Zhao, Haowen Bai, Jiangshe Zhang, Yulun Zhang, Shuang Xu, Zudi Lin, Radu Timofte, and Luc Van Gool. Cddfuse: Correlation-driven dual-branch feature decompo- sition for multi-modality image fusion. In CVPR, 2023. 3, 6
2023
-
[99]
Equivariant multi-modality image fu- sion
Zixiang Zhao, Haowen Bai, Jiangshe Zhang, Yulun Zhang, Kai Zhang, Shuang Xu, Dongdong Chen, Radu Timofte, and Luc Van Gool. Equivariant multi-modality image fu- sion. In CVPR, 2024. 6
2024
-
[100]
Dmm: Disparity-guided multispectral mamba for oriented object detection in remote
Minghang Zhou, Tianyu Li, Chaofan Qiao, Dongyu Xie, Guoqing Wang, Ningjuan Ruan, Lin Mei, and Yang Yang. Dmm: Disparity-guided multispectral mamba for oriented object detection in remote. sens. arXiv:2407.08132, 2024. 2, 3, 6
2024 arXiv
-
[101]
Cross teaching-enhanced multispectral re- mote sensing object detection with transformer
Jiahe Zhu, Huan Zhang, Simin Li, Shengjin Wang, and Hongbing Ma. Cross teaching-enhanced multispectral re- mote sensing object detection with transformer. J-STARS, 18:2401–2413, 2025. 3
2025
-
[102]
Multi-modal feature pyramid transformer for rgb-infrared object detection
Yaohui Zhu, Xiaoyu Sun, Miao Wang, and Hua Huang. Multi-modal feature pyramid transformer for rgb-infrared object detection. IEEE Trans. Intell. Transport. Syst. , 24 (9):9984–9995, 2023. 8
2023
-
[103]
{ P1, P2, P3}
Wenbin Zou, Mingchao Jiang, Yunchen Zhang, Liang Chen, Zhiyong Lu, and Yi Wu. Sdwnet: A straight dilated network with wavelet transformation for image deblurring. In ICCVW, 2021. 3 WaveMamba: Wavelet-Driven Mamba Fusion for RGB-Infrared Object Detection Supplementary Material ...
2021
Reviewed August 6, 2026 · model on record in the stance chip above.
Discussion (0). Sign in to comment.