REVIEW 3 major objections 6 minor 102 references
Not Every Patch is Needed: Towards a More Efficient and Effective Backbone for Video-based Person Re-identification
T0 review · 3 major / 6 minor · reviewed 2026-08-10 · deepseek-v4-flash
Pith's one-line read A video ReID backbone that extracts features only from crucial patches matches ViT accuracy at 26% of the compute.
desk verdict A solid efficiency win for video ReID that likely survives review, but the GOP-after-sampling cost/alignment story is the load-bearing detail that has to be resolved before the FLOP claims can be trusted. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The machinery is the Group of Pictures (GOP), the compressed-video structure that pairs one fully encoded I-frame with later P-frames stored as motion vectors plus residual maps. It carries both halves of the method: the residual maps supply the novelty signal that drives patch selection, and the motion vectors plus residuals let the transformer warp the I-frame's features into pseudo features for skipped patches, generating global context without processing those patches. Around this core, the dynamic routing gate trades cheap global warping against expensive patch-wise warping by estimating the accumulated warping error, and the noise-conditioned gate plus the saturating-sigmoid selection make the whole pipeline end-to-end trainable.
What would settle it
Take the trained model and randomly shuffle the motion vectors and residual maps before patch selection and pseudo-context warping, leaving all other weights and inputs unchanged; if MARS mAP stays near the reported 86.1, the GOP alignment is not carrying the result, whereas a large drop would confirm that the claimed efficiency depends on correct compression-side correspondences.
Extended reading notes
Core claim
The central discovery is that the redundancy in ReID videos is exploitable at the patch level, not just the frame level. Treating the first frame of a Group of Pictures as the anchor, the method scores every patch in later P-frames by three cues: novelty (the residual map from video compression), semantics (a shallow 3D-CNN feature enhanced by the spectral-decomposition eigenvector that highlights the target person), and progressiveness (residual against patches already selected in earlier frames). Only patches with positive scores enter the transformer, and the selection is made differentiable through a hard gate built from a saturating sigmoid. In the patch-sparse transformer, the skipped patches are not ignored: their features are synthesized by warping the I-frame features along GOP motion vectors, refined by cross-attention to the I-frame, and summarized into a pseudo global context token; a dynamic routing gate chooses between cheap global-level warping and expensive patch-wise warping based on an estimated error, so sparse input retains global information at low cost. With this design the paper reports ViT-comparable accuracy at roughly a quarter of ViT-B's compute and better accuracy than ResNet50 at lower compute, consistently across four ReID models and four benchmarks.
Load-bearing premise
The whole pipeline depends on the motion vectors and residual maps that describe how each later frame relates to the first frame staying accurate for the particular eight-frame clip sampled and fed to the network; if those pointers are wrong, both the chosen patches and the warped pseudo context are built on incorrect matches.
Editorial extensions
If this is right
- Replacing ResNet50 with this backbone in MGH, SINet, GRL, or STMN improves mAP and rank-1 on MARS, LS-VID, iLiDS-VID, and PRID-2011 while using roughly 28% less backbone compute.
- Against ViT-B, the 12-layer variant stays within about 0.6 mAP (e.g., 86.1 vs 86.7 on MARS) while dropping GMACs from 88.9 to 23.5.
- The selection mechanism beats existing token-pruning transformers (DynamicViT, EViT, SPViT, dTPS, MViT, DiffRate) at both lower cost and higher accuracy on MARS and LS-VID.
- The single hyperparameter s in the dynamic routing gate adjusts the accuracy/compute tradeoff at inference time without retraining, spanning 19.5 to 27.1 GMACs with mAP from 84.2 to 86.3 on MARS.
- Because all temporal correspondences come from the GOP in the compressed video stream, the method needs no optical-flow computation, recurrent networks, or extra sensors, making it practical for camera-server pipelines where compression already happens.
Reading between the lines
- A broader principle suggested, but not argued, by the paper is that any video task with a static camera and stable subject can treat temporal redundancy as a property of the compressed stream rather than as a cost to be solved by optical flow; person detection and tracking with the same cropped-subject prior are natural next targets.
- The error-conditioned routing gate is a general template for sparse transformers: run the cheap approximation, estimate its own error from a reverse warp, and invoke the expensive refinement only when the estimate crosses a threshold; this could be tested in masked image modeling or efficient video classification.
- A direct extension is to test the method on uncompressed video by synthesizing GOPs with block-matching motion estimation; if performance holds, the approach no longer depends on the video being encoded with a specific codec and can be applied to arbitrary camera feeds.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes a plug-and-play efficient backbone for video-based person re-identification. The method uses GOP motion vectors and residual maps to select novel and semantically important patches from P-frames, retains the full I-frame, and feeds only the selected patches into a patch-sparse transformer (PSFormer). To compensate for sparse inputs, PSFormer generates pseudo global context for each P-frame via two warping strategies—global-level warping and patch-wise warping—selected per layer by a dynamic routing gate that estimates accumulated error. Extensive experiments on MARS, LS-VID, iLiDS-VID, and PRID-2011, including plug-in tests with MGH, SINet, GRL, and STMN, report that Ours-B reduces computational cost by 74% versus ViT-B and 28% versus ResNet50 while achieving accuracy comparable to ViT-B and outperforming ResNet50 significantly.
Significance. If the efficiency and accuracy claims hold, this is a valuable contribution: it addresses the practical cost of transformer backbones for video ReID, makes novel use of compressed-video GOP data for token selection and feature warping, and demonstrates plug-and-play generality across several existing methods. The experimental suite is extensive, with ablations for each component (Tables V–IX), comparisons to other token-pruning methods (Tables II–III), and state-of-the-art comparison (Table IV). The central risk is the underexplained pipeline from an arbitrary random frame sample to valid GOP correspondences; this must be resolved before the reported MACs can be taken at face value.
major comments (3)
- [Section VI-A, Section IV-C2] The paper states in Section VI-A that 'the GOP that helps to perform the patch selection and patch-wise warping are obtained from this generated video clip after sampling,' but it never specifies how a GOP is constructed for an arbitrary 8-frame clip sampled with the restricted random sampling strategy. In the compressed-video GOP structure, P-frame motion vectors reference the immediately preceding reference frame (or the I-frame) in the original stream, not necessarily the first frame of the sampled clip; after random sampling, these vectors can point outside the sampled subsequence or reference frames that are not present in the clip. If the authors re-encode the sampled frames to obtain valid motion vectors and residuals, the encoding computation is not accounted for in the reported 23.5 GMACs or 78 ms/video, contradicting the Introduction's claim that GOP carries 'no additional computational costs.' If original GOPs are used, the displacement assumption in Section IV-C2 ('the motion vector M represents the pairwise alignment between each patch of a P-frame and its displacement patch in the I-frame') is invalid. Either way, the claimed efficiency/accuracy trade-off is not established as presented.
- [Table I and Section VI-B1] The claim that accuracy is 'on par with ViT-B' rests on small gaps (e.g., Ours-B is within 0.6 mAP of ViT-B on MARS and within 0.7 on LS-VID across the four plug-in baselines), but all numbers are single-run point estimates. Without multiple seeds or confidence intervals, it is impossible to tell whether these gaps are within run-to-run noise or represent a genuine degradation. At minimum, the main comparison in Table I should report the mean and standard deviation over at least three runs for the Ours-B and ViT-B backbones.
- [Section IV-C2] The dynamic routing gate estimates accumulated error by computing a cosine distance between the warped I-frame context and the actual I-frame context, and L_error is trained using synthetic Gaussian noise added to the I-frame context. The paper does not show that this synthetic noise distribution matches the actual distribution of errors encountered during inference, where the pseudo-context is warped from previous P-frame contexts; the threshold s=0.5 is fixed on MARS and its transfer to other datasets is not analyzed. Including a per-layer analysis of gate activation across datasets would strengthen the claim that the routing is self-adaptive rather than tuned to one dataset.
minor comments (6)
- [Table I] In the STMN block, ViT-S's GMACs is listed as 92.6, identical to ViT-B's 92.6; this is likely a typo (cf. 51.1–56.1 in other blocks) and should be corrected.
- [Section VI-A] The implementation details do not specify the video codec (e.g., H.264 vs. HEVC), the GOP length, or the encoder configuration used to obtain the GOP; these details are needed for reproducibility.
- [Algorithm 2] The condition on line 10 is 'if cl,t < s then' and the text in Section IV-C2 says the gate opens when cl,t > s; while the two are consistent (line 11 uses the cheap global-level path), the naming of the branches could be clarified to avoid confusion about which branch is the 'gate open' case.
- [Eq. (1)] The saturating gate constants 1.2 and 0.1 in the differentiable selection formula are introduced without motivation or sensitivity analysis; a sentence on how these values were chosen would improve the presentation.
- [References] The paper cites [60] as 'Segment Anything Model' but the reference list entry is for SAM 2 (Ravi et al., 2024); please reconcile the citation with the actual model used.
- [Section VI-D2] The quantitative validation of spectral decomposition reports an mIoU of 74.1% on the MARS validation set, but does not describe the number of frames evaluated, the binarization threshold selection, or the prompt used with SAM to generate ground-truth masks.
Circularity Check
No circularity: the efficiency and accuracy claims rest on external benchmark comparisons, not on definitions or fitted parameters that presuppose the results.
full rationale
The paper's central claims—74% and 28% computational reductions with ViT-parity accuracy—are established empirically through reported GMACs, ms/video, mAP, and rank-1 numbers compared against ViT-B, ResNet50, and prior methods on MARS, LS-VID, iLiDS-VID, and PRID-2011. The patch selection mechanism uses GOP residual maps, 3D-CNN semantic features, spectral decomposition, and progressive residual features; the PSFormer pseudo-context is generated from I-frame features, GOP motion vectors, residual maps, and learned warping MLPs. None of these components is defined in terms of the reported mAP/rank-1 or FLOP reductions, and the selection threshold s and Lerror weight are hyperparameters tuned on validation data, which is standard practice rather than a fitted input renamed as a prediction. The most notable weakness is an unverified engineering assumption, not circularity: Section VI-A states that "the GOP that helps to perform the patch selection and patch-wise warping are obtained from this generated video clip after sampling," without specifying whether the GOP is re-encoded after restricted random sampling or taken from the original compressed stream; if the original GOP's P-frame motion vectors reference original reference frames, they may not align with arbitrary 8-frame samples, threatening the validity of selection and warping. This is a missing-support or correctness concern, not a logical reduction of the derivation to its own inputs. The paper's load-bearing citations, such as spectral decomposition [56] and the saturating sigmoid [33], are external prior work, and self-citations in the reference list are not used to justify the central efficiency or accuracy claims. Therefore, no significant circularity is present.
Assumptions & free parameters
free parameters (5)
- Dynamic routing threshold s =
0.5 (default; swept 0.4 to 0.9 in Table VIII)
- Error-constraint loss weight Werror =
Not specified in paper (ablation sweeps 0.5 to 3.0)
- Saturating gate constants (1.2, 0.1) =
1.2 and 0.1 in Eq. (1)
- Noise samples S for Lerror =
4
- Two-stage epoch split =
100 + 100
assumptions (5)
- domain assumption ReID video clips have large cross-frame redundancy and small person motion, so informative content is concentrated in few patches.
- domain assumption GOP motion vectors and residual maps accurately align P-frame patches to I-frame patches after random frame sampling.
- domain assumption The eigenvector y1 of the graph Laplacian with smallest nonzero eigenvalue localizes the target person in ReID frames.
- domain assumption P-frame global context evolves across layers similarly to I-frame global context.
- domain assumption Straight-through estimation with a saturating sigmoid yields useful gradients for discrete patch selection.
invented entities (1)
-
Pseudo frame global context C^P_{l,t}
Cite this review
Pith. "Pith review of Not Every Patch is Needed: Towards a More Efficient and Effective Backbone for Video-based Person Re-identification." pith.science (2026). https://pith.science/paper/IOE4S2N2
@misc{pith2026250116811,
author = {Pith},
title = {Pith review of: Not Every Patch is Needed: Towards a More Efficient and Effective Backbone for Video-based Person Re-identification},
year = {2026},
howpublished = {\url{https://pith.science/paper/IOE4S2N2}},
note = {Machine review of arXiv:2501.16811}
}
read the original abstract
This paper proposes a new effective and efficient plug-and-play backbone for video-based person re-identification (ReID). Conventional video-based ReID methods typically use CNN or transformer backbones to extract deep features for every position in every sampled video frame. Here, we argue that this exhaustive feature extraction could be unnecessary, since we find that different frames in a ReID video often exhibit small differences and contain many similar regions due to the relatively slight movements of human beings. Inspired by this, a more selective, efficient paradigm is explored in this paper. Specifically, we introduce a patch selection mechanism to reduce computational cost by choosing only the crucial and non-repetitive patches for feature extraction. Additionally, we present a novel network structure that generates and utilizes pseudo frame global context to address the issue of incomplete views resulting from sparse inputs. By incorporating these new designs, our backbone can achieve both high performance and low computational cost. Extensive experiments on multiple datasets show that our approach reduces the computational cost by 74\% compared to ViT-B and 28\% compared to ResNet50, while the accuracy is on par with ViT-B and outperforms ResNet50 significantly.
Figures
Reference graph
Works this paper leans on
-
[1]
Spatio-temporal repre- sentation factorization for video-based person re-identification
Abhishek Aich, Meng Zheng, Srikrishna Karanam, Terrence Chen, Amit K Roy-Chowdhury, and Ziyan Wu. Spatio-temporal repre- sentation factorization for video-based person re-identification. In Proceedings of the IEEE/CVF international conference on computer vision, pages 152–162, 2021. JOURNAL OF LATEX CLASS FILES, VOL. 18, NO. 9, SEPTEMBER 2020 14
2021
-
[2]
Salient-to-broad transition for video person re-identification
Shutao Bai, Bingpeng Ma, Hong Chang, Rui Huang, and Xilin Chen. Salient-to-broad transition for video person re-identification. In Pro- ceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 7339–7348, 2022
2022
-
[3]
Event-guided person re- identification via sparse-dense complementary learning
Chengzhi Cao, Xueyang Fu, Hongjian Liu, Yukun Huang, Kunyu Wang, Jiebo Luo, and Zheng-Jun Zha. Event-guided person re- identification via sparse-dense complementary learning. In Proceed- ings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 17990–17999, 2023
2023
-
[4]
End-to-end object detection with transformers
Nicolas Carion, Francisco Massa, Gabriel Synnaeve, Nicolas Usunier, Alexander Kirillov, and Sergey Zagoruyko. End-to-end object detection with transformers. In European conference on computer vision , pages 213–229. Springer, 2020
2020
-
[5]
Video person re-identification with competitive snippet- similarity aggregation and co-attentive snippet embedding
Dapeng Chen, Hongsheng Li, Tong Xiao, Shuai Yi, and Xiaogang Wang. Video person re-identification with competitive snippet- similarity aggregation and co-attentive snippet embedding. In Pro- ceedings of the IEEE conference on computer vision and pattern recognition, pages 1169–1178, 2018
2018
-
[6]
Guangyi Chen, Yongming Rao, Jiwen Lu, and Jie Zhou. Temporal coherence or temporal motion: Which is more critical for video- based person re-identification? In Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part VIII 16, pages 660–676. Springer, 2020
2020
-
[7]
Diffrate: Differentiable compression rate for efficient vision transformers
Mengzhao Chen, Wenqi Shao, Peng Xu, Mingbao Lin, Kaipeng Zhang, Fei Chao, Rongrong Ji, Yu Qiao, and Ping Luo. Diffrate: Differentiable compression rate for efficient vision transformers. In Proceedings of the IEEE/CVF international conference on computer vision , 2023
2023
-
[8]
Reality3dsketch: Rapid 3d modeling of objects from single freehand sketches
Tianrun Chen, Chaotao Ding, Lanyun Zhu, Ying Zang, Yiyi Liao, Zejian Li, and Lingyun Sun. Reality3dsketch: Rapid 3d modeling of objects from single freehand sketches. IEEE Transactions on Multimedia, 2023
2023
Show all 102 references
-
[9]
Abd-net: Attentive but diverse person re-identification
Tianlong Chen, Shaojin Ding, Jingyi Xie, Ye Yuan, Wuyang Chen, Yang Yang, Zhou Ren, and Zhangyang Wang. Abd-net: Attentive but diverse person re-identification. In Proceedings of the IEEE/CVF international conference on computer vision , pages 8351–8361, 2019
2019
-
[10]
Deep3dsketch: 3d modeling from free-hand sketches with view-and structural-aware adversarial training
Tianrun Chen, Chenglong Fu, Lanyun Zhu, Papa Mao, Jia Zhang, Ying Zang, and Lingyun Sun. Deep3dsketch: 3d modeling from free-hand sketches with view-and structural-aware adversarial training. arXiv preprint arXiv:2312.04435, 2023
2023 arXiv
-
[11]
Sam2- adapter: Evaluating & adapting segment anything 2 in downstream tasks: Camouflage, shadow, medical image segmentation, and more
Tianrun Chen, Ankang Lu, Lanyun Zhu, Chaotao Ding, Chunan Yu, Deyi Ji, Zejian Li, Lingyun Sun, Papa Mao, and Ying Zang. Sam2- adapter: Evaluating & adapting segment anything 2 in downstream tasks: Camouflage, shadow, medical image segmentation, and more. arXiv preprint arXiv:2...
2024 arXiv
-
[12]
Reasoning3d– grounding and reasoning in 3d: Fine-grained zero-shot open-vocabulary 3d reasoning part segmentation via large vision-language models
Tianrun Chen, Chunan Yu, Jing Li, Jianqi Zhang, Lanyun Zhu, Deyi Ji, Yong Zhang, Ying Zang, Zejian Li, and Lingyun Sun. Reasoning3d– grounding and reasoning in 3d: Fine-grained zero-shot open-vocabulary 3d reasoning part segmentation via large vision-language models. arXiv pre...
2024 arXiv
-
[13]
Sam-adapter: Adapting segment anything in underperformed scenes
Tianrun Chen, Lanyun Zhu, Chaotao Deng, Runlong Cao, Yan Wang, Shangzhan Zhang, Zejian Li, Lingyun Sun, Ying Zang, and Papa Mao. Sam-adapter: Adapting segment anything in underperformed scenes. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 3...
2023
-
[14]
Masked-attention mask transformer for universal image segmentation
Bowen Cheng, Ishan Misra, Alexander G Schwing, Alexander Kirillov, and Rohit Girdhar. Masked-attention mask transformer for universal image segmentation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 1290–1299, 2022
2022
-
[15]
Towards accurate post-training quantization for vision transformer
Yifu Ding, Haotong Qin, Qinghua Yan, Zhenhua Chai, Junjie Liu, Xiaolin Wei, and Xianglong Liu. Towards accurate post-training quantization for vision transformer. In Proceedings of the 30th ACM International Conference on Multimedia , pages 5380–5388, 2022
2022
-
[16]
An image is worth 16x16 words: Transformers for image recognition at scale
Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weis- senborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, et al. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arX...
2010 arXiv
-
[17]
Eventful transformers: Leveraging temporal redundancy in vision transformers
Matthew Dutson, Yin Li, and Mohit Gupta. Eventful transformers: Leveraging temporal redundancy in vision transformers. InProceedings of the IEEE/CVF international conference on computer vision , 2023
2023
-
[18]
Video- based person re-identification with spatial and temporal memory net- works
Chanho Eom, Geon Lee, Junghyup Lee, and Bumsub Ham. Video- based person re-identification with spatial and temporal memory net- works. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 12036–12045, 2021
2021
-
[19]
Motion adaptive pose estimation from compressed videos
Zhipeng Fan, Jun Liu, and Yao Wang. Motion adaptive pose estimation from compressed videos. In Proceedings of the IEEE/CVF Interna- tional Conference on Computer Vision , pages 11719–11728, 2021
2021
-
[20]
Sta: Spatial-temporal attention for large-scale video-based person re- identification
Yang Fu, Xiaoyang Wang, Yunchao Wei, and Thomas Huang. Sta: Spatial-temporal attention for large-scale video-based person re- identification. In Proceedings of the AAAI conference on artificial intelligence, volume 33, pages 8287–8294, 2019
2019
-
[21]
Sparse- former: Sparse visual recognition via limited latent tokens
Ziteng Gao, Zhan Tong, Limin Wang, and Mike Zheng Shou. Sparse- former: Sparse visual recognition via limited latent tokens. arXiv preprint arXiv:2304.03768, 2023
2023 arXiv
-
[22]
Appearance-preserving 3d convolution for video-based person re-identification
Xinqian Gu, Hong Chang, Bingpeng Ma, Hongkai Zhang, and Xilin Chen. Appearance-preserving 3d convolution for video-based person re-identification. In Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part II 16, pages 228–243. S...
2020
-
[23]
Flatten transformer: Vision transformer using focused linear attention
Dongchen Han, Xuran Pan, Yizeng Han, Shiji Song, and Gao Huang. Flatten transformer: Vision transformer using focused linear attention. In Proceedings of the IEEE/CVF International Conference on Com- puter Vision, pages 5961–5971, 2023
2023
-
[24]
Deep residual learning for image recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 770–778, 2016
2016
-
[25]
Transreid: Transformer-based object re-identification
Shuting He, Hao Luo, Pichao Wang, Fan Wang, Hao Li, and Wei Jiang. Transreid: Transformer-based object re-identification. In Proceedings of the IEEE/CVF international conference on computer vision , pages 15013–15022, 2021
2021
-
[26]
Bicnet-tks: Learning efficient spatial-temporal representation for video person re-identification
Ruibing Hou, Hong Chang, Bingpeng Ma, Rui Huang, and Shiguang Shan. Bicnet-tks: Learning efficient spatial-temporal representation for video person re-identification. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages 2014– 2023, 2021
2014
-
[27]
Temporal complementary learning for video person re-identification
Ruibing Hou, Hong Chang, Bingpeng Ma, Shiguang Shan, and Xilin Chen. Temporal complementary learning for video person re-identification. In Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part XXV 16, pages 388–405. Springer, 2020
2020
-
[28]
Vrstc: Occlusion-free video person re-identification
Ruibing Hou, Bingpeng Ma, Hong Chang, Xinqian Gu, Shiguang Shan, and Xilin Chen. Vrstc: Occlusion-free video person re-identification. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 7183–7192, 2019
2019
-
[29]
Orthogonal transformer: An efficient vision transformer backbone with token orthogonalization
Huaibo Huang, Xiaoqiang Zhou, and Ran He. Orthogonal transformer: An efficient vision transformer backbone with token orthogonalization. Advances in Neural Information Processing Systems, 35:14596–14607, 2022
2022
-
[30]
Reasoning and tuning: Graph attention network for occluded person re- identification
Meiyan Huang, Chunping Hou, Qingyuan Yang, and Zhipeng Wang. Reasoning and tuning: Graph attention network for occluded person re- identification. IEEE Transactions on Image Processing, 32:1568–1582, 2023
2023
-
[31]
En- hancing person re-identification performance through in vivo learning
Yan Huang, Zhang Zhang, Qiang Wu, Yi Zhong, and Liang Wang. En- hancing person re-identification performance through in vivo learning. IEEE Transactions on Image Processing , 2023
2023
-
[32]
Discrete latent perspective learning for segmentation and detection
Deyi Ji, Feng Zhao, Lanyun Zhu, Wenwei Jin, Hongtao Lu, and Jieping Ye. Discrete latent perspective learning for segmentation and detection. arXiv preprint arXiv:2406.10475 , 2024
2024 arXiv
-
[33]
Fast decoding in sequence models using discrete latent variables
Lukasz Kaiser, Samy Bengio, Aurko Roy, Ashish Vaswani, Niki Parmar, Jakob Uszkoreit, and Noam Shazeer. Fast decoding in sequence models using discrete latent variables. In International Conference on Machine Learning, pages 2390–2399. PMLR, 2018
2018
-
[34]
Spvit: Enabling faster vision transformers via latency-aware soft token pruning
Zhenglun Kong, Peiyan Dong, Xiaolong Ma, Xin Meng, Wei Niu, Mengshu Sun, Xuan Shen, Geng Yuan, Bin Ren, Hao Tang, et al. Spvit: Enabling faster vision transformers via latency-aware soft token pruning. In European Conference on Computer Vision, pages 620–640. Springer, 2022
2022
-
[35]
Global-local temporal representations for video person re-identification
Jianing Li, Jingdong Wang, Qi Tian, Wen Gao, and Shiliang Zhang. Global-local temporal representations for video person re-identification. In Proceedings of the IEEE/CVF international conference on computer vision, pages 3958–3967, 2019
2019
-
[36]
Multi-scale 3d convolu- tion network for video based person re-identification
Jianing Li, Shiliang Zhang, and Tiejun Huang. Multi-scale 3d convolu- tion network for video based person re-identification. In Proceedings of the AAAI Conference on Artificial Intelligence , volume 33, pages 8618–8625, 2019
2019
-
[37]
Diverse part discovery: Occluded person re-identification with part-aware transformer
Yulin Li, Jianfeng He, Tianzhu Zhang, Xiang Liu, Yongdong Zhang, and Feng Wu. Diverse part discovery: Occluded person re-identification with part-aware transformer. In Proceedings of the IEEE/CVF Confer- ence on Computer Vision and Pattern Recognition , pages 2898–2907, 2021
2021
-
[38]
Svitt: Tem- poral learning of sparse video-text transformers
Yi Li, Kyle Min, Subarna Tripathi, and Nuno Vasconcelos. Svitt: Tem- poral learning of sparse video-text transformers. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 18919–18929, 2023
2023
-
[39]
Efficientformer: Vision transformers at mobilenet speed
Yanyu Li, Geng Yuan, Yang Wen, Ju Hu, Georgios Evangelidis, Sergey Tulyakov, Yanzhi Wang, and Jian Ren. Efficientformer: Vision transformers at mobilenet speed. Advances in Neural Information JOURNAL OF LATEX CLASS FILES, VOL. 18, NO. 9, SEPTEMBER 2020 15 Processing Systems, 3...
2020
-
[40]
Evit: Expediting vision transformers via token reor- ganizations
Youwei Liang, GE Chongjian, Zhan Tong, Yibing Song, Jue Wang, and Pengtao Xie. Evit: Expediting vision transformers via token reor- ganizations. In International Conference on Learning Representations , 2021
2021
-
[41]
Not all patches are what you need: Expediting vision transformers via token reorganizations
Youwei Liang, Chongjian Ge, Zhan Tong, Yibing Song, Jue Wang, and Pengtao Xie. Not all patches are what you need: Expediting vision transformers via token reorganizations. In International Conference on Learning Representations, 2022
2022
-
[42]
Supervised masked knowledge distillation for few-shot transformers
Han Lin, Guangxing Han, Jiawei Ma, Shiyuan Huang, Xudong Lin, and Shih-Fu Chang. Supervised masked knowledge distillation for few-shot transformers. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 19649–19659, 2023
2023
-
[43]
A versatile model for packet loss visibility and its application to packet prioritization
Ting-Lan Lin, Sandeep Kanumuri, Yuan Zhi, David Poole, Pamela C Cosman, and Amy R Reibman. A versatile model for packet loss visibility and its application to packet prioritization. IEEE Transactions on Image Processing , 19(3):722–735, 2009
2009
-
[44]
Learning modal-invariant and temporal-memory for video-based visible-infrared person re- identification
Xinyu Lin, Jinxing Li, Zeyu Ma, Huafeng Li, Shuang Li, Kaixiong Xu, Guangming Lu, and David Zhang. Learning modal-invariant and temporal-memory for video-based visible-infrared person re- identification. In Proceedings of the IEEE/CVF Conference on Com- puter Vision and Patter...
2022
-
[45]
Video-based person re-identification with accumulative motion context
Hao Liu, Zequn Jie, Karlekar Jayashree, Meibin Qi, Jianguo Jiang, Shuicheng Yan, and Jiashi Feng. Video-based person re-identification with accumulative motion context. IEEE transactions on circuits and systems for video technology , 28(10):2788–2802, 2017
2017
-
[46]
Spatial-temporal correlation and topology learning for person re- identification in videos
Jiawei Liu, Zheng-Jun Zha, Wei Wu, Kecheng Zheng, and Qibin Sun. Spatial-temporal correlation and topology learning for person re- identification in videos. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages 4370–4379, 2021
2021
-
[47]
Fre- quency information disentanglement network for video-based person re-identification
Liangchen Liu, Xi Yang, Nannan Wang, and Xinbo Gao. Fre- quency information disentanglement network for video-based person re-identification. IEEE Transactions on Image Processing , 2023
2023
-
[48]
Deeply coupled convolution–transformer with spatial–temporal complementary learning for video-based person re-identification
Xuehu Liu, Chenyang Yu, Pingping Zhang, and Huchuan Lu. Deeply coupled convolution–transformer with spatial–temporal complementary learning for video-based person re-identification. IEEE Transactions on Neural Networks and Learning Systems , 2023
2023
-
[49]
Watching you: Global-guided reciprocal learning for video-based person re-identification
Xuehu Liu, Pingping Zhang, Chenyang Yu, Huchuan Lu, and Xiaoyun Yang. Watching you: Global-guided reciprocal learning for video-based person re-identification. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 13334–13343, 2021
2021
-
[50]
Noisyquant: Noisy bias-enhanced post-training activation quantization for vision transformers
Yijiang Liu, Huanrui Yang, Zhen Dong, Kurt Keutzer, Li Du, and Shanghang Zhang. Noisyquant: Noisy bias-enhanced post-training activation quantization for vision transformers. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 20321–20330, 2023
2023
-
[51]
Post-training quantization for vision transformer
Zhenhua Liu, Yunhe Wang, Kai Han, Wei Zhang, Siwei Ma, and Wen Gao. Post-training quantization for vision transformer. Advances in Neural Information Processing Systems , 34:28092–28103, 2021
2021
-
[52]
Label-guided attention distillation for lane segmentation
Zhikang Liu and Lanyun Zhu. Label-guided attention distillation for lane segmentation. Neurocomputing, 438:312–322, 2021
2021
-
[53]
Learning based multi-modality image and video compression
Guo Lu, Tianxiong Zhong, Jing Geng, Qiang Hu, and Dong Xu. Learning based multi-modality image and video compression. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 6083–6092, 2022
2022
-
[54]
Ppt: token- pruned pose transformer for monocular and multi-view human pose estimation
Haoyu Ma, Zhe Wang, Yifei Chen, Deying Kong, Liangjian Chen, Xingwei Liu, Xiangyi Yan, Hao Tang, and Xiaohui Xie. Ppt: token- pruned pose transformer for monocular and multi-view human pose estimation. In European Conference on Computer Vision , pages 424–
-
[55]
Re- current convolutional network for video-based person re-identification
Niall McLaughlin, Jesus Martinez Del Rincon, and Paul Miller. Re- current convolutional network for video-based person re-identification. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 1325–1334, 2016
2016
-
[56]
Deep spectral methods: A surprisingly strong baseline for unsupervised semantic segmentation and localization
Luke Melas-Kyriazi, Christian Rupprecht, Iro Laina, and Andrea Vedaldi. Deep spectral methods: A surprisingly strong baseline for unsupervised semantic segmentation and localization. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recog- nition, pages ...
2022
-
[57]
Adavit: Adaptive vision transformers for efficient image recognition
Lingchen Meng, Hengduo Li, Bor-Chun Chen, Shiyi Lan, Zuxuan Wu, Yu-Gang Jiang, and Ser-Nam Lim. Adavit: Adaptive vision transformers for efficient image recognition. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 12309–12318, 2022
2022
-
[58]
Counterfac- tual attention learning for fine-grained visual categorization and re- identification
Yongming Rao, Guangyi Chen, Jiwen Lu, and Jie Zhou. Counterfac- tual attention learning for fine-grained visual categorization and re- identification. In Proceedings of the IEEE/CVF International Confer- ence on Computer Vision , pages 1025–1034, 2021
2021
-
[59]
Dynamicvit: Efficient vision transformers with dynamic token sparsification
Yongming Rao, Wenliang Zhao, Benlin Liu, Jiwen Lu, Jie Zhou, and Cho-Jui Hsieh. Dynamicvit: Efficient vision transformers with dynamic token sparsification. Advances in neural information processing sys- tems, 34:13937–13949, 2021
2021
-
[60]
Sam 2: Segment anything in images and videos
Nikhila Ravi, Valentin Gabeur, Yuan-Ting Hu, Ronghang Hu, Chai- tanya Ryali, Tengyu Ma, Haitham Khedr, Roman R¨adle, Chloe Rolland, Laura Gustafson, et al. Sam 2: Segment anything in images and videos. arXiv preprint arXiv:2408.00714 , 2024
2024 arXiv
-
[61]
Co- segmentation inspired attention networks for video-based person re- identification
Arulkumar Subramaniam, Athira Nambiar, and Anurag Mittal. Co- segmentation inspired attention networks for video-based person re- identification. In Proceedings of the IEEE/CVF international confer- ence on computer vision , pages 562–572, 2019
2019
-
[62]
Patch slimming for efficient vision transformers
Yehui Tang, Kai Han, Yunhe Wang, Chang Xu, Jianyuan Guo, Chao Xu, and Dacheng Tao. Patch slimming for efficient vision transformers. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 12165–12174, 2022
2022
-
[63]
Multi-stage spatio-temporal aggregation transformer for video person re-identification
Ziyi Tang, Ruimao Zhang, Zhanglin Peng, Jinrui Chen, and Liang Lin. Multi-stage spatio-temporal aggregation transformer for video person re-identification. IEEE Transactions on Multimedia , 25:7917–7929, 2022
2022
-
[64]
Training data-efficient image transformers & distillation through attention
Hugo Touvron, Matthieu Cord, Matthijs Douze, Francisco Massa, Alexandre Sablayrolles, and Herv ´e J ´egou. Training data-efficient image transformers & distillation through attention. In International conference on machine learning , pages 10347–10357. PMLR, 2021
2021
-
[65]
Efficient video transformers with spatial-temporal token selection
Junke Wang, Xitong Yang, Hengduo Li, Li Liu, Zuxuan Wu, and Yu- Gang Jiang. Efficient video transformers with spatial-temporal token selection. In European Conference on Computer Vision , pages 69–86. Springer, 2022
2022
-
[66]
Pyramid spatial-temporal aggregation for video-based person re-identification
Yingquan Wang, Pingping Zhang, Shang Gao, Xia Geng, Hu Lu, and Dong Wang. Pyramid spatial-temporal aggregation for video-based person re-identification. In Proceedings of the IEEE/CVF international conference on computer vision , pages 12026–12035, 2021
2021
-
[67]
Joint token pruning and squeezing towards more aggressive compression of vision transformers
Siyuan Wei, Tianzhu Ye, Shen Zhang, Yao Tang, and Jiajun Liang. Joint token pruning and squeezing towards more aggressive compression of vision transformers. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 2092–2101, 2023
2023
-
[68]
Overview of the h
Thomas Wiegand, Gary J Sullivan, Gisle Bjontegaard, and Ajay Luthra. Overview of the h. 264/avc video coding standard. IEEE Transactions on circuits and systems for video technology , 13(7):560–576, 2003
2003
-
[69]
Cavit: Contextual alignment vision transformer for video object re-identification
Jinlin Wu, Lingxiao He, Wu Liu, Yang Yang, Zhen Lei, Tao Mei, and Stan Z Li. Cavit: Contextual alignment vision transformer for video object re-identification. In European Conference on Computer Vision , pages 549–566. Springer, 2022
2022
-
[70]
Tinyvit: Fast pretraining distillation for small vision transformers
Kan Wu, Jinnian Zhang, Houwen Peng, Mengchen Liu, Bin Xiao, Jianlong Fu, and Lu Yuan. Tinyvit: Fast pretraining distillation for small vision transformers. In European Conference on Computer Vision, pages 68–85. Springer, 2022
2022
-
[71]
Learning resolution- adaptive representations for cross-resolution person re-identification
Lin Yuanbo Wu, Lingqiao Liu, Yang Wang, Zheng Zhang, Farid Bous- said, Mohammed Bennamoun, and Xianghua Xie. Learning resolution- adaptive representations for cross-resolution person re-identification. IEEE Transactions on Image Processing , 2023
2023
-
[72]
Temporal complementarity-guided reinforcement learning for image- to-video person re-identification
Wei Wu, Jiawei Liu, Kecheng Zheng, Qibin Sun, and Zheng-Jun Zha. Temporal complementarity-guided reinforcement learning for image- to-video person re-identification. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 7319– 7328, 2022
2022
-
[73]
Adaptive graph representation learning for video person re- identification
Yiming Wu, Omar El Farouk Bourahla, Xi Li, Fei Wu, Qi Tian, and Xue Zhou. Adaptive graph representation learning for video person re- identification. IEEE Transactions on Image Processing, 29:8821–8830, 2020
2020
-
[74]
Segformer: Simple and efficient design for semantic segmentation with transformers
Enze Xie, Wenhai Wang, Zhiding Yu, Anima Anandkumar, Jose M Alvarez, and Ping Luo. Segformer: Simple and efficient design for semantic segmentation with transformers. Advances in Neural Information Processing Systems , 34:12077–12090, 2021
2021
-
[75]
Learning multi-granular hypergraphs for video-based person re- identification
Yichao Yan, Jie Qin, Jiaxin Chen, Li Liu, Fan Zhu, Ying Tai, and Ling Shao. Learning multi-granular hypergraphs for video-based person re- identification. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages 2899–2908, 2020
2020
-
[76]
Spatial-temporal graph convolutional network for video-based person re-identification
Jinrui Yang, Wei-Shi Zheng, Qize Yang, Ying-Cong Chen, and Qi Tian. Spatial-temporal graph convolutional network for video-based person re-identification. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages 3289–3299, 2020
2020
-
[77]
Stfe: A comprehensive video-based person re-identification network based on spatio-temporal feature enhancement
Xi Yang, Xian Wang, Liangchen Liu, Nannan Wang, and Xinbo Gao. Stfe: A comprehensive video-based person re-identification network based on spatio-temporal feature enhancement. IEEE Transactions on Multimedia, 2024
2024
-
[78]
Shiftaddvit: Mixture of multiplication primitives towards efficient vision trans- former
Haoran You, Huihong Shi, Yipin Guo, and Yingyan Lin. Shiftaddvit: Mixture of multiplication primitives towards efficient vision trans- former. Advances in Neural Information Processing Systems, 36, 2024
2024
-
[79]
Haoran You, Yunyang Xiong, Xiaoliang Dai, Bichen Wu, Peizhao JOURNAL OF LATEX CLASS FILES, VOL. 18, NO. 9, SEPTEMBER 2020 16 Zhang, Haoqi Fan, Peter Vajda, and Yingyan Celine Lin. Castling- vit: Compressing self-attention via switching towards linear-angular attention at visio...
2020
-
[80]
Tf-clip: Learning text-free clip for video-based person re-identification
Chenyang Yu, Xuehu Liu, Yingquan Wang, Pingping Zhang, and Huchuan Lu. Tf-clip: Learning text-free clip for video-based person re-identification. Proceedings of the AAAI conference on artificial intelligence, 2024
2024
-
[81]
Metaformer is actually what you need for vision
Weihao Yu, Mi Luo, Pan Zhou, Chenyang Si, Yichen Zhou, Xinchao Wang, Jiashi Feng, and Shuicheng Yan. Metaformer is actually what you need for vision. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages 10819–10829, 2022
2022
-
[82]
Ptq4vit: Post-training quantization for vision transformers with twin uniform quantization
Zhihang Yuan, Chenhao Xue, Yiqi Chen, Qiang Wu, and Guangyu Sun. Ptq4vit: Post-training quantization for vision transformers with twin uniform quantization. In European conference on computer vision, pages 191–207. Springer, 2022
2022
-
[83]
Resmatch: Referring expression segmentation in a semi-supervised manner
Ying Zang, Runlong Cao, Chenglong Fu, Didi Zhu, Min Zhang, Wenjun Hu, Lanyun Zhu, and Tianrun Chen. Resmatch: Referring expression segmentation in a semi-supervised manner. Information Sciences, 694:121709, 2025
2025
-
[84]
Minivit: Compressing vision transformers with weight multiplexing
Jinnian Zhang, Houwen Peng, Kan Wu, Mengchen Liu, Bin Xiao, Jianlong Fu, and Lu Yuan. Minivit: Compressing vision transformers with weight multiplexing. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 12145–12154, 2022
2022
-
[85]
Magic tokens: Select diverse tokens for multi-modal object re-identification
Pingping Zhang, Yuhao Wang, Yang Liu, Zhengzheng Tu, and Huchuan Lu. Magic tokens: Select diverse tokens for multi-modal object re-identification. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 17117–17126, 2024
2024
-
[86]
Learning bidirectional temporal cues for video-based person re-identification
Wei Zhang, Xiaodong Yu, and Xuanyu He. Learning bidirectional temporal cues for video-based person re-identification. IEEE Transac- tions on Circuits and Systems for Video Technology, 28(10):2768–2776, 2017
2017
-
[87]
Multi- granularity reference-aided attentive feature aggregation for video- based person re-identification
Zhizheng Zhang, Cuiling Lan, Wenjun Zeng, and Zhibo Chen. Multi- granularity reference-aided attentive feature aggregation for video- based person re-identification. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages 10407– 10416, 2020
2020
-
[88]
Structure- aware cross-modal transformer for depth completion
Linqing Zhao, Yi Wei, Jiaxin Li, Jie Zhou, and Jiwen Lu. Structure- aware cross-modal transformer for depth completion. IEEE Transac- tions on Image Processing , 2024
2024
-
[89]
Attribute-driven feature disentangling and temporal aggregation for video person re-identification
Yiru Zhao, Xu Shen, Zhongming Jin, Hongtao Lu, and Xian-sheng Hua. Attribute-driven feature disentangling and temporal aggregation for video person re-identification. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages 4913– 4922, 2019
2019
-
[90]
3d human pose estimation with spatial and temporal transformers
Ce Zheng, Sijie Zhu, Matias Mendieta, Taojiannan Yang, Chen Chen, and Zhengming Ding. 3d human pose estimation with spatial and temporal transformers. In Proceedings of the IEEE/CVF international conference on computer vision , pages 11656–11665, 2021
2021
-
[91]
Per- son re-identification: Past, present and future
Liang Zheng, Yi Yang, and Alexander G Hauptmann. Per- son re-identification: Past, present and future. arXiv preprint arXiv:1610.02984, 2016
2016 arXiv
-
[92]
Joint discriminative and generative learning for person re-identification
Zhedong Zheng, Xiaodong Yang, Zhiding Yu, Liang Zheng, Yi Yang, and Jan Kautz. Joint discriminative and generative learning for person re-identification. In proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages 2138–2147, 2019
2019
-
[93]
Omni-scale feature learning for person re-identification
Kaiyang Zhou, Yongxin Yang, Andrea Cavallaro, and Tao Xiang. Omni-scale feature learning for person re-identification. In Proceedings of the IEEE/CVF international conference on computer vision , pages 3702–3712, 2019
2019
-
[94]
See the forest for the trees: Joint spatial and temporal recurrent neural networks for video-based person re-identification
Zhen Zhou, Yan Huang, Wei Wang, Liang Wang, and Tieniu Tan. See the forest for the trees: Joint spatial and temporal recurrent neural networks for video-based person re-identification. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 4747...
2017
-
[95]
Llafs: When large language models meet few-shot segmentation
Lanyun Zhu, Tianrun Chen, Deyi Ji, Jieping Ye, and Jun Liu. Llafs: When large language models meet few-shot segmentation. In Proceed- ings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 3065–3075, 2024
2024
-
[96]
Continual semantic segmentation with automatic memory sample selection
Lanyun Zhu, Tianrun Chen, Jianxiong Yin, Simon See, and Jun Liu. Continual semantic segmentation with automatic memory sample selection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 3082–3092, 2023
2023
-
[97]
Learning gabor texture features for fine-grained recognition
Lanyun Zhu, Tianrun Chen, Jianxiong Yin, Simon See, and Jun Liu. Learning gabor texture features for fine-grained recognition. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 1621–1631, 2023
2023
-
[98]
Addressing background context bias in few-shot segmentation through iterative modulation
Lanyun Zhu, Tianrun Chen, Jianxiong Yin, Simon See, and Jun Liu. Addressing background context bias in few-shot segmentation through iterative modulation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 3370–3379, 2024
2024
-
[99]
Ibd: Alleviating hallucinations in large vision-language models via image-biased decoding
Lanyun Zhu, Deyi Ji, Tianrun Chen, Peng Xu, Jieping Ye, and Jun Liu. Ibd: Alleviating hallucinations in large vision-language models via image-biased decoding. arXiv preprint arXiv:2402.18476 , 2024
2024 arXiv
-
[100]
Learning statistical texture for semantic segmentation
Lanyun Zhu, Deyi Ji, Shiping Zhu, Weihao Gan, Wei Wu, and Junjie Yan. Learning statistical texture for semantic segmentation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 12537–12546, 2021
2021
-
[101]
High-definition video com- pression system based on perception guidance of salient information of a convolutional neural network and hevc compression domain
Shiping Zhu, Chang Liu, and Ziyao Xu. High-definition video com- pression system based on perception guidance of salient information of a convolutional neural network and hevc compression domain. IEEE Transactions on Circuits and Systems for Video Technology , 30(7):1946–1959, 2019
1946
-
[102]
Deformable detr: Deformable transformers for end-to-end object detection
Xizhou Zhu, Weijie Su, Lewei Lu, Bin Li, Xiaogang Wang, and Jifeng Dai. Deformable detr: Deformable transformers for end-to-end object detection. arXiv preprint arXiv:2010.04159 , 2020
2010 arXiv
Reviewed August 10, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.