pith. sign in

arxiv: 2406.03459 · v1 · pith:FIUJJU4Dnew · submitted 2024-06-05 · 💻 cs.CV

LW-DETR: A Transformer Replacement to YOLO for Real-Time Detection

Qiang Chen , Xiangbo Su , Xinyu Zhang , Jian Wang , Jiahui Chen , Yunpeng Shen , Chuchu Han , Ziliang Chen
show 7 more authors
Weixiang Xu Fanrong Li Shan Zhang Kun Yao Errui Ding Gang Zhang Jingdong Wang
This is my paper
classification 💻 cs.CV
keywords encoderfeaturedetectionlw-detrmapsreal-timeapproachinterleaved
0
0 comments X
read the original abstract

In this paper, we present a light-weight detection transformer, LW-DETR, which outperforms YOLOs for real-time object detection. The architecture is a simple stack of a ViT encoder, a projector, and a shallow DETR decoder. Our approach leverages recent advanced techniques, such as training-effective techniques, e.g., improved loss and pretraining, and interleaved window and global attentions for reducing the ViT encoder complexity. We improve the ViT encoder by aggregating multi-level feature maps, and the intermediate and final feature maps in the ViT encoder, forming richer feature maps, and introduce window-major feature map organization for improving the efficiency of interleaved attention computation. Experimental results demonstrate that the proposed approach is superior over existing real-time detectors, e.g., YOLO and its variants, on COCO and other benchmark datasets. Code and models are available at (https://github.com/Atten4Vis/LW-DETR).

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 7 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. WUTDet: A 100K-Scale Ship Detection Dataset and Benchmarks with Dense Small Objects

    cs.CV 2026-04 unverdicted novelty 7.0

    WUTDet is a 100K-image ship detection dataset with benchmarks indicating Transformer models outperform CNN and Mamba architectures in accuracy and small-object detection for complex maritime environments.

  2. SAM 3: Segment Anything with Concepts

    cs.CV 2025-11 unverdicted novelty 7.0

    SAM 3 introduces promptable concept segmentation that doubles accuracy of prior systems on images and videos while improving standard SAM segmentation performance.

  3. Real-Time Source-Free Object Detection

    cs.CV 2026-06 unverdicted novelty 6.0

    RT-SFOD adapts dual-head detectors like YOLOv10 for source-free object detection via DHF pseudo-label fusion and MARD loss, delivering 1.4-3.5% mAP gains with 1.3x higher throughput and ~2x fewer parameters than prior...

  4. Hippocampus-DETR: An Explicit Memory Object Detection Framework Based on Hippocampus Modeling

    cs.CV 2026-06 unverdicted novelty 5.0

    Hippocampus-DETR integrates a hippocampal memory network (HipNet) into DETR to simulate brain subregions for pattern separation, completion, and improved detection accuracy plus generalization.

  5. Echo-{\alpha}: Large Agentic Multimodal Reasoning Model for Ultrasound Interpretation

    cs.CV 2026-04 unverdicted novelty 5.0

    Echo-α integrates organ-specific detectors with global visual context via an invoke-and-reason agentic loop, trained on a nine-task curriculum plus sequential RL, to achieve superior grounding (56.73%/43.78% F1@0.5) a...

  6. RT-SDGOD: Real-Time Single-Domain Generalized Object Detection

    cs.CV 2026-06 unverdicted novelty 4.0

    RT-SDGDet applies one-to-many supervision, Discriminative Evidence Diversity Learning, and Dual-view Evidence Consistency Learning during training to reduce missed detections in real-time object detectors under unseen...

  7. Ultralytics YOLO26: Unified Real-Time End-to-End Vision Models

    cs.CV 2026-06 unverdicted novelty 4.0

    YOLO26 presents a unified real-time vision model family with dual-head end-to-end design, new training components, and task-specific heads that reports improved mAP-latency tradeoffs on COCO and LVIS benchmarks across...