Pith. sign in

REVIEW 18 cited by

End-to-End Object Detection with Transformers

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2005.12872 v3 pith:MU3HKHFY submitted 2020-05-26 cs.CV

Nicolas Carion , Francisco Massa , Gabriel Synnaeve , Nicolas Usunier , Alexander Kirillov , Sergey Zagoruyko This is my paper
classification cs.CV
keywords detectiondetrobjectglobalmanypredictionstransformeraccuracy
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

We present a new method that views object detection as a direct set prediction problem. Our approach streamlines the detection pipeline, effectively removing the need for many hand-designed components like a non-maximum suppression procedure or anchor generation that explicitly encode our prior knowledge about the task. The main ingredients of the new framework, called DEtection TRansformer or DETR, are a set-based global loss that forces unique predictions via bipartite matching, and a transformer encoder-decoder architecture. Given a fixed small set of learned object queries, DETR reasons about the relations of the objects and the global image context to directly output the final set of predictions in parallel. The new model is conceptually simple and does not require a specialized library, unlike many other modern detectors. DETR demonstrates accuracy and run-time performance on par with the well-established and highly-optimized Faster RCNN baseline on the challenging COCO object detection dataset. Moreover, DETR can be easily generalized to produce panoptic segmentation in a unified manner. We show that it significantly outperforms competitive baselines. Training code and pretrained models are available at https://github.com/facebookresearch/detr.

Discussion (0). Sign in to comment.

Forward citations

Cited by 18 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Specialization of softmax attention heads: insights from the high-dimensional single-location model

    cs.LG 2026-03 conditional novelty 7.0 of 10

    In a high-dimensional toy task, multi-head softmax attention first aligns all heads with the mean signal, then sequentially specializes to latent directions; the paper introduces Bayes-softmax, which attains the Bayes...

  2. FUSEP: A Multi-Center Benchmark for Diverse Tasks in Early Pregnancy Fetal Ultrasound Screening

    cs.CV 2026-08 conditional novelty 6.0 of 10

    FUSEP is a new multi-center public benchmark with 4,017 early-pregnancy ultrasound images, 45,820 box annotations of 14 structures, and detection baselines across four learning paradigms.

  3. Kepler-Encoder-v0.1: Towards a Multimodal Embedding Model for Robots

    cs.RO 2026-07 conditional novelty 6.0 of 10

    A self-supervised multimodal encoder trained with vision, proprioception, and force yields a vision-only latent that recovers end-effector state and force above vision baselines on RH20T, with modest absolute force accuracy.

  4. Where Will They Go? Modelling Multimodal Pedestrian Manoeuvres from Ego-centric Videos

    cs.CV 2026-06 unverdicted novelty 6.0 of 10

    MMPM uses PIM for gaze/head/hand interactions and MTP (CVAE with query decoder) to model separate crossing/non-crossing trajectory distributions, outperforming baselines on PIE and JAAD with a new validation protocol.

  5. PokeNet: Learning Kinematic Models of Articulated Objects from Human Observations

    cs.RO 2026-02 conditional novelty 6.0 of 10

    PokeNet estimates joint types, axes, ranges, and operation order of articulated objects directly from a single-view point cloud video of a human demonstration.

  6. Benchmarking Table Extraction from Heterogeneous Scientific PDF Documents

    cs.DB 2025-11 conditional novelty 6.0 of 10

    A new benchmark with two new datasets and end-to-end metrics shows that table extraction from PDFs is still unreliable across heterogeneous layouts.

  7. TransForSeg: A Multitask Stereo ViT for Joint Stereo Segmentation and 3D Force Estimation in Catheterization

    cs.CV 2025-09 conditional novelty 6.0 of 10

    A shared-weight stereo ViT with cross-attention fusion segments the catheter in two views and regresses 3D tip forces, claiming state-of-the-art results on synthetic X-ray datasets.

  8. Transformer-Based Neural Network for Transient Detection without Image Subtraction

    cs.CV 2025-08 conditional novelty 6.0 of 10

    A distance-weighted transformer classifier using search plus template images reaches 97.4% accuracy on DES real/bogus data, matching difference-image methods and making image subtraction optional.

  9. Screen2AX: Vision-Based Approach for Automatic macOS Accessibility Generation

    cs.LG 2025-07 conditional novelty 6.0 of 10

    Screen2AX generates hierarchical macOS accessibility metadata from a screenshot and reports improved GPT-4 UI task success compared with native accessibility and OmniParser V2.

  10. Hierarchical Neural Collapse Detection Transformer for Class Incremental Object Detection

    cs.CV 2025-06 conditional novelty 6.0 of 10

    Hier-DETR reports state-of-the-art incremental detection accuracy, 48.4 AP on COCO 70+10 and 45.46 AP on MTSD 150+71, using a frozen hierarchical tree of general orthogonal frame prototypes with a proxy-based guiding loss.

  11. Small-Pollinator Detection in Cluttered Field Video

    cs.CV 2026-07 conditional novelty 5.0 of 10

    RF-DETR Large at 1344-pixel input beat all tested YOLO, ensemble, slicing, and temporal post-processing systems on the BuzzSpot hidden test, reaching 0.405 mAP50:95.

  12. Signal from Space: Detecting Schools and Towers to Bridge the Digital Divide

    cs.CV 2026-07 conditional novelty 5.0 of 10

    Transfer-learned YOLO detectors find schools and towers in Lesotho satellite imagery; CPP line-of-sight within 1 km triages schools as high-potential or hard-to-connect.

  13. Contrasting Cognitive Styles in Vision-Language Models: Holistic Attention in Japanese Versus Analytical Focus in English

    cs.CL 2025-07 reject novelty 5.0 of 10

    Japanese-prompted vision-language models produce more background-first captions than English-prompted ones, but the effect is confounded by the evaluator and by language grammar.

  14. CALM: Contextual Analog Logic with Multimodality

    cs.AI 2025-06 conditional novelty 5.0 of 10

    CALM couples neural perception with a fuzzy-logic-style reasoning engine to place objects into scenes, reporting 92.2% accuracy on a fill-in-the-blank task.

  15. SynSur: An end-to-end generative pipeline for synthetic industrial surface defect generation and detection

    cs.CV 2026-04 unverdicted novelty 4.0 of 10

    A generative pipeline creates realistic synthetic pitting defects and other surface flaws that, when added to real training data, yield modest gains in industrial defect detectors without replacing the need for authen...

  16. Tracking Moose using Aerial Object Detection

    cs.CV 2025-07 conditional novelty 4.0 of 10

    Across 36 model/threshold/overlap configurations, all three detectors reached at least 93% mAP@IoU=0.5, and the lightweight YOLOv11n matched the heavier models.

  17. Improve Underwater Object Detection through YOLOv12 Architecture and Physics-informed Augmentation

    cs.CV 2025-06 conditional novelty 4.0 of 10

    Applying YOLOv12 with physics-flavored augmentations yields high reported mAP on four underwater detection benchmarks, but the claims are weakened by missing code, variance, and inconsistent speed numbers.

  18. SHeRL-FL: When Representation Learning Meets Split Learning in Hierarchical Federated Learning

    cs.LG 2025-08 unverdicted novelty 2.0 of 10

    The submitted body is an unrelated survey, not the SHeRL-FL method claimed in the metadata.

Pith tools