REVIEW 3 major objections 7 minor 18 references
RiO-DETR: DETR for Real-time Oriented Object Detection
T0 review · 3 major / 7 minor · reviewed 2026-08-02 · deepseek-v4-flash
Pith's one-line read RiO-DETR claims the first end-to-end transformer that detects rotated objects in real time, matching CNN latency while exceeding its accuracy.
desk verdict A capable real-time oriented DETR, but the speed-accuracy headline rests on a community YOLO baseline and unmatched latency protocols. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing mechanism is the π-periodic quotient structure of oriented boxes, respected at every stage: positional queries encode only center and size, leaving angle to content (Geometry-Decoupled Query Encoding); attention heads split symmetrically between θ and θ+π/2 sampling (Rotation-Rectified Orthogonal Attention); decoder updates are tanh-bounded, layer-wise decayed, and wrapped modulo π, trained with the shortest-path periodic L1 loss (Decoupled Periodic Refinement); and dense supervision uses quadrant-wise 90° rotations for angular diversity (Oriented Dense O2O). All four pieces add essentially no parameters or FLOPs.
What would settle it
Re-benchmark the strongest CNN baseline and RiO-DETR-x on the same T4 with the official weights and TensorRT 10 FP16 engine; if the baseline matches or exceeds RiO-DETR-x's 81.8 AP50 at 30.5 ms, the claimed frontier is a benchmark artifact.
Extended reading notes
Core claim
Oriented DETR fails for three fixable reasons, and treating angle as a content-inferred, π-periodic quantity rather than a geometric coordinate resolves all three. Removing θ from positional queries beats every periodic positional encoding tested, showing orientation is disambiguated by appearance. Orthogonal attention heads sample the major axis and its perpendicular; a bounded, coarse-to-fine periodic update paired with a shortest-path L1 loss makes refinement seam-consistent; and quadrant-wise rotation of stitched training images adds angular diversity to dense supervision at zero cost. The sum is 78.4 AP50 at 2.7 ms and 81.8 AP50 at 29.9 ms on DOTA-1.0, better than prior real-time CNN de
Load-bearing premise
The headline speed–accuracy frontier rests on a single fair measurement setup, and one of the strongest CNN baselines is a community reimplementation rather than an official engine, so the reported margins may shift under independent measurement.
Editorial extensions
If this is right
- Real-time oriented detection no longer requires CNN architectures with NMS; end-to-end transformers can match or beat them in speed and accuracy on DOTA-1.0, DIOR-R, and FAIR-1M-2.0.
- Angle should be treated as content-inferred rather than a geometric prior: removing θ from positional queries beat every periodic positional encoding tested, suggesting a general design rule for rotated detection.
- The bounded coarse-to-fine periodic refinement stabilizes angle learning across seams; layer-wise angular corrections in the trained model decay exponentially, confirming the intended schedule.
- The speed–accuracy gains hold across model scales and backbones, so the recipe is portable beyond the specific configuration reported.
- Oriented Dense O2O cuts the epochs to peak accuracy (60 vs 94 without augmentation on DIOR-R), reducing training cost while improving AP50.
Reading between the lines
- If angle decoupling is right, other geometry variables that are annotation-convention-dependent (e.g., long-side vs short-side aspect ratio) might also be better left out of positional queries for ambiguous instances.
- The orthogonal head-splitting could be made adaptive: for near-square objects, a 4:4 split across θ and θ+π/2 is optimal in the paper's ablations; a query-dependent split based on predicted aspect ratio might gain further.
- The shortest-path periodic loss is a drop-in for any cyclic regression target in end-to-end detectors (heading, pose, phase); the paper tests it only for oriented boxes.
- Quadrant-wise discrete rotation for dense supervision is a zero-cost data organization trick; it could be combined with stronger augmentation policies for rotation-sensitive tasks beyond aerial imagery.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. RiO-DETR is a real-time oriented object detection transformer built on an RT-DETRv2-style baseline. It introduces three task-specific designs: Content-Driven Angle Estimation (decoupling θ from positional query encoding, plus Rotation-Rectified Orthogonal Attention), Decoupled Periodic Refinement (bounded coarse-to-fine periodic angle updates with a shortest-path periodic L1 loss), and Oriented Dense O2O (random quadrant rotations in dense supervision). Experiments on DOTA-1.0, DIOR-R, and FAIR-1M-2.0 report state-of-the-art speed-accuracy trade-offs, e.g., RiO-DETR-n at 78.4 AP50 / 2.7 ms and RiO-DETR-x at 81.8 AP50 / 29.9 ms on DOTA-1.0, outperforming YOLO26-obb variants at similar latencies. The paper claims to be the first real-time oriented DETR and attributes the gains to the three proposed components, supported by ablations on DIOR-R.
Significance. If the reported comparisons hold, this is a meaningful contribution: it demonstrates that an end-to-end transformer detector can operate in the real-time regime for oriented object detection, narrowing the gap with CNN-based detectors. The three components are well-motivated, and the ablations are structured to isolate each design choice. Consistency of improvements across three large-scale benchmarks strengthens the empirical case. The authors promise code release, which is important for reproducibility. However, the headline speed-accuracy frontier rests on fair latency and baseline-parity assumptions that are not fully established in the manuscript. The internal ablations are largely coherent and support incremental gains, but the external validity of the frontier claim needs stronger evidence.
major comments (3)
- [Sec. 4.2, Fig. 1, Tables 1-2] The latency-comparison protocol is not apples-to-apples. Sec. 4.2 states that 'all latencies are measured equally' but then says that for end-to-end models latency excludes pre/post-processing while for other models the BatchedNMSPlugin is employed. The headline 2.7 ms for RiO-DETR-n may exclude preprocessing steps such as letterboxing and normalization, while YOLO26-obb latencies include NMS post-processing. This asymmetry directly affects the claimed frontier, especially because the multi-scale margin over YOLO26x-obb is only 0.06 AP50 (Table 2). In addition, Fig. 1 marks YOLO26-obb as a 'community implemented version' but no source or version is specified; citing the YOLO26 paper does not establish that the OBB variant is the official one. Please measure full-pipeline latency (or explicitly quantify pre/post-processing overhead) for all models, specify the exact YOLO26-obb implementat
- [Tables 1-2] All accuracy numbers appear to be from a single run with no error bars or seed variance. The multi-scale DOTA-1.0 comparison shows RiO-DETR-x at 81.76 AP50 vs YOLO26x-obb at 81.70 — a 0.06 AP50 difference that is within typical run-to-run variation for oriented detection training. Without multiple seeds or a statistical test, the claimed superiority at that operating point is not established. Please report mean ± std over at least 3 seeds for the key comparisons, or at least confirm that the reported margins are reproducible. This is particularly important for the x-scale model where the gain is small.
- [Tables 5, 7, 8] The ablation stages are not consistently defined across tables. Table 5 shows Oriented Dense O2O improving from 75.46 to 75.73, while Table 7 reports Oriented Dense O2O at 73.88 AP50. Similarly, Table 8 shows that combining SP-L1 and the periodic update raises AP50 from 74.18 to 74.74, which exactly matches the Table 5 step where Rotation-Rectified Orthogonal Attention is added on top of geometry-decoupled queries (74.18 → 74.74). It appears that the ablations in Tables 7-8 are run on a different base model than the roadmap in Table 5. Please specify the exact base model for each ablation, and ideally re-run ablations on the same full model so that the incremental contribution of each component is directly attributable.
minor comments (7)
- [Sec. 3.2] The text states that Rotation-Rectified Orthogonal Attention introduces 'no additional parameters or GFlops,' but Table 5 shows FLOPs increasing from 97.01 to 97.18 G when this component is added. The overhead is small, but the wording is inaccurate. Suggest qualifying it as 'negligible overhead' and reporting the exact change.
- [Eq. (7)] The periodic normalization in Eq. (7) is confusing: it checks whether (θ_raw mod π) < 0 and adds π, but the standard modulo operation with positive divisor is already nonnegative. Please define wrapπ explicitly as in Appendix C and use it consistently.
- [Appendix D, Table 3] The row labeled 'YOLO26m-obb' in Appendix D Table 3 lists the backbone as YOLO26l (25.6M params, 230G FLOPs). This is likely a typo; the main text Table 2 also lists YOLO26m-obb. Please correct the labeling.
- [References] Reference [55] has a malformed author entry ('Chen, W., , G., Song, Y.'). Please fix the author list. Also, several references are incomplete (e.g., missing page numbers for some arXiv papers), though this is a minor formatting issue.
- [Appendix B] The final sentence says 'Our claims above are further proved by Sec. 4.6 in the main text, Appendix E.3 and F.' Visualizations and ablations do not constitute a proof; please rephrase to 'supported by' or 'corroborated by.'
- [Fig. 1 caption] The caption says '* denotes a community implemented version' but does not say whose implementation or how to obtain it. Since YOLO26-obb is a key baseline, please provide a link or specification of the implementation used.
- [Sec. 1] The paper repeatedly uses the term 'real-time' without a quantitative definition. On T4, 29.9 ms corresponds to ~33 FPS, which may or may not be considered real-time depending on the application. Please state the latency threshold or FPS criterion used to define 'real-time.'
Circularity Check
No significant circularity: the paper's claims are empirical evaluations of architecture components on public benchmarks, and none of the reported predictions reduce by construction to fitted parameters or self-citations.
full rationale
RiO-DETR does not claim a first-principles derivation chain. Its central claim is a speed-accuracy balance (Sec. 1) supported by measured AP50 and latency on DOTA-1.0, DIOR-R, and FAIR-1M-2.0 (Tables 1-4). The three proposed components are design choices with explicit ablations (Tables 5-9 and Appendix Tables 5-8). The shortest-path periodic L1 loss (Eq. 8) is a standard circular-distance loss in oriented detection; the paper cites prior periodic-angle literature ([5,51-54]) and does not present the loss itself as a derived prediction. The bounded periodic update (Eqs. 5-7) is an architectural mechanism, and its decay factor alpha0 is selected by ablation (Appendix Table 5) on DIOR-R and then used on other test splits, which is normal hyperparameter selection rather than fitting a parameter to the headline result. Self-citations to D-FINE and DOME-DETR appear as building blocks or related-work context, but D-FINE is a published, externally evaluated method used to construct the baseline, and the baseline is explicitly shown to remain 1.18 AP50 below state of the art (Table 6), so the central improvement is not carried by the self-citation. The benchmark-parity concerns about YOLO26-obb being a community implementation and about latency excluding pre/post-processing for end-to-end models are important external-validity questions, but they are not circularity: they concern whether comparisons are fair, not whether the paper's derivations reduce to their inputs. No circular step can be exhibited from the paper's equations or citations.
Assumptions & free parameters
free parameters (3)
- α0 (decay base for Decoupled Periodic Refinement) =
1.5
- Attention head split ratio (θ : θ+π/2) =
4:4
- Loss weights λ_L1, λ_KLD, λ_angle =
5, 5, 1 (default)
assumptions (4)
- domain assumption OBB orientation is a content/semantics-disambiguated quantity, so angle should be learned from content features rather than positional queries (Sec. 3.2, Appendix B).
- domain assumption Angle space is π-periodic with long-side canonicalization θ∈[0,π), and the shortest-path periodic distance is the correct training metric (Sec. 3.3, Appendix C).
- domain assumption Stitching four rotated copies of an image for dense supervision does not introduce harmful domain shift or boundary artifacts (Sec. 3.4).
- domain assumption The benchmarks (DOTA-1.0, DIOR-R, FAIR-1M-2.0) are labeled consistently and the official evaluation servers are ground truth (Sec. 4.1).
Cite this review
Pith. "Pith review of RiO-DETR: DETR for Real-time Oriented Object Detection." pith.science (2026). https://pith.science/paper/YETBHJ6F
@misc{pith2026260309411,
author = {Pith},
title = {Pith review of: RiO-DETR: DETR for Real-time Oriented Object Detection},
year = {2026},
howpublished = {\url{https://pith.science/paper/YETBHJ6F}},
note = {Machine review of arXiv:2603.09411}
}
read the original abstract
We present RiO-DETR: DETR for Real-time Oriented Object Detection, the first real-time oriented detection transformer to the best of our knowledge. Adapting DETR to oriented bounding boxes (OBBs) poses three challenges: semantics-dependent orientation, angle periodicity that breaks standard Euclidean refinement, and an enlarged search space that slows convergence. RiO-DETR resolves these issues with task-native designs while preserving real-time efficiency. First, we propose Content-Driven Angle Estimation by decoupling angle from positional queries, together with Rotation-Rectified Orthogonal Attention to capture complementary cues for reliable orientation. Second, Decoupled Periodic Refinement combines bounded coarse-to-fine updates with a Shortest-Path Periodic Loss for stable learning across angular seams. Third, Oriented Dense O2O injects angular diversity into dense supervision to speed up angle convergence at no extra cost. Extensive experiments on DOTA-1.0, DIOR-R, and FAIR-1M-2.0 demonstrate RiO-DETR establishes a new speed--accuracy trade-off for real-time oriented detection. GitHub Repository: https://github.com/RicePasteM/RiO-DETR.
Figures
Figures from the paper (4 more)
Reference graph
Works this paper leans on
-
[1]
In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition
Cai, X., Lai, Q., Wang, Y., Wang, W., Sun, Z., Yao, Y.: Poly kernel inception network for remote sensing detection. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. pp. 27706–27716 (2024)
2024
-
[2]
IEEE transactions on circuits and systems for video tech- nology33(5), 2342–2356 (2022)
Dai, L., Liu, H., Tang, H., Wu, Z., Song, P.: Ao2-detr: Arbitrary-oriented object detection transformer. IEEE transactions on circuits and systems for video tech- nology33(5), 2342–2356 (2022)
2022
-
[3]
In: 2009 IEEE conference on computer vision and pattern recognition
Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: Imagenet: A large- scale hierarchical image database. In: 2009 IEEE conference on computer vision and pattern recognition. pp. 248–255. Ieee (2009)
2009
-
[4]
In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition
Ding, J., Xue, N., Long, Y., Xia, G.S., Lu, Q.: Learning roi transformer for oriented object detection in aerial images. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. pp. 2849–2858 (2019)
2019
-
[5]
In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition
Han, J., Ding, J., Xue, N., Xia, G.S.: Redet: A rotation-equivariant detector for aerial object detection. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. pp. 2786–2795 (2021)
2021
-
[6]
In: Proceedings of the computer vision and pattern recognition conference
Huang, S., Lu, Z., Cun, X., Yu, Y., Zhou, X., Shen, X.: Deim: Detr with improved matching for fast convergence. In: Proceedings of the computer vision and pattern recognition conference. pp. 15162–15171 (2025)
2025
-
[7]
In: 2025 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)
Lee, H., Song, M., Koo, J., Seo, J.: Hausdorff distance matching with adaptive query denoising for rotated detection transformer. In: 2025 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV). pp. 1872–1882. IEEE (2025)
2025
-
[8]
li et al
Li, Y., Li, X., Dai, Y., Hou, Q., Liu, L., Liu, Y., Cheng, M.M., Yang, J.: Lsknet: A foundation lightweight backbone for remote sensing: Y. li et al. International Journal of Computer Vision133(3), 1410–1431 (2025)
2025
Show all 18 references
-
[9]
arXiv preprint arXiv:2407.17140 (2024)
Lv, W., Zhao, Y., Chang, Q., Huang, K., Wang, G., Liu, Y.: Rt-detrv2: Improved baseline with bag-of-freebies for real-time detection transformer. arXiv preprint arXiv:2407.17140 (2024)
2024 arXiv
-
[10]
arXiv preprint arXiv:2212.07784 (2022)
Lyu, C., Zhang, W., Huang, H., Zhou, Y., Wang, Y., Liu, Y., Zhang, S., Chen, K.: Rtmdet: An empirical study of designing real-time object detectors. arXiv preprint arXiv:2212.07784 (2022)
2022 arXiv
-
[11]
arXiv preprint arXiv:2410.13842 (2024)
Peng, Y., Li, H., Wu, P., Zhang, Y., Sun, X., Wu, F.: D-fine: Redefine re- gression task in detrs as fine-grained distribution refinement. arXiv preprint arXiv:2410.13842 (2024)
2024 arXiv
-
[12]
arXiv preprint arXiv:2509.25164 (2025)
Sapkota, R., Cheppally, R.H., Sharda, A., Karkee, M.: Yolo26: key architectural enhancements and performance benchmarking for real-time object detection. arXiv preprint arXiv:2509.25164 (2025)
2025
-
[13]
In: Proceedings of the IEEE/CVF international conference on computer vision
Xie, X., Cheng, G., Wang, J., Yao, X., Han, J.: Oriented r-cnn for object detection. In: Proceedings of the IEEE/CVF international conference on computer vision. pp. 3520–3529 (2021)
2021
-
[14]
arXiv preprint arXiv:2203.16250 (2022)
Xu, S., Wang, X., Lv, W., Chang, Q., Cui, C., Deng, K., Wang, G., Dang, Q., Wei, S., Du, Y., et al.: Pp-yoloe: An evolved version of yolo. arXiv preprint arXiv:2203.16250 (2022)
2022 arXiv
-
[15]
arXiv preprint arXiv:2501.03775 (2025)
Yuan, X., Zheng, Z., Li, Y., Liu, X., Liu, L., Li, X., Hou, Q., Cheng, M.M.: Strip r-cnn: Large strip convolution for remote sensing object detection. arXiv preprint arXiv:2501.03775 (2025)
2025 arXiv
-
[16]
IEEE transactions on geoscience and remote sensing62, 1–15 (2024) 12
Zeng, Y., Chen, Y., Yang, X., Li, Q., Yan, J.: Ars-detr: Aspect ratio-sensitive detection transformer for aerial oriented object detection. IEEE transactions on geoscience and remote sensing62, 1–15 (2024) 12
2024
-
[17]
In: European conference on computer vision
Zhao, Z., Xue, Q., He, Y., Bai, Y., Wei, X., Gong, Y.: Projecting points to axes: Oriented object detection via point-axis representation. In: European conference on computer vision. pp. 161–179. Springer (2024)
2024
-
[18]
In: Proceedings of the 30th ACM international conference on multimedia
Zhou, Y., Yang, X., Zhang, G., Wang, J., Liu, Y., Hou, L., Jiang, X., Liu, X., Yan, J., Lyu, C., et al.: Mmrotate: A rotated object detection benchmark using pytorch. In: Proceedings of the 30th ACM international conference on multimedia. pp. 7331–7334 (2022)
2022
Reviewed August 2, 2026 · model on record in the stance chip above.
Discussion (0). Sign in to comment.