REVIEW 5 major objections 7 minor 3 cited by
Separating Drone Point Clouds From Complex Backgrounds by Cluster Filter -- Technical Report for CVPR 2024 UG2 Challenge
T0 review · 5 major / 7 minor · reviewed 2026-08-11 · deepseek-v4-flash
Pith's one-line read The paper claims a cluster filter can isolate a drone's point cloud from noisy lidar background by scoring each candidate on density ratio and voxel displacement, then picking the highest score as the trajectory.
desk verdict Unsupervised drone-trajectory extraction with a plausible density/IoU scoring rule and an external 4th-place challenge finish, but the report is missing nearly all quantitative support. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The mechanism is a global-local cluster filter: DBSCAN, a density-based clustering algorithm, runs on the superimposed global cloud to define candidate objects, and each candidate is re-examined inside short sliding time windows of the original sequence. The two load-bearing quantities are the relative density ratio $R_k^{\mathrm{frame}} = \rho_k^{\mathrm{local}} / \rho_k^{\mathrm{global}}$ and the voxel IoU $\mathrm{IoU}^{i,j}_k$ between local windows. They are combined as $\mathrm{Score}^k = \sum e^{R_k^{\mathrm{frame}}} + \lambda \sum \log(1/\mathrm{IoU}^{i,j}_k)$, a weighted sum that rewards a cluster whose local density stays comparable to its global density while its occupied voxels shift. Spline fitting over timestamp-ordered selected points turns the selected cluster into the 3D trajectory. This mechanism is what lets an unsupervised pipeline separate a moving small target from static clutter.
What would settle it
Take a lidar sequence that contains one drone and one moving distractor, such as a bird or vehicle, and compute the paper's Score for every DBSCAN cluster; if any non-drone cluster outscores the true drone cluster in even one time window, the highest-score-is-the-drone claim fails. The absence of per-sequence scores in the paper makes this check the natural way to test the claim.
Extended reading notes
Core claim
The central claim is that the drone trajectory is exactly the cluster with the highest combined score of density-ratio stability and voxel displacement. In the method, all point clouds in a sequence are superimposed and clustered by DBSCAN; each resulting global cluster is then intersected with short temporal windows of the original sequence. For every cluster, the paper computes the local density, the relative density ratio $R_k^{\mathrm{frame}} = \rho_k^{\mathrm{local}} / \rho_k^{\mathrm{global}}$, and the voxel Intersection-over-Union between windows. The scoring identity is $\mathrm{Score}^k = \sum e^{R_k^{\mathrm{frame}}} + \lambda \sum \log(1/\mathrm{IoU}^{i,j}_k)$, and the paper states that the target with the highest confidence is selected as the final target, that is, the drone trajectory. The selected cluster is then sorted by timestamp and fitted with a spline to produce the UAV's 3D coordinates at arbitrary time nodes. The paper presents this as an unsupervised alternative to deep detection, arguing that small drones are too sparse and unstable for traditional detectors but leave a distinctive motion-density trace in the point-cloud time series.
Load-bearing premise
The load-bearing premise is that the cluster with the highest density-and-voxel score is always the drone; if a bird, vehicle, or any other moving object ever has the right density and overlap profile, the scorer would pick it instead of the drone.
Editorial extensions
If this is right
- Anti-drone detection from lidar can run without labeled training data, so it transfers to new drones and new sites without re-annotation.
- The pipeline outputs the UAV's 3D trajectory directly, so downstream tracking or interception systems can use it without a separate data-association step.
- Because the computation is clustering plus arithmetic, it can be deployed on edge devices rather than requiring a GPU or a large deep network.
- The reported 99.15% sequence detection accuracy on the challenge benchmark indicates the unsupervised scorer misses the drone during only a small fraction of the sequence time.
Reading between the lines
- The method's decision rule assumes one drone per sequence; scenes with two drones or several movers would require a top-k extension or a second discriminative stage, which the paper does not discuss.
- The same cluster-scoring signature should pick out any small moving object, such as a bird, ground vehicle, or debris, not only drones, because it never models what a drone looks like; that generality could be tested directly on diverse moving-target lidar sequences.
- The paper reports no per-sequence scores or sensitivity of the weight $\lambda$; without them, a reader cannot tell how close the runner-up clusters are or how robust the highest-score rule is across the 50 sequences.
- Combining the cluster score with audio or radar modalities, which the MMAUD dataset also provides, could disambiguate cases where a bird and a drone have similar motion-density profiles; that fusion is a natural next step not explored by the paper.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes an unsupervised lidar point cloud pipeline for small-drone detection and trajectory reconstruction. It denoises Livox Avia data, performs global and local DBSCAN clustering over spatio-temporal point cloud sequences, computes per-cluster density ratios and voxel IoU between frames, and combines them into a confidence score whose maximum is declared to be the drone trajectory. The selected point cloud is then fitted with a cubic spline and interpolated to timestamps to produce estimated 3D positions. The authors report a 4th-place finish in the CVPR 2024 UG2+ Challenge on the MMAUD dataset and claim the method is simple, fast, and interpretable.
Significance. If the described claim were fully validated, the paper would offer a useful unsupervised alternative to supervised detectors for a difficult small-object lidar task, and the interpretable scoring mechanism would be a noteworthy contribution. The method's reliance on only two hand-picked cues (density stability and inter-frame voxel overlap) is elegant and could be applicable beyond drones. However, the evidence presented is not currently sufficient: the quantitative table is corrupted, the scoring equations contain a cluster-index summation error, the selection rule is unvalidated, and all hyperparameters are unreported. The external challenge result suggests a working system existed, but it does not by itself establish that the described scoring rule, rather than unstated preprocessing or calibration, is what selects the correct trajectory.
major comments (5)
- [Section III-C, Eq. (6)-(8)] The definitions Score_IoU^k = sum_{k=1}^{n} log(1/IoU^{i,j}_k) and Score_dens^k = sum_{k=1}^{n} exp(R_k^frame) sum over the cluster index k inside a per-cluster score. As written, the index k is summed out, so the score is not cluster-specific and the sentence "the category with the highest score" (Section III-C) is ill-defined. The summation should be over frames or time windows, and the score must be indexed by the cluster k.
- [Section III-C, Eq. (6)] The term log(1/IoU) is singular and unbounded as IoU approaches zero. A cluster whose voxel sets are disjoint in adjacent frames receives an arbitrarily large IoU score, so this term can dominate and make the ranking unstable. The paper gives no epsilon offset, clipping rule, or averaging over frames to make the score finite and comparable across clusters, which is load-bearing for the claimed selection rule.
- [Table I] The comparison table is corrupted: every method has MSE value '1', several rows have no method name, the backbone column contains stray values like '20', and the proposed method's SDA of 99.15% is given without standard deviation, number of sequences, or per-sequence results. This table provides no quantitative support for the central trajectory-accuracy claim, and no MSE numbers or error bars appear elsewhere in the paper.
- [Section III-B/III-C, central selection claim] The paper asserts without supporting evidence that the cluster with the maximum Score is always the drone trajectory. The two scoring cues (stable local density and low inter-frame voxel IoU) are also exhibited by other small moving objects such as birds or debris, and the paper provides no per-sequence score distribution, no failure analysis, and no sensitivity study for the weighting lambda. The external 4th-place result cannot substitute for validating the specific selection rule described in the manuscript.
- [Sections III-A and III-B, hyperparameters] The method depends on several hand-chosen hyperparameters that are never reported: DBSCAN epsilon and MinPts, the local window length 'frames', the voxel size used for V_global and V_local, the noise-density threshold for denoising, and the scoring weight lambda. Without these values the method is not reproducible, and the absence of a sensitivity analysis leaves open whether the reported challenge result relies on a narrow parameter choice.
minor comments (7)
- [Throughout] The manuscript repeatedly uses 'UA V' and 'MA V' with spurious spaces; the text should use 'UAV' and 'MAV' consistently.
- [Section III-D] The spline basis function B_i(u) includes an undefined parameter h and a four-element polynomial list; it does not match standard cubic B-spline notation and should be rewritten or given a proper citation.
- [Section III-C] The text says 'as shown in Figure ()', but the figure pointer is left incomplete; Figure 4 is referenced later but its actual content is not embedded in the manuscript.
- [Section III-C] The text refers to 'Section 3.2' when describing where the scoring mechanism is detailed, but the scoring mechanism is in Section III-C.
- [Table I] Several rows in Table I have empty method names and stray '20' values in the backbone column; these entries should be completed or removed.
- [Contributions list, Section I] The fourth contribution claims 'ablation experiments', but no ablation experiments appear anywhere in the paper; this claim should be removed or the experiments should be added.
- [References] References [12], [18], and [19] are cited as ICASSP 2025 papers without page or DOI information and may not be publicly available yet; the authors should verify these entries.
Circularity Check
No circularity found: the scoring heuristic is falsifiable and externally benchmarked, and the only self-citation is not load-bearing.
full rationale
The derivation chain is not circular. The pipeline computes density and voxel statistics directly from the input point clouds: global density rho^k_global = Num^k_global / V^k_global, local density rho^{k,frame}_local, IoU^{i,j}_k, relative density R, and the combined score Scorek = Scorek_dens + lambda * Scorek_IoU; none of these quantities is fitted to the ground-truth drone trajectory and then renamed as a prediction. The decision "the target with the highest confidence is selected as the final target. That is, the drone trajectory" is an empirical selection heuristic: it is checked against MMAUD ground truth via MSE/SDA and by the external CVPR 2024 UG2+ Challenge, so the statement is falsifiable rather than true by definition. The only self-citation ([18], H. Liang et al., sharing two authors) appears in the related-work discussion of lidar noise and sparsity and does not supply the scoring rule or any uniqueness claim, so it is not load-bearing. The displayed Scorek formulas sum over the cluster index k inside a per-cluster score, which as written makes the expression ill-defined; this is a correctness/clarity defect, not a circular reduction. Unreported hyperparameters and the absence of per-sequence score distributions are reproducibility and validation concerns, but they do not make any prediction equivalent to its input.
Assumptions & free parameters
free parameters (6)
- DBSCAN epsilon (ε)
- DBSCAN MinPts
- Local time window length 'frames'
- Voxel size for V_global and V_local
- Noise density threshold for denoising
- Scoring weight lambda (λ)
assumptions (6)
- domain assumption Moving-object point cloud density is approximately constant over short windows while static background density increases.
- ad hoc to paper The cluster with the highest combined score is the drone trajectory.
- domain assumption Static background voxel overlap (IoU) is higher across adjacent windows than the moving drone's.
- standard math DBSCAN yields meaningful clusters on the fused multi-lidar point cloud.
- standard math Cubic B-spline interpolation over timestamp-ordered points recovers drone positions at arbitrary frames.
- domain assumption MMAUD ground truth and timestamps are accurate.
Cite this review
Pith. "Pith review of Separating Drone Point Clouds From Complex Backgrounds by Cluster Filter -- Technical Report for CVPR 2024 UG2 Challenge." pith.science (2026). https://pith.science/paper/E7CS3CB6
@misc{pith2026241216947,
author = {Pith},
title = {Pith review of: Separating Drone Point Clouds From Complex Backgrounds by Cluster Filter -- Technical Report for CVPR 2024 UG2 Challenge},
year = {2026},
howpublished = {\url{https://pith.science/paper/E7CS3CB6}},
note = {Machine review of arXiv:2412.16947}
}
read the original abstract
The increasing deployment of small drones as tools of conflict and disruption has amplified their threat, highlighting the urgent need for effective anti-drone measures. However, the compact size of most drones presents a significant challenge, as traditional supervised point cloud or image-based object detection methods often fail to identify such small objects effectively. This paper proposes a simple UAV detection method using an unsupervised pipeline. It uses spatial-temporal sequence processing to fuse multiple lidar datasets effectively, tracking and determining the position of UAVs, so as to detect and track UAVs in challenging environments. Our method performs front and rear background segmentation of point clouds through a global-local sequence clusterer and parses point cloud data from both the spatial-temporal density and spatial-temporal voxels of the point cloud. Furthermore, a scoring mechanism for point cloud moving targets is proposed, using time series detection to improve accuracy and efficiency. We used the MMAUD dataset, and our method achieved 4th place in the CVPR 2024 UG2+ Challenge, confirming the effectiveness of our method in practical applications.
Figures
Forward citations
Cited by 3 Pith papers
-
TAME: Temporal Audio-based Mamba for Enhanced Drone Trajectory Estimation and Classification
TAME applies parallel Mamba state-space models to audio spectrograms and reports state-of-the-art drone trajectory estimation and classification on MMAUD, with unresolved evaluation concerns.
-
Audio Array-Based 3D UAV Trajectory Estimation with LiDAR Pseudo-Labeling
An audio-only neural network predicts 3D UAV trajectories with 0.48 m average position error on MMAUD, trained with unsupervised LiDAR trajectory estimates as pseudo-labels.
-
Unsupervised UAV 3D Trajectories Estimation with Sparse Point Clouds
An unsupervised LiDAR clustering and spline method estimates UAV 3D trajectories from sparse point clouds, reporting 1.35 m RMSE on the MMAUD v2/v3 benchmark.
Reference graph
Works this paper leans on
-
[18]
Unsupervised uav 3d trajectories estimation with sparse point clouds,
H. Liang, Y . Yang, J. Hu, J. Yang, F. Liu, and S. Yuan, “Unsupervised uav 3d trajectories estimation with sparse point clouds,” 2025 IEEE International Conference on Acoustics, Speech, and Signal Processing , 2025
work page 2025
-
[1]
Air-to-air visual detection of micro-uavs: An experimental evaluation of deep learning,
Y . Zheng, Z. Chen, D. Lv, Z. Li, Z. Lan, and S. Zhao, “Air-to-air visual detection of micro-uavs: An experimental evaluation of deep learning,” IEEE Robotics and automation letters , vol. 6, no. 2, pp. 1020–1027, 2021
2021
-
[2]
B. K. Isaac-Medina, M. Poyser, D. Organisciak, C. G. Willcocks, T. P. Breckon, and H. P. Shum, “Unmanned aerial vehicle visual detection and tracking using deep neural networks: A performance benchmark,” in Proceedings of the IEEE/CVF International Conference on Com- puter Vision, 2021, pp. 1223–1232
work page 2021
-
[3]
Real-time small drones detection based on pruned yolov4,
H. Liu, K. Fan, Q. Ouyang, and N. Li, “Real-time small drones detection based on pruned yolov4,” Sensors, vol. 21, no. 10, p. 3374, 2021
2021
-
[4]
C. Rui, G. Youwei, Z. Huafei, and J. Hongyu, “A comprehensive approach for uav small object detection with simulation-based transfer learning and adaptive fusion,” arXiv preprint arXiv:2109.01800, 2021
work page Pith review arXiv 2021
-
[5]
Real- time and accurate drone detection in a video with a static background,
U. Seidaliyeva, D. Akhmetov, L. Ilipbayeva, and E. T. Matson, “Real- time and accurate drone detection in a video with a static background,” Sensors, vol. 20, no. 14, p. 3856, 2020. 6
work page 2020
-
[6]
Small low-contrast target detection: Data-driven spatiotemporal feature fusion and implementa- tion,
J. Xie, C. Gao, J. Wu, Z. Shi, and J. Chen, “Small low-contrast target detection: Data-driven spatiotemporal feature fusion and implementa- tion,” IEEE transactions on cybernetics , vol. 52, no. 11, pp. 11 847– 11 858, 2021
work page 2021
-
[7]
Adaptive switching spatial-temporal fusion detection for remote flying drones,
J. Xie, J. Yu, J. Wu, Z. Shi, and J. Chen, “Adaptive switching spatial-temporal fusion detection for remote flying drones,” IEEE Transactions on V ehicular Technology, vol. 69, no. 7, pp. 6964–6976, 2020
work page 2020
Show all 19 references
-
[8]
Detection, localization, and tracking of multiple mavs with panoramic stereo camera networks,
Y . Zheng, C. Zheng, X. Zhang, F. Chen, Z. Chen, and S. Zhao, “Detection, localization, and tracking of multiple mavs with panoramic stereo camera networks,” IEEE transactions on automation science and engineering , vol. 20, no. 2, pp. 1226–1243, 2022
2022
-
[9]
Fast and robust uav to uav detection and tracking from video,
J. Li, D. H. Ye, M. Kolsch, J. P. Wachs, and C. A. Bouman, “Fast and robust uav to uav detection and tracking from video,” IEEE Transactions on Emerging Topics in Computing , vol. 10, no. 3, pp. 1519–1531, 2021
2021
-
[10]
Dogfight: Detecting drones from drones videos,
M. W. Ashraf, W. Sultani, and M. Shah, “Dogfight: Detecting drones from drones videos,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2021, pp. 7067–7076
2021
-
[11]
Low in resolution, high in precision: Uav detection with super-resolution and motion information extraction,
H. Wang, X. Wang, C. Zhou, W. Meng, and Z. Shi, “Low in resolution, high in precision: Uav detection with super-resolution and motion information extraction,” in ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . IEEE, 2023, pp. 1–5
2023
-
[12]
Audio array-based 3d uav trajectory estimation with lidar pseudo-labeling,
A. Lei, T. Deng, H. Wang, J. Yang, and S. Yuan, “Audio array-based 3d uav trajectory estimation with lidar pseudo-labeling,” 2025 IEEE International Conference on Acoustics, Speech, and Signal Processing , 2025
2025
-
[13]
Adaptive lidar scan frame integration: Tracking known mavs in 3d point clouds,
L. Qingqing, Y . Xianjia, J. P. Queralta, and T. Westerlund, “Adaptive lidar scan frame integration: Tracking known mavs in 3d point clouds,” in 2021 20th International Conference on Advanced Robotics (ICAR) . IEEE, 2021, pp. 1079–1086
2021
-
[14]
Drone detection using sparse lidar mea- surements,
S. Dogru and L. Marques, “Drone detection using sparse lidar mea- surements,” IEEE Robotics and Automation Letters , vol. 7, no. 2, pp. 3062–3069, 2022
2022
-
[15]
Detection and tracking of small objects in sparse 3d laser range data,
J. Razlaw, J. Quenzel, and S. Behnke, “Detection and tracking of small objects in sparse 3d laser range data,” in 2019 International Conference on Robotics and Automation (ICRA) . IEEE, 2019, pp. 2967–2973
2019
-
[16]
Study on target detection and tracking method of uav based on lidar,
H. Wang, Y . Peng, L. Liu, and J. Liang, “Study on target detection and tracking method of uav based on lidar,” in 2021 Global Reliability and Prognostics and Health Management (PHM-Nanjing) . IEEE, 2021, pp. 1–6
2021
-
[17]
Uav tracking with lidar as a camera sensor in gnss-denied environ- ments,
H. Sier, X. Yu, I. Catalano, J. P. Queralta, Z. Zou, and T. Westerlund, “Uav tracking with lidar as a camera sensor in gnss-denied environ- ments,” in 2023 International Conference on Localization and GNSS (ICL-GNSS). IEEE, 2023, pp. 1–7
2023
-
[19]
Tame: Temporal audio-based mamba for enhanced drone trajectory estimation and classification,
Z. Xiao, H. Hu, G. Xu, and J. He, “Tame: Temporal audio-based mamba for enhanced drone trajectory estimation and classification,” 2025 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2025. 7
2025
Reviewed August 11, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.