REVIEW 4 major objections 5 minor 27 references
Runway vs. Taxiway: Challenges in Automated Line Identification and Notation Approaches
T0 review · 4 major / 5 minor · reviewed 2026-08-09 · deepseek-v4-flash
Pith's one-line read A CNN pre-classification step distinguishes runway from taxiway imagery and is claimed to make the ALINA labeling pipeline resilient to environmental variations, with 99.5% validation accuracy.
desk verdict Honest negative result, unproven fix: ALINA's runway failures are real, but AssistNet's claimed benefit is never tested end-to-end. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
AssistNet, a convolutional neural network with convolutional layers, max-pooling, dense layers, and a sigmoid output, combined with a contextually reduced ROI that crops out the horizon and sky. In the proposed pipeline, AssistNet acts as a gate that routes runway images away from the taxiway-tuned ALINA algorithm, whose CIRCLEDAT pixel-traversal step then operates only on appropriate input.
What would settle it
Run the full AssistNet-plus-ALINA pipeline on runway videos from the AssistTaxi dataset and measure labeling precision; if horizon or background mislabeling persists, or if partially obscured or faded runway markings cause the classifier to route runway frames to the taxiway branch, the central claim is weakened.
Extended reading notes
Core claim
The central claim is that a simple CNN can reliably distinguish runway imagery from taxiway imagery based primarily on line color (white vs yellow) and a contextually reduced region of interest, and that this pre-classification makes the labeling pipeline more resilient to environmental interference. The paper also documents that modifying ALINA's color thresholds and ROI selection alone is insufficient, with the horizon and background features still being mislabeled.
Load-bearing premise
The assumption that a runway-versus-taxiway classification driven mostly by line color (white versus yellow) is sufficient, and that the 99.5% validation accuracy will generalize to real conditions with faded markings, varied lighting, and the horizon present.
Editorial extensions
If this is right
- If the classification step works, ALINA can be restricted to taxiway frames, reducing false positives from horizon and background features.
- A dedicated runway labeling algorithm can be developed separately, tuned to white markings and runway geometry, and inserted after the classifier.
- The pipeline becomes modular: any future surface type (apron, ramp) could be handled by adding another classification branch.
- The reported 99.5% validation accuracy suggests the color cue is strong, but the paper's own discussion indicates that more diverse data and end-to-end testing are needed to confirm real-world behavior.
Reading between the lines
- The classifier's reliance on line color may fail on monochrome cameras or under strong color casts; a testable extension is augmenting with grayscale or hue-invariant features.
- The proposed pre-classification approach could naturally scale to multi-class surface identification (runway, taxiway, apron, ramp) using the same architecture, a step the paper does not explore.
- Because the paper explicitly notes the absence of an end-to-end test, the 99.5% figure should be read as a component-level result; measuring the full pipeline's labeling error is the immediate next step.
- A dynamic ROI driven by aircraft position, which the paper says could not be implemented due to missing position data, would likely improve both classification and labeling under approach conditions.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper addresses automated labeling of runway versus taxiway markings in aviation imagery. It first documents attempts to adapt the existing ALINA line-labeling algorithm to runways by adjusting color thresholds and ROI selection, finding these modifications insufficient. The authors then propose AssistNet, a CNN that classifies images as runway or taxiway before applying a labeling algorithm, and report 99.5% validation accuracy. The paper argues that this classification step makes the overall detection pipeline more resilient to environmental variations and misclassifications. However, no end-to-end experiment measures whether gating ALINA with AssistNet actually improves labeling performance.
Significance. The paper identifies a genuine problem: ALINA works on taxiway markings but struggles on runway markings, and a pre-classification step that routes imagery to the appropriate labeling algorithm is a plausible architectural solution. The release of the AssistNet code on GitHub and the concrete failure analysis of ALINA on runway frames are useful contributions. The significance is conditional, however, because the central claim of improved pipeline resilience is asserted rather than demonstrated; the only quantitative evidence is a validation-set classifier accuracy with unresolved dataset-split and resolution inconsistencies.
major comments (4)
- [Abstract and Section V] The central claim that the classification step makes the pipeline 'more resilient' is not tested end-to-end. No experiment measures whether gating ALINA with AssistNet changes ALINA's labeling errors on runway or taxiway frames, so the pipeline-level benefit is asserted rather than demonstrated. The 99.5% accuracy is reported on the validation set only and does not establish that the downstream labeling improves.
- [Section IV.A and Section V] The dataset split is contradictory: Section IV.A states a 70:20:10 train/validation/test split, while Section V describes 500 images with 125 per class for training and validation and no test set at all. This ambiguity makes the reported 99.5% validation accuracy uninterpretable and must be resolved with a clear statement of the exact split and held-out test performance.
- [Section IV.C and Section V] The input resolution is inconsistent: Section IV.C says images are resized to 400x225 pixels, while Section V initially says images were resized to 150x150 and later says the resolution was increased to 400x225. The final preprocessing protocol must be stated unambiguously, and any resolution-dependent results should be reported with the corresponding setting.
- [Section V] No baseline or statistical comparison is provided for the classifier. The 99.5% accuracy lacks error bars, per-class precision/recall, and the mentioned confusion matrix is not shown. Because Section IV.B asserts that color is the key differentiating factor, a comparison against a simple color-threshold baseline is necessary to show that AssistNet adds value beyond the color cue already used by ALINA.
minor comments (5)
- [Section I] The introduction says Section V contains a case study on a subset of the AssistTaxi dataset, but I could not identify a distinct case-study subsection; please clarify or reword.
- [Figure 4] The caption reads 'Training and Validation Results over 20 epochs' but the axes and plotted metrics are not described; add axis labels and indicate whether accuracy or loss is shown.
- [Section V] The text says 'the confusion matrix revealed...' but no confusion matrix is included; either include the matrix or remove the reference.
- [Author affiliation, Section II.A] Minor typographical issues: 'Hampton V A' should be 'Hampton, VA', and 'UA V' should be 'UAV'.
- [Section IV.B] The GitHub repository link is appreciated; consider adding a version tag or commit hash to support reproducibility.
Circularity Check
No significant circularity: AssistNet's 99.5% validation accuracy is a standard trained-model evaluation, and the pipeline-resilience claim is an unsupported inference rather than a construction-level reduction.
full rationale
The paper's central claim—that adding the AssistNet classification step makes the ALINA labeling pipeline more resilient—is not derived from its inputs by construction. AssistNet is trained on labeled AssistTaxi images, and its 99.5% validation accuracy is a conventional empirical evaluation of a fitted model, not a fitted parameter that is renamed as a prediction. The assertion that this accuracy transfers to improved ALINA labeling is unsupported because no end-to-end experiment measures the classifier's effect on ALINA's output, but an unsupported inference is an evidence gap, not circularity. The paper explicitly acknowledges missing position data prevented dynamic ROI implementation and lists unresolved limitations in Section VI. The prior ALINA and AssistTaxi works are self-cited, yet the paper does not use those citations to define away the target result; it reports its own modified-ALINA experiments in Figure 1 and uses the dataset only as training input. No equation or construction equates the claimed outcome to an input. The internal inconsistencies in dataset split (70:20:10 versus 125/125 training/validation) and image resolution (400x225 versus 150x150) undermine reliability but do not make any prediction equivalent to its input. Therefore, no significant circularity is present.
Assumptions & free parameters
free parameters (5)
- AssistNet CNN weights =
Not reported
- ALINA color thresholds for white markings =
Not reported
- Reduced ROI crop parameters =
Not reported
- Data augmentation ranges =
Not reported
- Input image resolution =
150x150 and 400x225 (inconsistent)
assumptions (5)
- standard math Backpropagation and standard CNN operations (convolution, max-pooling, dense layers) are valid.
- domain assumption Runway markings are predominantly white and taxiway markings yellow, and this color difference is the key distinguishing feature.
- domain assumption The horizon and non-surface regions can be removed by a fixed crop without losing class-relevant information.
- ad hoc to paper A binary runway/taxiway label is sufficient to route images to the correct labeling algorithm.
- domain assumption The AssistTaxi subset is representative of operational runway and taxiway conditions.
Cite this review
Pith. "Pith review of Runway vs. Taxiway: Challenges in Automated Line Identification and Notation Approaches." pith.science (2026). https://pith.science/paper/UUCANVQH
@misc{pith2026250118494,
author = {Pith},
title = {Pith review of: Runway vs. Taxiway: Challenges in Automated Line Identification and Notation Approaches},
year = {2026},
howpublished = {\url{https://pith.science/paper/UUCANVQH}},
note = {Machine review of arXiv:2501.18494}
}
read the original abstract
The increasing complexity of autonomous systems has amplified the need for accurate and reliable labeling of runway and taxiway markings to ensure operational safety. Precise detection and labeling of these markings are critical for tasks such as navigation, landing assistance, and ground control automation. Existing labeling algorithms, like the Automated Line Identification and Notation Algorithm (ALINA), have demonstrated success in identifying taxiway markings but encounter significant challenges when applied to runway markings. This limitation arises due to notable differences in line characteristics, environmental context, and interference from elements such as shadows, tire marks, and varying surface conditions. To address these challenges, we modified ALINA by adjusting color thresholds and refining region of interest (ROI) selection to better suit runway-specific contexts. While these modifications yielded limited improvements, the algorithm still struggled with consistent runway identification, often mislabeling elements such as the horizon or non-relevant background features. This highlighted the need for a more robust solution capable of adapting to diverse visual interferences. In this paper, we propose integrating a classification step using a Convolutional Neural Network (CNN) named AssistNet. By incorporating this classification step, the detection pipeline becomes more resilient to environmental variations and misclassifications. This work not only identifies the challenges but also outlines solutions, paving the way for improved automated labeling techniques essential for autonomous aviation systems.
Figures
Figures from the paper (2 more)
Reference graph
Works this paper leans on
-
[1]
A robust airport runway detection network based on r-cnn using remote sensing images
Rasna A Amit and C Krishna Mohan. A robust airport runway detection network based on r-cnn using remote sensing images. IEEE Aerospace and Electronic Systems Magazine , 36(11):4–20, 2021
work page 2021
-
[2]
Robust lane detection and tracking algorithm for steering assist systems
Mihail-Alexandru Andrei, Costin-Anton Boiangiu, Nicolae Tarb ˘a, and Mihai-Lucian V oncil˘a. Robust lane detection and tracking algorithm for steering assist systems. Machines, 10(1):10, 2022
work page 2022
-
[3]
Aerodrome taxiway line detection and cross-track error estimation using computer vision techniques
Aman Batra and Jason Gauci. Aerodrome taxiway line detection and cross-track error estimation using computer vision techniques. In 2020 IEEE Aerospace Conference, pages 1–9, 2020
work page 2020
-
[4]
Automated ground operation for an unmanned cargo gyrocopter
Sebastian Benders and Sven Lorenz. Automated ground operation for an unmanned cargo gyrocopter. In AIAA SciTech 2022 Forum, page 2160, 2022
work page 2022
-
[5]
Robust horizon detection using segmentation for uav applications
Nasim Sepehri Boroujeni, S Ali Etemad, and Anthony Whitehead. Robust horizon detection using segmentation for uav applications. In 2012 ninth conference on computer and robot vision , pages 346–352. IEEE, 2012
work page 2012
-
[6]
An image-based runway detection method for fixed-wing aircraft based on deep neural network
Mingqiang Chen and Yuzhou Hu. An image-based runway detection method for fixed-wing aircraft based on deep neural network. IET Image Processing, 2024
work page 2024
-
[7]
Road marking detection and classification using machine learning algorithms
Tairui Chen, Zhilu Chen, Quan Shi, and Xinming Huang. Road marking detection and classification using machine learning algorithms. In 2015 IEEE Intelligent Vehicles Symposium (IV) , pages 617–621, 2015
work page 2015
-
[8]
Explaining autonomous driving by learning end- to-end visual attention
Luca Cultrera, Lorenzo Seidenari, Federico Becattini, Pietro Pala, and Alberto Del Bimbo. Explaining autonomous driving by learning end- to-end visual attention. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops , June 2020
work page 2020
Show all 27 references
-
[9]
Yomo-runwaynet: A lightweight fixed-wing aircraft runway detection algorithm combining yolo and mobilerunwaynet
Wei Dai, Zhengjun Zhai, Dezhong Wang, Zhaozi Zu, Siyuan Shen, Xinlei Lv, Sheng Lu, and Lei Wang. Yomo-runwaynet: A lightweight fixed-wing aircraft runway detection algorithm combining yolo and mobilerunwaynet. Drones, 8(7):330, 2024
2024
-
[10]
Autonomous navigation with taxiway crossings identification using camera vision and airport map
Quentin Delezenne, Ivan Petrunin, Zhengjia Xu, Jonathan Neptune, and Timothy Bleakley. Autonomous navigation with taxiway crossings identification using camera vision and airport map. In AIAA SCITECH 2024 Forum, page 1300, 2024
2024
-
[11]
A comprehensive approach for road marking detection and recognition
Ling Ding, Huyin Zhang, Jinsheng Xiao, Bijun Li, Shejie Lu, Reinhard Klette, Mohammad Norouzifard, and Fang Xu. A comprehensive approach for road marking detection and recognition. Multimedia Tools and Applications, 79(23-24):17193–17210, 2020
2020
-
[12]
Lard–landing approach runway detection–dataset for vision based landing
M ´elanie Ducoffe, Maxime Carrere, L ´eo F ´eliers, Adrien Gauffriau, Vincent Mussot, Claire Pagetti, and Thierry Sammour. Lard–landing approach runway detection–dataset for vision based landing. arXiv preprint arXiv:2304.09938, 2023
2023 arXiv
-
[13]
Image segmentation for automated taxiing of unmanned aircraft
William Eaton and Wen-Hua Chen. Image segmentation for automated taxiing of unmanned aircraft. In 2015 international conference on unmanned aircraft systems (ICUAS) , pages 1–8. IEEE, 2015
2015
-
[14]
Towards flight autonomy: Vision-based horizon detection for micro air vehicles
Scott M Ettinger, Michael C Nechyba, Peter G Ifju, and Martin Waszak. Towards flight autonomy: Vision-based horizon detection for micro air vehicles. In Florida Conference on Recent Advances in Robotics, volume
-
[15]
Horizon detection using machine learning techniques
Sergiy Fefilatyev, V olha Smarodzinava, Lawrence O Hall, and Dmitry B Goldgof. Horizon detection using machine learning techniques. In 2006 5th International Conference on Machine Learning and Applications (ICMLA’06), pages 17–21. IEEE, 2006
2006
-
[16]
Developing a computer vision based system for autonomous taxiing of aircraft
Prashant Gaikwad, Abhishek Mukhopadhyay, Anujith Muraleedharan, Mukund Mitra, and Pradipta Biswas. Developing a computer vision based system for autonomous taxiing of aircraft. Aviation, 27(4):248– 258, 2023
2023
-
[17]
Assisttaxi: A comprehensive dataset for taxiway analysis and au- tonomous operations
Parth Ganeriwala, Siddhartha Bhattacharyya, Sean Gunther, Brian Kish, Mohammed Abdul Hafeez Khan, Ankur Dhadoti, and Natasha Neogi. Assisttaxi: A comprehensive dataset for taxiway analysis and au- tonomous operations. In 2023 International Conference on Machine Learning and Ap...
2023
-
[18]
Cross dataset analysis and network architecture repair for autonomous car lane detection*
Parth Ganeriwala, Siddhartha Bhattacharyya, and Raja Muthalagu. Cross dataset analysis and network architecture repair for autonomous car lane detection*. In 2023 IEEE Intelligent Vehicles Symposium (IV), pages 1– 6, 2023
2023
-
[19]
Road marking extraction in uav imagery using attentive capsule feature pyramid network
Haiyan Guan, Xiangda Lei, Yongtao Yu, Haohao Zhao, Daifeng Peng, Jos´e Marcato Junior, and Jonathan Li. Road marking extraction in uav imagery using attentive capsule feature pyramid network. International Journal of Applied Earth Observation and Geoinformation, 107:102677, 2022
2022
-
[20]
Clrernet: Improving confidence of lane detection with laneiou
Hiroto Honda and Yusuke Uchida. Clrernet: Improving confidence of lane detection with laneiou. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) , pages 1176– 1185, January 2024
2024
-
[21]
Alina: Advanced line identification and notation algorithm
Mohammed Abdul Hafeez Khan, Parth Ganeriwala, Siddhartha Bhat- tacharyya, Natasha Neogi, and Raja Muthalagu. Alina: Advanced line identification and notation algorithm. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 7293– 7302, 2024
2024
-
[22]
Federated adversarial learning for robust autonomous landing runway detection
Yi Li, Plamen Angelov, Zhengxin Yu, Alvaro Lopez Pellicer, and Neeraj Suri. Federated adversarial learning for robust autonomous landing runway detection. In International Conference on Artificial Neural Networks, pages 159–173. Springer, 2024
2024
-
[23]
Aircraft navigation on taxiways: Evaluation of line detection algorithms proposed for automotive applications
Claire Meymandi-Nejad, Esteban Perrotin, Ariane Herbulot, and Michel Devy. Aircraft navigation on taxiways: Evaluation of line detection algorithms proposed for automotive applications. In Proceedings of the 2020 4th International Symposium on Computer Science and Intelligent ...
2020
-
[24]
Towards end-to-end lane detection: an instance segmentation approach
Davy Neven, Bert De Brabandere, Stamatios Georgoulis, Marc Proes- mans, and Luc Van Gool. Towards end-to-end lane detection: an instance segmentation approach. In 2018 IEEE Intelligent Vehicles Symposium (IV), pages 286–291, 2018
2018
-
[25]
Vision-based runway detection and landing for unmanned aerial vehicle enhanced autonomy
Kyriacos Tsapparellas, Nickolay Jelev, Jonathon Waters, Sabine Brunswicker, and Lyudmila S Mihaylova. Vision-based runway detection and landing for unmanned aerial vehicle enhanced autonomy. In 2023 IEEE International Conference on Mechatronics and Automation (ICMA), pages 239...
2023
-
[26]
Real-time horizon line detection based on fusion of classification and clustering
Ali Pour Yazdanpanah, Emma E Regentova, Venkatesan Muthukumar, and George Bebis. Real-time horizon line detection based on fusion of classification and clustering. International Journal of Computer Applications, 121(10), 2015
2015
-
[27]
Graph model-based lane-marking feature extraction for lane detection
Juhan Yoo and Donghwan Kim. Graph model-based lane-marking feature extraction for lane detection. Sensors, 21(13):4428, 2021
2021
Reviewed August 9, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.