REVIEW 3 major objections 6 minor 17 references
FPGA & VPU Co-Processing in Space Applications: Development and Testing with DSP/AI Benchmarks
T0 review · 3 major / 6 minor · reviewed 2026-08-07 · deepseek-v4-flash
Pith's one-line read The paper demonstrates that an FPGA and a commercial VPU can work as a co-processor for space on-board processing, sustaining 6-20 FPS on DSP kernels and more than 1 FPS on 1MP CNN image classification.
desk verdict A transparent lab report on FPGA+VPU co-processing with real measured FPS numbers, but the CNN throughput claim needs accuracy validation before it supports mission-relevant AI capability. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing mechanism is the CIF/LCD interface pair, where the FPGA's Camera Interface sends pixel data into the VPU and the VPU's Liquid Crystal Display output returns results to the FPGA. The FPGA side is implemented in VHDL with pixel FIFOs, CRC-16 checking, and clock-domain-crossing registers, while the VPU side uses vendor camera and display driver routines plus its 12 SHA VE vector cores for processing. This repurposing of camera and display interfaces creates a generic, configurable I/O channel (8/16/24-bit pixels, independently set frame sizes and clocks) that lets a framing FPGA hand data to a low-power AI accelerator without a dedicated high-speed link.
What would settle it
Run the deployed 16-bit floating-point, 64-patch ship detector on a labeled set of 1024x1024 satellite images and compare its detection accuracy with the 96.8% training figure; if the detection rate drops below what a mission would require, the claimed CNN throughput is not evidence of usable ship detection.
Extended reading notes
Core claim
The central claim is that a mixed-criticality co-processing scheme, with a Kintex-class FPGA handling framing and transcoding and a Myriad2 VPU handling DSP/AI, can meet meaningful real-time throughput for space applications while consuming roughly 1 W on the VPU. The CIF/LCD interconnection transmits 1MPixel frames in about 21 ms at 50 MHz with zero CRC errors, which corresponds to 48 FPS for pure I/O. With both I/O and processing, the system delivers 6-20 FPS for averaging binning, floating-point convolution, and depth rendering, and 1.4 FPS for CNN ship detection on 1MPixel images. The FPGA fabric usage for the interface is under 1 percent, leaving room for additional functions such as compression, FIR filtering, or corner detection, whose resource use is also reported. The paper further shows that pipelining I/O and processing via masked I/O helps only computation-heavy benchmarks, while lightweight kernels lose throughput due to frame buffering overhead.
Load-bearing premise
The CNN ship detector's on-board accuracy is untested: the 96.8% figure was measured on 128x128 RGB training images, not on the 64-patch, 16-bit floating-point 1024x1024 deployment that produced the 1.4 FPS result.
Editorial extensions
If this is right
- If the architecture holds up in flight-like conditions, space payload data handling can offload DSP/AI to a ~1 W VPU while the FPGA remains free for instrument I/O and trusted heritage functions.
- The error-free 48 FPS 1MPixel CIF/LCD transfer rate means the I/O channel is not the bottleneck for the reported 6-20 FPS kernel throughputs.
- The low FPGA resource footprint (<1% for the interface, single-digit percentages for compression and DSP kernels) suggests the same board can host multiple algorithmic pipelines without dynamic reconfiguration.
- The masked-I/O results imply a simple design rule: pipeline I/O only when processing time dominates the frame copy time, otherwise serial processing is faster.
- The 1.4 FPS CNN rate, combined with the 96.8% reported training accuracy, indicates that a COTS VPU could support onboard ship detection and similar EO classification tasks, assuming the deployed accuracy is verified.
Reading between the lines
- An unstated but natural next experiment is to measure the deployed CNN's detection accuracy on full-resolution 1024x1024 images; without that measurement, the reported 1.4 FPS is a throughput number not tied to a demonstrated detection quality.
- The architecture could generalize beyond framing and EO to other streaming instruments, e.g., hyperspectral imagers, by reusing the same CIF/LCD channel with wider pixel formats or multiple VPUs, though the paper only reports 24-bit RGB support.
- Since the platform includes three VPUs for fault tolerance, a natural extension is to test how throughput and error detection behave when one VPU fails or when the same frame is redundantly processed by multiple VPUs.
- The comparison with FPGA and GPU implementations suggests that a developer could choose the VPU when runtime programmability and multi-algorithm storage matter more than peak FPS/W, which is an engineering trade-off the paper states only indirectly.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper describes a proof-of-concept heterogeneous FPGA+VPU co-processing architecture for space on-board processing, in which a Kintex/Virtex FPGA implements CIF and LCD controllers to exchange image data with an Intel Movidius Myriad2 VPU. Custom DSP/AI benchmarks (averaging binning, floating-point convolution, depth rendering, and CNN ship detection) are mapped to the VPU's SHAVE cores. The authors report measured interface throughput of 48 FPS for 1MPixel transfers, 6–20 FPS for small kernels, and 1.4–1.5 FPS for CNN classification, together with FPGA resource utilization and power measurements. They conclude that the architecture is a viable low-power COTS-based option for space payload processing.
Significance. If the reported measurements are reliable, the paper provides a useful engineering data point for low-power heterogeneous processing in space, and the CIF/LCD interface integration between an FPGA and a VPU is a non-trivial contribution. The performance numbers in Table II are derived directly from measured component times via transparent formulas rather than from a fitted model, and the FPGA resource utilization is documented clearly. The main significance is limited by three gaps: the deployed CNN configuration has no accuracy validation, the claimed order-of-magnitude CNN speedup over LEON is an extrapolation rather than a measurement, and the masked-I/O results are not fully reproducible from the stated formulas. The 48 FPS one-way interface transfer result is the most defensible claim in the paper.
major comments (3)
- [III-C and Table II] The CNN ship-detection benchmark is converted from 32-bit floating point to 16-bit floating point and is run as 64 non-overlapping 128x128 patches on 1024x1024 images, but no accuracy of this deployed configuration is reported. The only accuracy given (96.8%) is for training on 128x128 images with the original precision. Since the abstract and conclusion claim “more than 1 FPS for deep AI image classification,” this throughput number is not tied to any demonstrated detection capability. Patch-boundary effects, the lack of overlap or non-maximum suppression, and the effect of 16-bit quantization on detection quality all remain unexamined. Please report end-to-end detection metrics on representative 1024x1024 images, or qualify the claim as raw throughput without validated accuracy.
- [IV, CNN speedup paragraph] The statement that the CNN speedup over the LEON processor is “expected to be more than 2 orders of magnitude” is explicitly an extrapolation based on convolution performance, not a measured result. No LEON execution time for the CNN is reported. The conclusion then states as fact that CNN was accelerated by 1–2 orders of magnitude versus the LEON4 CPU. This is unsupported by the data. The extrapolation should be removed or clearly labeled as an estimate, and the conclusion should claim only the measured speedups.
- [Table II, footnote 2 (Masked I/O formulas)] The masked-I/O latency and throughput formulas depend on “CIF Buff. Time” and “LCD Buff. Time,” which are never defined or tabulated, and the relationship between these quantities and the “copying an 1MPixel frame requires ∼42ms” statement is unclear. Using the stated CIF/VPU/LCD times and plausible buffering times derived from that statement, I could not reproduce the reported 906ms masked latency for Averaging Binning. Please define all buffering times explicitly, list their values per benchmark, and show one worked example, or report the masked-I/O latencies and throughputs directly.
minor comments (6)
- [IV, paragraph 1] The word “trasmitted” should be “transmitted.”
- [V, Conclusion] “DPS/AI” should read “DSP/AI.”
- [Fig. 1] The labels “M” and “CM” in the architecture diagram are not explained in the caption or text; please define them.
- [IV, performance evaluation] All throughput and latency numbers are reported as single values without stating the number of repeated trials or the observed variance; please state the measurement methodology or add error bars.
- [Abstract and Section IV] The “48 FPS for 1MPixel image transfers” claim corresponds to one-way CIF transfer time (1/20.9ms); please clarify in the abstract or text that this is a one-way rate, since a bidirectional round trip would be roughly half that rate.
- [Table II, CNN row] The CIF input time for the CNN is 63ms for “1MP RGB/64×1, 16bpp,” which is three times the 21ms used for 1MP 8-bit images; please specify the pixel format and bit width per channel so the reader can verify this timing.
Circularity Check
No significant circularity: all throughput, I/O, and power results are measured or directly computed from measured component times via stated formulas.
full rationale
This paper is an experimental evaluation, not a derivation. Every throughput, latency, FPS, and power value is either directly measured on the FPGA/VPU testbed or computed from measured component times using the explicit formulas in Table II (e.g., Unmasked I/O Throughput = 1/(CIF Time + VPU Time + LCD Time)). There are no fitted parameters, no model-based predictions, and no theoretical claims that reduce to their own inputs by construction. The CNN ship-detection benchmark's 96.8% accuracy is cited from an external Kaggle dataset reference [15], not from this paper's own fit, and although the paper does not validate accuracy after 16-bit conversion and 64-patch deployment, that is a missing validation and a correctness risk, not circularity. Self-citations such as [1], [2], [3], and [17] are used for background, related work, and benchmark comparisons; they do not carry any load-bearing argument that substitutes for the paper's own measurements. The CCSDS-123 resource utilization note in Table I is explicitly marked as extrapolated from a cited prior implementation, but it is a peripheral FPGA-remaining-capacity illustration rather than a central claim. Therefore, the paper's central claims are self-contained against external benchmarks and do not exhibit circular reasoning.
Assumptions & free parameters
assumptions (4)
- domain assumption CIF and LCD parallel bus interfaces operate at 50MHz with zero bit errors between the FPGA and Myriad2 VPU for the frame sizes used in the benchmarks.
- domain assumption The Myriad2 VPU SHAVE cores execute the benchmark kernels correctly, with output validated by comparison to groundtruth on the Host PC.
- domain assumption The CNN trained on 128x128 images performs useful ship detection when applied patch-wise to 1024x1024 images in 16-bit floating point.
- domain assumption The Masked I/O pipelining model accurately predicts throughput when the VPU's LEON core concurrently handles CIF reception, LCD transmission, and DRAM buffering while SHAVE cores process.
Cite this review
Pith. "Pith review of FPGA & VPU Co-Processing in Space Applications: Development and Testing with DSP/AI Benchmarks." pith.science (2026). https://pith.science/paper/4QUZ5J2E
@misc{pith2026250612968,
author = {Pith},
title = {Pith review of: FPGA & VPU Co-Processing in Space Applications: Development and Testing with DSP/AI Benchmarks},
year = {2026},
howpublished = {\url{https://pith.science/paper/4QUZ5J2E}},
note = {Machine review of arXiv:2506.12968}
}
read the original abstract
The advent of computationally demanding algorithms and high data rate instruments in new space applications pushes the space industry to explore disruptive solutions for on-board data processing. We examine heterogeneous computing architectures involving high-performance and low-power commercial SoCs. The current paper implements an FPGA with VPU co-processing architecture utilizing the CIF & LCD interfaces for I/O data transfers. A Kintex FPGA serves as our framing processor and heritage accelerator, while we offload novel DSP/AI functions to a Myriad2 VPU. We prototype our architecture in the lab to evaluate the interfaces, the FPGA resource utilization, the VPU computational throughput, as well as the entire data handling system's performance, via custom benchmarking.
Figures
Figures from the paper (3 more)
Reference graph
Works this paper leans on
-
[1]
High-Performance Vision-Based Navigation on SoC FPGA for Spacecraft Proximity Operations,
G. Lentaris, I. Stratakos, I. Stamoulias, D. Soudris, M. Lourakis, and X. Zabulis, “High-Performance Vision-Based Navigation on SoC FPGA for Spacecraft Proximity Operations,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 30, no. 4, pp. 1188–1202, 2020
work page 2020
-
[2]
V . Leon, I. Stamoulias, G. Lentaris, D. Soudris, D. Gonzalez-Arjona, R. Domingo, D. M. Codinachs, and I. Conway, “Development and Testing on the European Space-Grade BRA VE FPGAs: Evaluation of NG-Large Using High-Performance DSP Benchmarks,” IEEE Access , vol. 9, pp. 131 877–131 892, 2021
work page 2021
-
[3]
Improving Performance-Power-Programmability in Space Avionics with Edge Devices: VBN on Myriad2 SoC,
V . Leon, G. Lentaris, E. Petrongonas, D. Soudris, G. Furano, A. Tavoularis, and D. Moloney, “Improving Performance-Power-Programmability in Space Avionics with Edge Devices: VBN on Myriad2 SoC,” ACM Trans- actions on Embedded Computing Systems (TECS), vol. 20, no. 3, pp. 1–23, 2021
work page 2021
-
[4]
Onboard Processing with Hybrid and Reconfigurable Computing on Small Satellites,
A. D. George and C. M. Wilson, “Onboard Processing with Hybrid and Reconfigurable Computing on Small Satellites,” Proceedings of the IEEE, vol. 106, no. 3, pp. 458–470, 2018
work page 2018
-
[5]
System-Level Architecture for Mixed Crit- icality Applications on MPSoC: A Space Application,
S. Esposito and M. Violante, “System-Level Architecture for Mixed Crit- icality Applications on MPSoC: A Space Application,” in IEEE Interna- tional Workshop on Metrology for AeroSpace (MetroAeroSpace), 2017, pp. 479–483
work page 2017
-
[6]
Towards an Integrated GPU Accelerated SoC as a Flight Computer for Small Satellites,
C. Adams, A. Spain, J. Parker, M. Hevert, J. Roach, and D. Cotten, “Towards an Integrated GPU Accelerated SoC as a Flight Computer for Small Satellites,” in IEEE Aerospace Conference, 2019, pp. 1–7
work page 2019
-
[7]
Enabling Radiation Tolerant Heterogeneous GPU-based Onboard Data Processing in Space,
F. C. Bruhn, N. Tsog, F. Kunkel, O. Flordal, and I. Troxel, “Enabling Radiation Tolerant Heterogeneous GPU-based Onboard Data Processing in Space,” CEAS Space Journal, vol. 12, pp. 551–564, 2020
work page 2020
-
[8]
Run-Time Reconfigurable MPSoC- Based On-Board Processor for Vision-Based Space Navigation,
A. P ´erez, A. Rodr´ıguez, A. Otero, D. Gonz´alez-Arjona, A. Jim´enez-Peralo, M. A. Verdugo, and E. De La Torre, “Run-Time Reconfigurable MPSoC- Based On-Board Processor for Vision-Based Space Navigation,” IEEE Access, vol. 8, pp. 59 891–59 905, 2020
work page 2020
Show all 17 references
-
[9]
Always-on Vision Processing Unit for Mobile Applications,
B. Barry, C. Brick, F. Connor, D. Donohoe, D. Moloney, R. Richmond, M. O’Riordan, and V . Toma, “Always-on Vision Processing Unit for Mobile Applications,” IEEE Micro, vol. 35, no. 2, pp. 56–66, 2015
2015
-
[10]
GAP-8: A RISC-V SoC for AI at the Edge of the IoT,
E. Flamand, D. Rossi, F. Conti, I. Loi, A. Pullini, F. Rotenberg, and L. Benini, “GAP-8: A RISC-V SoC for AI at the Edge of the IoT,” inIEEE International Conference on Application-specific Systems, Architectures and Processors (ASAP), 2018, pp. 1–4
2018
-
[11]
High-Performance Compute Board – A Fault-Tolerant Module for On-Board Vision Processing,
J. E. Navarro, A. Samuelsson, H. Gingsj ¨o, J. Barendt, A. Dunne, L. Buck- ley, D. Reisis, A. Kyriakos, E.-A. Papatheofanous, C. Bezaitis, P. Matthijs, J. P. Ramos, and D. Steenari, “High-Performance Compute Board – A Fault-Tolerant Module for On-Board Vision Processing,” in E...
2021
-
[12]
[Online]
Xilinx, Kintex UltraScale FPGA Family , (accessed July 2021). [Online]. Available: https://www.xilinx.com/products/silicon-devices/ fpga/kintex-ultrascale.html
2021
-
[13]
[Online]
Intel Movidius, Myriad2 Vision Processing Unit (VPU) , (accessed July 2021). [Online]. Available: https://newsroom.intel.com/wp-content/ uploads/sites/11/2017/06/Myriad-2-VPU-Fact-Sheet.pdf
2021
-
[14]
[Online]
Cobham Gaisler, GR716 – LEON3FT Microcontroller , (accessed July 2021). [Online]. Available: https://www.gaisler.com/index.php/products/ components/gr716
2021
-
[15]
March 2021)
Kaggle, Ships in Satellite Imagery , 2018 (acces. March 2021). [Online]. Available: https://www.kaggle.com/rhammell/ships-in-satellite-imagery
2018
-
[16]
High- Performance COTS FPGA SoC for Parallel Hyperspectral Image Com- pression with CCSDS-123.0-B-1,
A. Tsigkanos, N. Kranitis, D. Theodoropoulos, and A. Paschalis, “High- Performance COTS FPGA SoC for Parallel Hyperspectral Image Com- pression with CCSDS-123.0-B-1,”IEEE Transactions on Very Large Scale Integration (VLSI) Systems, vol. 28, no. 11, pp. 2397–2409, 2020
2020
-
[17]
Combining Arithmetic Approximation Techniques for Improved CNN Circuit Design,
G. Lentaris, G. Chatzitsompanis, V . Leon, K. Pekmestzi, and D. Soudris, “Combining Arithmetic Approximation Techniques for Improved CNN Circuit Design,” inIEEE International Conference on Electronics, Circuits and Systems (ICECS), 2020, pp. 1–4
2020
Reviewed August 7, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.