Pith. sign in

REVIEW 2 major objections 5 minor 24 references

The Oxford Radar RobotCar Dataset: A Radar Extension to the Oxford RobotCar Dataset

T0 review · 2 major / 5 minor · reviewed 2026-08-14 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read The paper releases 240,088 radar sweeps, 32 urban traversals, cameras, lidar, GPS/INS, and optimized radar odometry as a 4.7 TB public dataset for self-driving perception.

desk verdict A solid, genuinely useful large-scale radar dataset release; the 'ground truth' odometry label overpromises, but the raw data and tools are the real value. read the letter →

arxiv 1909.01300 v3 pith:O677WIIE submitted 2019-09-03 cs.RO eess.SP

Dan Barnes , Matthew Gadd , Paul Murcutt , Paul Newman , Ingmar Posner This is my paper · ORCID
classification cs.ROeess.SP
keywords FMCWradarmillimetre-waveautonomousdrivingdatasetodometrysensorcalibrationurbansceneunderstandingmulti-modalsensing
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper's aim is to establish that a large, openly shared corpus of 360-degree FMCW radar sweeps, collected together with cameras, lidar, and GPS/INS on a road vehicle, is a sufficient foundation for radar-based scene understanding in autonomous driving. The release documents 32 traversals of a central urban route spanning 280 km in January weather, including rain, fog, snow, direct sunlight, and varying traffic. It provides 240,088 radar sweeps, 2.4 million Velodyne scans, six cameras, two 2D lidars, GPS/INS, optimized radar odometry, and an SDK for loading and converting the radar and lidar data. The authors intend this to lower the barrier to radar research and to complement existing vision- and lidar-centric datasets.

What carries the argument

The central object is the Navtech CTS350-X FMCW scanning radar in its dataset configuration: 360-degree coverage at 4 Hz, 400 azimuths per sweep, 3768 range bins out to 163 m with 4.38 cm range resolution and 1.8-degree beamwidth. What makes this radar the load-bearing element is that the whole dataset, including sensor placement, calibration targets, the optimized trajectories, and the SDK's polar-to-Cartesian conversion, is organised around its sweeps; every other sensor is aligned to the radar frame.

What would settle it

Download one traversal recorded in heavy rain and one in clear weather over the same road segment, register the radar sweeps using the published reference odometry, and check whether static building returns agree to within the radar's range resolution; if they disagree consistently, the optimized ground-truth trajectory is not accurate across conditions.

Watch

Extended reading notes

Core claim

The discovery presented here is that a millimetre-wave FMCW radar can be integrated into an existing urban autonomous-driving platform and released as a usable, well-organised research dataset without sacrificing the other sensor modalities. The radar sweeps are stored losslessly in polar form with per-azimuth timestamps, sweep counters, and validity flags embedded in the image files, and tools are provided to convert them to Cartesian images; raw lidar sweeps are similarly stored with embedded metadata and converted to point clouds. The paper also claims a joint optimisation of visual odometry, visual loop closures, and GPS/INS over all 32 traversals produces radar-frame reference trajectories accurate enough to be released as ground-truth odometry, giving radar motion research a benchmark that does not rely on the vehicle's GPS alone.

Load-bearing premise

The release assumes the radar stayed fixed relative to the cameras and lidars for the whole month of collection; the paper itself notes the sensor extrinsics are not guaranteed to have remained constant, so any unnoticed shift would be inherited by every cross-modal algorithm trained on the data.

Editorial extensions

If this is right

  • Radar odometry, place recognition, and mapping methods can be benchmarked on 32 repeats of the same route, including conditions where vision and lidar degrade.
  • Cross-modal calibration research can use the co-observed radar-lidar-camera data and the provided initial extrinsics as starting points.
  • The optimized radar-frame trajectories give motion-estimation researchers a reference that does not depend on the vehicle's own GPS accuracy.
  • The polar PNG format lets future work feed radar directly into image-based deep learning pipelines without writing a bespoke radar parser.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • Because all 32 traversals follow nearly the same route, one could construct a radar appearance-change benchmark by measuring, point-by-point, how the same static scene renders under rain, fog, and sun; the paper does not calculate these statistics.
  • The embedded per-azimuth timestamps and sweep counters make the radar a self-timed sensor, so a natural extension is fusing radar with lidar at the raw level for motion compensation; this is not explored in the paper.
  • If the published radar trajectory is accepted as ground truth, the dataset could also be used to audit GPS/INS failures in urban canyons, a use the paper does not claim but the co-recorded data permit.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

2 major / 5 minor

Summary. This paper presents the Oxford Radar RobotCar Dataset, a large public dataset for research on millimeter-wave FMCW scanning radar in autonomous driving. The dataset comprises 32 traversals of a central Oxford route in January 2019, totaling 280 km and 4.7 TB, including over 240,000 radar scans from a Navtech CTS350-X, 2.4 million Velodyne HDL-32E scans, six cameras, two 2D lidars, and GPS/INS data. The authors also release extrinsic calibrations, optimized radar odometry, and MATLAB/Python development tools for loading and converting the radar and lidar data. The paper details the sensor platform, data formats, calibration procedure, and the generation of the released 'ground truth' radar odometry via Ceres optimization of visual odometry, FAB-MAP loop closures, and GPS/INS constraints.

Significance. If the dataset performs as described, it is a valuable community resource. It is, to my knowledge, one of the largest public urban FMCW radar datasets, with synchronized camera, lidar, and GPS/INS data that enable research on radar-only and cross-modal state estimation, mapping, and scene understanding under adverse weather. The release of development tools and a downloadable SDK lowers the barrier to entry. The main risk to the dataset's benchmark value is the unvalidated nature of the 'ground truth' radar odometry, which is an optimized estimate rather than an independent reference; this issue is discussed in my major comments.

major comments (2)
  1. [Section VI and Section V-B] The artifact named 'ground truth radar odometry' is an optimized estimate, not an independent measurement. Section VI states that the trajectories are produced by optimizing robust VO, FAB-MAP loop closures, and GPS/INS constraints, and Section V-A notes that GPS/INS accuracy 'varied significantly' over the collection period. The paper itself calls the result 'approximately accurate' in Section VI. Yet the abstract and introduction describe this product as 'ground truth' without qualification, and the data files are named gt/radar_odometry.csv. If a user benchmarks a radar odometry method against this reference, any systematic bias in the optimization (e.g., VO scale drift, loop-closure misassociation, or GPS/INS outage) will be silently transmitted to the evaluation. I request that the authors either (a) provide a quantitative validation of the optimized trajectories against an independent higher-accuracy reference (e.g., post-processed GNSS/INS with survey-grade corrections, or surveyed landmarks), with reported error bounds, or (b) rename the artifact to something like 'optimized radar odometry' and clearly state in the abstract and introduction that it is not independently validated ground truth. As it stands, the naming creates a risk of unsupported benchmark claims in the literature built on this dataset.
  2. [Section V-A] The extrinsic calibration between the new radar and lidar sensors is described as being seeded by manual tape measurements and refined by pose optimization over laser-radar co-observations, but no quantitative validation of the resulting calibration accuracy is reported. Since the dataset is explicitly intended to support cross-modal research (e.g., radar-lidar-camera fusion), an undetected calibration error would propagate into all downstream fused perception and state-estimation work. I ask the authors to provide a calibration-quality metric for at least a representative subset of the traversals, such as reprojection error, point-to-plane residuals, or agreement with a target-based calibration. Even a brief report of the residual magnitudes and their stability across the month of collection would materially strengthen the dataset's usability.
minor comments (5)
  1. [Section VIII] There is a typo in the first sentence: 'We have presented the The Oxford Radar RobotCar Dataset' should read 'We have presented the Oxford Radar RobotCar Dataset'.
  2. [Section III] In the sentence about sensor drivers, there is a double period: 'with the other sensors..' should be 'with the other sensors.'
  3. [Section IV] The phrase 'or higher rotation frequencies' would be clearer as 'or higher rotation rates'.
  4. [Section V-B] In the description of Velodyne raw scan timestamps, it is stated that timestamps are linearly interpolated at each azimuth and that the original received timestamps can be extracted by 'taking every twelfth timestamp.' Clarifying whether the first timestamp in the row corresponds to the first packet or the first azimuth would help users parse the data correctly.
  5. [Section V-A] The paper notes that sensor extrinsics are not guaranteed to have remained constant, but it does not state whether any check was performed after the data collection period to confirm the assumption of 'little degradation.' A simple statement about whether post-hoc checks were made would be helpful.

Circularity Check

0 steps flagged · score 0.0 of 10

Dataset release with no derivation chain; no circularity identified.

full rationale

This paper is a dataset release paper, not a derivation of a result from first principles. It describes the collection, formatting, calibration, and post-processing of raw sensor data. The only processed quantity offered as a reference is the 'ground truth optimised radar odometry' (Section VI), generated by a Ceres optimization over robust visual odometry, FAB-MAP loop closures, and GPS/INS constraints. This is a trajectory estimate produced by applying external algorithms to new data, not a fitted parameter renamed as a prediction, and it is not used as an input to derive the dataset's other contents. The paper is transparent that the GPS/INS solution accuracy 'varied significantly during the course of data collection' and explicitly recommends the optimized odometry as 'the best available solution' rather than claiming an independently validated ground truth. Concerns about whether that reference is accurate enough for benchmarking are legitimate correctness or validation concerns, but they are not circularity: no equation in the paper reduces a claimed output to its own input, and no load-bearing argument rests on a self-citation chain. The citations to the original RobotCar dataset, the VO method, and FAB-MAP are ordinary methodological references to externally published algorithms, and the dataset itself is an externally observable artifact. Therefore no significant circularity is present.

Assumptions & free parameters 0 free parameters · 2 assumptions · 0 invented entities

The dataset paper introduces no new physical entities or free parameters. It relies on two domain assumptions: that the provided extrinsic calibrations are accurate and stable enough for cross-modal research, and that the optimized pose chains are accurate enough to serve as ground truth. Both are explicitly acknowledged as approximate in the text.

assumptions (2)
  • domain assumption Extrinsic calibration values supplied in the SDK are accurate and stable enough for cross-modal fusion.
    Section V-A describes calibrations seeded by manual tape measurements and refined by pose optimization; the paper notes they are not guaranteed constant over the vehicle lifetime. No uncertainty estimates are given.
  • domain assumption The optimized radar odometry poses are accurate enough to serve as reference ground truth.
    Section VI calls the poses 'ground truth' but also 'approximately accurate,' and they are generated from VO, loop closures and GPS/INS constraints without independent validation.

how reviews work

0 comments
Cite this review

Pith. "Pith review of The Oxford Radar RobotCar Dataset: A Radar Extension to the Oxford RobotCar Dataset." pith.science (2026). https://pith.science/paper/O677WIIE

@misc{pith2026190901300,
  author       = {Pith},
  title        = {Pith review of: The Oxford Radar RobotCar Dataset: A Radar Extension to the Oxford RobotCar Dataset},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/O677WIIE}},
  note         = {Machine review of arXiv:1909.01300}
}
read the original abstract

In this paper we present The Oxford Radar RobotCar Dataset, a new dataset for researching scene understanding using Millimetre-Wave FMCW scanning radar data. The target application is autonomous vehicles where this modality is robust to environmental conditions such as fog, rain, snow, or lens flare, which typically challenge other sensor modalities such as vision and LIDAR. The data were gathered in January 2019 over thirty-two traversals of a central Oxford route spanning a total of 280km of urban driving. It encompasses a variety of weather, traffic, and lighting conditions. This 4.7TB dataset consists of over 240,000 scans from a Navtech CTS350-X radar and 2.4 million scans from two Velodyne HDL-32E 3D LIDARs; along with six cameras, two 2D LIDARs, and a GPS/INS receiver. In addition we release ground truth optimised radar odometry to provide an additional impetus to research in this domain. The full dataset is available for download at: ori.ox.ac.uk/datasets/radar-robotcar-dataset

Figures

Figures reproduced from arXiv: 1909.01300 by the authors.

Figure 1
Figure 1. The Oxford Radar RobotCar Dataset for complex and robust [PITH_FULL_IMAGE:figures/full_fig_p001_1.png] view at source ↗
Figure 2
Figure 2. The Radar RobotCar platform (top) and sensor location diagram [PITH_FULL_IMAGE:figures/full_fig_p002_2.png] view at source ↗
Figure 3
Figure 3. Example sensor data from the Navtech CTS350-X radar. Raw radar power power returns in polar form (left) for a full sweep of [PITH_FULL_IMAGE:figures/full_fig_p003_3.png] view at source ↗
Figures from the paper (4 more)
Figure 4
Figure 4. Figure 4: Random pairs of Bumblebee XB3 images (left) with the temporally closest Navtech CTS350-X radar scan (right) from the Oxford Radar RobotCar [PITH_FULL_IMAGE:figures/full_fig_p004_4.png]
Figure 5
Figure 5. Figure 5: Directory layout for the Oxford Radar RobotCar Dataset. When [PITH_FULL_IMAGE:figures/full_fig_p005_5.png]
Figure 6
Figure 6. Figure 6: Optimised radar odometry plotted on OpenStreetMap [19] for [PITH_FULL_IMAGE:figures/full_fig_p006_6.png]
Figure 7
Figure 7. Figure 7: Example sensor data from the Velodyne HDL-32E 3D LIDAR. A raw Velodyne scan (left) stores intensities (top) and ranges (bottom) for [PITH_FULL_IMAGE:figures/full_fig_p007_7.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

24 extracted references · 20 canonical work pages

  1. [17]

    Radar Dataset for Robust Localization and Mapping in Urban Environment,

    Y . S. Park, J. Jeong, Y . Shin, and A. Kim, “Radar Dataset for Robust Localization and Mapping in Urban Environment,” in ICRA 2019 Workshop on Dataset Generation and Benchmarking of SLAM Algorithms for Robotics and VR/AR, Montreal, Canada , 2019

    work page 2019

  2. [1]

    1 year, 1000 km: The Oxford RobotCar dataset,

    W. Maddern, G. Pascoe, C. Linegar, and P. Newman, “1 year, 1000 km: The Oxford RobotCar dataset,” The International Journal of Robotics Research, vol. 36, no. 1, pp. 3–15, 2017

    work page 2017

  3. [2]

    Ford campus vision and lidar data set,

    G. Pandey, J. R. McBride, and R. M. Eustice, “Ford campus vision and lidar data set,” The International Journal of Robotics Research , vol. 30, no. 13, pp. 1543–1552, 2011

    work page 2011

  4. [3]

    Vision meets robotics: The kitti dataset,

    A. Geiger, P. Lenz, C. Stiller, and R. Urtasun, “Vision meets robotics: The kitti dataset,” The International Journal of Robotics Research , vol. 32, no. 11, pp. 1231–1237, 2013

    2013

  5. [4]

    The málaga urban dataset: High-rate stereo and lidar in a realistic urban scenario,

    J.-L. Blanco-Claraco, F.-Á. Moreno-Dueñas, and J. González-Jiménez, “The málaga urban dataset: High-rate stereo and lidar in a realistic urban scenario,” The International Journal of Robotics Research , vol. 33, no. 2, pp. 207–214, 2014

    work page 2014

  6. [5]

    The cityscapes dataset for semantic urban scene understanding,

    M. Cordts, M. Omran, S. Ramos, T. Rehfeld, M. Enzweiler, R. Be- nenson, U. Franke, S. Roth, and B. Schiele, “The cityscapes dataset for semantic urban scene understanding,” in Proceedings of the IEEE conference on computer vision and pattern recognition , 2016, pp. 3213–3223

    work page 2016

  7. [6]

    Bdd100k: A diverse driving video database with scalable annotation tooling,

    F. Yu, W. Xian, Y . Chen, F. Liu, M. Liao, V . Madhavan, and T. Darrell, “Bdd100k: A diverse driving video database with scalable annotation tooling,” arXiv preprint arXiv:1805.04687 , 2018

    arXiv 2018

  8. [7]

    nuscenes: A multimodal dataset for autonomous driving,

    H. Caesar, V . Bankiti, A. H. Lang, S. V ora, V . E. Liong, Q. Xu, A. Kr- ishnan, Y . Pan, G. Baldan, and O. Beijbom, “nuscenes: A multimodal dataset for autonomous driving,” arXiv preprint arXiv:1903.11027 , 2019

    arXiv 1903

Show all 24 references
  1. [8]

    Lyft level 5 av dataset 2019,

    R. Kesten, M. Usman, J. Houston, T. Pandya, K. Nadhamuni, A. Fer- reira, M. Yuan, B. Low, A. Jain, P. Ondruska, S. Omari, S. Shah, A. Kulkarni, A. Kazakova, C. Tao, L. Platinsky, W. Jiang, and V . Shet, “Lyft level 5 av dataset 2019,” https://level5.lyft.com/dataset/, 2019

    2019

  2. [9]

    Radar slam using visual features,

    J. Callmer, D. Törnqvist, F. Gustafsson, H. Svensson, and P. Carlbom, “Radar slam using visual features,” EURASIP Journal on Advances in Signal Processing, vol. 2011, no. 1, p. 71, 2011

    2011

  3. [10]

    Radar- based perception for autonomous outdoor vehicles,

    G. Reina, J. Underwood, G. Brooker, and H. Durrant-Whyte, “Radar- based perception for autonomous outdoor vehicles,” Journal of Field Robotics, vol. 28, no. 6, pp. 894–913, 2011

    2011

  4. [11]

    Adams, M

    M. Adams, M. D. Adams, and E. Jose, Robotic navigation and mapping with radar . Artech House, 2012

    2012

  5. [12]

    Localization and mapping using only a rotating FMCW radar sensor,

    D. Vivet, P. Checchin, and R. Chapuis, “Localization and mapping using only a rotating FMCW radar sensor,” Sensors, vol. 13, no. 4, pp. 4527–4552, 2013

    2013

  6. [13]

    Landmark based radar slam using graph optimization,

    F. Schuster, C. G. Keller, M. Rapp, M. Haueis, and C. Curio, “Landmark based radar slam using graph optimization,” in 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC). IEEE, 2016, pp. 2559–2564

    2016

  7. [14]

    Precise Ego-Motion Estimation with Millimeter-Wave Radar under Diverse and Challenging Conditions,

    S. H. Cen and P. Newman, “Precise Ego-Motion Estimation with Millimeter-Wave Radar under Diverse and Challenging Conditions,” Proceedings of the 2018 IEEE International Conference on Robotics and Automation , 2018

    2018

  8. [15]

    Radar-only ego-motion estimation in difficult settings via graph matching,

    S. Cen and P. Newman, “Radar-only ego-motion estimation in difficult settings via graph matching,” in Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Montreal, Canada , 2019

    2019

  9. [16]

    Fast Radar Motion Estimation with a Learnt Focus of Attention using Weak Supervision,

    R. Aldera, D. De Martini, M. Gadd, and P. Newman, “Fast Radar Motion Estimation with a Learnt Focus of Attention using Weak Supervision,” in Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Montreal, Canada , 2019

    2019

  10. [18]

    The marulan data sets: Multi-sensor perception in a natural environment with challenging conditions,

    T. Peynot, S. Scheding, and S. Terho, “The marulan data sets: Multi-sensor perception in a natural environment with challenging conditions,” The International Journal of Robotics Research , vol. 29, no. 13, pp. 1602–1607, 2010

    2010

  11. [19]

    Planet dump retrieved from https://planet.osm.org ,

    OpenStreetMap contributors, “Planet dump retrieved from https://planet.osm.org ,” https://www.openstreetmap.org, 2017

    2017

  12. [20]

    Driven to distraction: Self-supervised distractor learning for robust monocular visual odometry in urban environments,

    D. Barnes, W. Maddern, G. Pascoe, and I. Posner, “Driven to distraction: Self-supervised distractor learning for robust monocular visual odometry in urban environments,” in 2018 IEEE International Conference on Robotics and Automation (ICRA) . IEEE, 2018, pp. 1894–1900

    2018

  13. [21]

    FAB-MAP: Probabilistic localization and mapping in the space of appearance,

    M. Cummins and P. Newman, “FAB-MAP: Probabilistic localization and mapping in the space of appearance,” The International Journal of Robotics Research , vol. 27, no. 6, pp. 647–665, 2008

    2008

  14. [22]

    Ceres solver,

    S. Agarwal, K. Mierle, and Others, “Ceres solver,” http://ceres-solver. org

  15. [23]

    Experience based navigation: Theory, practice and implementation,

    W. Churchill, “Experience based navigation: Theory, practice and implementation,” Ph.D. dissertation, University of Oxford, 2012

    2012

  16. [24]

    An Extrinsic Calibration Tool for Lidar, Camera and Radar,

    J. Domhof, J. F. P. Kooij, and D. M. Gavrila, “An Extrinsic Calibration Tool for Lidar, Camera and Radar,” in Proceedings of the IEEE Inter- national Conference on Robotics and Automation (ICRA), Montreal, Canada, 2019 , 2019

    2019

Pith tools

Reviewed August 14, 2026 · model on record in the stance chip above.