Pith. sign in

REVIEW 4 major objections 4 minor 1 cited by

A Comprehensive Review of Reinforcement Learning for Autonomous Driving in the CARLA Simulator

T0 review · 4 major / 4 minor · reviewed 2026-08-04 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read A systematic review of roughly 100 CARLA reinforcement-learning papers maps the field and finds model-free methods dominate, with over 80% of studies using DQN, PPO, SAC, DDPG, or TD3.

desk verdict Useful survey of CARLA RL work, but the headline numbers rest on a selection process that is never described, and the 'peer-reviewed' label does not survive contact with the reference list. read the letter →

arxiv 2509.08221 v1 pith:BZMZCDYF submitted 2025-09-10 cs.RO

Elahe Delavari , Feeza Khan Khanzada , Jaerock Kwon This is my paper
classification cs.RO
keywords reinforcementlearningautonomousdrivingCARLAsimulatormodel-freeRLrewarddesignevaluationmetricssim-to-realtransfersurvey
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper is a survey aiming to give a complete picture of how reinforcement learning is actually used for autonomous driving inside the CARLA simulator. It claims to systematically analyze about 100 peer-reviewed papers, grouping them by algorithmic family, state representation, action space, reward design, terminal conditions, and evaluation metrics. The central quantitative finding is that model-free methods account for over 80% of the surveyed work, while model-based and hybrid approaches are rare. The authors also catalog which sensors, control abstractions, reward terms, and metrics recur, and distill persistent challenges such as sparse rewards, sim-to-real transfer, and limited safety guarantees into open research questions. A sympathetic reader would care because the paper promises a unified map that newcomers can use to orient themselves and that seasoned researchers can use to spot underexplored directions.

What carries the argument

The organizing device is a four-way algorithmic taxonomy—model-free, model-based, hierarchical, and hybrid—combined with design axes for state space (RGB, LiDAR, BEV, semantic maps, kinematics), action space (discrete, continuous, hierarchical), reward terms, terminal conditions, and evaluation metrics. The taxonomy does the work of converting a scattered body of papers into quantitative distributions, such as the over-80% model-free share, the frequency of collision-based rewards, and the concentration of experiments in a small subset of CARLA towns.

What would settle it

A reproducible literature search with explicit inclusion and exclusion criteria across the same databases would settle the central quantitative claims: if a systematically constructed corpus yields a model-free share clearly different from the reported figure, or a different count of unique evaluation metrics, the survey's map of the field would need revision.

Watch

Extended reading notes

Core claim

The paper's central claim is that the CARLA RL literature, sampled as roughly 100 IEEE and ACM papers, can be organized into a taxonomy whose quantitative shape is currently dominated by model-free methods: DQN, PPO, SAC, DDPG, TD3, and variants together appear in more than 80% of studies. The survey further claims that state representations most often rely on front-facing RGB or kinematic vehicle states rather than bird's-eye-view or semantic images; that combined discrete or continuous action spaces are the norm; that collision penalties, speed control, and lane-deviation terms are the most frequent reward components; and that evaluation is split across at least 95 unique metrics, with suc

Load-bearing premise

The survey's quantitative claims rest on the assumption that the roughly 100 papers it selected from IEEE and ACM sources are representative of the peer-reviewed CARLA RL literature, but the paper does not report its search or screening protocol.

Editorial extensions

If this is right

  • If the survey's sample is representative, then model-based and hybrid RL are genuinely underused in CARLA research, suggesting a concrete opening for methods that learn environment dynamics.
  • The prevalence of kinematic and RGB state representations implies that many current policies may not exploit the spatial structure that BEV and semantic inputs provide, which could limit generalization.
  • The identification of 95 unique evaluation metrics means cross-paper comparison is currently fragmented; a move toward standardized metrics would make reported success rates and collision rates more meaningful.
  • The recurring limitations—sparse rewards, sim-to-real gap, weak safety guarantees, and narrow behavior diversity—indicate that progress in CARLA RL depends less on new model-free variants than on addressing these systemic gaps.
  • The survey's town and scenario mapping shows that most experiments concentrate on the simpler official towns, so claims of urban driving competence are often tested only in relatively easy settings.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • A reader should treat the 80% model-free figure as a provisional estimate: the paper reports no search strings, database queries, or inclusion and exclusion criteria, so the sample's representativeness cannot be independently verified from the text.
  • If the sampling premise fails, the quantitative statistics (method shares, reward frequencies, metric counts) could shift even though the individual paper summaries remain accurate; the taxonomy itself would still be a usable map.
  • The implied call for standardized CARLA benchmarks is testable: a future survey could apply a reproducible search protocol to the same databases and check whether the distributions and the 95-metric count are stable.
  • The paper leaves implicit that the same taxonomy could be applied to newer CARLA releases and leaderboard submissions, which would show whether model-free dominance is a stable property of the field or an artifact of the reviewed time window.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 4 minor

Summary. This manuscript is a literature review of reinforcement learning (RL) research conducted in the CARLA simulator. The authors claim to systematically analyze around 100 peer-reviewed papers and organize the field according to algorithmic family (model-free, model-based, hybrid, and alternative methods), state-space representations, action-space designs, reward functions, terminal conditions, evaluation metrics, and CARLA towns/scenarios. The paper reports quantitative prevalence, most notably that over 80% of surveyed works use model-free RL, and identifies persistent challenges and future research directions.

Significance. If the quantitative claims are reliable, the survey would provide a useful map of design choices and evaluation practices in CARLA-based RL, valuable to both newcomers and experienced researchers. The manuscript's strengths include its broad coverage, structured taxonomies in Tables 1-9, explicit discussion of limitations, and useful categorization of rewards, terminal conditions, and evaluation metrics. However, the central value of the paper is an empirical aggregation over an unreported and unverifiable sample. The stress-test concern about the undefined selection protocol is confirmed by the manuscript text: the only inclusion description is 'we consider around 100 papers from IEEE and ACM,' with no search strings, databases, inclusion/exclusion criteria, or list of included papers. As a result, the paper's quantitative conclusions are currently not testable or reproducible.

major comments (4)
  1. [Section 1 (final paragraph) and throughout] The only selection description is 'we consider around 100 papers from IEEE and ACM' (end of Section 1). No search strings, databases, date range, inclusion/exclusion criteria, screening steps, or an enumerated list of included papers are reported. Every aggregate result — the >80% model-free share (Fig. 1), the 95 unique evaluation metrics (§8), and the reward/terminal-condition/town distributions (Figs. 3-5; Tables 5, 7, 9) — depends on this unspecified sample. As written, the quantitative claims are not reproducible. Please add a Methods subsection describing the full protocol and release the list of included papers and per-paper extraction data, e.g., as a supplementary table.
  2. [Abstract / Conclusion vs. Reference list] The abstract and conclusion describe the corpus as 'around 100 peer-reviewed papers,' but numerous cited works are arXiv preprints with no verified peer-reviewed status (e.g., [14], [15], [16], [17], [45], [48], [59], [60], [72], [86], [101], [106], [113], [117], [118], [127]). Some carry comments such as 'Accepted by ECCV 2024' or 'Accepted at CVPR 2020,' but no systematic verification or recording of peer-review status is provided. The 'peer-reviewed' label is therefore unsupported. Please either restrict the corpus to verified peer-reviewed publications or explicitly report preprint status and adjust the claims accordingly.
  3. [§3.1.6 and Tables 5, 2, 3] The extraction tables contain internal errors that undermine confidence in the per-paper categorization. For example, §3.1.6 attributes [69] to 'Weng et al.' but the reference list gives 'Friji et al.'; Table 5 contains duplicated reference indices in the Speed Penalty row ('70, 70, 71, 71') and malformed entries in the Deviation and Travel rows ('101],[14]', '14],[11'); §3.1.2 refers to 'Doe et al. [36]', and reference [36] lacks a title and venue. Please audit every table entry against the cited source and correct the bibliography and in-text attributions.
  4. [§5.1 (Table 2 footnote)] The action-space taxonomy relies on an unvalidated coding rule: 'we categorized the mapping strategy of the papers that has not explicitly mentioned the low level controller as direct.' Since the direct/indirect mapping distinction is a reported finding (Tables 2 and 3), this ad-hoc rule should be stated as a coding decision, the number of papers classified under it should be reported, and a sensitivity check (e.g., second-coder agreement or a re-analysis excluding those papers) should be provided.
minor comments (4)
  1. [§4.3] Heading typo: 'Segmentic' should be 'Semantic'. Also within §4.3, 'beyesian' should be 'Bayesian'.
  2. [Figures 1-5] The figures are word-cloud/pie-style with no numeric axes, counts, or legends defining the meaning of token size/color. Since the manuscript makes quantitative claims, please add exact percentages, counts, or a supplementary table so readers can verify the displayed shares.
  3. [Table 9] The checkmark matrix of scenario types versus CARLA towns has no per-cell citations. It is impossible to tell which references support each town-scenario combination. Please add citations or provide a supplementary table mapping each included paper to the towns and scenarios used.
  4. [Reference list] Several references are incomplete or inconsistently formatted, e.g., [36], [53], [64], and [95] lack titles or venues, and [71] is formatted as an arXiv identifier. A full bibliography consistency pass is needed.

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity: this is an aggregation survey; its quantitative claims are empirical counts over the authors' sample, not derived predictions or fitted outputs.

full rationale

This paper is a literature review and taxonomy of roughly 100 CARLA-based RL papers. It does not derive equations, fit parameters to data, or make predictions from a model. The central quantitative claim—that over 80% of surveyed works are model-free—is an empirical count over the authors' selected sample, presented as a distribution in Fig. 1. That is an aggregation of reported categories, not a quantity defined in terms of the conclusion it supports. Likewise, counts such as '95 unique evaluation metrics' and the reward/terminal-condition distributions are tabulations of the reviewed papers. No step in the paper reduces a 'prediction' to an input by construction, because there are no predictive derivations at all. I checked for self-citation load-bearing: the reference list contains no entries authored by Delavari, Khanzada, or Kwon, so the paper does not import uniqueness or ansatz from the authors' own prior work. The main weakness is sample representativeness: the authors say 'we consider around 100 papers from IEEE and ACM' without reporting search strings, inclusion/exclusion criteria, or a PRISMA-style flow, and several included items are arXiv preprints rather than verified peer-reviewed publications. That is a legitimate threat to the survey's coverage claim, but it is a selection-bias / reproducibility concern, not circularity. The absence of a reported sampling protocol does not make the survey's numerical summaries equivalent to its own inputs by definition. Therefore the appropriate circularity score is 0.

Assumptions & free parameters 0 free parameters · 3 assumptions · 0 invented entities

This review introduces no free parameters or entities. It rests on load-bearing premises: the sampled papers are representative of the CARLA RL literature, the classification rules (including the stated assumption for unmapped controllers) are accurate, and the claimed peer-review status holds.

assumptions (3)
  • domain assumption The ~100 selected papers are representative of the peer-reviewed CARLA RL literature.
    Section 1 states "we consider around 100 papers from IEEE and ACM" without a documented search or inclusion protocol; all quantitative estimates depend on this sample.
  • ad hoc to paper For papers that do not explicitly mention a low-level controller, the action mapping strategy is categorized as direct mapping.
    Footnote in Section 5.1: "In this study we categorized the mapping strategy of the papers that has not explicitly mentioned the low level controller as direct." This affects Tables 2 and 3.
  • domain assumption Papers cited as peer-reviewed are indeed peer-reviewed.
    The abstract claims peer-reviewed papers, but the bibliography includes several arXiv preprints (e.g., refs [14]-[17], [20], [48], [86]) without explicit venue verification.

how reviews work

0 comments
Cite this review

Pith. "Pith review of A Comprehensive Review of Reinforcement Learning for Autonomous Driving in the CARLA Simulator." pith.science (2026). https://pith.science/paper/BZMZCDYF

@misc{pith2026250908221,
  author       = {Pith},
  title        = {Pith review of: A Comprehensive Review of Reinforcement Learning for Autonomous Driving in the CARLA Simulator},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/BZMZCDYF}},
  note         = {Machine review of arXiv:2509.08221}
}
read the original abstract

Autonomous-driving research has recently embraced deep Reinforcement Learning (RL) as a promising framework for data-driven decision making, yet a clear picture of how these algorithms are currently employed, benchmarked and evaluated is still missing. This survey fills that gap by systematically analysing around 100 peer-reviewed papers that train, test or validate RL policies inside the open-source CARLA simulator. We first categorize the literature by algorithmic family model-free, model-based, hierarchical, and hybrid and quantify their prevalence, highlighting that more than 80% of existing studies still rely on model-free methods such as DQN, PPO and SAC. Next, we explain the diverse state, action and reward formulations adopted across works, illustrating how choices of sensor modality (RGB, LiDAR, BEV, semantic maps, and carla kinematics states), control abstraction (discrete vs. continuous) and reward shaping are used across various literature. We also consolidate the evaluation landscape by listing the most common metrics (success rate, collision rate, lane deviation, driving score) and the towns, scenarios and traffic configurations used in CARLA benchmarks. Persistent challenges including sparse rewards, sim-to-real transfer, safety guarantees and limited behaviour diversity are distilled into a set of open research questions, and promising directions such as model-based RL, meta-learning and richer multi-agent simulations are outlined. By providing a unified taxonomy, quantitative statistics and a critical discussion of limitations, this review aims to serve both as a reference for newcomers and as a roadmap for advancing RL-based autonomous driving toward real-world deployment.

Discussion (0). Sign in to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Zero-Human Demonstration End-to-end Autonomous Driving with Trajectory Scorer

    cs.RO 2025-10 conditional novelty 6.0 of 10

    A reward-only offline RL method for trajectory planning in end-to-end autonomous driving achieves state-of-the-art on Navhard and competitive closed-loop HUGSIM performance without imitation learning.

Reference graph

Works this paper leans on

132 extracted references · 52 canonical work pages · cited by 1 Pith paper

  1. [69]

    In: 2020 IEEE Global Conference on Artificial Intelligence and Internet of Things (GCAIoT), pp

    Friji, H., Ghazzai, H., Besbes, H., Massoud, Y.: A DQN-Based Autonomous Car- Following Framework Using RGB-D Frames. In: 2020 IEEE Global Conference on Artificial Intelligence and Internet of Things (GCAIoT), pp. 1–6 (2020). https: //doi.org/10.1109/GCAIoT51063.2020.9345899

    work page arXiv 2020

  2. [14]

    In: Proceedings of the Fifth International Conference on Distributed Artificial Intelligence

    Zhu, Z., Zhang, S., Zhuang, Y., Liu, Y., Liu, M., Gong, Z., Kai, S., Gu, Q., Wang, B., Cheng, S., Wang, X., Hao, J., Yu, Y.: RITA: Boost Driving Simulators with Realistic Interactive Traffic Flow. In: Proceedings of the Fifth International Conference on Distributed Artificial Intelligence. DAI ’23, pp. 1–10. Association for Computing Machinery, New York, ...

    arXiv 2023

  3. [15]

    Li, Q., Jia, X., Wang, S., Yan, J.: Think2Drive: Efficient Reinforcement Learning by Thinking in Latent World Model for Quasi-Realistic Autonomous Driving (in CARLA-v2). arXiv. Comment: Accepted by ECCV 2024 (2024). https://doi. org/10.48550/arXiv.2402.16720

    arXiv doi:10.48550/arxiv.2402.16720 2024

  4. [16]

    Pan, M., Zhu, X., Zheng, Y., Wang, Y., Yang, X.: Model-Based Reinforce- ment Learning with Isolated Imaginations. arXiv. Comment: arXiv admin note: 53 text overlap with arXiv:2205.13817 (2023). https://doi.org/10.48550/arXiv. 2303.14889

    arXiv doi:10.48550/arxiv 2023

  5. [17]

    Cai, P., Wang, H., Huang, H., Liu, Y., Liu, M.: Vision-Based Autonomous Car Racing Using Deep Imitative Reinforcement Learning. arXiv. Comment: 8 pages, 8 figures. IEEE Robotics and Automation Letters (RA-L) & IROS 2021 (2021). https://doi.org/10.48550/arXiv.2107.08325

    work page Pith review arXiv doi:10.48550/arxiv.2107.08325 2021

  6. [45]

    IEEE Transactions on Vehicular Technology73(2), 1567–1581 (2024) https://doi.org/10.1109/TVT

    Deng, Q., Li, R., Hu, Q., Zhao, Y., Li, R.: Context-Aware Meta-RL With Two-Stage Constrained Adaptation for Urban Driving. IEEE Transactions on Vehicular Technology73(2), 1567–1581 (2024) https://doi.org/10.1109/TVT. 56 2023.3312495 . Conference Name: IEEE Transactions on Vehicular Technology. Accessed 2025-01-10

    work page arXiv 2024

  7. [48]

    Zhang, Z., Liniger, A., Dai, D., Yu, F., Gool, L.V.: End-to-End Urban Driving by Imitating a Reinforcement Learning Coach. arXiv. Comment: Published at ICCV 2021 (2021). https://doi.org/10.48550/arXiv.2108.08265

    work page Pith review arXiv doi:10.48550/arxiv.2108.08265 2021

  8. [59]

    arXiv (2022)

    Chekroun, R., Toromanoff, M., Hornauer, S., Moutarde, F.: GRI: General Rein- forced Imitation and Its Application to Vision-Based Autonomous Driving. arXiv (2022). https://doi.org/10.48550/arXiv.2111.08575

    arXiv doi:10.48550/arxiv.2111.08575 2022

  9. [72]

    In: 2021 7th International Conference on Computer and Communications (ICCC), pp

    Liu, Z., Hu, J., Song, T., Huang, Z.: A Methodology Based on Deep Rein- forcement Learning to Autonomous Driving with Double Q-Learning. In: 2021 7th International Conference on Computer and Communications (ICCC), pp. 59 1266–1271 (2021). https://doi.org/10.1109/ICCC54389.2021.9674600

    work page arXiv 2021

  10. [86]

    In: 2023 IEEE/CVF Interna- tional Conference on Computer Vision (ICCV), pp

    Huang, Y., Peng, P., Zhao, Y., Zhai, Y., Xu, H., Tian, Y.: Simoun: Synergizing Interactive Motion-appearance Understanding for Vision-based Reinforcement Learning. In: 2023 IEEE/CVF Interna- tional Conference on Computer Vision (ICCV), pp. 176–185 (2023). https://doi.org/10.1109/ICCV51070.2023.00023 . ISSN: 2380-7504. https://ieeexplore.ieee.org/document/...

    arXiv 2023

  11. [101]

    Wang, G., Niu, H., Zhu, D., Hu, J., Zhan, X., Zhou, G.: A Versatile and Efficient Reinforcement Learning Framework for Autonomous Driving. arXiv. Comment: 8 pages, 6 figures (2022). https://doi.org/10.48550/arXiv.2110.11573

    work page Pith review arXiv doi:10.48550/arxiv.2110.11573 2022

  12. [106]

    In: 2021 7th International Conference on Robotics and Artificial Intelligence, pp

    Wang, J., Zhang, Q., Zhao, D.: Benchmarking Lane-changing Decision- making for Deep Reinforcement Learning. In: 2021 7th International Conference on Robotics and Artificial Intelligence, pp. 26–32. ACM, Guangzhou China (2021). https://doi.org/10.1145/3505688.3505693 . https://dl.acm.org/doi/10.1145/3505688.3505693Accessed 2025-01-10

    work page arXiv 2021

  13. [113]

    A Bayesian Approach to Reinforcement Learning of Vision-Based Vehicular Control

    Gharaee, Z., Holmquist, K., He, L., Felsberg, M.: A Bayesian Approach to Reinforcement Learning of Vision-Based Vehicular Control. arXiv (2021). https: //doi.org/10.48550/arXiv.2104.03807

    work page Pith review arXiv doi:10.48550/arxiv.2104.03807 2021

  14. [117]

    He, X., Yang, L., Lu, C., Li, Z., Gong, J.: Adaptive Decision Making at the Intersection for Autonomous Vehicles Based on Skill Discovery. arXiv. Com- ment: Accepted by IEEE ITSC 2022 (2022). https://doi.org/10.48550/arXiv. 2207.11724

    work page Pith review arXiv doi:10.48550/arxiv.2207.11724 2022

  15. [118]

    In: Artificial Intelligence, vol

    Sutton, R.S., Precup, D., Singh, S.: Between mdps and semi-mdps: A framework for temporal abstraction in reinforcement learning. In: Artificial Intelligence, vol. 112, pp. 181–211 (1999) 64

    1999

  16. [127]

    Boosting Offline Reinforcement Learning for Autonomous Driving with Hierarchical Latent Skills

    Li, Z., Nie, F., Sun, Q., Da, F., Zhao, H.: Boosting Offline Reinforcement Learning for Autonomous Driving with Hierarchical Latent Skills. arXiv (2023). https://doi.org/10.48550/arXiv.2309.13614

    work page Pith review arXiv doi:10.48550/arxiv.2309.13614 2023

  17. [36]

    Accessed 2025-05-06

    Doe, D.M., Chen, D., Han, K., Wang, H., Xie, J., Han, Z.: DSORL: Data source optimization with reinforcement learning scheme for vehicular named data networks24(10), 11225–11237 https://doi.org/10.1109/TITS.2023.3292033 . Accessed 2025-05-06

    arXiv 2023

Show all 132 references
  1. [1]

    Tech- nical Report DOT HS 812 115, U.S

    National Highway Traffic Safety Administration: Critical reasons for crashes investigated in the national motor vehicle crash causation survey. Tech- nical Report DOT HS 812 115, U.S. Department of Transportation (2015). Accessed: 2025-04-09. https://crashstats.nhtsa.dot.gov/A...

    2015

  2. [2]

    Electronic Imaging29(19), 70–76 (2017) https://doi.org/10.2352/issn.2470-1173.2017.19.avm-023

    Sallab, A.E., Abdou, M., Perot, E., Yogamani, S.: Deep reinforcement learning framework for autonomous driving. Electronic Imaging29(19), 70–76 (2017) https://doi.org/10.2352/issn.2470-1173.2017.19.avm-023

    2017

  3. [3]

    In: Proceedings of the 1st Annual Confer- ence on Robot Learning, pp

    Dosovitskiy, A., Ros, G., Codevilla, F., Lopez, A., Koltun, V.: CARLA: An Open Urban Driving Simulator. In: Proceedings of the 1st Annual Confer- ence on Robot Learning, pp. 1–16. PMLR, ??? (2017). ISSN: 2640-3498. https://proceedings.mlr.press/v78/dosovitskiy17a.htmlAccessed ...

    2017

  4. [4]

    In: 2022 IEEE 7th International Conference on Intelligent Transportation Engineer- ing (ICITE), pp

    Wu, Y., Yin, Z., Yu, J., Zhang, M.: Lane Change Decision-Making through Deep Reinforcement Learning with Driver’s Inputs. In: 2022 IEEE 7th International Conference on Intelligent Transportation Engineer- ing (ICITE), pp. 314–319 (2022). https://doi.org/10.1109/ICITE56321.2022...

    2022

  5. [5]

    In: Advances in Robotics - 5th International Conference of The Robotics Society, pp

    Goel, A., Chauhan, S.: Adaptive Look-ahead distance for Pure Pursuit Controller with Deep Reinforcement Learning Techniques. In: Advances in Robotics - 5th International Conference of The Robotics Society, pp. 1–

  6. [6]

    https://doi.org/10.1145/3478586.3478600

    ACM, Kanpur India (2021). https://doi.org/10.1145/3478586.3478600 . https://dl.acm.org/doi/10.1145/3478586.3478600Accessed 2025-01-10

    2021

  7. [7]

    In: Proceedings of the 4th Inter- national Conference on Smart City Applications, pp

    Youssef, F., Houda, B.: Deep reinforcement learning with external control: self-driving car application. In: Proceedings of the 4th Inter- national Conference on Smart City Applications, pp. 1–7. ACM, Casablanca Morocco (2019). https://doi.org/10.1145/3368756.3369038 . https:/...

    2019

  8. [8]

    In: 2021 IEEE Winter Conference on Applica- tions of Computer Vision Workshops (W ACVW), pp

    Carton, F., Filliat, D., Rabarisoa, J., Pham, Q.C.: Using Semantic Infor- mation to Improve Generalization of Reinforcement Learning Policies for Autonomous Driving. In: 2021 IEEE Winter Conference on Applica- tions of Computer Vision Workshops (W ACVW), pp. 144–151. IEEE, Wai...

    2021

  9. [9]

    In: 2024 IEEE/SICE International Symposium on System Integration (SII), pp

    Mohammed, S., Argun, A., Ascheid, G.: A Unified Approach to Autonomous Driving in a High-Fidelity Simulator Using Vision- Based Reinforcement Learning. In: 2024 IEEE/SICE International Symposium on System Integration (SII), pp. 1093–1098 (2024). 52 https://doi.org/10.1109/SII5...

    2024

  10. [10]

    In: 2022 Tenth International Symposium on Com- puting and Networking Workshops (CANDAR W), pp

    Zhang, M., Nakamoto, Y.: Toward ensuring better learning performance in reinforcement learning. In: 2022 Tenth International Symposium on Com- puting and Networking Workshops (CANDAR W), pp. 134–139 (2022). https://doi.org/10.1109/CANDAR W57323.2022.00037 . ISSN: 2832-1324. ht...

    2022

  11. [11]

    In: 2022 6th CAA International Conference on Vehicular Control and Intelligence (CVCI), pp

    Yang, Z., Pei, X., Xu, J., Zhang, X., Xi, W.: Decision-making in Autonomous Driving by Reinforcement Learning Combined with Planning & control. In: 2022 6th CAA International Conference on Vehicular Control and Intelligence (CVCI), pp. 1–6 (2022). https://doi.org/10.1109/CVCI5...

    2022

  12. [12]

    IEEE Transactions on Vehicular Tech- nology72(9), 11213–11226 (2023) https://doi.org/10.1109/TVT.2023.3266940

    Wang, J., Sun, H., Zhu, C.: Vision-Based Autonomous Driving: A Hierarchical Reinforcement Learning Approach. IEEE Transactions on Vehicular Tech- nology72(9), 11213–11226 (2023) https://doi.org/10.1109/TVT.2023.3266940 . Conference Name: IEEE Transactions on Vehicular Technolo...

    2023

  13. [18]

    Chen, D., Koltun, V., Kr¨ ahenb¨ uhl, P.: Learning to Drive from a World on Rails. arXiv. Comment: Paper published in ICCV 2021(Oral); Code and data available at: https://dotchen.github.io/world on rails/ (2021). https://doi.org/10.48550/ arXiv.2105.00636

    2021 doi arXiv

  14. [19]

    IEEE Trans- actions on Intelligent Vehicles, 1–14 (2024) https://doi.org/10.1109/TIV.2024

    Wang, C., Zhou, S., Wang, L., Lu, Z., Wu, C., Wen, X., Shou, G.: Autonomous Driving via Knowledge-Enhanced Safe Reinforcement Learning. IEEE Trans- actions on Intelligent Vehicles, 1–14 (2024) https://doi.org/10.1109/TIV.2024. 3412916

    2024 doi

  15. [20]

    IEEE Transactions on Neural Networks and Learning Systems32(12), 5379– 5391 (2021) https://doi.org/10.1109/TNNLS.2021.3109284

    Huang, C., Zhang, R., Ouyang, M., Wei, P., Lin, J., Su, J., Lin, L.: Deduc- tive Reinforcement Learning for Visual Autonomous Urban Driving Navigation. IEEE Transactions on Neural Networks and Learning Systems32(12), 5379– 5391 (2021) https://doi.org/10.1109/TNNLS.2021.3109284

    2021

  16. [21]

    Yurtsever, E., Capito, L., Redmill, K., Ozguner, U.: Integrating Deep Reinforce- ment Learning with Model-based Path Planners for Automated Driving. arXiv. Comment: 6 pages, 5 figures. Accepted for IEEE Intelligent Vehicles Symposium 2020 (2020). https://doi.org/10.48550/arXiv...

    2020 doi arXiv

  17. [22]

    In: ICRA Workshop on Open Source Software, vol

    Quigley, M., Conley, K., Gerkey, B., Faust, J., Foote, T., Leibs, J., Wheeler, R., Ng, A.Y.,et al.: Ros: an open-source robot operating system. In: ICRA Workshop on Open Source Software, vol. 3, p. 5 (2009). Kobe

    2009

  18. [23]

    https://github.com/autowarefoundation/autoware

    Autoware Foundation: Autoware: Open-source software for autonomous driving. https://github.com/autowarefoundation/autoware. Accessed: June 2025

    2025

  19. [24]

    https://arxiv.org/abs/2101.05337

    Kaur, P., Taghavi, S., Tian, Z., Shi, W.: A Survey on Simulators for Testing Self-Driving Cars (2021). https://arxiv.org/abs/2101.05337

    2021 arXiv

  20. [25]

    https://arxiv.org/abs/2005.03778

    Rong, G., Shin, B.H., Tabatabaee, H., Lu, Q., Lemke, S., Moˇ zeiko, M., Boise, E., Uhm, G., Gerow, M., Mehta, S., Agafonov, E., Kim, T.H., Sterner, E., Ushiroda, K., Reyes, M., Zelenkovsky, D., Kim, S.: LGSVL Simulator: A High Fidelity Simulator for Autonomous Driving (2020). ...

    2020 arXiv

  21. [26]

    In: 25th Pan-Hellenic Conference on Informatics, pp

    Chronis, C., Sardianos, C., Varlamis, I., Michail, D., Tserpes, K.: A driving profile recommender system for autonomous driving using sensor data and reinforcement learning. In: 25th Pan-Hellenic Conference on Informatics, pp. 33–38. ACM, Volos Greece (2021). https://doi.org/1...

    2021

  22. [27]

    In: 2023 IEEE International Conference on Robotics and Automation (ICRA), pp

    Udatha, S., Lyu, Y., Dolan, J.: Reinforcement learning with probabilis- tically safe control barrier functions for ramp merging. In: 2023 IEEE International Conference on Robotics and Automation (ICRA), pp. 5625–

    2023

  23. [28]

    In: Proceedings of the 31st Interna- tional Conference on Machine Learning, pp

    Silver, D., Lever, G., Heess, N., Degris, T., Wierstra, D., Riedmiller, M.: Deterministic Policy Gradient Algorithms. In: Proceedings of the 31st Interna- tional Conference on Machine Learning, pp. 387–395. PMLR, ??? (2014). ISSN: 1938-7228.https://proceedings.mlr.press/v32/si...

    2014

  24. [29]

    Lillicrap, T.P., Hunt, J.J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., Wierstra, D.: Continuous control with deep reinforcement learning. arXiv. arXiv:1509.02971 [cs] (2019). https://doi.org/10.48550/arXiv.1509.02971 . http: //arxiv.org/abs/1509.02971 Accessed 2...

    2019 doi arXiv

  25. [30]

    In: 2020 IEEE International Conference on Robotics and Automation (ICRA), pp

    Peng, M., Gong, Z., Sun, C., Chen, L., Cao, D.: Imitative reinforcement learn- ing fusing vision and pure pursuit for self-driving. In: 2020 IEEE International Conference on Robotics and Automation (ICRA), pp. 3298–3304 (2020). IEEE

    2020

  26. [31]

    Nature 518(7540), 529–533 (2015) https://doi.org/10.1038/nature14236

    Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A.A., Veness, J., Bellemare, M.G., Graves, A., Riedmiller, M., Fidjeland, A.K., Ostrovski, G., Petersen, S., Beattie, C., Sadik, A., Antonoglou, I., King, H., Kumaran, D., Wierstra, D., Legg, S., Hassabis, D.: Human-level control th...

    2015 doi

  27. [32]

    In: 2022 IEEE International Conference on Real-time Computing and Robotics (RCAR), pp

    Fu, W., Li, Y., Ye, Z., Liu, Q.: Decision Making for Autonomous Driving Via Multimodal Transformer and Deep Reinforcement Learning. In: 2022 IEEE International Conference on Real-time Computing and Robotics (RCAR), pp. 481–486 (2022). https://doi.org/10.1109/RCAR54675.2022.9872180

    2022

  28. [33]

    Multimedia Tools and Applications81(3), 3553–3576 (2022) https://doi.org/10.1007/s11042-021-11437-3

    P´ erez-Gil,´O., Barea, R., L´ opez-Guill´ en, E., Bergasa, L.M., G´ omez-Hu´ elamo, C., Guti´ errez, R., D ´ ıaz-D ´ ıaz, A.: Deep reinforcement learning based control for Autonomous Vehicles in CARLA. Multimedia Tools and Applications81(3), 3553–3576 (2022) https://doi.org/1...

    2022 doi

  29. [34]

    In: ICMLCA 2021; 2nd International Conference on Machine Learning and 55 Computer Application, pp

    Zhang, B., Xu, C., Su, Y., Xu, J.: A self-learning lane keeping algorithm. In: ICMLCA 2021; 2nd International Conference on Machine Learning and 55 Computer Application, pp. 1–7 (2021)

    2021

  30. [35]

    In: 2021 IEEE International Conference on Real-time Computing and Robotics (RCAR), pp

    Chen, M., Li, Y., Liu, Q., Lv, S., Xu, Y., Liu, Y.: Towards Autonomous Driving Decision by Combining Self-attention and Deep Reinforcement Learn- ing. In: 2021 IEEE International Conference on Real-time Computing and Robotics (RCAR), pp. 1110–1115 (2021). https://doi.org/10.11...

    2021

  31. [37]

    In: 2023 IEEE International Symposium on Robotic and Sensors Environments (ROSE), pp

    Tsai, J., Chang, Y.-T., Chuang, P.-H., You, Z.: An Autonomous Vehicle- Following Technique for Self-Driving Cars Based on the Semantic Segmentation Technique. In: 2023 IEEE International Symposium on Robotic and Sensors Environments (ROSE), pp. 1–7 (2023). https://doi.org/10.1...

    2023

  32. [38]

    Accessed 2025-05-06

    Ahmed, M., Abobakr, A., Lim, C.P., Nahavandi, S.: Policy-based reinforcement learning for training autonomous driving agents in urban areas with affor- dance learning23(8), 12562–12571 https://doi.org/10.1109/TITS.2021.3115235 . Accessed 2025-05-06

    2021

  33. [39]

    In: 2022 International Conference on Advanced Robotics and Mechatronics (ICARM), pp

    Li, L., Jiang, W., Shi, M., Wu, T.: Dynamic target following control for autonomous vehicles with deep reinforcement learning. In: 2022 International Conference on Advanced Robotics and Mechatronics (ICARM), pp. 386–

    2022

  34. [40]

    Schulman, J., Wolski, F., Dhariwal, P., Radford, A., Klimov, O.: Proximal Policy Optimization Algorithms. arXiv. arXiv:1707.06347 [cs] (2017). https:// doi.org/10.48550/arXiv.1707.06347 . http://arxiv.org/abs/1707.06347 Accessed 2025-03-27

    2017 doi arXiv

  35. [41]

    In: 2023 International Joint Conference on Neural Networks (IJCNN), pp

    Deng, Q., Zhao, Y., Li, R., Hu, Q., Liu, T., Li, R.: Context - Enhanced Meta-Reinforcement Learning with Data-Reused Adapta- tion for Urban Autonomous Driving. In: 2023 International Joint Conference on Neural Networks (IJCNN), pp. 1–8 (2023). https: //doi.org/10.1109/IJCNN545...

    2023

  36. [42]

    In: 2021 26th International Conference on Automation and Computing (ICAC), pp

    Cheng, S., Wang, N., Chen, F., Pipe, T.: Longitudinal Driv- ing Skills Transfer from Driver to Smart Vehicle. In: 2021 26th International Conference on Automation and Computing (ICAC), pp. 1–6 (2021). https://doi.org/10.23919/ICAC50006.2021.9594177 . https://ieeexplore.ieee.or...

    2021

  37. [43]

    In: 2024 IEEE 13th Data Driven Control and Learning Systems Conference (DDCLS), pp

    Zhao, J., Zhao, Y., Li, W., Zeng, C.: End-to-End Autonomous Driving Algo- rithm Based on PPO and Its Implementation. In: 2024 IEEE 13th Data Driven Control and Learning Systems Conference (DDCLS), pp. 1852–1858 (2024). https://doi.org/10.1109/DDCLS61622.2024.10606596 . ISSN: 2...

    2024

  38. [44]

    In: 2023 38th Youth Academic Annual Conference of Chinese Association of Automation (YAC), pp

    Wu, Y., Yuan, X.: Proximal Policy Optimization-based Reinforcement Learn- ing for End-to-end Autonomous Driving. In: 2023 38th Youth Academic Annual Conference of Chinese Association of Automation (YAC), pp. 844–849 (2023). https://doi.org/10.1109/YAC59482.2023.10401381 . ISSN...

    2023

  39. [46]

    In: 2021 IEEE International Intelligent Trans- portation Systems Conference (ITSC), pp

    Agarwal, T., Arora, H., Schneider, J.: Learning Urban Driving Policies using Deep Reinforcement Learning. In: 2021 IEEE International Intelligent Trans- portation Systems Conference (ITSC), pp. 607–614 (2021). https://doi.org/10. 1109/ITSC48978.2021.9564412

    2021

  40. [47]

    Trumpp, R., B¨ uchner, M., Valada, A., Caccamo, M.: Efficient Learning of Urban Driving Policies Using Bird’s-Eye-View State Representations. arXiv. Comment: IEEE International Conference on Intelligent Transportation Systems 2023 (2023). https://doi.org/10.48550/arXiv.2305.19904

    2023 doi arXiv

  41. [49]

    In: 2021 IEEE International Conference on Image Processing (ICIP), pp

    Anzalone, L., Barra, S., Nappi, M.: Reinforced Curriculum Learning For Autonomous Driving In Carla. In: 2021 IEEE International Conference on Image Processing (ICIP), pp. 3318–3322 (2021). https://doi.org/10.1109/ICIP42928. 2021.9506673

    2021

  42. [50]

    In: 2021 Latin American Robotics Symposium (LARS), 2021 Brazilian Symposium on Robotics (SBR), and 2021 Workshop on Robotics in Education (WRE), pp

    Silva, V.A.S., Grassi, V.: Addressing Lane Keeping and Intersections using Deep Conditional Reinforcement Learning. In: 2021 Latin American Robotics Symposium (LARS), 2021 Brazilian Symposium on Robotics (SBR), and 2021 Workshop on Robotics in Education (WRE), pp. 330–335 (202...

    2021

  43. [51]

    Xing, J., Nagata, T., Chen, K., Zou, X., Neftci, E., Krichmar, J.L.: Domain Adaptation In Reinforcement Learning Via Latent Unified State Representation. arXiv. Comment: Accepted by AAAI 2021; Fixed a typo in equation 3 (2021). https://doi.org/10.48550/arXiv.2102.05714

    2021 doi arXiv

  44. [53]

    Jin, Y.-L., Ji, Z.-Y., Zeng, D., Zhang, X.-P.: VWP:an efficient DRL-based autonomous driving model26, 2096–2108 https://doi.org/10.1109/TMM.2022. 3177942 . Accessed 2025-05-06

    doi

  45. [54]

    In: 2023 IEEE 35th International Conference on Tools with Arti- ficial Intelligence (ICTAI), pp

    Albilani, M., Bouzeghoub, A.: Guided hierarchical reinforcement learning for safe urban driving. In: 2023 IEEE 35th International Conference on Tools with Arti- ficial Intelligence (ICTAI), pp. 746–753. https://doi.org/10.1109/ICTAI59109. 2023.00115 . ISSN: 2375-0197. https://...

    2023

  46. [55]

    In: 2024 IEEE Intelli- gent Vehicles Symposium (IV), pp

    Guti´ errez-Moreno, R., Barea, R., L´ opez-Guill´ en, E., Arango, F., Revenga, P., Bergasa, L.M.: Decision Making for Autonomous Driving Stack: Shortening the Gap from Simulation to Real-World Implementations. In: 2024 IEEE Intelli- gent Vehicles Symposium (IV), pp. 3107–3113 ...

    2024

  47. [56]

    https://ieeexplore.ieee.org/document/10422486 Accessed 2025-05-06

    2025

  48. [57]

    In: 2021 28th IEEE International Conference on Electronics, Circuits, and Systems (ICECS), pp

    Muhammed, A., Essam, H., Alber, B., Samuel, K., Muhammed, H., Wagdy, M., Khaled, N., Fawzy, H., Tarek, A., AbdelSalam, M., El-Kharashi, M.W.: Develop- ing AI Agent with Functional Mockup Units for Car Autonomous Navigation. In: 2021 28th IEEE International Conference on Electr...

    2021

  49. [61]

    In: 2024 2nd International Conference on Electrical Engineering and Automatic Control (ICEEAC), pp

    Marouane, C., Saad, B.: Safe Navigation Based on Deep Q-Network Algorithm Using an Improved Control Architecture. In: 2024 2nd International Conference on Electrical Engineering and Automatic Control (ICEEAC), pp. 1–6 (2024). https://doi.org/10.1109/ICEEAC61226.2024.10576248

    2024

  50. [62]

    In: 2022 International Conference on Innovation and Intelligence for Informatics, Computing, and Technologies (3ICT), pp

    Elallid, B.B., Benamar, N., Mrani, N., Rachidi, T.: Dqn-based reinforcement learning for vehicle control of autonomous vehicles interacting with pedestrians. In: 2022 International Conference on Innovation and Intelligence for Informatics, Computing, and Technologies (3ICT), p...

    2022

  51. [63]

    In: 2023 International Wireless Communications and Mobile Computing (IWCMC), pp

    Elallid, B.B., Bagaa, M., Benamar, N., Mrani, N.: A Reinforcement Learning Based Approach for Controlling Autonomous Vehicles in Complex Scenarios. In: 2023 International Wireless Communications and Mobile Computing (IWCMC), pp. 1358–1364 (2023). https://doi.org/10.1109/IWCMC5...

    2023

  52. [64]

    Toromanoff, M., Wirbel, E., Moutarde, F.: End-to-End Model-Free Reinforce- ment Learning for Urban Driving Using Implicit Affordances. arXiv. Comment: Accepted at main conference of CVPR 2020 (2020). https://doi.org/10.48550/ arXiv.1911.10868

    2020 doi arXiv

  53. [65]

    In: 2021 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp

    Ahmed, M., Lim, C.P., Nahavandi, S.: A Deep Q-Network Reinforcement Learning-Based Model for Autonomous Driving. In: 2021 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 739–744 (2021). https://doi.org/10.1109/SMC52423.2021.9658892

    2021

  54. [66]

    In: 2023 International Seminar on Intelligent Technology and Its Applications (ISITIA), pp

    Muhtadin, Meliaz, M.R., Dikairono, R., Purnama, I.K.E., Purnomo, M.H.: Deep Reinforcement Learning Control Strategy at Roundabout for i-CAR Autonomous Car. In: 2023 International Seminar on Intelligent Technology and Its Applications (ISITIA), pp. 473–478 (2023). https://doi.o...

    2023

  55. [67]

    IEEE Sensors Journal22(5), 4687–4696 (2022) https://doi.org/10

    Li, G., Lin, S., Li, S., Qu, X.: Learning Automated Driving in Complex Inter- section Scenarios Based on Camera Sensors: A Deep Reinforcement Learning Approach. IEEE Sensors Journal22(5), 4687–4696 (2022) https://doi.org/10. 1109/JSEN.2022.3146307

    2022

  56. [68]

    May, J., Poudel, S., Hamdan, S., Poudel, K., Vargas, J.: Using the CARLA Sim- ulator to Train A Deep Q Self-Driving Car to Control a Real-World Counterpart on A College Campus

  57. [70]

    In: 2023 24th International Symposium on Quality Elec- tronic Design (ISQED), pp

    Clemmons, J., Jin, Y.-F.: Reinforcement Learning-Based Guidance of Autonomous Vehicles. In: 2023 24th International Symposium on Quality Elec- tronic Design (ISQED), pp. 1–6 (2023). https://doi.org/10.1109/ISQED57927. 2023.10129362

    2023

  58. [71]

    https://arxiv.org/abs/2210.16567

    [2210.16567] DeFIX: Detecting and Fixing Failure Scenarios with Rein- forcement Learning in Imitation Learning Based Autonomous Driving. https://arxiv.org/abs/2210.16567

    arXiv

  59. [73]

    https://dl.acm.org/doi/10.1145/3605098.3635992 Accessed 2025-05-06

    Explainable Artificial Intelligence (XAI) Approach for Reinforcement Learning Systems|Proceedings of the 39th ACM/SIGAPP Symposium on Applied Com- puting. https://dl.acm.org/doi/10.1145/3605098.3635992 Accessed 2025-05-06

    2025

  60. [74]

    In: 2020 11th International Conference on Information and Communication Systems (ICICS), pp

    Hishmeh, L., Awad, F.: Deer in The Headlights: Short Term Planning via Reinforcement Learning Algorithms for Autonomous Vehicles. In: 2020 11th International Conference on Information and Communication Systems (ICICS), pp. 255–260 (2020). https://doi.org/10.1109/ICICS49469.2020.239561

    2020

  61. [75]

    Neural computation3(1), 88–97 (1991)

    Pomerleau, D.A.: Efficient training of artificial neural networks for autonomous navigation. Neural computation3(1), 88–97 (1991)

    1991

  62. [76]

    Deshpande, N., Vaufreydaz, D., Spalanzani, A.: Navigation In Urban Envi- ronments Amongst Pedestrians Using Multi-Objective Deep Reinforcement Learning. arXiv. https://doi.org/10.48550/arXiv.2110.05205 . http://arxiv.org/ abs/2110.05205 Accessed 2025-05-06

    2025 doi arXiv

  63. [77]

    Advances in neural information processing systems30(2017)

    Li, Y., Song, J., Ermon, S.: Infogail: Interpretable imitation learning from visual demonstrations. Advances in neural information processing systems30(2017)

    2017

  64. [78]

    Haarnoja, T., Zhou, A., Abbeel, P., Levine, S.: Soft Actor-Critic: Off-Policy Max- imum Entropy Deep Reinforcement Learning with a Stochastic Actor. arXiv. https://doi.org/10.48550/arXiv.1801.01290 . http://arxiv.org/abs/1801.01290 Accessed 2025-07-07

    2025 doi arXiv

  65. [79]

    In: 2021 International Joint Conference on Neural Networks (IJCNN), pp

    Savari, M., Choe, Y.: Online Virtual Training in Soft Actor- Critic for Autonomous Driving. In: 2021 International Joint Conference on Neural Networks (IJCNN), pp. 1–8 (2021). https: //doi.org/10.1109/IJCNN52387.2021.9533791 . ISSN: 2161-4407. https://ieeexplore.ieee.org/docum...

    2021

  66. [80]

    Advances in neural information processing systems29(2016)

    Ho, J., Ermon, S.: Generative adversarial imitation learning. Advances in neural information processing systems29(2016)

    2016

  67. [81]

    In: 2023 11th RSI International Conference on Robotics and Mechatronics (ICRoM), pp

    Aghdasian, A.J., Ardakani, A.H., Aqabakee, K., Abdollahi, F.: Autonomous Driving using Residual Sensor Fusion and Deep Rein- forcement Learning. In: 2023 11th RSI International Conference on Robotics and Mechatronics (ICRoM), pp. 265–270 (2023). https: //doi.org/10.1109/ICRoM6...

    2023 arXiv

  68. [82]

    Advances in neural information processing systems31(2018)

    Song, J., Ren, H., Sadigh, D., Ermon, S.: Multi-agent generative adversarial imitation learning. Advances in neural information processing systems31(2018)

    2018

  69. [83]

    IEEE Access9, 93152–93164 (2021) https://doi.org/10.1109/ACCESS.2021.3085142

    Kong, S.-H., Nahrendra, I.M.A., Paek, D.-H.: Enhanced Off-Policy Reinforce- ment Learning With Focused Experience Replay. IEEE Access9, 93152–93164 (2021) https://doi.org/10.1109/ACCESS.2021.3085142

    2021

  70. [84]

    In: 2023 7th CAA International Conference on Vehicular Control and Intelligence (CVCI), pp

    Wu, Y., Wang, L., Lu, X., Wu, Y., Zhang, H.: Reinforcement Learning- based Autonomous Parking with Expert Demonstrations. In: 2023 7th CAA International Conference on Vehicular Control and Intelligence (CVCI), pp. 1–6 (2023). https://doi.org/10.1109/CVCI59596.2023.10397136 .ht...

    2023

  71. [85]

    In: 2023 IEEE Latin American Conference on Computational Intelligence (LA-CCI), pp

    Tong, Z., Ayala, A., Sandoval, E.B., Cruz, F.: Urban Autonomous Driving of Emergency Vehicles with Reinforcement Learning. In: 2023 IEEE Latin American Conference on Computational Intelligence (LA-CCI), pp. 1–6 (2023). https://doi.org/10.1109/LA-CCI58595.2023.10409469

    2023

  72. [87]

    In: 2023 IEEE International Conference on Robotics and Automa- tion (ICRA), pp

    Igoe, C., Pande, S., Venkatraman, S., Schneider, J.: Multi-Alpha Soft Actor- Critic: Overcoming Stochastic Biases in Maximum Entropy Reinforcement Learning. In: 2023 IEEE International Conference on Robotics and Automa- tion (ICRA), pp. 7162–7168 (2023). https://doi.org/10.110...

    2023

  73. [88]

    In: 2022 IEEE 95th Vehicular Technol- ogy Conference: (VTC2022-Spring), pp

    Jo, S.-B., Kim, P.-S., Jeong, H.-Y.: An Integrated Reward Function of End-to-End Deep Reinforcement Learning for the Longitudinal and Lateral Control of Autonomous Vehicles. In: 2022 IEEE 95th Vehicular Technol- ogy Conference: (VTC2022-Spring), pp. 1–5 (2022). https://doi.org...

    2022

  74. [89]

    In: Proceedings of the 35th International Confer- ence on Machine Learning, pp

    Fujimoto, S., Hoof, H., Meger, D.: Addressing function approximation error in actor-critic methods. In: Proceedings of the 35th International Confer- ence on Machine Learning, pp. 1587–1596. PMLR. ISSN: 2640-3498. https: //proceedings.mlr.press/v80/fujimoto18a.html Accessed 2025-07-07

    2025

  75. [90]

    arXiv (2022)

    Han, Y., Yilmaz, A.: Learning to Drive Using Sparse Imitation Reinforcement Learning. arXiv (2022). https://doi.org/10.48550/arXiv.2205.12128

    2022 doi arXiv

  76. [91]

    In: 2023 5th Inter- national Conference on Robotics, Intelligent Control and Artificial Intelli- gence (RICAI), pp

    Xu, T., Wang, Q., Yang, Y., Meng, J., Wang, Y.: End-to-End Autonomous Driving Decision-Making Solution Based on Pri-TD3. In: 2023 5th Inter- national Conference on Robotics, Intelligent Control and Artificial Intelli- gence (RICAI), pp. 525–529 (2023). https://doi.org/10.1109/...

    2023

  77. [92]

    In: 2023 IEEE Intelli- gent Vehicles Symposium (IV), pp

    Gupta, D., Klusch, M.: HyLEAR: Hybrid deep reinforcement learning and planning for safe and comfortable automated driving. In: 2023 IEEE Intelli- gent Vehicles Symposium (IV), pp. 1–8. https://doi.org/10.1109/IV55152.2023. 10186781 . ISSN: 2642-7214. https://ieeexplore.ieee.or...

    2023

  78. [93]

    In: 2023 International Conference on Innovation and Intelligence for Informatics, Computing, and Technologies (3ICT), pp

    Elallid, B.B., El Alaoui, H., Benamar, N.: Deep reinforcement learning for autonomous vehicle intersection navigation. In: 2023 International Conference on Innovation and Intelligence for Informatics, Computing, and Technologies (3ICT), pp. 308–313 (2023). IEEE

    2023

  79. [94]

    In: 2023 China Automation Congress (CAC), pp

    Jia, R., Lu, S., Xie, W., Dai, L., Wu, Q., Zhang, J.: Safe Reinforcement Learn- ing for Autonomous Lane-Changing: Considering the Collision Time and Lane Boundary Constraints. In: 2023 China Automation Congress (CAC), pp. 3484– 3489 (2023). https://doi.org/10.1109/CAC59555.202...

    2023

  80. [95]

    Accessed 2025-05-06

    Li, S., Peng, K., Hui, F., Li, Z., Wei, C., Wang, W.: A decision-making approach for complex unsignalized intersection by deep reinforcement learning73(11), 62 16134–16147 https://doi.org/10.1109/TVT.2024.3408917 . Accessed 2025-05-06

    2024

  81. [96]

    In: 2023 IEEE 26th International Conference on Intelligent Transportation Systems (ITSC), pp

    Liao, Y., Yu, G., Chen, P., Zhou, B., Li, H.: Lateral Motion Con- trol for Obstacle Avoidance in Autonomous Driving Based on Deep Reinforcement Learning. In: 2023 IEEE 26th International Conference on Intelligent Transportation Systems (ITSC), pp. 5229–5234 (2023). https://doi...

    2023

  82. [97]

    In: 2023 IEEE 3rd International Conference on Digital Twins and Parallel Intelligence (DTPI), pp

    Qi, H., Hou, E., Liu, G., Ye, P.: Cognitive Reinforcement Learning For Autonomous Driving. In: 2023 IEEE 3rd International Conference on Digital Twins and Parallel Intelligence (DTPI), pp. 1–5 (2023). https://doi.org/10. 1109/DTPI59677.2023.10365456

    2023

  83. [98]

    IEEE Trans- actions on Cognitive and Developmental Systems16(5), 1759–1774 (2024) https://doi.org/10.1109/TCDS.2024.3384269

    Liu, Y., Zhang, Q., Gao, Y., Zhao, D.: Deep-Reinforcement-Learning-Based Driving Policy at Intersections Utilizing Lane Graph Networks. IEEE Trans- actions on Cognitive and Developmental Systems16(5), 1759–1774 (2024) https://doi.org/10.1109/TCDS.2024.3384269

    2024

  84. [99]

    In: 2019 18th IEEE International Conference On Machine Learning And Applications (ICMLA), pp

    Jaafra, Y., Deruyver, A., Laurent, J.L., Naceur, M.S.: Context-Aware Autonomous Driving Using Meta-Reinforcement Learning. In: 2019 18th IEEE International Conference On Machine Learning And Applications (ICMLA), pp. 450–455 (2019). https://doi.org/10.1109/ICMLA.2019.00084

    2019

  85. [100]

    IEEE Trans- actions on Vehicular Technology72(3), 2921–2935 (2023) https://doi.org/10

    Khalil, Y.H., Mouftah, H.T.: Exploiting Multi-Modal Fusion for Urban Autonomous Driving Using Latent Deep Reinforcement Learning. IEEE Trans- actions on Vehicular Technology72(3), 2921–2935 (2023) https://doi.org/10. 1109/TVT.2022.3217299 . Conference Name: IEEE Transactions o...

    2023

  86. [102]

    IEEE Transactions on Intelligent Vehicles (2024)

    Couto, G.C.K., Antonelo, E.A.: Hierarchical generative adversarial imitation learning with mid-level input generation for autonomous driving on urban environments. IEEE Transactions on Intelligent Vehicles (2024)

    2024

  87. [103]

    IEEE Access9, 154553–154562 (2021) https://doi.org/10.1109/ACCESS.2021

    Cai, Y., Yang, S., Wang, H., Teng, C., Chen, L.: A Decision Control Method for Autonomous Driving Based on Multi-Task Reinforcement Learning. IEEE Access9, 154553–154562 (2021) https://doi.org/10.1109/ACCESS.2021. 3126796

    2021 doi

  88. [104]

    In: 2020 American Con- trol Conference (ACC), pp

    Baheri, A., Kolmanovsky, I., Girard, A., Tseng, H.E., Filev, D.: Vision-based autonomous driving: A model learning approach. In: 2020 American Con- trol Conference (ACC), pp. 2520–2525. https://doi.org/10.23919/ACC45564. 2020.9147510 . ISSN: 2378-5861. https://ieeexplore.ieee....

    2020

  89. [105]

    IEEE Access11, 92285–92297 (2023) https://doi.org/10.1109/ ACCESS.2023.3297661

    Manikandan, N.S., Kaliyaperumal, G., Wang, Y.: Ad Hoc-Obstacle Avoidance- Based Navigation System Using Deep Reinforcement Learning for Self- Driving Vehicles. IEEE Access11, 92285–92297 (2023) https://doi.org/10.1109/ ACCESS.2023.3297661 . Conference Name: IEEE Access. Access...

    2023

  90. [107]

    Accessed 2025-07-07

    Sutton, R.S.: Dyna, an integrated architecture for learning, planning, and react- ing2(4), 160–163 https://doi.org/10.1145/122344.122377 . Accessed 2025-07-07

    2025

  91. [108]

    In: 2022 International Con- ference on Advanced Robotics and Mechatronics (ICARM), pp

    Xu, S.-Y., Chen, X.-M., Wang, Z.-J., Hu, Y.-H., Han, X.-T.: Decision- Making Models for Autonomous Vehicles at Unsignalized Intersections Based on Deep Reinforcement Learning. In: 2022 International Con- ference on Advanced Robotics and Mechatronics (ICARM), pp. 63 672–677 (20...

    2022

  92. [109]

    Janner, M., Fu, J., Zhang, M., Levine, S.: When to Trust Your Model: Model- Based Policy Optimization. arXiv. https://doi.org/10.48550/arXiv.1906.08253 . http://arxiv.org/abs/1906.08253 Accessed 2025-07-07

    1906 doi arXiv

  93. [110]

    Frauenknecht, B., Ehlgen, T., Trimpe, S.: Data-efficient Deep Reinforcement Learning for Vehicle Trajectory Control. arXiv. arXiv:2311.18393 [cs] (2023). https://doi.org/10.48550/arXiv.2311.18393 . http://arxiv.org/abs/2311.18393 Accessed 2025-01-10

    2023 doi arXiv

  94. [111]

    Hafner, D., Pasukonis, J., Ba, J., Lillicrap, T.: Mastering Diverse Domains through World Models. arXiv. https://doi.org/10.48550/arXiv.2301.04104 . http://arxiv.org/abs/2301.04104 Accessed 2025-07-07

    2025 doi arXiv

  95. [112]

    Chua, K., Calandra, R., McAllister, R., Levine, S.: Deep Reinforcement Learning in a Handful of Trials using Probabilistic Dynamics Models. arXiv. https:// doi.org/10.48550/arXiv.1805.12114 . http://arxiv.org/abs/1805.12114 Accessed 2025-07-07

    2025 doi arXiv

  96. [114]

    In: Proceedings of the 36th International Conference on Machine Learning, pp

    Hafner, D., Lillicrap, T., Fischer, I., Villegas, R., Ha, D., Lee, H., Davidson, J.: Learning latent dynamics for planning from pixels. In: Proceedings of the 36th International Conference on Machine Learning, pp. 2555–2565. PMLR. ISSN: 2640-3498. https://proceedings.mlr.press...

    2025

  97. [115]

    In: 2021 International Conference on Computer Engineering and Application (ICCEA), pp

    Li, Z.: A Hierarchical Autonomous Driving Framework Combining Reinforce- ment Learning and Imitation Learning. In: 2021 International Conference on Computer Engineering and Application (ICCEA), pp. 395–400 (2021). https: //doi.org/10.1109/ICCEA53728.2021.00084

    2021

  98. [116]

    Foundations and Trends in Machine Learning8(5-6), 359–483 (2015)

    Ghavamzadeh, M., Mannor, S., Pineau, J., Tamar, A.: Bayesian reinforcement learning: A survey. Foundations and Trends in Machine Learning8(5-6), 359–483 (2015)

    2015

  99. [119]

    IEEE Transactions on Intelligent Transportation Systems23(8), 10902–10911 (2022) https://doi

    Gangopadhyay, B., Soora, H., Dasgupta, P.: Hierarchical Program-Triggered Reinforcement Learning Agents For Automated Driving. IEEE Transactions on Intelligent Transportation Systems23(8), 10902–10911 (2022) https://doi. org/10.1109/TITS.2021.3096998 arXiv:2103.13861 [cs]. Com...

    2022

  100. [120]

    In: 2024 9th International Conference on Computer and Communication Systems (ICCCS), pp

    Wang, H., Lu, C., Gong, J.: Hierarchical Reinforcement Learning with Successor Representation for Intelligent Vehicle Collision Avoidance of Dynamic Pedes- trian. In: 2024 9th International Conference on Computer and Communication Systems (ICCCS), pp. 575–581 (2024). https://d...

    2024

  101. [121]

    In: Proceedings of the 34th International Conference on Machine Learning, pp

    Haarnoja, T., Tang, H., Abbeel, P., Levine, S.: Reinforcement learning with deep energy-based policies. In: Proceedings of the 34th International Conference on Machine Learning, pp. 1352–1361 (2017)

    2017

  102. [122]

    Naveed, K.B., Qiao, Z., Dolan, J.M.: Trajectory Planning for Autonomous Vehi- cles Using Hierarchical Reinforcement Learning. arXiv. Comment: 7 pages, 5 figures (2020). https://doi.org/10.48550/arXiv.2011.04752

    2020 doi arXiv

  103. [123]

    In: International Conference on Machine Learning, pp

    Bellemare, M.G., Dabney, W., Munos, R.: A distributional perspective on rein- forcement learning. In: International Conference on Machine Learning, pp. 449–458 (2017)

    2017

  104. [124]

    PhD thesis, Carnegie Mellon University (2010)

    Ziebart, B.D.: Modeling purposeful adaptive behavior with the principle of maximum causal entropy. PhD thesis, Carnegie Mellon University (2010)

    2010

  105. [125]

    In: 2024 36th Chinese Control and Decision Conference (CCDC), pp

    Chen, X., Yang, Y., Xu, S., Fu, S., Yang, D.: Motion Planning 65 for Autonomous Vehicles in Uncertain Environments Using Hierar- chical Distributional Reinforcement Learning. In: 2024 36th Chinese Control and Decision Conference (CCDC), pp. 1844–1851 (2024). https://doi.org/10...

    2024

  106. [126]

    In: 2021 International Wireless Com- munications and Mobile Computing (IWCMC), pp

    Khalil, Y.H., Mouftah, H.T.: Integration of Motion Prediction with End-to-end Latent RL for Self-Driving Vehicles. In: 2021 International Wireless Com- munications and Mobile Computing (IWCMC), pp. 1111–1116 (2021). https: //doi.org/10.1109/IWCMC51323.2021.9498581

    2021

  107. [128]

    In: Advances in Neural Information Processing Systems (2019)

    Yang, Z., Zhang, X., Meng, D., Wen, Y., Zhang, B., Xu, Z.: Fully parameter- ized quantile function for distributional reinforcement learning. In: Advances in Neural Information Processing Systems (2019)

    2019

  108. [129]

    In: 2021 6th International Confer- ence on Computational Intelligence and Applications (ICCIA), pp

    Zhao, X., Zhu, X., Su, Y.: A Real-time and Robust Visual-based Autonomous Driving Model. In: 2021 6th International Confer- ence on Computational Intelligence and Applications (ICCIA), pp. 257–261 (2021). https://doi.org/10.1109/ICCIA52886.2021.00057 . https://ieeexplore.ieee....

    2021

  109. [130]

    In: Conference on Robot Learning, pp

    Sharma, A., Jain, A., Finn, C., Levine, S.: Emergent latent skills in multi-task reinforcement learning. In: Conference on Robot Learning, pp. 973–991 (2020)

    2020

  110. [131]

    In: 2021 IEEE Intelligent Vehicles Symposium (IV), pp

    P´ erez-Gill,´O., Barea, R., L´ opez-Guill´ en, E., Bergasa, L.M., G´ omez-Hu´ elamo, C., Guti´ errez, R., D ´ ıaz, A.: Deep Reinforcement Learning based control algorithms: Training and validation using the ROS Framework in CARLA Simulator for Self-Driving applications. In: 2...

    2021

  111. [132]

    In: 2022 Thirteenth Interna- tional Conference on Ubiquitous and Future Networks (ICUFN), pp

    Hussonnois, M., Jun, J.-Y.: End-to-end autonomous driving using the ape- x algorithm in carla simulation environment. In: 2022 Thirteenth Interna- tional Conference on Ubiquitous and Future Networks (ICUFN), pp. 18–23. https://doi.org/10.1109/ICUFN55119.2022.9829674 . ISSN: 21...

    2022

  112. [133]

    https://arxiv.org/abs/1806.06498

    Sauer, A., Savinov, N., Geiger, A.: Conditional Affordance Learning for Driving in Urban Environments (2018). https://arxiv.org/abs/1806.06498

    2018 arXiv

  113. [134]

    Wu, P., Chen, S., Metaxas, D.: MotionNet: Joint Perception and Motion Predic- tion for Autonomous Driving Based on Bird’s Eye View Maps. arXiv. https:// doi.org/10.48550/arXiv.2003.06754 . http://arxiv.org/abs/2003.06754 Accessed 2025-07-07

    2003 doi arXiv

  114. [136]

    In: Proceedings of the European Conference on Computer Vision (ECCV) (2018)

    Liang, X., Wang, T., Yang, L., Xing, E.: Cirl: Controllable imitative reinforce- ment learning for vision-based self-driving. In: Proceedings of the European Conference on Computer Vision (ECCV) (2018)

    2018

  115. [138]

    In: Proceedings of the IEEE/CVF 66 International Conference on Computer Vision (ICCV) (2019) 67

    Codevilla, F., Santana, E., Lopez, A.M., Gaidon, A.: Exploring the limitations of behavior cloning for autonomous driving. In: Proceedings of the IEEE/CVF 66 International Conference on Computer Vision (ICCV) (2019) 67

    2019

Pith tools

Reviewed August 4, 2026 · model on record in the stance chip above.