Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-07T21:36:19.656167Z
Paper Citation Record · LEDGER
As of 16 August 2026, this Paper Citation Record lists 57 of 57 outbound references and 1 inbound Pith citation observation for arXiv:2502.09432.
A citation records a reference. It does not transfer a finding from one paper to another.
Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-07T21:36:19.656167Z
One-hop event checks from named stored sources.
Source: scholarly_work_events, retraction_status_cache, observed 2026-08-16T06:30:59.297886+00:00
Pith citing papers itemized under the disclosed page cap.
Source: paper_references, paper_reference_links, observed 2026-06-29T10:31:29.175140Z
A source-named dated measurement, never combined with another source.
Source: arxiv_reference, observed 2026-06-29T10:33:18.779573Z
57 of 57 outbound references displayed
External citation measurements
No source-named external measurement is stored.
Observation 0b6c4991-7123-41f6-87a7-945dd0b2482a · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Tsitsiklis
Reference 1
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation d068d777-fdf7-4f58-bc22-82cf9e89f98e · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Robust data-driven dynamic programming
Reference 2
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation aa9b5782-8f78-4873-bde4-cda8b7a91372 · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Scaling up robust mdps using function approxi- mation
Reference 3
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation afe40254-2806-4775-9ab3-b7a178f8b8ff · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Robust control of markov decision processes with uncertain transition matrices.Oper
Reference 4
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation c81ac82f-9975-427a-b930-af27340dcda7 · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work
Reference 5
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 419da8df-17b9-43d8-a4fb-fb994e518124 · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Robustness and generalization, 2010
Reference 6
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 4a825354-3a52-422d-9f43-e5ae315287a0 · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Hospedales
Reference 7
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 5b6896b6-866b-41e5-9487-998733ad90b7 · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Assessing generalization in deep reinforcement learning, 2018
Reference 8
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 5775abf2-2ba1-44f5-9c20-2c4a0fda77f2 · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Robust markov decision processes
Reference 9
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation faf38675-618d-4f52-be99-3259c365fd6e · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Robust mdps with k-rectangular uncertainty
Reference 10
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 6958771c-17eb-476e-969f-82f69e30975c · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Robust markov decision process: Beyond rectan- gularity, 2018
Reference 11
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 50b4c15e-7a13-4973-ab19-404a9d6c2dc2 · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Kaufman and Andrew J
Reference 12
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 819598ad-e2ed-4b48-bafb-922795164d34 · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Andrew Bagnell, Andrew Y
Reference 13
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation bf527111-eaf5-481b-b603-8ffde6c430e2 · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Partial policy iteration for l1-robust markov decision processes, 2020
Reference 14
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation dcd86abc-f994-4f57-93c5-48c9c9c0cfb2 · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Online robust reinforcement learning with model uncertainty, 2021
Reference 15
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 6841709c-70a0-49ff-950e-7ce3ca8ea7ed · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Policy gradient method for robust reinforcement learning, 2022
Reference 16
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 0430343d-875d-49b4-a815-0971c3ddfbd0 · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Policy gradient in robust mdps with global convergence guarantee, 2023
Reference 17
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 6066d4e6-4f32-416a-b875-dc1bf49c8064 · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Twice regularized mdps and the equivalence between robustness and regularization, 2021
Reference 18
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation b1e7768d-3351-4017-9ac6-fb82a947672d · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Efficient value iteration for s-rectangular robust markov decision processes
Reference 19
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 2fca1ffd-6e9d-4eda-96ab-fcf794ce255d · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Pol- icy gradient for rectangular robust markov decision processes
Reference 20
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 580cf6d2-91f7-4995-a432-781b475e0600 · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Natural actor-critic for robust reinforcement learning with function approximation
Reference 21
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 9f7ec817-9d0e-4894-bcf8-b6677202d6d0 · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Robust reinforce- ment learning via adversarial kernel approximation, 2023
Reference 22
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation ddc55e57-2f07-4962-95fa-100a13f7354c · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Solving non-rectangular reward-robust mdps via frequency regularization, 2023
Reference 23
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation d571b47b-d0d0-4044-b84c-e6ae4990628b · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Smith and Mavina K
Reference 24
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation fc0ad112-f3c5-4d6d-a40c-cb072c396f7f · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Puterman
Reference 25
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 61788557-f5ed-472d-937f-067bad6b0743 · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Tractable robust markov decision processes, 2024
Reference 26
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation c4da2e3f-ba0f-4e02-88f3-03864ea9b1f8 · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Sutton and Andrew G
Reference 27
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation ebb2794d-4a82-4ad2-b555-fc984540d777 · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Wasserstein robust reinforcement learning, 2019
Reference 28
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation aaba2e2f-1859-4405-9b5d-cf5a4484971a · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Robust $\phi$-divergence MDPs
Reference 29
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 7f9ed6a9-a3a2-43c5-aacd-930eab901a5e · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work
Reference 30
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 64eb255c-ac09-4a74-a887-d4f8e0058f25 · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Bellemare
Reference 31
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 039ddbee-795b-408e-a57e-f8aa5fd4e736 · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes The geometry of robust value functions
Reference 32
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation c2934878-e35f-4b07-b3aa-3d54fe13f949 · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Lightning Does Not Strike Twice: Robust MDPs with Coupled Uncertainty
Reference 33
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 87e096e3-176b-4a56-8a34-29a9890f7309 · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work
Reference 34
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation fc595b09-c6d7-4e2e-8f9a-2a2ce5757e56 · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Oliphant, Matt Haberland, Tyler Reddy, David Cournapeau, EvgeniBurovski, PearuPeterson, WarrenWeckesser, JonathanBright, StéfanJ
Reference 35
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 649bac79-e0ab-4eff-af3e-0a715a06007b · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Policy gradient methods for reinforcement learning with function approximation
Reference 36
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 8aa4f6c6-9342-45fa-b733-83f9d17b8dbb · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work
Reference 37
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 0ce3b136-52f1-4a87-beaa-b93639cba9ad · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Cambridge University Press, March 2004
Reference 38
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation dddb15a4-ac21-499f-874e-573f4b4bf369 · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Policy gradient for reinforce- ment learning with general utilities, 2023
Reference 39
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 9def3c86-ab34-4660-9448-3c3caaf52cd8 · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes This makes sense, as the more the agent visits states with high uncertainty, the higher is the ability of the adversary to undermine it
Reference 40
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 553b68c4-1f7c-4cdb-aac4-0c09dcfa1fac · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes nominal value functionvπ R)
Reference 41
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 506d608b-819a-4519-9bb8-740b6421e2f5 · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes This can be done, by putting negative entries ofk at maximal entries of vπ β, and positive entries ofkT at states which has minimum uncertainty value function
Reference 42
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation dd773552-dec4-43b5-89e0-b9bbb083db60 · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work
Reference 43
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 422fa3d0-5881-494f-ace0-786c9f567779 · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work
Reference 44
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation b138513d-1381-4031-9656-dc3b6ae76802 · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work
Reference 45
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 2edeacfe-e812-409b-92de-aaa3a4193d7d · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work
Reference 46
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 7c61d827-b01b-4157-b63f-9e7d2d5e4390 · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work
Reference 47
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 6083aa55-ce62-4c26-95b0-2ae338ed70ce · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Robust policy evaluation is proven to be NP-hard for general uncertainty sets defined as intersections of finite hyperplanes [9]
Reference 48
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation a6dc41b7-5135-4578-9cbd-afb4f0b67f3d · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work
Reference 49
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation ec46a7bd-bc95-4f9d-907f-cb128b6f19b9 · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work
Reference 50
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 30afade0-ed22-44d1-97b1-8630032d946e · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes This method is simple to implement but computationally expensive, as it evaluatesA for a large number of randomly generated vectors
Reference 51
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation c2615a3f-5157-4667-a01d-4b66477e2297 · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work
Reference 52
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 1f70338b-74cb-460f-8826-c216989c711e · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work
Reference 53
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 68957e29-950d-41b5-8977-65ddcfb75bb0 · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes This method provides the exact solution but is computationally more expensive than the spectral method
Reference 54
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 78aee9ed-86aa-46ea-97d7-7c98b435ce26 · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work
Reference 55
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 9235abd9-1024-4bd0-b9ab-3a162974a240 · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work
Reference 56
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation a0231bc6-ba6b-48ac-9920-1d824e750f52 · outbound
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes The results, including the optimal values and computational times, are recorded for each method
Reference 57
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 233a9c31-c3aa-46fd-b70b-debdf5215a43 · inbound
Robust Markov Decision Processes on Continuous State Spaces Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes
Reference 24
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.