Pith. sign in

Paper Citation Record · LEDGER

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes

As of 16 August 2026, this Paper Citation Record lists 57 of 57 outbound references and 1 inbound Pith citation observation for arXiv:2502.09432.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2502.09432 v1

Coverage vector

measured 57 of 57 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T21:36:19.656167Z

measured 58 of 58 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-16T06:30:59.297886+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-06-29T10:31:29.175140Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-06-29T10:33:18.779573Z

Reference resolution

57 of 57 outbound references displayed

  • verified exact1
  • verified fuzzy36
  • unresolved20
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 0b6c4991-7123-41f6-87a7-945dd0b2482a · outbound

This paper cites Tsitsiklis.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Tsitsiklis

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.257433Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.458006Z digest=sha256:1c7f77054e2e4548a4580331a26cb5954022c3e042f8e2b3cf9af74176ead13f

Observation d068d777-fdf7-4f58-bc22-82cf9e89f98e · outbound

This paper cites Robust data-driven dynamic programming.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Robust data-driven dynamic programming

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.248258Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.462035Z digest=sha256:5a66cf6b7c678352eef1a3f1da5c9c974743d24a9a9c304090016f84995caadd

Observation aa9b5782-8f78-4873-bde4-cda8b7a91372 · outbound

This paper cites Scaling up robust mdps using function approxi- mation.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Scaling up robust mdps using function approxi- mation

Reference 3

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.238739Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.465605Z digest=sha256:b08fd09c5ad4b4a1e6dfdbbded098d3d425dd3d3f77c65c029f737ea1c4c093a

Observation afe40254-2806-4775-9ab3-b7a178f8b8ff · outbound

This paper cites Robust control of markov decision processes with uncertain transition matrices.Oper.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Robust control of markov decision processes with uncertain transition matrices.Oper

Reference 4

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.228532Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.469142Z digest=sha256:b05364a23ced8ec8b0de9b451321ec600b946c16070ac5058a21ccae0613741e

Observation c81ac82f-9975-427a-b930-af27340dcda7 · outbound

This paper cites an unresolved cited work.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-08-07T21:36:20.218580Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.472591Z digest=sha256:8d48673e9eb8a330578318e457cd3f7aceb80798400eb7cc337030e10df50edf

Observation 419da8df-17b9-43d8-a4fb-fb994e518124 · outbound

This paper cites Robustness and generalization, 2010.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Robustness and generalization, 2010

Reference 6

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.208490Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.476160Z digest=sha256:843d8e90b01cae840276374a50041041312318a88580922fc331ce7cb5403ea0

Observation 4a825354-3a52-422d-9f43-e5ae315287a0 · outbound

This paper cites Hospedales.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Hospedales

Reference 7

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.198388Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.479899Z digest=sha256:5f169f99f67bd732e80454b49d68b6548bbd487c2a04c76cf57b779f870b1eb2

Observation 5b6896b6-866b-41e5-9487-998733ad90b7 · outbound

This paper cites Assessing generalization in deep reinforcement learning, 2018.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Assessing generalization in deep reinforcement learning, 2018

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.189184Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.483166Z digest=sha256:4e9a9c0aba4901d2f8a7442b3c9b3c3b2426bf7466617d589b320d934783119d

Observation 5775abf2-2ba1-44f5-9c20-2c4a0fda77f2 · outbound

This paper cites Robust markov decision processes.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Robust markov decision processes

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.179762Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.486850Z digest=sha256:c12ac49ecdb5d0a0afd51756d82b83bfb5e80e31d0ff725d7f667d8595fba496

Observation faf38675-618d-4f52-be99-3259c365fd6e · outbound

This paper cites Robust mdps with k-rectangular uncertainty.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Robust mdps with k-rectangular uncertainty

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.170486Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.490118Z digest=sha256:9a90b8f586a5a2e9dee94e09e621b7e51cd86f938a09cdaf9be20ca27e5fe50d

Observation 6958771c-17eb-476e-969f-82f69e30975c · outbound

This paper cites Robust markov decision process: Beyond rectan- gularity, 2018.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Robust markov decision process: Beyond rectan- gularity, 2018

Reference 11

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.159650Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.493480Z digest=sha256:18484ac32c49fbecd4ef7ddac5ad561fcf2930be9f92e72fb8e4b0877a26e47b

Observation 50b4c15e-7a13-4973-ab19-404a9d6c2dc2 · outbound

This paper cites Kaufman and Andrew J.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Kaufman and Andrew J

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.149285Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.496750Z digest=sha256:ed5616bba5b8f67cb192da7302b6a5984bd8396a0527158f5b9dc9c62fce2ca9

Observation 819598ad-e2ed-4b48-bafb-922795164d34 · outbound

This paper cites Andrew Bagnell, Andrew Y.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Andrew Bagnell, Andrew Y

Reference 13

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.138685Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.499998Z digest=sha256:888929497eda097ead0e28ec555a8a134f0d0ee00971ec317e75baeac1ae1095

Observation bf527111-eaf5-481b-b603-8ffde6c430e2 · outbound

This paper cites Partial policy iteration for l1-robust markov decision processes, 2020.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Partial policy iteration for l1-robust markov decision processes, 2020

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.128774Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.503457Z digest=sha256:713b6167254b05ef58224b18ef4134b1136c87bb99d64222fe9305fad291e165

Observation dcd86abc-f994-4f57-93c5-48c9c9c0cfb2 · outbound

This paper cites Online robust reinforcement learning with model uncertainty, 2021.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Online robust reinforcement learning with model uncertainty, 2021

Reference 15

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.118568Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.506765Z digest=sha256:35abcd94396ffa78d5b9910e056461af6ccf5f0496a0e6ea38d6d286a8930d47

Observation 6841709c-70a0-49ff-950e-7ce3ca8ea7ed · outbound

This paper cites Policy gradient method for robust reinforcement learning, 2022.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Policy gradient method for robust reinforcement learning, 2022

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-07T21:36:19.510193Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T21:36:19.510193Z digest=sha256:7602256600ce0f30015bbc1a754a20a19c63f0c005d7f8fcbedac0b2de2507c1

Observation 0430343d-875d-49b4-a815-0971c3ddfbd0 · outbound

This paper cites Policy gradient in robust mdps with global convergence guarantee, 2023.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Policy gradient in robust mdps with global convergence guarantee, 2023

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.102796Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.513827Z digest=sha256:1f7eeb459708de30448f8057fe3b96be3b0ce030f7f0ddb3e7bc9ad3d68193f9

Observation 6066d4e6-4f32-416a-b875-dc1bf49c8064 · outbound

This paper cites Twice regularized mdps and the equivalence between robustness and regularization, 2021.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Twice regularized mdps and the equivalence between robustness and regularization, 2021

Reference 18

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.093368Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.517278Z digest=sha256:533c6bf5a87c64ba2580c018507fd0ac8382808832a638d79922be83f0d855b7

Observation b1e7768d-3351-4017-9ac6-fb82a947672d · outbound

This paper cites Efficient value iteration for s-rectangular robust markov decision processes.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Efficient value iteration for s-rectangular robust markov decision processes

Reference 19

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.083565Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.520560Z digest=sha256:2b9eef8971c1019a99495314750e782e5cb0852e4e363f85b4bcba13a9e2d8ce

Observation 2fca1ffd-6e9d-4eda-96ab-fcf794ce255d · outbound

This paper cites Pol- icy gradient for rectangular robust markov decision processes.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Pol- icy gradient for rectangular robust markov decision processes

Reference 20

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.073066Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.523939Z digest=sha256:393fb5b93ed4a65b3377634215e782afc4a1eb21265bd6e0d57cb4c73426eb16

Observation 580cf6d2-91f7-4995-a432-781b475e0600 · outbound

This paper cites Natural actor-critic for robust reinforcement learning with function approximation.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Natural actor-critic for robust reinforcement learning with function approximation

Reference 21

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.063185Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.527335Z digest=sha256:f426843a237254df40ae59aad6376860773a957b87248e1e07aa9993bbccf1ca

Observation 9f7ec817-9d0e-4894-bcf8-b6677202d6d0 · outbound

This paper cites Robust reinforce- ment learning via adversarial kernel approximation, 2023.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Robust reinforce- ment learning via adversarial kernel approximation, 2023

Reference 22

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.053423Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.530518Z digest=sha256:28855be7e16311b2451ef4be00bf1996e5daec8e360b68b943f8fd0043ed484b

Observation ddc55e57-2f07-4962-95fa-100a13f7354c · outbound

This paper cites Solving non-rectangular reward-robust mdps via frequency regularization, 2023.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Solving non-rectangular reward-robust mdps via frequency regularization, 2023

Reference 23

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.043450Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.533981Z digest=sha256:36f7e63807fa4434eb8a4e2e7cda5e1dd1c879a2db7c26b9c3cb561be5c53cc7

Observation d571b47b-d0d0-4044-b84c-e6ae4990628b · outbound

This paper cites Smith and Mavina K.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Smith and Mavina K

Reference 24

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.033705Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.537530Z digest=sha256:a4a94e51af42367f27bccfe524d5422329beefeefefcb664d715f8995077833c

Observation fc0ad112-f3c5-4d6d-a40c-cb072c396f7f · outbound

This paper cites Puterman.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Puterman

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-07T21:36:19.541038Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T21:36:19.541038Z digest=sha256:da6d26d9f4482ffd8f0489a72539788f43425a68eb1ca3e2b6474d1b63f8b221

Observation 61788557-f5ed-472d-937f-067bad6b0743 · outbound

This paper cites Tractable robust markov decision processes, 2024.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Tractable robust markov decision processes, 2024

Reference 26

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.018254Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.544428Z digest=sha256:28e996fc8ba3d2a8e941da19085a58eb43d6bbd341228978d75d2c9e54e13c52

Observation c4da2e3f-ba0f-4e02-88f3-03864ea9b1f8 · outbound

This paper cites Sutton and Andrew G.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Sutton and Andrew G

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-07T21:36:19.547831Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T21:36:19.547831Z digest=sha256:ded6ff04ab51013463ff7e486d5412dd6f5860b50ca843af104e2380e9ecd75e

Observation ebb2794d-4a82-4ad2-b555-fc984540d777 · outbound

This paper cites Wasserstein robust reinforcement learning, 2019.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Wasserstein robust reinforcement learning, 2019

Reference 28

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.002741Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.551215Z digest=sha256:d8a7e272b593a9626d534ad7cdbe57570e7ccde27a54406a625077346f7e316a

Observation aaba2e2f-1859-4405-9b5d-cf5a4484971a · outbound

This paper cites Robust $\phi$-divergence MDPs.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Robust $\phi$-divergence MDPs

Reference 29

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:19.992855Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.554703Z digest=sha256:cd2c536025418b1b94a5bc17c35af07448019e646f97a3b49d63781d150101b1

Observation 7f9ed6a9-a3a2-43c5-aacd-930eab901a5e · outbound

This paper cites an unresolved cited work.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work

Reference 30

Resolution
unresolved
raw_fallback, observed 2026-08-07T21:36:19.982063Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.558054Z digest=sha256:c70717a75f1b44545d92b99be79a78439ac1f4ee3cc45e77f3eae39fb17399bf

Observation 64eb255c-ac09-4a74-a887-d4f8e0058f25 · outbound

This paper cites Bellemare.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Bellemare

Reference 31

Resolution
unresolved
no resolver link, observed 2026-08-07T21:36:19.561426Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T21:36:19.561426Z digest=sha256:fb79ba4a8bbf382aa4c135bee78d306b5d6ff3eabd76895d50aceddab1df451e

Observation 039ddbee-795b-408e-a57e-f8aa5fd4e736 · outbound

This paper cites The geometry of robust value functions.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes The geometry of robust value functions

Reference 32

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:19.964291Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.564840Z digest=sha256:58c18fe4e79acbe589ae419aa3c1e9d398a44ae666c7829697d145dcfb177ba6

Observation c2934878-e35f-4b07-b3aa-3d54fe13f949 · outbound

This paper cites Lightning Does Not Strike Twice: Robust MDPs with Coupled Uncertainty.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Lightning Does Not Strike Twice: Robust MDPs with Coupled Uncertainty

Reference 33

Resolution
verified exact
local_arxiv, observed 2026-08-07T21:36:19.692742Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.568498Z digest=sha256:54baf12cc1dc5c54c4ba4c06dfb19f691d47c19a91def26465536055a3b95703

Observation 87e096e3-176b-4a56-8a34-29a9890f7309 · outbound

This paper cites an unresolved cited work.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work

Reference 34

Resolution
unresolved
raw_fallback, observed 2026-08-07T21:36:19.952879Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.572528Z digest=sha256:0d67c560bce331fecac6c8eb7cd5388526234cced8b525a3972ff00233db86ec

Observation fc595b09-c6d7-4e2e-8f9a-2a2ce5757e56 · outbound

This paper cites Oliphant, Matt Haberland, Tyler Reddy, David Cournapeau, EvgeniBurovski, PearuPeterson, WarrenWeckesser, JonathanBright, StéfanJ.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Oliphant, Matt Haberland, Tyler Reddy, David Cournapeau, EvgeniBurovski, PearuPeterson, WarrenWeckesser, JonathanBright, StéfanJ

Reference 35

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:19.942183Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.575826Z digest=sha256:f724d649a5525e11d94f6192a4d5b9bfdd024490215986446f012396a7787baf

Observation 649bac79-e0ab-4eff-af3e-0a715a06007b · outbound

This paper cites Policy gradient methods for reinforcement learning with function approximation.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Policy gradient methods for reinforcement learning with function approximation

Reference 36

Resolution
unresolved
no resolver link, observed 2026-08-07T21:36:19.579273Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T21:36:19.579273Z digest=sha256:df7bdccce348df6a9bd2c3b0567dc3b6cd7b752342998e0919e5b57cf05131cf

Observation 8aa4f6c6-9342-45fa-b733-83f9d17b8dbb · outbound

This paper cites an unresolved cited work.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work

Reference 37

Resolution
unresolved
raw_fallback, observed 2026-08-07T21:36:19.923924Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.583088Z digest=sha256:875172072b6f4bc33eae377d69988d147017d774d350365cff9538a2761cde72

Observation 0ce3b136-52f1-4a87-beaa-b93639cba9ad · outbound

This paper cites Cambridge University Press, March 2004.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Cambridge University Press, March 2004

Reference 38

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:19.913235Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.586820Z digest=sha256:b60a9e2ebed946e8aae3fc4b76dd633a564c905984fb1f0a25f1c92219a4e249

Observation dddb15a4-ac21-499f-874e-573f4b4bf369 · outbound

This paper cites Policy gradient for reinforce- ment learning with general utilities, 2023.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Policy gradient for reinforce- ment learning with general utilities, 2023

Reference 39

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:19.902250Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.590353Z digest=sha256:931650e5c783cf5144b6b62329d3882b79446fd8aee89ade8211d71faacb3241

Observation 9def3c86-ab34-4660-9448-3c3caaf52cd8 · outbound

This paper cites This makes sense, as the more the agent visits states with high uncertainty, the higher is the ability of the adversary to undermine it.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes This makes sense, as the more the agent visits states with high uncertainty, the higher is the ability of the adversary to undermine it

Reference 40

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:19.891391Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.594133Z digest=sha256:8f621853f7529a08ef8eb91f960b4de8bc31e808b3a860c77e9713ac6a37a5ca

Observation 553b68c4-1f7c-4cdb-aac4-0c09dcfa1fac · outbound

This paper cites nominal value functionvπ R).

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes nominal value functionvπ R)

Reference 41

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:19.880758Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.598039Z digest=sha256:cf6e9d0298cf34db6e3ecea51b1c039c92c7fe1d896604e6da5c582686e8e415

Observation 506d608b-819a-4519-9bb8-740b6421e2f5 · outbound

This paper cites This can be done, by putting negative entries ofk at maximal entries of vπ β, and positive entries ofkT at states which has minimum uncertainty value function.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes This can be done, by putting negative entries ofk at maximal entries of vπ β, and positive entries ofkT at states which has minimum uncertainty value function

Reference 42

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:19.870305Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.601727Z digest=sha256:4f60afa1f6880d7a22c1f2a5aa281050626b45693c1d63abcda253167d0e3ef9

Observation dd773552-dec4-43b5-89e0-b9bbb083db60 · outbound

This paper cites an unresolved cited work.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work

Reference 43

Resolution
unresolved
raw_fallback, observed 2026-08-07T21:36:19.859571Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.605716Z digest=sha256:0564a604a7b8c3672315d7d580809b0a09ef24cde366c13ea260b43a8c894058

Observation 422fa3d0-5881-494f-ace0-786c9f567779 · outbound

This paper cites an unresolved cited work.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work

Reference 44

Resolution
unresolved
raw_fallback, observed 2026-08-07T21:36:19.849233Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.609273Z digest=sha256:5c244302b6a7b21716fa9267e825b3db256edfa4ad4f1825aff609c60641f77d

Observation b138513d-1381-4031-9656-dc3b6ae76802 · outbound

This paper cites an unresolved cited work.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work

Reference 45

Resolution
unresolved
raw_fallback, observed 2026-08-07T21:36:19.838287Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.612680Z digest=sha256:21489fc26238003c59b2a8c202c2e1f6ae036af3d6e1bcc8d81d5569ceb0c9db

Observation 2edeacfe-e812-409b-92de-aaa3a4193d7d · outbound

This paper cites an unresolved cited work.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work

Reference 46

Resolution
unresolved
raw_fallback, observed 2026-08-07T21:36:19.828174Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.617065Z digest=sha256:62ea3b769ab9fb8f44ddc1e882c061c9fa7ba6c91a7f87d5433151ed9cb43d15

Observation 7c61d827-b01b-4157-b63f-9e7d2d5e4390 · outbound

This paper cites an unresolved cited work.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work

Reference 47

Resolution
unresolved
raw_fallback, observed 2026-08-07T21:36:19.817675Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.620603Z digest=sha256:88261b8017b72de27540f744567cc26a4f469902f9c42dabacbfc3e5aad45821

Observation 6083aa55-ce62-4c26-95b0-2ae338ed70ce · outbound

This paper cites Robust policy evaluation is proven to be NP-hard for general uncertainty sets defined as intersections of finite hyperplanes [9].

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Robust policy evaluation is proven to be NP-hard for general uncertainty sets defined as intersections of finite hyperplanes [9]

Reference 48

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:19.806953Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.623783Z digest=sha256:585bd5ec8ea7096c8dcdd960e1448ccda2db5bde334b579db699b5a4328b17e1

Observation a6dc41b7-5135-4578-9cbd-afb4f0b67f3d · outbound

This paper cites an unresolved cited work.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work

Reference 49

Resolution
unresolved
raw_fallback, observed 2026-08-07T21:36:19.796328Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.628677Z digest=sha256:c2c0b5a934eb7a3966ae2e2439760ed9d7f20615fce6ef760f1bea64cc787ac6

Observation ec46a7bd-bc95-4f9d-907f-cb128b6f19b9 · outbound

This paper cites an unresolved cited work.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work

Reference 50

Resolution
unresolved
raw_fallback, observed 2026-08-07T21:36:19.785350Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.632037Z digest=sha256:a62bc769d1fc2eee847a8d7ed412b4612e297f8731805da405362e60e617435e

Observation 30afade0-ed22-44d1-97b1-8630032d946e · outbound

This paper cites This method is simple to implement but computationally expensive, as it evaluatesA for a large number of randomly generated vectors.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes This method is simple to implement but computationally expensive, as it evaluatesA for a large number of randomly generated vectors

Reference 51

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:19.774632Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.635470Z digest=sha256:1c5866a75b19ad267003b2451a76f6f0033aec6d035ca185eb8b226c685a10c3

Observation c2615a3f-5157-4667-a01d-4b66477e2297 · outbound

This paper cites an unresolved cited work.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work

Reference 52

Resolution
unresolved
raw_fallback, observed 2026-08-07T21:36:19.762906Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.638873Z digest=sha256:b66680926ef6ae8a1767b687aa182e14a8d30cfdf46b214910991ac96316747f

Observation 1f70338b-74cb-460f-8826-c216989c711e · outbound

This paper cites an unresolved cited work.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work

Reference 53

Resolution
unresolved
raw_fallback, observed 2026-08-07T21:36:19.750523Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.642236Z digest=sha256:fc3daa5c88d24a325237e6b2c6e2d8d77899d54a4d7a06cb05ef7a696f309334

Observation 68957e29-950d-41b5-8977-65ddcfb75bb0 · outbound

This paper cites This method provides the exact solution but is computationally more expensive than the spectral method.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes This method provides the exact solution but is computationally more expensive than the spectral method

Reference 54

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:19.739160Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.645535Z digest=sha256:cda851bd59dd5bdfbe301def8fd9b1c2c0917647606d3009226b3dcff2d41f86

Observation 78aee9ed-86aa-46ea-97d7-7c98b435ce26 · outbound

This paper cites an unresolved cited work.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work

Reference 55

Resolution
unresolved
raw_fallback, observed 2026-08-07T21:36:19.727520Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.648971Z digest=sha256:371c8e4116576a006baa3a4df664bdf73dd70e882b1342746e05b2fb88a3e147

Observation 9235abd9-1024-4bd0-b9ab-3a162974a240 · outbound

This paper cites an unresolved cited work.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work

Reference 56

Resolution
unresolved
raw_fallback, observed 2026-08-07T21:36:19.716000Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.652497Z digest=sha256:6b795f41a4a8f7e475912604aa49f263cd71e0996963f27429ea8a2c82436c24

Observation a0231bc6-ba6b-48ac-9920-1d824e750f52 · outbound

This paper cites The results, including the optimal values and computational times, are recorded for each method.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes The results, including the optimal values and computational times, are recorded for each method

Reference 57

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:19.705050Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T21:36:19.656167Z digest=sha256:93b9efd38dea0af9e40980ef70b7c047a7aca20c3cd782c854d52ea9d7e11f50

Pith citing papers

Observation 233a9c31-c3aa-46fd-b70b-debdf5215a43 · inbound

Robust Markov Decision Processes on Continuous State Spaces cites this paper.

Robust Markov Decision Processes on Continuous State Spaces Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes

Reference 24

Resolution
verified exact
arxiv_id, observed 2026-06-29T10:33:18.781161Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-06-29T10:31:29.175140Z digest=sha256:376af55299fb2d3e53164a84efac96cfd5e1d92966a168978925ed7ba75d0d9b