Pith. sign in

Paper Citation Record · LEDGER

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes

As of 17 August 2026, this Paper Citation Record lists 57 of 57 outbound references and 1 inbound Pith citation observation for arXiv:2502.09432.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2502.09432 v1

Coverage vector

measured 57 of 57 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T21:36:19.656167Z

measured 58 of 58 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-17T06:30:58.91139+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-06-29T10:31:29.175140Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-06-29T10:33:18.779573Z

Reference resolution

57 of 57 outbound references displayed

  • verified exact1
  • verified fuzzy36
  • unresolved20
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 0b6c4991-7123-41f6-87a7-945dd0b2482a · outbound

This paper cites Tsitsiklis.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Tsitsiklis

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.257433Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.458006Z digest=sha256:3e25df5b1a7e708e6896849162b6afb2f4522a167bb1ee66e96b1c5da062cfb6

Observation d068d777-fdf7-4f58-bc22-82cf9e89f98e · outbound

This paper cites Robust data-driven dynamic programming.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Robust data-driven dynamic programming

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.248258Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.462035Z digest=sha256:43f0b9f97756091ea2404863119d0a764289834bcb9cec6544295b709f20c8f2

Observation aa9b5782-8f78-4873-bde4-cda8b7a91372 · outbound

This paper cites Scaling up robust mdps using function approxi- mation.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Scaling up robust mdps using function approxi- mation

Reference 3

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.238739Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.465605Z digest=sha256:140f56141deabf12d78e0963ea863892bf98490938269e85589a19fb6164d088

Observation afe40254-2806-4775-9ab3-b7a178f8b8ff · outbound

This paper cites Robust control of markov decision processes with uncertain transition matrices.Oper.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Robust control of markov decision processes with uncertain transition matrices.Oper

Reference 4

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.228532Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.469142Z digest=sha256:190e7c1e36880f5848332ef8495a148c265872a06c2e8e39609ae5d0b53a1dc3

Observation c81ac82f-9975-427a-b930-af27340dcda7 · outbound

This paper cites an unresolved cited work.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-08-07T21:36:20.218580Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.472591Z digest=sha256:0a97945d8c380a4e8897fd77f0172fe2859b1e08613eeb15a02891b03108e555

Observation 419da8df-17b9-43d8-a4fb-fb994e518124 · outbound

This paper cites Robustness and generalization, 2010.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Robustness and generalization, 2010

Reference 6

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.208490Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.476160Z digest=sha256:c6ec88f877b8a506b0d21583ede984ae3abd6f8c339184addeb128d3d1b24a4d

Observation 4a825354-3a52-422d-9f43-e5ae315287a0 · outbound

This paper cites Hospedales.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Hospedales

Reference 7

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.198388Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.479899Z digest=sha256:b9dcae5223a31bace9cacd52508bc6b7f7f828018429bc7c55793987d63b9b2e

Observation 5b6896b6-866b-41e5-9487-998733ad90b7 · outbound

This paper cites Assessing generalization in deep reinforcement learning, 2018.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Assessing generalization in deep reinforcement learning, 2018

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.189184Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.483166Z digest=sha256:086bfc7190e16e565126b0f2642c646b764cf234aafbd5553a4395590410664d

Observation 5775abf2-2ba1-44f5-9c20-2c4a0fda77f2 · outbound

This paper cites Robust markov decision processes.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Robust markov decision processes

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.179762Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.486850Z digest=sha256:e4fbf47cec8e60d29b8cc4dfaef679e51b8eceaebd3d776acfa5cac87a5748ce

Observation faf38675-618d-4f52-be99-3259c365fd6e · outbound

This paper cites Robust mdps with k-rectangular uncertainty.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Robust mdps with k-rectangular uncertainty

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.170486Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.490118Z digest=sha256:79b1d1451aff632119a7b48d32a1b207966bb137e65679a5871feea1507d872b

Observation 6958771c-17eb-476e-969f-82f69e30975c · outbound

This paper cites Robust markov decision process: Beyond rectan- gularity, 2018.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Robust markov decision process: Beyond rectan- gularity, 2018

Reference 11

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.159650Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.493480Z digest=sha256:ab756138d5135b26ccdee4b92974b93b553bc29f291ce1de216f7deb01f5c5dd

Observation 50b4c15e-7a13-4973-ab19-404a9d6c2dc2 · outbound

This paper cites Kaufman and Andrew J.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Kaufman and Andrew J

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.149285Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.496750Z digest=sha256:80e8e3b4d1262ccfe9ecdcb65e197acf08c42761bc93f8080ceebf574c4b7be4

Observation 819598ad-e2ed-4b48-bafb-922795164d34 · outbound

This paper cites Andrew Bagnell, Andrew Y.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Andrew Bagnell, Andrew Y

Reference 13

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.138685Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.499998Z digest=sha256:cd779f2ab043f38cc79b092160e5db71bab518a457edfd093eaf486e3db05cbf

Observation bf527111-eaf5-481b-b603-8ffde6c430e2 · outbound

This paper cites Partial policy iteration for l1-robust markov decision processes, 2020.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Partial policy iteration for l1-robust markov decision processes, 2020

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.128774Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.503457Z digest=sha256:f0ab7a148f9db8a91775b5a2ad85e796855eb4734fce4e54f7e98b65e09d448c

Observation dcd86abc-f994-4f57-93c5-48c9c9c0cfb2 · outbound

This paper cites Online robust reinforcement learning with model uncertainty, 2021.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Online robust reinforcement learning with model uncertainty, 2021

Reference 15

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.118568Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.506765Z digest=sha256:d50e2d16fbc77cc3072ab29990cd2af43fc5d693918459e0c27539df08d51e1f

Observation 6841709c-70a0-49ff-950e-7ce3ca8ea7ed · outbound

This paper cites Policy gradient method for robust reinforcement learning, 2022.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Policy gradient method for robust reinforcement learning, 2022

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-07T21:36:19.510193Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T21:36:19.510193Z digest=sha256:7602256600ce0f30015bbc1a754a20a19c63f0c005d7f8fcbedac0b2de2507c1

Observation 0430343d-875d-49b4-a815-0971c3ddfbd0 · outbound

This paper cites Policy gradient in robust mdps with global convergence guarantee, 2023.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Policy gradient in robust mdps with global convergence guarantee, 2023

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.102796Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.513827Z digest=sha256:afbb0141d46ce05ceb830d07f3c7748b46b49bb2fc663ecd8ff9d37c274623aa

Observation 6066d4e6-4f32-416a-b875-dc1bf49c8064 · outbound

This paper cites Twice regularized mdps and the equivalence between robustness and regularization, 2021.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Twice regularized mdps and the equivalence between robustness and regularization, 2021

Reference 18

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.093368Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.517278Z digest=sha256:69a146a169eb9c1e031bc035aaa31be9ff49d4a3609248e61c3f82d7d181d712

Observation b1e7768d-3351-4017-9ac6-fb82a947672d · outbound

This paper cites Efficient value iteration for s-rectangular robust markov decision processes.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Efficient value iteration for s-rectangular robust markov decision processes

Reference 19

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.083565Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.520560Z digest=sha256:db2b018d554972182cf475a99d4ebaa6bcdab14dd96b38520261bf87501ace17

Observation 2fca1ffd-6e9d-4eda-96ab-fcf794ce255d · outbound

This paper cites Pol- icy gradient for rectangular robust markov decision processes.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Pol- icy gradient for rectangular robust markov decision processes

Reference 20

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.073066Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.523939Z digest=sha256:da0a8d0f77f8680c6726bec9b5ddffcc6fda929ad758ea64c077d297c89f5437

Observation 580cf6d2-91f7-4995-a432-781b475e0600 · outbound

This paper cites Natural actor-critic for robust reinforcement learning with function approximation.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Natural actor-critic for robust reinforcement learning with function approximation

Reference 21

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.063185Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.527335Z digest=sha256:e66999fac099e19ff99a45c718fbdfd4af1c9e6bf7aa0af141cedb723dcdfae7

Observation 9f7ec817-9d0e-4894-bcf8-b6677202d6d0 · outbound

This paper cites Robust reinforce- ment learning via adversarial kernel approximation, 2023.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Robust reinforce- ment learning via adversarial kernel approximation, 2023

Reference 22

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.053423Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.530518Z digest=sha256:4ef2c95356cbdd9b6c7ff5b92b25df6f2b56dbe4b142822dc1e678ff91c9f93c

Observation ddc55e57-2f07-4962-95fa-100a13f7354c · outbound

This paper cites Solving non-rectangular reward-robust mdps via frequency regularization, 2023.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Solving non-rectangular reward-robust mdps via frequency regularization, 2023

Reference 23

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.043450Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.533981Z digest=sha256:a8830b5cfbfa04bcd83749124863eb1d585a597af7068df04de9f578b67bd818

Observation d571b47b-d0d0-4044-b84c-e6ae4990628b · outbound

This paper cites Smith and Mavina K.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Smith and Mavina K

Reference 24

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.033705Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.537530Z digest=sha256:f1d1f99afb34a0c75de15ce129e8c23c2ecdedb3ae1f527ff418cefa3c4d3a4c

Observation fc0ad112-f3c5-4d6d-a40c-cb072c396f7f · outbound

This paper cites Puterman.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Puterman

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-07T21:36:19.541038Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T21:36:19.541038Z digest=sha256:da6d26d9f4482ffd8f0489a72539788f43425a68eb1ca3e2b6474d1b63f8b221

Observation 61788557-f5ed-472d-937f-067bad6b0743 · outbound

This paper cites Tractable robust markov decision processes, 2024.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Tractable robust markov decision processes, 2024

Reference 26

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.018254Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.544428Z digest=sha256:da266a369668f28432a56f4ad4253681fa600932b3af9e762bf928e6f24c8646

Observation c4da2e3f-ba0f-4e02-88f3-03864ea9b1f8 · outbound

This paper cites Sutton and Andrew G.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Sutton and Andrew G

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-07T21:36:19.547831Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T21:36:19.547831Z digest=sha256:ded6ff04ab51013463ff7e486d5412dd6f5860b50ca843af104e2380e9ecd75e

Observation ebb2794d-4a82-4ad2-b555-fc984540d777 · outbound

This paper cites Wasserstein robust reinforcement learning, 2019.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Wasserstein robust reinforcement learning, 2019

Reference 28

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:20.002741Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.551215Z digest=sha256:0cb72a19345f1fd14f30b5ee023d33ec07f6b88ed4f4e0e8aa1d4b261e2d720b

Observation aaba2e2f-1859-4405-9b5d-cf5a4484971a · outbound

This paper cites Robust $\phi$-divergence MDPs.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Robust $\phi$-divergence MDPs

Reference 29

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:19.992855Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.554703Z digest=sha256:c1abf869aa251ca5e1e4715544c67165bd4a36538d44ac41c67feb1451dcbd39

Observation 7f9ed6a9-a3a2-43c5-aacd-930eab901a5e · outbound

This paper cites an unresolved cited work.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work

Reference 30

Resolution
unresolved
raw_fallback, observed 2026-08-07T21:36:19.982063Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.558054Z digest=sha256:2787e216b4fb30bd6b0f4d3bd0b3135a192da13cadb276119a319c79547124e9

Observation 64eb255c-ac09-4a74-a887-d4f8e0058f25 · outbound

This paper cites Bellemare.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Bellemare

Reference 31

Resolution
unresolved
no resolver link, observed 2026-08-07T21:36:19.561426Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T21:36:19.561426Z digest=sha256:fb79ba4a8bbf382aa4c135bee78d306b5d6ff3eabd76895d50aceddab1df451e

Observation 039ddbee-795b-408e-a57e-f8aa5fd4e736 · outbound

This paper cites The geometry of robust value functions.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes The geometry of robust value functions

Reference 32

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:19.964291Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.564840Z digest=sha256:0692343e46b0bc4256737f82879b81807ebea20cedb9d573eb701d3692f5a304

Observation c2934878-e35f-4b07-b3aa-3d54fe13f949 · outbound

This paper cites Lightning Does Not Strike Twice: Robust MDPs with Coupled Uncertainty.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Lightning Does Not Strike Twice: Robust MDPs with Coupled Uncertainty

Reference 33

Resolution
verified exact
local_arxiv, observed 2026-08-07T21:36:19.692742Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.568498Z digest=sha256:7908cbfeef01253ef7e758e4e96730426ad8819f1f5bc6c2a891a0712e541b72

Observation 87e096e3-176b-4a56-8a34-29a9890f7309 · outbound

This paper cites an unresolved cited work.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work

Reference 34

Resolution
unresolved
raw_fallback, observed 2026-08-07T21:36:19.952879Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.572528Z digest=sha256:3b98320d8b64e8ce2885f3b1338c29af7b37bf50714eaa7cd287f9e5d3dd2412

Observation fc595b09-c6d7-4e2e-8f9a-2a2ce5757e56 · outbound

This paper cites Oliphant, Matt Haberland, Tyler Reddy, David Cournapeau, EvgeniBurovski, PearuPeterson, WarrenWeckesser, JonathanBright, StéfanJ.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Oliphant, Matt Haberland, Tyler Reddy, David Cournapeau, EvgeniBurovski, PearuPeterson, WarrenWeckesser, JonathanBright, StéfanJ

Reference 35

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:19.942183Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.575826Z digest=sha256:cc41a304c8e8335fc1c669fa09a1c2cbe564dedf0bfb1066279c9a1fba008e3c

Observation 649bac79-e0ab-4eff-af3e-0a715a06007b · outbound

This paper cites Policy gradient methods for reinforcement learning with function approximation.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Policy gradient methods for reinforcement learning with function approximation

Reference 36

Resolution
unresolved
no resolver link, observed 2026-08-07T21:36:19.579273Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T21:36:19.579273Z digest=sha256:df7bdccce348df6a9bd2c3b0567dc3b6cd7b752342998e0919e5b57cf05131cf

Observation 8aa4f6c6-9342-45fa-b733-83f9d17b8dbb · outbound

This paper cites an unresolved cited work.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work

Reference 37

Resolution
unresolved
raw_fallback, observed 2026-08-07T21:36:19.923924Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.583088Z digest=sha256:b212ebcd84776cf55500f56e3a537c3d49be77f2dea04e691967e748e1e0bb8d

Observation 0ce3b136-52f1-4a87-beaa-b93639cba9ad · outbound

This paper cites Cambridge University Press, March 2004.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Cambridge University Press, March 2004

Reference 38

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:19.913235Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.586820Z digest=sha256:e47db2d895d5ab9c32a52d6bc3547c66cef6bfb0ee82de5640d4cda2205e923d

Observation dddb15a4-ac21-499f-874e-573f4b4bf369 · outbound

This paper cites Policy gradient for reinforce- ment learning with general utilities, 2023.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Policy gradient for reinforce- ment learning with general utilities, 2023

Reference 39

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:19.902250Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.590353Z digest=sha256:674136a66bb65d8190e29795753914ccfa3e8496c2fdeb49e46902136c6feb91

Observation 9def3c86-ab34-4660-9448-3c3caaf52cd8 · outbound

This paper cites This makes sense, as the more the agent visits states with high uncertainty, the higher is the ability of the adversary to undermine it.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes This makes sense, as the more the agent visits states with high uncertainty, the higher is the ability of the adversary to undermine it

Reference 40

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:19.891391Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.594133Z digest=sha256:4bc9f11eeb93aeca9b69e48197aa3308c3a8931dd3d8b6945643fed9e54e4396

Observation 553b68c4-1f7c-4cdb-aac4-0c09dcfa1fac · outbound

This paper cites nominal value functionvπ R).

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes nominal value functionvπ R)

Reference 41

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:19.880758Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.598039Z digest=sha256:a1b3446635a77830377523a5943ded6553a1ac81d8051e55d5de15cb6c24d012

Observation 506d608b-819a-4519-9bb8-740b6421e2f5 · outbound

This paper cites This can be done, by putting negative entries ofk at maximal entries of vπ β, and positive entries ofkT at states which has minimum uncertainty value function.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes This can be done, by putting negative entries ofk at maximal entries of vπ β, and positive entries ofkT at states which has minimum uncertainty value function

Reference 42

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:19.870305Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.601727Z digest=sha256:ff61cd8f69a438d1d41c407179e764033622739d4f4981d05eafbd3c486dce47

Observation dd773552-dec4-43b5-89e0-b9bbb083db60 · outbound

This paper cites an unresolved cited work.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work

Reference 43

Resolution
unresolved
raw_fallback, observed 2026-08-07T21:36:19.859571Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.605716Z digest=sha256:c3e44010f554886e683ac52465eae1fdd4c3ce65db3bb7e891f847476aa752af

Observation 422fa3d0-5881-494f-ace0-786c9f567779 · outbound

This paper cites an unresolved cited work.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work

Reference 44

Resolution
unresolved
raw_fallback, observed 2026-08-07T21:36:19.849233Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.609273Z digest=sha256:3c9d6de8044c8ec09c9f61b32dd85f8665b14471da22ab516e8284e297240bdf

Observation b138513d-1381-4031-9656-dc3b6ae76802 · outbound

This paper cites an unresolved cited work.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work

Reference 45

Resolution
unresolved
raw_fallback, observed 2026-08-07T21:36:19.838287Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.612680Z digest=sha256:fff10fb0bdd56f78baeee0e11abf823df5c66e7e2008d89998f192a9e453dfe6

Observation 2edeacfe-e812-409b-92de-aaa3a4193d7d · outbound

This paper cites an unresolved cited work.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work

Reference 46

Resolution
unresolved
raw_fallback, observed 2026-08-07T21:36:19.828174Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.617065Z digest=sha256:fc2f7a140bb7b24b75404541de6c48dd4da5144c1ecb6927866f858e09441ff9

Observation 7c61d827-b01b-4157-b63f-9e7d2d5e4390 · outbound

This paper cites an unresolved cited work.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work

Reference 47

Resolution
unresolved
raw_fallback, observed 2026-08-07T21:36:19.817675Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.620603Z digest=sha256:9ccb73692ee597eaf5ffb1fbe38945c0fa0721a87b9713e52eb9629b1d88c3f4

Observation 6083aa55-ce62-4c26-95b0-2ae338ed70ce · outbound

This paper cites Robust policy evaluation is proven to be NP-hard for general uncertainty sets defined as intersections of finite hyperplanes [9].

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Robust policy evaluation is proven to be NP-hard for general uncertainty sets defined as intersections of finite hyperplanes [9]

Reference 48

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:19.806953Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.623783Z digest=sha256:fe10f4573a838517207cd2a43ef745613d5d82ec0fcf849af4632d1806a73c08

Observation a6dc41b7-5135-4578-9cbd-afb4f0b67f3d · outbound

This paper cites an unresolved cited work.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work

Reference 49

Resolution
unresolved
raw_fallback, observed 2026-08-07T21:36:19.796328Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.628677Z digest=sha256:4ec4f55f30582be5597eb2b47a0162ae21dd7816c3412f624c35f565fab9e549

Observation ec46a7bd-bc95-4f9d-907f-cb128b6f19b9 · outbound

This paper cites an unresolved cited work.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work

Reference 50

Resolution
unresolved
raw_fallback, observed 2026-08-07T21:36:19.785350Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.632037Z digest=sha256:d0e90b12c3e0658c8c78322ebbd00e0fb5832dea380cb2ef87e16afd45aec890

Observation 30afade0-ed22-44d1-97b1-8630032d946e · outbound

This paper cites This method is simple to implement but computationally expensive, as it evaluatesA for a large number of randomly generated vectors.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes This method is simple to implement but computationally expensive, as it evaluatesA for a large number of randomly generated vectors

Reference 51

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:19.774632Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.635470Z digest=sha256:d0562ef5280d9cbd869c1fabea2e12541ba4887d38638483cfa1e3eea7bd4454

Observation c2615a3f-5157-4667-a01d-4b66477e2297 · outbound

This paper cites an unresolved cited work.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work

Reference 52

Resolution
unresolved
raw_fallback, observed 2026-08-07T21:36:19.762906Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.638873Z digest=sha256:b81e1158007a114ed2760e2aee61ea1031122aed866a2a71d5027c575491f271

Observation 1f70338b-74cb-460f-8826-c216989c711e · outbound

This paper cites an unresolved cited work.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work

Reference 53

Resolution
unresolved
raw_fallback, observed 2026-08-07T21:36:19.750523Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.642236Z digest=sha256:c1c278b467201c221631106d078e72fd0dd32780e39f1f92bba6c46729fe6d23

Observation 68957e29-950d-41b5-8977-65ddcfb75bb0 · outbound

This paper cites This method provides the exact solution but is computationally more expensive than the spectral method.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes This method provides the exact solution but is computationally more expensive than the spectral method

Reference 54

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:19.739160Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.645535Z digest=sha256:dbb584fcc1f649383ec7ee88a1e500b4eb7f18621dbbefae7f7f46f927a9fa18

Observation 78aee9ed-86aa-46ea-97d7-7c98b435ce26 · outbound

This paper cites an unresolved cited work.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work

Reference 55

Resolution
unresolved
raw_fallback, observed 2026-08-07T21:36:19.727520Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.648971Z digest=sha256:d12e130f03866a19b17f25cb080bf50dea477d346a80f943c90687b50046e04f

Observation 9235abd9-1024-4bd0-b9ab-3a162974a240 · outbound

This paper cites an unresolved cited work.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Unresolved cited work

Reference 56

Resolution
unresolved
raw_fallback, observed 2026-08-07T21:36:19.716000Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.652497Z digest=sha256:03b11f8de5ade68c9512f6600bdd8ceb4df539084d8e38dca851766c2d8324e7

Observation a0231bc6-ba6b-48ac-9920-1d824e750f52 · outbound

This paper cites The results, including the optimal values and computational times, are recorded for each method.

Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes The results, including the optimal values and computational times, are recorded for each method

Reference 57

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T21:36:19.705050Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-07T21:36:19.656167Z digest=sha256:e205048ec6f0bae2f4db575275a2221d13006aef2c3ccbf2fad31ce07e9415f6

Pith citing papers

Observation 233a9c31-c3aa-46fd-b70b-debdf5215a43 · inbound

Robust Markov Decision Processes on Continuous State Spaces cites this paper.

Robust Markov Decision Processes on Continuous State Spaces Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes

Reference 24

Resolution
verified exact
arxiv_id, observed 2026-06-29T10:33:18.781161Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-06-29T10:31:29.175140Z digest=sha256:cb215387bf9d7e52d381e637d8cb0178c67b0ee3539f8c719fea09b7811ee626