Pith. sign in

Paper Citation Record · LEDGER

Exploration-Exploitation in Constrained MDPs

As of 10 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 15 inbound Pith citation observations for arXiv:2003.02189.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2003.02189 v1

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 15 of 15 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-10T06:31:04.303077+00:00

measured 15 of 15 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-07T13:35:48.684747Z

measured 1 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Reference resolution

0 of 0 outbound references displayed

  • verified exact0
  • verified fuzzy0
  • unresolved0
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

31
arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation eba87700-be3c-470c-a60c-50d2b7d0a52e · inbound

Last-Iterate Convergence of General Parameterized Policies in Constrained MDPs cites this paper.

Last-Iterate Convergence of General Parameterized Policies in Constrained MDPs Exploration-Exploitation in Constrained MDPs

Reference 11

Resolution
verified exact
arxiv_id, observed 2026-05-23T21:33:29.055069Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-23T21:28:42.912349Z digest=sha256:945431fd8bdcab0364c04ec98dd7a40226ea10b4be75a3399acb6beb93658512

Observation e715c81e-a517-4504-8d2b-dd23015a0d4e · inbound

Near-Optimal Policy Identification in Robust Constrained Markov Decision Processes via Epigraph Form cites this paper.

Near-Optimal Policy Identification in Robust Constrained Markov Decision Processes via Epigraph Form Exploration-Exploitation in Constrained MDPs

Reference 30

Resolution
verified exact
arxiv_id, observed 2026-05-23T22:03:30.941084Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=arxiv_source observed=2026-05-23T21:58:56.180393Z digest=sha256:2d909df2eda29101b255488d929d654da0c4096129223e3193a098ce89b08e6d

Observation 9b1fab1b-2b67-43ce-a413-b9e645253a4c · inbound

An Optimistic Algorithm for online CMDPS with Anytime Adversarial Constraints cites this paper.

An Optimistic Algorithm for online CMDPS with Anytime Adversarial Constraints Exploration-Exploitation in Constrained MDPs

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-07T13:35:48.684747Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T13:35:48.684747Z digest=sha256:b5440d0c45296680cbe9f8810c0d8d2216ac94a482adfd7c037b2b3046c8706d

Observation e0820b41-f4b5-402f-aef3-21ef84b9141e · inbound

No-Regret Learning Under Adversarial Resource Constraints: A Spending Plan Is All You Need! cites this paper.

No-Regret Learning Under Adversarial Resource Constraints: A Spending Plan Is All You Need! Exploration-Exploitation in Constrained MDPs

Reference 2020

Resolution
unresolved
no resolver link, observed 2026-08-07T00:44:26.431839Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T00:44:26.431839Z digest=sha256:b16368a02f61a8c60b4ec79b0a89b2d562415d06e471208a917f1f3359421360

Observation 5c4d3254-5465-45ec-98c1-039d7f78ac04 · inbound

Tail-Risk-Safe Monte Carlo Tree Search under PAC-Level Guarantees cites this paper.

Tail-Risk-Safe Monte Carlo Tree Search under PAC-Level Guarantees Exploration-Exploitation in Constrained MDPs

Reference 41

Resolution
unresolved
no resolver link, observed 2026-08-05T23:22:29.406776Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-05T23:22:29.406776Z digest=sha256:84977957612273286d7fa5feb201793c21d5f5d1ef28d3e642913d69d3b0f9ae

Observation 4060531c-1847-4585-b001-198f32c05dd6 · inbound

Know When to Explore: Difficulty-Aware Certainty as a Guide for LLM Reinforcement Learning cites this paper.

Know When to Explore: Difficulty-Aware Certainty as a Guide for LLM Reinforcement Learning Exploration-Exploitation in Constrained MDPs

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-05T14:23:52.737271Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-05T14:23:52.737271Z digest=sha256:796b1be8aa1805cba4569735a35af4f2f8b537f268ac8a3a2f497e0b3659aee9

Observation 571673aa-a36d-4155-abbd-62165f56dc9a · inbound

Beyond Slater's Condition in Online CMDPs with Stochastic and Adversarial Constraints cites this paper.

Beyond Slater's Condition in Online CMDPs with Stochastic and Adversarial Constraints Exploration-Exploitation in Constrained MDPs

Reference 2020

Resolution
unresolved
no resolver link, observed 2026-08-04T15:22:09.724181Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-04T15:22:09.724181Z digest=sha256:82884bb3683e17e30bc4d8c6e0a78f501f15451872329083c82dee6660a56470

Observation 80e66425-a1e9-4e7e-84c4-33d5736d10fe · inbound

Learning Safely Without Knowing the World:COMPASS-Hedge cites this paper.

Learning Safely Without Knowing the World:COMPASS-Hedge Exploration-Exploitation in Constrained MDPs

Reference 22

Resolution
verified exact
arxiv_id, observed 2026-05-25T07:16:41.926464Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-25T07:16:33.440440Z digest=sha256:1c66584d2dc1783d5a53a8e8c09a15eed4fb828d3d403d1e012b1d4bfeae3d6a

Observation 5c8c753c-d9c4-4ad7-a600-206c39652fe4 · inbound

Toward Optimal Regret in Robust Pricing: Decoupling Corruption and Time cites this paper.

Toward Optimal Regret in Robust Pricing: Decoupling Corruption and Time Exploration-Exploitation in Constrained MDPs

Reference 13

Resolution
verified exact
arxiv_id, observed 2026-05-12T02:26:15.751639Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=arxiv_source observed=2026-05-12T02:23:56.057336Z digest=sha256:a604daba1a00049a3fc1ab844a37e628fc121e8659724ac14eeee70bca988d54

Observation f84147f9-cbcb-42fb-8db7-abaa3fdf81c2 · inbound

Fast Rates for Offline Contextual Bandits with Forward-KL Regularization under Single-Policy Concentrability cites this paper.

Fast Rates for Offline Contextual Bandits with Forward-KL Regularization under Single-Policy Concentrability Exploration-Exploitation in Constrained MDPs

Reference 59

Resolution
metadata mismatch
arxiv_id, observed 2026-05-12T06:56:30.866351Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=arxiv_source observed=2026-05-12T03:47:14.379908Z digest=sha256:c900cdc49c502aeaac6cf229b0469b7f8ed2f3ff2b4ee5f790eb870a009b94cb

Observation a8e76c9d-688c-4462-8a74-f69ef1ed7247 · inbound

Online Resource Allocation With General Constraints cites this paper.

Online Resource Allocation With General Constraints Exploration-Exploitation in Constrained MDPs

Reference 12

Resolution
verified exact
arxiv_id, observed 2026-05-12T04:06:20.753688Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=arxiv_source observed=2026-05-12T04:04:36.278591Z digest=sha256:f753de4b050a0bd1c47bb748311b5d64c6bca05da50a1514f9ecde68a0f811a5

Observation 2b5a5595-2a6b-4c4a-8364-b719b4e9805d · inbound

Primal-Dual Policy Optimization for Linear CMDPs with Adversarial Losses cites this paper.

Primal-Dual Policy Optimization for Linear CMDPs with Adversarial Losses Exploration-Exploitation in Constrained MDPs

Reference 24

Resolution
metadata mismatch
arxiv_id, observed 2026-05-13T01:52:06.135233Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=arxiv_source observed=2026-05-13T01:10:23.797409Z digest=sha256:12640bce621344b657f4f2ccd20d6a4f5ca5b84d0e60c53ea974b30ecf52c991

Observation d8b31c72-80e8-42d3-b5c7-3141f7c14cce · inbound

Prudent-Banker: No Extra Fees for Baseline Safety in Adversarial Bandits With and Without Delays cites this paper.

Prudent-Banker: No Extra Fees for Baseline Safety in Adversarial Bandits With and Without Delays Exploration-Exploitation in Constrained MDPs

Reference 20

Resolution
verified exact
arxiv_id, observed 2026-05-25T05:30:22.948274Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-25T05:28:04.999708Z digest=sha256:7e643e6838998a9fd09bfb1fe2de2a9dfc824051e7696a116adfb32194a7da01

Observation 5291fe25-a104-46ec-bc95-384e868ab6e7 · inbound

Fairness in two-player zero-sum games with bandit feedback cites this paper.

Fairness in two-player zero-sum games with bandit feedback Exploration-Exploitation in Constrained MDPs

Reference 43

Resolution
metadata mismatch
arxiv_id, observed 2026-07-01T21:16:14.801108Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=arxiv_source observed=2026-06-28T17:14:08.601884Z digest=sha256:01cf22232ecc07588fc05473bdc55035abf1b2d7902a30f35fa69db8c66a834b

Observation 59dae569-6776-4900-9cc3-18c31c9f57c3 · inbound

Decoupling Corruption and Horizon in Robust Contextual Pricing cites this paper.

Decoupling Corruption and Horizon in Robust Contextual Pricing Exploration-Exploitation in Constrained MDPs

Reference 13

Resolution
unresolved
no resolver link, observed 2026-07-14T06:16:13.601515Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-07-14T06:16:13.601515Z digest=sha256:f8ed5a89de6b4a6506c590575615ab67c13cd55e0bcbccb2788e30fcbcd34de7