Pith. sign in

Paper Citation Record · LEDGER

Exploration-Exploitation in Constrained MDPs

As of 10 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 15 inbound Pith citation observations for arXiv:2003.02189.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2003.02189 v1

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 15 of 15 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-09T06:31:02.800959+00:00

measured 15 of 15 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-07T13:35:48.684747Z

measured 1 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Reference resolution

0 of 0 outbound references displayed

  • verified exact0
  • verified fuzzy0
  • unresolved0
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

31
arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation eba87700-be3c-470c-a60c-50d2b7d0a52e · inbound

Last-Iterate Convergence of General Parameterized Policies in Constrained MDPs cites this paper.

Last-Iterate Convergence of General Parameterized Policies in Constrained MDPs Exploration-Exploitation in Constrained MDPs

Reference 11

Resolution
verified exact
arxiv_id, observed 2026-05-23T21:33:29.055069Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-05-23T21:28:42.912349Z digest=sha256:38bf1787ea32e21a2305adab9f1c17cff738bfbe33dad29ba63d46fe8fa7551f

Observation e715c81e-a517-4504-8d2b-dd23015a0d4e · inbound

Near-Optimal Policy Identification in Robust Constrained Markov Decision Processes via Epigraph Form cites this paper.

Near-Optimal Policy Identification in Robust Constrained Markov Decision Processes via Epigraph Form Exploration-Exploitation in Constrained MDPs

Reference 30

Resolution
verified exact
arxiv_id, observed 2026-05-23T22:03:30.941084Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=arxiv_source observed=2026-05-23T21:58:56.180393Z digest=sha256:3bf3be103de9d94b39c6fa0468a66928d0ad0e5b41aa2ac293336f125b425d78

Observation 9b1fab1b-2b67-43ce-a413-b9e645253a4c · inbound

An Optimistic Algorithm for online CMDPS with Anytime Adversarial Constraints cites this paper.

An Optimistic Algorithm for online CMDPS with Anytime Adversarial Constraints Exploration-Exploitation in Constrained MDPs

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-07T13:35:48.684747Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T13:35:48.684747Z digest=sha256:9f26ca9a41639f8224fda89adc68885eddb2ea8ffe2e09598a2e233c6cc2af02

Observation e0820b41-f4b5-402f-aef3-21ef84b9141e · inbound

No-Regret Learning Under Adversarial Resource Constraints: A Spending Plan Is All You Need! cites this paper.

No-Regret Learning Under Adversarial Resource Constraints: A Spending Plan Is All You Need! Exploration-Exploitation in Constrained MDPs

Reference 2020

Resolution
unresolved
no resolver link, observed 2026-08-07T00:44:26.431839Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T00:44:26.431839Z digest=sha256:b16368a02f61a8c60b4ec79b0a89b2d562415d06e471208a917f1f3359421360

Observation 5c4d3254-5465-45ec-98c1-039d7f78ac04 · inbound

Tail-Risk-Safe Monte Carlo Tree Search under PAC-Level Guarantees cites this paper.

Tail-Risk-Safe Monte Carlo Tree Search under PAC-Level Guarantees Exploration-Exploitation in Constrained MDPs

Reference 41

Resolution
unresolved
no resolver link, observed 2026-08-05T23:22:29.406776Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-05T23:22:29.406776Z digest=sha256:84977957612273286d7fa5feb201793c21d5f5d1ef28d3e642913d69d3b0f9ae

Observation 4060531c-1847-4585-b001-198f32c05dd6 · inbound

Know When to Explore: Difficulty-Aware Certainty as a Guide for LLM Reinforcement Learning cites this paper.

Know When to Explore: Difficulty-Aware Certainty as a Guide for LLM Reinforcement Learning Exploration-Exploitation in Constrained MDPs

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-05T14:23:52.737271Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-05T14:23:52.737271Z digest=sha256:796b1be8aa1805cba4569735a35af4f2f8b537f268ac8a3a2f497e0b3659aee9

Observation 571673aa-a36d-4155-abbd-62165f56dc9a · inbound

Beyond Slater's Condition in Online CMDPs with Stochastic and Adversarial Constraints cites this paper.

Beyond Slater's Condition in Online CMDPs with Stochastic and Adversarial Constraints Exploration-Exploitation in Constrained MDPs

Reference 2020

Resolution
unresolved
no resolver link, observed 2026-08-04T15:22:09.724181Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-04T15:22:09.724181Z digest=sha256:82884bb3683e17e30bc4d8c6e0a78f501f15451872329083c82dee6660a56470

Observation 80e66425-a1e9-4e7e-84c4-33d5736d10fe · inbound

Learning Safely Without Knowing the World:COMPASS-Hedge cites this paper.

Learning Safely Without Knowing the World:COMPASS-Hedge Exploration-Exploitation in Constrained MDPs

Reference 22

Resolution
verified exact
arxiv_id, observed 2026-05-25T07:16:41.926464Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-05-25T07:16:33.440440Z digest=sha256:85d6a033aa22558295f08ec0625e372f1fb292b5366a7ad8f3221b70400279f5

Observation 5c8c753c-d9c4-4ad7-a600-206c39652fe4 · inbound

Toward Optimal Regret in Robust Pricing: Decoupling Corruption and Time cites this paper.

Toward Optimal Regret in Robust Pricing: Decoupling Corruption and Time Exploration-Exploitation in Constrained MDPs

Reference 13

Resolution
verified exact
arxiv_id, observed 2026-05-12T02:26:15.751639Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=arxiv_source observed=2026-05-12T02:23:56.057336Z digest=sha256:df9d5e1807aceaacd9d8b9dfbf31fa1210c5f4863a1cdadfdf575fc85ff58b20

Observation f84147f9-cbcb-42fb-8db7-abaa3fdf81c2 · inbound

Fast Rates for Offline Contextual Bandits with Forward-KL Regularization under Single-Policy Concentrability cites this paper.

Fast Rates for Offline Contextual Bandits with Forward-KL Regularization under Single-Policy Concentrability Exploration-Exploitation in Constrained MDPs

Reference 59

Resolution
metadata mismatch
arxiv_id, observed 2026-05-12T06:56:30.866351Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=arxiv_source observed=2026-05-12T03:47:14.379908Z digest=sha256:161c48bf3d30ebb6f22270e7cfd7f3aee5092f760774206985b7391b75808915

Observation a8e76c9d-688c-4462-8a74-f69ef1ed7247 · inbound

Online Resource Allocation With General Constraints cites this paper.

Online Resource Allocation With General Constraints Exploration-Exploitation in Constrained MDPs

Reference 12

Resolution
verified exact
arxiv_id, observed 2026-05-12T04:06:20.753688Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=arxiv_source observed=2026-05-12T04:04:36.278591Z digest=sha256:5a6d1cd630ca3677239ac15b492863ea89ec3ccd12ec017f39a73ab7c136363e

Observation 2b5a5595-2a6b-4c4a-8364-b719b4e9805d · inbound

Primal-Dual Policy Optimization for Linear CMDPs with Adversarial Losses cites this paper.

Primal-Dual Policy Optimization for Linear CMDPs with Adversarial Losses Exploration-Exploitation in Constrained MDPs

Reference 24

Resolution
metadata mismatch
arxiv_id, observed 2026-05-13T01:52:06.135233Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=arxiv_source observed=2026-05-13T01:10:23.797409Z digest=sha256:1afea1b39800b8ff183c4024242a1b1ee7622e01fd594b89b1975cd2a301fa4d

Observation d8b31c72-80e8-42d3-b5c7-3141f7c14cce · inbound

Prudent-Banker: No Extra Fees for Baseline Safety in Adversarial Bandits With and Without Delays cites this paper.

Prudent-Banker: No Extra Fees for Baseline Safety in Adversarial Bandits With and Without Delays Exploration-Exploitation in Constrained MDPs

Reference 20

Resolution
verified exact
arxiv_id, observed 2026-05-25T05:30:22.948274Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-05-25T05:28:04.999708Z digest=sha256:d65160640d9a9944eeddb9405f12252f28d33f43b2138ead537bb80bd2102bfe

Observation 5291fe25-a104-46ec-bc95-384e868ab6e7 · inbound

Fairness in two-player zero-sum games with bandit feedback cites this paper.

Fairness in two-player zero-sum games with bandit feedback Exploration-Exploitation in Constrained MDPs

Reference 43

Resolution
metadata mismatch
arxiv_id, observed 2026-07-01T21:16:14.801108Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=arxiv_source observed=2026-06-28T17:14:08.601884Z digest=sha256:88a9e92bf66cbd0923508de1025e1a0a8a8fb2c969eed16b91963ff73e6d25fa

Observation 59dae569-6776-4900-9cc3-18c31c9f57c3 · inbound

Decoupling Corruption and Horizon in Robust Contextual Pricing cites this paper.

Decoupling Corruption and Horizon in Robust Contextual Pricing Exploration-Exploitation in Constrained MDPs

Reference 13

Resolution
unresolved
no resolver link, observed 2026-07-14T06:16:13.601515Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-07-14T06:16:13.601515Z digest=sha256:f8ed5a89de6b4a6506c590575615ab67c13cd55e0bcbccb2788e30fcbcd34de7