Pith. sign in

Paper Citation Record · LEDGER

A Bit of Freedom Goes a Long Way: Classical and Quantum Algorithms for Reinforcement Learning under a Generative Model

As of 21 August 2026, this Paper Citation Record lists 16 of 16 outbound references and 1 inbound Pith citation observation for arXiv:2507.22854.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2507.22854 v3

Coverage vector

measured 16 of 16 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T11:22:57.874474Z

measured 17 of 17 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-21T06:32:19.484+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-15T15:07:17.743225Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-08-15T15:07:18.042953Z

Reference resolution

16 of 16 outbound references displayed

  • verified exact1
  • verified fuzzy10
  • unresolved5
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 75fe3cf3-5c90-4468-bd2e-87fc122f11db · outbound

This paper cites Markov decision processes with their applications , vol- ume 14.

A Bit of Freedom Goes a Long Way: Classical and Quantum Algorithms for Reinforcement Learning under a Generative Model Markov decision processes with their applications , vol- ume 14

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-06T11:22:57.842621Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:22:57.842621Z digest=sha256:10a69010d0e32c563f534c225f019e6835c52b3c22d453a73a7f0f27740df7f0

Observation 4818222d-efd6-4c52-9fad-972f49f8c88e · outbound

This paper cites Approximations and Learning for Continuous State and Action MDPs under Average Cost Criteria.

A Bit of Freedom Goes a Long Way: Classical and Quantum Algorithms for Reinforcement Learning under a Generative Model Approximations and Learning for Continuous State and Action MDPs under Average Cost Criteria

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-06T11:22:57.846867Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:22:57.846867Z digest=sha256:596bb84f7007442965ddcaa8ce88fe36abfd7801c199876d03ef9b8f69eb7da0

Observation de05e2e0-113e-441b-9c5e-e193260455b9 · outbound

This paper cites Almost optimal model-free reinforce- ment learningvia reference-advantage decomposition.

A Bit of Freedom Goes a Long Way: Classical and Quantum Algorithms for Reinforcement Learning under a Generative Model Almost optimal model-free reinforce- ment learningvia reference-advantage decomposition

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T11:22:58.102079Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-06T11:22:57.874474Z digest=sha256:7a2a98fe38973354e5c087e60f226d235f54950bf39b399cfa6f543b3973bfdf

Observation 67e72fbd-9ef6-47f6-9b05-2f1f3fffb0e4 · outbound

This paper cites A Quantum Algorithm for Finding the Minimum.

A Bit of Freedom Goes a Long Way: Classical and Quantum Algorithms for Reinforcement Learning under a Generative Model A Quantum Algorithm for Finding the Minimum

Reference 1998

Resolution
unresolved
no resolver link, observed 2026-08-06T11:22:57.829026Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:22:57.829026Z digest=sha256:183a4403b88ea1be3a3d5c4f8c284c151c0c6a5d3a324eb37b0f217dfbb0ae48

Observation 18e15db9-9115-45ca-9938-caa8c5ed36a4 · outbound

This paper cites Improved Analysis of UCRL2 with Empirical Bernstein Inequality.

A Bit of Freedom Goes a Long Way: Classical and Quantum Algorithms for Reinforcement Learning under a Generative Model Improved Analysis of UCRL2 with Empirical Bernstein Inequality

Reference 2005

Resolution
unresolved
no resolver link, observed 2026-08-06T11:22:57.833805Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:22:57.833805Z digest=sha256:a7f56b92cdd7ae69420e54a52e751cda4f482dda9b03bcec90c469791272de63

Observation ab7710d8-836a-4d91-a4b9-2db33c708e67 · outbound

This paper cites Minimax regret bounds for reinforcement learning.

A Bit of Freedom Goes a Long Way: Classical and Quantum Algorithms for Reinforcement Learning under a Generative Model Minimax regret bounds for reinforcement learning

Reference 2006

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T11:22:58.190660Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-06T11:22:57.819860Z digest=sha256:05db69b9cbf33748c9b8f8c813f0cec6fc7aacae992de7142245fc96baff3cd6

Observation e68d45e1-769e-4625-98ba-b3e184298ee1 · outbound

This paper cites Logarithmic online regret bounds for undiscounted reinforcement learning.

A Bit of Freedom Goes a Long Way: Classical and Quantum Algorithms for Reinforcement Learning under a Generative Model Logarithmic online regret bounds for undiscounted reinforcement learning

Reference 2008

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T11:22:58.204202Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-06T11:22:57.815098Z digest=sha256:792e5403421934435cac0033295875b507cc4d882e7467b584bf80a3ba887cd0

Observation fd105edd-8c00-41f0-9eea-5e0d78751993 · outbound

This paper cites Near-optimal regret bounds for reinforcement learning.

A Bit of Freedom Goes a Long Way: Classical and Quantum Algorithms for Reinforcement Learning under a Generative Model Near-optimal regret bounds for reinforcement learning

Reference 2012

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T11:22:58.217846Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-06T11:22:57.810526Z digest=sha256:a317febf0cb130a49b36048b1651df00c456d3be0b8137cfdf0ba9e7dad546b1

Observation 67ae80fc-2a13-42db-b016-b8c2233fdfb5 · outbound

This paper cites Improved regret bounds for undiscounted continuous reinforcement learning.

A Bit of Freedom Goes a Long Way: Classical and Quantum Algorithms for Reinforcement Learning under a Generative Model Improved regret bounds for undiscounted continuous reinforcement learning

Reference 2013

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T11:22:58.146322Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-06T11:22:57.852347Z digest=sha256:a051016cbd85fcb66a1ec2f084c2ae7119bb17535293f53b4cbe77f1a8a6a7da

Observation fcb39ba7-a87b-49a5-835d-76a1daa5cb04 · outbound

This paper cites Quantum probability oracles & multidimensional amplitude estimation.

A Bit of Freedom Goes a Long Way: Classical and Quantum Algorithms for Reinforcement Learning under a Generative Model Quantum probability oracles & multidimensional amplitude estimation

Reference 2017

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T11:22:58.176021Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-06T11:22:57.824455Z digest=sha256:46f46332ebc8648bc8c3c5a23cfcd6ae2fd44759d91c82a2ce955b6536ce8063

Observation 0556d1d9-6889-41e9-b3d4-aaf336d63979 · outbound

This paper cites Dynamic policy programming.

A Bit of Freedom Goes a Long Way: Classical and Quantum Algorithms for Reinforcement Learning under a Generative Model Dynamic policy programming

Reference 2018

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T11:22:58.231651Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-06T11:22:57.805142Z digest=sha256:28ac0e127943c99c83f2000bd999cbc4c246268a767055d2352bd3db454dc2aa

Observation ed7c7f1b-2f63-4f6f-8943-36aa2379ada7 · outbound

This paper cites Hernandez-Lerma.

A Bit of Freedom Goes a Long Way: Classical and Quantum Algorithms for Reinforcement Learning under a Generative Model Hernandez-Lerma

Reference 2020

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T11:22:58.160474Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-06T11:22:57.838527Z digest=sha256:0ba7a27cfaf6248be0b874254a4014d30f0c46a38ea3f4c6024beb0ca829e04f

Observation f54689f6-5d42-400b-a9bf-f0e1dfc99477 · outbound

This paper cites Near Sample-Optimal Reduction-based Policy Learning for Average Reward MDP.

A Bit of Freedom Goes a Long Way: Classical and Quantum Algorithms for Reinforcement Learning under a Generative Model Near Sample-Optimal Reduction-based Policy Learning for Average Reward MDP

Reference 2021

Resolution
unresolved
no resolver link, observed 2026-08-06T11:22:57.865812Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:22:57.865812Z digest=sha256:0cf72a855df926342d6fd7b7a5b321a123fdd35f23954aebc19a86b63e326021

Observation b77448f8-06d7-44bd-b9a2-9dfae67d3fa4 · outbound

This paper cites Interactive value iteration for Markov decision processes with unknown rewards.

A Bit of Freedom Goes a Long Way: Classical and Quantum Algorithms for Reinforcement Learning under a Generative Model Interactive value iteration for Markov decision processes with unknown rewards

Reference 2022

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T11:22:58.117270Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-06T11:22:57.870544Z digest=sha256:de1e3eb3570bffe589672f7884a2cb0b17da848a24b0e3578fd8af3b9aed0e3f

Observation f4f8c309-e9e0-4570-b2c3-ad3751b2b498 · outbound

This paper cites Learn- ing infinite-horizon average-reward MDPs with linear function approximation.

A Bit of Freedom Goes a Long Way: Classical and Quantum Algorithms for Reinforcement Learning under a Generative Model Learn- ing infinite-horizon average-reward MDPs with linear function approximation

Reference 2023

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T11:22:58.131921Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-06T11:22:57.861761Z digest=sha256:df0017177e7ce5e7eb65d91de24108897424fcc39024a2a27dc7069eb8494583

Observation 87020556-fd2f-4104-b40c-d19aa609a1d4 · outbound

This paper cites Quantum Algorithms for Bandits with Knapsacks with Improved Regret and Time Complexities.

A Bit of Freedom Goes a Long Way: Classical and Quantum Algorithms for Reinforcement Learning under a Generative Model Quantum Algorithms for Bandits with Knapsacks with Improved Regret and Time Complexities

Reference 2024

Resolution
verified exact
local_arxiv, observed 2026-08-06T11:22:57.934217Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-06T11:22:57.856397Z digest=sha256:7df92c3a3dcef97eec680c19c11ca014c979595364786f2b5c2bd1fe6dff68b5

Pith citing papers

Observation 73a7406c-769d-4718-a6bd-433367a55a14 · inbound

Improved Quantum Algorithms for Reinforcement Learning Under a Generative Model cites this paper.

Improved Quantum Algorithms for Reinforcement Learning Under a Generative Model A Bit of Freedom Goes a Long Way: Classical and Quantum Algorithms for Reinforcement Learning under a Generative Model

Reference 4

Resolution
verified exact
local_arxiv, observed 2026-08-15T15:07:18.047918Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-15T15:07:17.743225Z digest=sha256:d45b78b8f68b55edc384f86f3fe22c6fac7f22a1139448d561339cd088a913c3