Paper Citation Record · LEDGER

Non-Stationary Restless Multi-Armed Bandits with Provable Guarantee

As of 10 August 2026, this Paper Citation Record lists 29 of 29 outbound references and 0 inbound Pith citation observations for arXiv:2508.10804.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2508.10804 v1

Coverage vector

measured 29 of 29 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-05T20:27:04.535925Z

measured 29 of 29 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-10T06:31:04.303077+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

29 of 29 outbound references displayed

verified exact3
verified fuzzy20
unresolved6
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation e219ae47-4f7b-4d24-bdd4-15a4dfab993d · outbound

This paper cites Whittle’s index policy for a multi-class queueing system with convex holding costs.

Non-Stationary Restless Multi-Armed Bandits with Provable Guarantee Whittle’s index policy for a multi-class queueing system with convex holding costs

Reference 1

Resolution: verified fuzzy; raw_fallback, observed 2026-08-05T20:27:10.088833Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation 57191e67-757e-47ab-a81c-20927c5d9c1f · outbound

This paper cites Dynamic allocation indices for restless projects and queueing admission control: a polyhedral approach.

Non-Stationary Restless Multi-Armed Bandits with Provable Guarantee Dynamic allocation indices for restless projects and queueing admission control: a polyhedral approach

Reference 2

Resolution: verified fuzzy; raw_fallback, observed 2026-08-05T20:27:09.843742Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation 61adbc05-dd6d-496b-83aa-e821ae97042b · outbound

This paper cites Field study in deploying restless multi- armed bandits: Assisting non-profits in improving maternal and child health.

Non-Stationary Restless Multi-Armed Bandits with Provable Guarantee Field study in deploying restless multi- armed bandits: Assisting non-profits in improving maternal and child health

Reference 3

Resolution: verified fuzzy; raw_fallback, observed 2026-08-05T20:27:09.581931Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation 5634b63f-55e1-4272-afdb-a302923553bc · outbound

This paper cites Collapsing bandits and their application to public health intervention.

Non-Stationary Restless Multi-Armed Bandits with Provable Guarantee Collapsing bandits and their application to public health intervention

Reference 4

Resolution: verified fuzzy; raw_fallback, observed 2026-08-05T20:27:09.368472Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation 36e713a6-2481-4cb5-b13c-0b44269523c4 · outbound

This paper cites Distributed optimal relay selection in wireless cooperative networks with finite-state markov channels.

Non-Stationary Restless Multi-Armed Bandits with Provable Guarantee Distributed optimal relay selection in wireless cooperative networks with finite-state markov channels

Reference 5

Resolution: verified fuzzy; raw_fallback, observed 2026-08-05T20:27:09.143708Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation 6531ab99-6dca-4f7b-bccf-825758c92033 · outbound

This paper cites Cell association with user behavior awareness in heterogeneous cellular networks.

Non-Stationary Restless Multi-Armed Bandits with Provable Guarantee Cell association with user behavior awareness in heterogeneous cellular networks

Reference 6

Resolution: verified fuzzy; raw_fallback, observed 2026-08-05T20:27:08.917036Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation a863df58-7f4a-49c3-a485-c81a1ac39673 · outbound

This paper cites Optimistic whittle index policy: Online learning for restless bandits.

Non-Stationary Restless Multi-Armed Bandits with Provable Guarantee Optimistic whittle index policy: Online learning for restless bandits

Reference 7

Resolution: verified fuzzy; raw_fallback, observed 2026-08-05T20:27:08.723592Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation 489a499a-f7a1-41d8-a302-59a33b08cc3f · outbound

This paper cites Reinforcement learning for non- stationary markov decision processes: The blessing of (more) optimism.

Non-Stationary Restless Multi-Armed Bandits with Provable Guarantee Reinforcement learning for non- stationary markov decision processes: The blessing of (more) optimism

Reference 8

Resolution: verified fuzzy; raw_fallback, observed 2026-08-05T20:27:08.424887Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation 1ef18fa3-6690-455b-8141-7c7e02bd0c39 · outbound

This paper cites Regret bounds for thompson sampling in episodic restless bandit problems.

Non-Stationary Restless Multi-Armed Bandits with Provable Guarantee Regret bounds for thompson sampling in episodic restless bandit problems

Reference 9

Resolution: verified fuzzy; raw_fallback, observed 2026-08-05T20:27:08.210494Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation 51d51be1-e07d-41b9-9b0f-d96e31b4ed55 · outbound

This paper cites Thompson Sampling in Non-Episodic Restless Bandits.

Non-Stationary Restless Multi-Armed Bandits with Provable Guarantee Thompson Sampling in Non-Episodic Restless Bandits

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-05T20:27:02.648338Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 95c17267-f2e2-44d0-9843-112aafd5f792 · outbound

This paper cites Restless bandits: Activity allocation in a changing world.

Non-Stationary Restless Multi-Armed Bandits with Provable Guarantee Restless bandits: Activity allocation in a changing world

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-05T20:27:02.738561Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1a471b5c-7ae8-408f-aa8e-197778d1fcc4 · outbound

This paper cites Introduction to multi-armed bandits.

Non-Stationary Restless Multi-Armed Bandits with Provable Guarantee Introduction to multi-armed bandits

Reference 12

Resolution: verified fuzzy; raw_fallback, observed 2026-08-05T20:27:08.064518Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation 579c20fe-caee-4318-9d21-6dc70c8324f4 · outbound

This paper cites Algorithms for multi-armed bandit problems.

Non-Stationary Restless Multi-Armed Bandits with Provable Guarantee Algorithms for multi-armed bandit problems

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-05T20:27:02.916543Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1d4e2415-cdb7-434e-a79d-f3ae2fa2cc28 · outbound

This paper cites The complexity of optimal queuing network control.

Non-Stationary Restless Multi-Armed Bandits with Provable Guarantee The complexity of optimal queuing network control

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-05T20:27:02.998565Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 41cbc4cd-3155-420d-bd28-8e757f3872a2 · outbound

This paper cites On an index policy for restless bandits.

Non-Stationary Restless Multi-Armed Bandits with Provable Guarantee On an index policy for restless bandits

Reference 15

Resolution: verified fuzzy; raw_fallback, observed 2026-08-05T20:27:07.814489Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation fa63806b-c50f-40da-9175-ee81a4a4f7e7 · outbound

This paper cites A restless bandit formulation of opportunistic access: Indexablity and index policy.

Non-Stationary Restless Multi-Armed Bandits with Provable Guarantee A restless bandit formulation of opportunistic access: Indexablity and index policy

Reference 16

Resolution: verified fuzzy; raw_fallback, observed 2026-08-05T20:27:07.643212Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation 04aad0be-57c6-4ceb-9d86-78f7a112e136 · outbound

This paper cites Indexability of restless bandit problems and optimality of whittle index for dynamic multichannel access.IEEE Transactions on Information Theory, 56(11):5547– 5567, 2010.

Non-Stationary Restless Multi-Armed Bandits with Provable Guarantee Indexability of restless bandit problems and optimality of whittle index for dynamic multichannel access.IEEE Transactions on Information Theory, 56(11):5547– 5567, 2010

Reference 17

Resolution: verified fuzzy; raw_fallback, observed 2026-08-05T20:27:07.327107Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation 3771e6c2-68db-4240-9077-3604d2a8ee23 · outbound

This paper cites Qwi: Q-learning with whittle index.

Non-Stationary Restless Multi-Armed Bandits with Provable Guarantee Qwi: Q-learning with whittle index

Reference 18

Resolution: verified fuzzy; raw_fallback, observed 2026-08-05T20:27:07.145281Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation f69f6a6f-b8de-421c-a133-d25ac6296dcc · outbound

This paper cites Learn to Intervene: An Adaptive Learning Policy for Restless Bandits in Application to Preventive Healthcare.

Non-Stationary Restless Multi-Armed Bandits with Provable Guarantee Learn to Intervene: An Adaptive Learning Policy for Restless Bandits in Application to Preventive Healthcare

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-05T20:27:03.273298Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 96ce33c7-4b11-4ccf-9b88-4ea9e493c82a · outbound

This paper cites Towards q-learning the whittle index for restless bandits.

Non-Stationary Restless Multi-Armed Bandits with Provable Guarantee Towards q-learning the whittle index for restless bandits

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-05T20:27:03.350381Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 93a38f69-b969-433e-97bb-cf564ef7329d · outbound

This paper cites Near-optimal regret bounds for reinforcement learning.

Non-Stationary Restless Multi-Armed Bandits with Provable Guarantee Near-optimal regret bounds for reinforcement learning

Reference 21

Resolution: verified fuzzy; raw_fallback, observed 2026-08-05T20:27:06.923679Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation 18741a19-acf4-45f8-aa35-a7167068442e · outbound

This paper cites Logarithmic online regret bounds for undiscounted reinforcement learning.

Non-Stationary Restless Multi-Armed Bandits with Provable Guarantee Logarithmic online regret bounds for undiscounted reinforcement learning

Reference 22

Resolution: verified fuzzy; raw_fallback, observed 2026-08-05T20:27:06.669105Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation c88f8d83-b79f-41fa-9a46-20deb7bd4c54 · outbound

This paper cites REGAL: A Regularization based Algorithm for Reinforcement Learning in Weakly Communicating MDPs.

Non-Stationary Restless Multi-Armed Bandits with Provable Guarantee REGAL: A Regularization based Algorithm for Reinforcement Learning in Weakly Communicating MDPs

Reference 23

Resolution: verified exact; local_arxiv, observed 2026-08-05T20:27:05.256092Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation 5325003f-4bfd-45f6-9c7d-5bfc62280e21 · outbound

This paper cites Non-stationary reinforcement learning without prior knowledge: An optimal black-box approach.

Non-Stationary Restless Multi-Armed Bandits with Provable Guarantee Non-stationary reinforcement learning without prior knowledge: An optimal black-box approach

Reference 24

Resolution: verified fuzzy; raw_fallback, observed 2026-08-05T20:27:06.481285Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation de96fa00-8325-4043-88b8-9c607e7228b5 · outbound

This paper cites A Sliding-Window Algorithm for Markov Decision Processes with Arbitrarily Changing Rewards and Transitions.

Non-Stationary Restless Multi-Armed Bandits with Provable Guarantee A Sliding-Window Algorithm for Markov Decision Processes with Arbitrarily Changing Rewards and Transitions

Reference 25

Resolution: verified exact; local_arxiv, observed 2026-08-05T20:27:05.038455Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation 0de02645-306b-4cd3-b529-8919694cc5a7 · outbound

This paper cites Near-optimal model-free reinforcement learning in non-stationary episodic mdps.

Non-Stationary Restless Multi-Armed Bandits with Provable Guarantee Near-optimal model-free reinforcement learning in non-stationary episodic mdps

Reference 26

Resolution: verified fuzzy; raw_fallback, observed 2026-08-05T20:27:06.110026Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation c11553c4-59ca-472e-ab2e-dfb59c929753 · outbound

This paper cites Learning in a changing world: Restless multiarmed bandit with unknown dynamics.

Non-Stationary Restless Multi-Armed Bandits with Provable Guarantee Learning in a changing world: Restless multiarmed bandit with unknown dynamics

Reference 27

Resolution: verified fuzzy; raw_fallback, observed 2026-08-05T20:27:05.833904Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation 0ba162fe-673c-4ab2-8097-ecca8b779c80 · outbound

This paper cites Regret Bounds for Discounted MDPs.

Non-Stationary Restless Multi-Armed Bandits with Provable Guarantee Regret Bounds for Discounted MDPs

Reference 28

Resolution: verified exact; local_arxiv, observed 2026-08-05T20:27:04.837991Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation d81409f8-2fdf-4991-bbee-084a78a9f3b2 · outbound

This paper cites X t∈N γt−1 R(st, at) − λ∗ t πt(st)⊤1 − K | s1 = s # (31) ≤ E(s,a)∼(P ,πt).

Non-Stationary Restless Multi-Armed Bandits with Provable Guarantee X t∈N γt−1 R(st, at) − λ∗ t πt(st)⊤1 − K | s1 = s # (31) ≤ E(s,a)∼(P ,πt)

Reference 29

Resolution: verified fuzzy; raw_fallback, observed 2026-08-05T20:27:05.546835Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Pith citing papers

No inbound Pith citation observations are available.