Paper Citation Record · LEDGER

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning

As of 17 August 2026, this Paper Citation Record lists 44 of 44 outbound references and 0 inbound Pith citation observations for arXiv:2411.08360.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2411.08360 v1

Coverage vector

measured 44 of 44 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-12T21:48:16.963053Z

measured 44 of 44 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-17T06:30:58.91139+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

44 of 44 outbound references displayed

verified exact1
verified fuzzy28
unresolved15
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 25ddcad1-4e33-4998-b32e-9fd794e2fa47 · outbound

This paper cites Reinforcement learning: An introduction.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning Reinforcement learning: An introduction

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-12T21:48:16.793163Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e33c4ae6-81d7-4c58-90bd-503960edf392 · outbound

This paper cites Reliable adaptive recoding for batched network coding with burst-noise channels.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning Reliable adaptive recoding for batched network coding with burst-noise channels

Reference 2

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T21:48:17.614969Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation df5fc6d5-2f8c-4203-ad21-3b5818c1a4a2 · outbound

This paper cites Markov decision processes with applications in wireless sensor networks: A survey.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning Markov decision processes with applications in wireless sensor networks: A survey

Reference 3

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T21:48:17.601632Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 8aa9d975-95bb-486c-84ea-e591686ef37a · outbound

This paper cites Q-learning algorithms: A comprehensive classification and appli- cations.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning Q-learning algorithms: A comprehensive classification and appli- cations

Reference 4

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T21:48:17.589829Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 5f436d24-5220-4a6a-81ca-e70262b8f621 · outbound

This paper cites Q-learning: Theory and applications.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning Q-learning: Theory and applications

Reference 5

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T21:48:17.577270Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 9f69c23c-ae2d-45c6-a9ae-8c326e57506a · outbound

This paper cites Double Q-learning.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning Double Q-learning

Reference 6

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T21:48:17.564179Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 14c6601e-c24c-4952-8378-c58e0e32367b · outbound

This paper cites Ensemble bootstrapping for Q-learning.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning Ensemble bootstrapping for Q-learning

Reference 7

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T21:48:17.548708Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation a2fbc0ca-5be0-4711-98bd-5ba95cd1fadf · outbound

This paper cites Maxmin Q-learning: Controlling the Estimation Bias of Q-learning.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning Maxmin Q-learning: Controlling the Estimation Bias of Q-learning

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-12T21:48:16.823437Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 788b4e98-d8e9-49e1-9cde-98ff85b29814 · outbound

This paper cites Speedy Q-learning.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning Speedy Q-learning

Reference 9

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T21:48:17.534597Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 437f5186-876e-428d-ad25-e206beb3b5ae · outbound

This paper cites Pac model-free reinforcement learning.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning Pac model-free reinforcement learning

Reference 10

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T21:48:17.503165Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation fdb3a6f6-4545-41b9-bcbd-6b76f079f28b · outbound

This paper cites Neural fitted Q iteration–first experiences with a data efficient neural reinforcement learning method.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning Neural fitted Q iteration–first experiences with a data efficient neural reinforcement learning method

Reference 11

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T21:48:17.490087Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation e8529386-077f-48d3-aff5-270c99a98bdd · outbound

This paper cites Deep exploration via bootstrapped dqn.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning Deep exploration via bootstrapped dqn

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-12T21:48:16.839747Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 437aba3e-ae67-4b77-9ca5-84988a9186ab · outbound

This paper cites Playing Atari with Deep Reinforcement Learning.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning Playing Atari with Deep Reinforcement Learning

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-12T21:48:16.843382Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 93088779-e9d7-477c-9357-8f8d585e4d46 · outbound

This paper cites Q-learning with linear function approximation.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning Q-learning with linear function approximation

Reference 14

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T21:48:17.469419Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation c4b897ad-5a0e-468c-a703-3d727afdbec3 · outbound

This paper cites Sample complexity of reinforcement learning using linearly combined model ensembles.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning Sample complexity of reinforcement learning using linearly combined model ensembles

Reference 15

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T21:48:17.438526Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 2cdac10e-b52c-4cb3-aeb4-900e4b5f0a31 · outbound

This paper cites Model-Ensemble Trust-Region Policy Optimization.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning Model-Ensemble Trust-Region Policy Optimization

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-12T21:48:16.858060Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9fc40cfa-629d-46e3-adf7-3a93dd311a94 · outbound

This paper cites Deep reinforcement learning in a handful of trials using prob- abilistic dynamics models.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning Deep reinforcement learning in a handful of trials using prob- abilistic dynamics models

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-12T21:48:16.862136Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bf293276-88c3-4155-ad35-927b6832fecf · outbound

This paper cites Asynchronous methods for deep reinforcement learning.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning Asynchronous methods for deep reinforcement learning

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-12T21:48:16.865881Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 35e61a55-621d-4e71-9e1b-795e9e89febf · outbound

This paper cites Ensemble link learning for large state space multiple access communications.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning Ensemble link learning for large state space multiple access communications

Reference 19

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T21:48:17.392417Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation f911ecda-c405-4234-bd60-bd8ea2784f04 · outbound

This paper cites Ensemble graph Q-learning for large scale networks.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning Ensemble graph Q-learning for large scale networks

Reference 20

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T21:48:17.377898Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation f1f5829f-c46c-415a-9af1-6c27bc24101b · outbound

This paper cites Multi-timescale ensemble q-learning for markov decision process policy optimization.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning Multi-timescale ensemble q-learning for markov decision process policy optimization

Reference 21

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T21:48:17.363970Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation c4653aeb-3949-4bef-acfc-97fae01d8eb2 · outbound

This paper cites Leveraging digital cousins for ensemble q-learning in large-scale wireless networks.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning Leveraging digital cousins for ensemble q-learning in large-scale wireless networks

Reference 22

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T21:48:17.348408Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation f7c8391b-7c76-480b-a1b7-38c697c05aa4 · outbound

This paper cites A novel ensemble q-learning algorithm for policy optimization in large-scale networks.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning A novel ensemble q-learning algorithm for policy optimization in large-scale networks

Reference 23

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T21:48:17.335126Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 94fe94b0-4fbe-4b16-9f65-7eb442b8d7c1 · outbound

This paper cites Link analysis for solving multiple- access mdps with large state spaces.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning Link analysis for solving multiple- access mdps with large state spaces

Reference 24

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T21:48:17.322383Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation d3692961-f7ac-4542-aa87-34bbb7cef735 · outbound

This paper cites Is q-learning provably efficient? Advances in neural information processing systems, 31, 2018.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning Is q-learning provably efficient? Advances in neural information processing systems, 31, 2018

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-12T21:48:16.893407Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8d6795f2-3ec8-4547-b960-5b58ae3ea6ff · outbound

This paper cites Online robust reinforcement learning with model uncertainty.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning Online robust reinforcement learning with model uncertainty

Reference 26

Resolution: unresolved; no resolver link, observed 2026-08-12T21:48:16.897232Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation da4cd2ce-b9f7-437a-a4a1-ddeb4688a324 · outbound

This paper cites Conser- vative q-learning for offline reinforcement learning.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning Conser- vative q-learning for offline reinforcement learning

Reference 27

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T21:48:17.285828Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation f0ea9ff9-5f10-44ff-b982-5d7ca4bfe099 · outbound

This paper cites An optimistic perspective on offline reinforcement learning.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning An optimistic perspective on offline reinforcement learning

Reference 28

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T21:48:17.273193Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 2b6f2766-2cab-49cd-adc5-e74516f10fdb · outbound

This paper cites Leveraging offline data in online reinforcement learning.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning Leveraging offline data in online reinforcement learning

Reference 29

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T21:48:17.260691Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 1b4cfa2c-1a0c-4510-bd0b-10d85210e379 · outbound

This paper cites AWAC: Accelerating Online Reinforcement Learning with Offline Datasets.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning AWAC: Accelerating Online Reinforcement Learning with Offline Datasets

Reference 30

Resolution: unresolved; no resolver link, observed 2026-08-12T21:48:16.912632Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a7cf1705-e583-4563-811c-3aa513f289a5 · outbound

This paper cites Policy finetuning: Bridging sample-efficient offline and online reinforce- ment learning.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning Policy finetuning: Bridging sample-efficient offline and online reinforce- ment learning

Reference 31

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T21:48:17.247073Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 2e6d1209-d8cc-4956-aa2c-08bc1c594bdc · outbound

This paper cites Hybrid RL: Using Both Offline and Online Data Can Make RL Efficient.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning Hybrid RL: Using Both Offline and Online Data Can Make RL Efficient

Reference 32

Resolution: unresolved; no resolver link, observed 2026-08-12T21:48:16.920591Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation af046d29-91fc-40f3-9395-0c54ed904789 · outbound

This paper cites Com- paring exploration strategies for q-learning in random stochastic mazes.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning Com- paring exploration strategies for q-learning in random stochastic mazes

Reference 33

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T21:48:17.230930Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation b10298f2-4e93-40ef-864d-5fcf11b9e2d3 · outbound

This paper cites The Role of Coverage in Online Reinforcement Learning.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning The Role of Coverage in Online Reinforcement Learning

Reference 34

Resolution: unresolved; no resolver link, observed 2026-08-12T21:48:16.928379Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 17fc7772-cfc9-4e89-83f4-c044a97f4ba1 · outbound

This paper cites Pessimistic Model-based Offline Reinforcement Learning under Partial Coverage.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning Pessimistic Model-based Offline Reinforcement Learning under Partial Coverage

Reference 35

Resolution: unresolved; no resolver link, observed 2026-08-12T21:48:16.932746Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0994f7b3-a7db-4031-a407-46709bcebc5f · outbound

This paper cites What can online reinforcement learning with function approximation benefit from general coverage conditions? In International Conference on Machine Learning, pages 22063–22091.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning What can online reinforcement learning with function approximation benefit from general coverage conditions? In International Conference on Machine Learning, pages 22063–22091

Reference 36

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T21:48:17.211572Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 14212655-35fd-4a34-ac2e-4f20997ff5ef · outbound

This paper cites When to trust your simulator: Dynamics-aware hybrid offline-and-online reinforcement learning.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning When to trust your simulator: Dynamics-aware hybrid offline-and-online reinforcement learning

Reference 37

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T21:48:17.196846Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 4a951e64-b95d-4ded-a363-bd8dd1f1a35d · outbound

This paper cites Coverage analysis of multi- environment q-learning algorithms for wireless network optimization.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning Coverage analysis of multi- environment q-learning algorithms for wireless network optimization

Reference 38

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T21:48:17.174530Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 62ba41a5-6357-4d1d-b602-938ee6d2ab46 · outbound

This paper cites Convergence of Q-learning: A simple proof.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning Convergence of Q-learning: A simple proof

Reference 39

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T21:48:17.160552Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 1afabcb6-37a8-4099-9fc0-3406415ba7bf · outbound

This paper cites Issues in using function ap- proximation for reinforcement learning.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning Issues in using function ap- proximation for reinforcement learning

Reference 40

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T21:48:17.140862Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 244acb39-d088-4af2-aa02-2e23dee15268 · outbound

This paper cites Randomized Ensembled Double Q-Learning: Learning Fast Without a Model.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning Randomized Ensembled Double Q-Learning: Learning Fast Without a Model

Reference 41

Resolution: unresolved; no resolver link, observed 2026-08-12T21:48:16.955046Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation eadff9d3-985d-40c0-8e74-1cf2992aabf5 · outbound

This paper cites The virtues of laziness in model-based rl: A unified objective and algorithms.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning The virtues of laziness in model-based rl: A unified objective and algorithms

Reference 42

Resolution: unresolved; no resolver link, observed 2026-08-12T21:48:16.959107Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e72cc9b0-35ce-41e7-9d18-6532afba8694 · outbound

This paper cites A Multi-Agent Multi-Environment Mixed Q-Learning for Partially Decentralized Wireless Network Optimization.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning A Multi-Agent Multi-Environment Mixed Q-Learning for Partially Decentralized Wireless Network Optimization

Reference 43

Resolution: verified exact; local_arxiv, observed 2026-08-12T21:48:17.003329Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 4dcbefa6-4607-4d8d-8b7f-c1537b30145f · outbound

This paper cites Springer, 2007.

Coverage Analysis for Digital Cousin Selection -- Improving Multi-Environment Q-Learning Springer, 2007

Reference 2007

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T21:48:17.455306Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Pith citing papers

No inbound Pith citation observations are available.