Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-11T22:15:09.161752Z
Paper Citation Record · LEDGER
As of 12 August 2026, this Paper Citation Record lists 59 of 59 outbound references and 0 inbound Pith citation observations for arXiv:2412.03767.
A citation records a reference. It does not transfer a finding from one paper to another.
Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-11T22:15:09.161752Z
One-hop event checks from named stored sources.
Source: scholarly_work_events, retraction_status_cache, observed 2026-08-12T06:34:41.77262+00:00
Pith citing papers itemized under the disclosed page cap.
Source: paper_references, paper_reference_links
A source-named dated measurement, never combined with another source.
Source: cited_works
59 of 59 outbound references displayed
External citation measurements
No source-named external measurement is stored.
Observation 5334bbc9-0520-4a6c-ac8d-65fba9774625 · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Playing Atari with Deep Reinforcement Learning
Reference 1
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 3f9ac66b-fcbb-4398-9916-83f6843b4059 · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Human-level control through deep reinforcement learning
Reference 2
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 2254d36b-be0f-4152-9df8-e6dc6447cd40 · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Mastering the game of go with deep neural networks and tree search
Reference 3
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation e1e9b94e-931a-4d47-b4f8-88451eded4f8 · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Mastering the game of go without human knowledge
Reference 4
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 628813d8-6d4a-4b89-9ea9-000295df3d8f · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Dota 2 with Large Scale Deep Reinforcement Learning
Reference 5
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation abd6207a-59ce-41b6-b65f-58e4c1187365 · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Alphastar: An evolutionary computation perspective
Reference 6
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.
Observation 8e6e462a-9ed2-46c4-b9da-9a4f92db2151 · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Unifying count-based exploration and intrinsic motivation
Reference 7
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation e641409a-cf0c-4a48-bc3b-ea8bf34a12af · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Curiosity-driven exploration by self- supervised prediction
Reference 8
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.
Observation 2329f066-004c-4d96-a2be-25cf83995d4e · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Count-based exploration with neural density models
Reference 9
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.
Observation 64bacd47-a6d9-4b9a-9f86-fb6817e829a8 · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Exploration by Random Network Distillation
Reference 10
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 65300bd7-1be3-4533-a0fe-c8462a1fa556 · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Count-based exploration with the successor representation
Reference 11
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 68ef5268-d29d-4128-a877-3d8b8ac5d113 · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Self-supervised exploration via disagreement
Reference 12
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.
Observation 47bcd4c3-323b-46c9-b3f5-4db9e47f67be · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Using confidence bounds for exploitation-exploration trade-offs
Reference 13
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation ab6e9ae4-2d5a-4412-9fc2-558f9265cf33 · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Minimax regret bounds for reinforcement learning
Reference 14
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.
Observation f7dfa20d-b28b-466d-812e-1002fb601f6c · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Is q-learning provably efficient? Advances in neural information processing systems, 31, 2018
Reference 15
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 04c70e77-3fdf-454a-a204-5f97e96e1c3e · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Reinforcement learning in feature space: Matrix bandit, kernels, and regret bound
Reference 16
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.
Observation 3b7e0732-f27d-4879-ba03-095be3993881 · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Provably efficient reinforcement learning with linear function approximation
Reference 17
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.
Observation 33bc6ba8-d99a-40b3-a9bf-90fad04cc456 · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Decoupling exploration and exploitation in reinforcement learning
Reference 18
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.
Observation 8bd19351-5d4d-4e01-8c62-7f86af3a70d8 · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Decoupled Exploration and Exploitation Policies for Sample-Efficient Reinforcement Learning
Reference 19
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation d1f09285-4e35-4751-9c94-7a6d79a46543 · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning A markovian decision process
Reference 20
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.
Observation 3f2ce05c-dd91-4d4b-9c40-10a93e2dbee2 · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Q-learning
Reference 21
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 128d976f-aa71-4d07-a54b-8d6d74e4b6c6 · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Sample-optimal parametric q-learning using linearly additive features
Reference 22
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.
Observation 98021d54-31fd-4116-b296-44297a5eab4f · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Addressing function approximation error in actor-critic methods
Reference 23
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 85190290-751b-4b7f-bd7b-b1710f629b3e · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning D4RL: Datasets for Deep Data-Driven Reinforcement Learning
Reference 24
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 4e59b5a9-1f9c-46fc-a131-2ce1a955dc52 · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Mujoco: A physics engine for model-based control
Reference 25
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 05a83d6f-1fd5-4a22-b5ca-f2c75d4819bf · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning On the likelihood that one unknown probability exceeds another in view of the evidence of two samples
Reference 26
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 4b104fa7-23b0-41f8-a669-27613a683d74 · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Intrinsic motivation systems for autonomous mental development
Reference 27
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.
Observation faf025e1-c39c-4958-876f-773b523613b0 · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning # exploration: A study of count-based exploration for deep reinforcement learning
Reference 28
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.
Observation db2679fb-1c8f-4e62-9d24-1f5c9217bc7b · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning DORA The Explorer: Directed Outreaching Reinforcement Action-Selection
Reference 29
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 0002ce96-1da6-4f36-84cb-ec4a8d0951fc · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Go-Explore: a New Approach for Hard-Exploration Problems
Reference 30
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 1a2de18c-5b05-43eb-a53b-d391695f7c9d · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Bayesian reinforcement learning: A survey
Reference 31
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.
Observation 60c46138-98ad-4aa7-b6d3-44fde8f74f58 · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Noisy Networks for Exploration
Reference 32
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation bd4eb3cb-e7ce-48cd-a173-7862acf5787b · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Deep exploration via bootstrapped dqn
Reference 33
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation e7ab1784-c3be-4c0c-955f-70b573cb2ec2 · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Between mdps and semi-mdps: A framework for temporal abstraction in reinforcement learning
Reference 34
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation bbfcc985-d3fc-420c-b456-82a1cf45a88c · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning The option-critic architecture
Reference 35
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation f4aaee55-e2ac-4197-9a3c-a0591c7617a7 · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Temporally-Extended {\epsilon}-Greedy Exploration
Reference 36
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 271d509a-fdfa-44ae-80c1-671978738de5 · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Redeeming intrinsic rewards via constrained optimization
Reference 37
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.
Observation 71e915c1-a226-46d4-aed6-19f27206c9ca · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning LESSON: Learning to Integrate Exploration Strategies for Reinforcement Learning via an Option Framework
Reference 38
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 4712356e-d74f-4682-abf0-fac63198ccaf · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Decoupling exploration and exploitation for meta- reinforcement learning without sacrifices
Reference 39
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.
Observation b508ad01-c083-4f05-9667-f25dc12f9852 · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Improved algorithms for linear stochastic bandits
Reference 40
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.
Observation 3b90f39c-5e0e-4d96-b646-1ad6e1f70fb1 · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning healthy reward
Reference 41
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.
Observation 64bbd336-8514-4a9e-9b96-3a84893009f4 · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Unresolved cited work
Reference 42
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.
Observation bb213bf0-c021-46e3-b007-99e2d45802cc · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Unresolved cited work
Reference 43
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.
Observation bbcfd74b-7ed8-4f46-a22b-763fb7180bd3 · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Unresolved cited work
Reference 44
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.
Observation bb7bb341-8ed3-4940-8281-747c3d8bf1c3 · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Unresolved cited work
Reference 45
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.
Observation 044fc1a1-a401-4154-8631-ac68a34efe74 · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning And further, X k∈I ˆV k 1 (sk
Reference 46
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.
Observation 18b5cdc6-d7b9-4d7c-adf4-867574b3376d · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Unresolved cited work
Reference 47
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.
Observation b0b6a364-8c63-42a2-9be8-af6df57fd8fd · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Unresolved cited work
Reference 48
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.
Observation f177c735-10fd-493b-8169-6ea3309ad979 · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Unresolved cited work
Reference 49
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.
Observation 27395cf3-b54a-47f4-ab34-03d0d1522bdf · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Unresolved cited work
Reference 50
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.
Observation 46a2843a-2a71-48c6-88e8-34561d8910d0 · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Unresolved cited work
Reference 51
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.
Observation 9fbde005-7587-4409-9913-0737366ab294 · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Unresolved cited work
Reference 52
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.
Observation bd9f997b-0b94-4f54-8333-d9aaf86b273f · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Unresolved cited work
Reference 53
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.
Observation ad613507-f506-49f9-a00e-6c2fec908dc8 · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Unresolved cited work
Reference 54
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.
Observation 6e636333-bf5f-418a-9df4-2b0bae31d1bb · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Unresolved cited work
Reference 55
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.
Observation 56747326-f28c-44ad-b205-df13f1e36f05 · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning By recursively applying Equation
Reference 56
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.
Observation 1c08dec8-5c4c-4d53-b80d-a485250dfe38 · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Unresolved cited work
Reference 57
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.
Observation 4c669c78-15b3-4b06-9ff0-bb53113a9b73 · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning Hence, the total regret is given by: KX k=1 ˆV k 1 (sk
Reference 58
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.
Observation 21551000-93d4-4bbc-881b-c4214708596e · outbound
Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning And equivalently, we conclude that our algorithm obtains ϵ-optimal policy with ˜O( d3H 4 ϵ2 ) samples with probability at least 1 − δ
Reference 59
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.
No inbound Pith citation observations are available.