Paper Citation Record · LEDGER

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals

As of 13 August 2026, this Paper Citation Record lists 47 of 47 outbound references and 1 inbound Pith citation observation for arXiv:2505.21750.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2505.21750 v1

Coverage vector

measured 47 of 47 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T13:35:59.110429Z

measured 48 of 48 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-13T06:32:02.005865+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-01T13:10:40.745747Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

47 of 47 outbound references displayed

verified exact0
verified fuzzy37
unresolved10
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 06404eaa-1f03-43ee-b9c1-a7a9897898a2 · outbound

This paper cites Hindsight experience replay.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals Hindsight experience replay

Reference 1

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T13:40:17.736073Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation b33426b7-e6c2-41ac-8363-038a15516f01 · outbound

This paper cites Hindsight experience replay.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals Hindsight experience replay

Reference 2

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T13:40:17.475063Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation 7f720488-02da-4924-b92f-025a835c81d0 · outbound

This paper cites The option-critic architecture.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals The option-critic architecture

Reference 3

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T13:40:17.269764Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation 8b668b89-2aed-4113-b696-fb002488b624 · outbound

This paper cites and Konidaris, G.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals and Konidaris, G

Reference 4

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T13:40:17.088240Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation 1970c616-3631-4000-888f-ae22e8b5a518 · outbound

This paper cites u ttler, H., Tenenbaum, J. B., Rockt \.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals u ttler, H., Tenenbaum, J. B., Rockt \

Reference 5

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T13:40:16.961435Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation 048656bf-33c7-4862-8f7f-e1b1c0c5bf5c · outbound

This paper cites Simple Hierarchical Planning with Diffusion.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals Simple Hierarchical Planning with Diffusion

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-07T13:35:54.985359Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f844171d-4409-446d-83d7-ccfcad222501 · outbound

This paper cites and Hinton, G.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals and Hinton, G

Reference 7

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T13:40:16.779826Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation 2165fddf-4cf0-493e-aa92-711311a0cd19 · outbound

This paper cites P., Fox, D., and Rasmussen, C.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals P., Fox, D., and Rasmussen, C

Reference 8

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T13:40:16.596010Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation fe5c4a6d-a15d-41ab-b91c-870f5cd876f4 · outbound

This paper cites Bayes meets bellman: The gaussian process approach to temporal difference learning.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals Bayes meets bellman: The gaussian process approach to temporal difference learning

Reference 9

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T13:40:16.273793Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation 8cb39dca-2e8f-4663-91c0-403d9ab35f0e · outbound

This paper cites Diversity is all you need: Learning skills without a reward function.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals Diversity is all you need: Learning skills without a reward function

Reference 10

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T13:40:16.055433Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation d0af773b-edbc-46cf-b33f-b1ff12e68765 · outbound

This paper cites Automatic goal generation for reinforcement learning agents.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals Automatic goal generation for reinforcement learning agents

Reference 11

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T13:40:15.977286Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation 30c0373f-cbca-4692-927a-892f7ae5206f · outbound

This paper cites Multi-Level Discovery of Deep Options.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals Multi-Level Discovery of Deep Options

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-07T13:35:55.682487Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 603c3fd2-3e11-4477-bc44-d378d8a31887 · outbound

This paper cites Addressing function approximation error in actor-critic methods.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals Addressing function approximation error in actor-critic methods

Reference 13

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T13:40:15.780779Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation 97ece402-7737-4b82-af7d-5b749eeef3b8 · outbound

This paper cites J., and Wierstra, D.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals J., and Wierstra, D

Reference 14

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T13:40:15.657184Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation 8252967e-8a17-42bc-98e8-0168d301bc0b · outbound

This paper cites Denoising diffusion probabilistic models.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals Denoising diffusion probabilistic models

Reference 15

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T13:40:15.516906Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation fdc16999-e22d-4a5c-a30f-eb0f0886515f · outbound

This paper cites B., and Levine, S.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals B., and Levine, S

Reference 16

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T13:40:15.318305Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation e136b906-c1a6-472a-9710-fabd279b7923 · outbound

This paper cites and Langford, J.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals and Langford, J

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-07T13:35:56.134724Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f832bb53-b95f-48d7-a8f3-3e58218d0e04 · outbound

This paper cites Efficient diffusion policies for offline reinforcement learning.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals Efficient diffusion policies for offline reinforcement learning

Reference 18

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T13:40:15.161977Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation 0d7a1b80-2c73-44ee-9f3b-c052c0218fd0 · outbound

This paper cites Landmark-guided subgoal generation in hierarchical reinforcement learning.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals Landmark-guided subgoal generation in hierarchical reinforcement learning

Reference 19

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T13:40:15.024468Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation 63e4a631-9338-49ab-a93a-632e04d469cb · outbound

This paper cites and Barto, A.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals and Barto, A

Reference 20

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T13:40:14.908454Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation 419265a2-70ca-44cd-b43e-9e77c0ec0b38 · outbound

This paper cites D., Narasimhan, K., Saeedi, A., and Tenenbaum, J.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals D., Narasimhan, K., Saeedi, A., and Tenenbaum, J

Reference 21

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T13:40:14.725746Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation a55cd15c-389d-4a70-bed2-9a64ece521e9 · outbound

This paper cites and Rasmussen, C.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals and Rasmussen, C

Reference 22

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T13:36:03.795891Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation 5e7a8d2a-0718-4718-85bc-712135c4686c · outbound

This paper cites Nonlinear inverse reinforcement learning with gaussian processes.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals Nonlinear inverse reinforcement learning with gaussian processes

Reference 23

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T13:36:03.624641Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation 341ece77-d5ab-44a4-bdec-88c174e9721d · outbound

This paper cites D., Jr., R.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals D., Jr., R

Reference 24

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T13:36:03.401588Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation 2f53b990-0409-4ea6-a24e-a5b936ddb280 · outbound

This paper cites Learning subgoal representations with slow dynamics.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals Learning subgoal representations with slow dynamics

Reference 25

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T13:36:03.198045Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation 0462c20b-59f1-4fcc-8fdc-59132f9cc274 · outbound

This paper cites Active hierarchical exploration with stable subgoal representation learning.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals Active hierarchical exploration with stable subgoal representation learning

Reference 26

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T13:36:02.957332Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation 1e2f3071-48bb-4e95-81ee-c1d31d3ded66 · outbound

This paper cites Hierarchical diffusion for offline decision making.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals Hierarchical diffusion for offline decision making

Reference 27

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T13:36:02.821818Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation 24d88f66-2764-4210-8e4f-bdd763bc0716 · outbound

This paper cites Data-efficient hierarchical reinforcement learning.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals Data-efficient hierarchical reinforcement learning

Reference 28

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T13:36:02.479986Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation dfeb8e05-0b73-4974-acc7-b55d842370fe · outbound

This paper cites Near-optimal representation learning for hierarchical reinforcement learning.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals Near-optimal representation learning for hierarchical reinforcement learning

Reference 29

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T13:36:02.288037Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation 6103e436-d2a4-4cdf-be91-f53ac9741211 · outbound

This paper cites Visual reinforcement learning with imagined goals.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals Visual reinforcement learning with imagined goals

Reference 30

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T13:36:02.080956Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation 8dc67b77-1ea5-4b4a-8f8f-59d49f88339a · outbound

This paper cites Exploration via hindsight goal generation.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals Exploration via hindsight goal generation

Reference 31

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T13:36:01.751612Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation cd18f090-d685-495a-bb11-5f71bf3e6205 · outbound

This paper cites and Wahnsiedler, R.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals and Wahnsiedler, R

Reference 32

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T13:36:01.466897Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation 0b7fc4bb-d5e8-4ea0-a93c-33e64871c1cc · outbound

This paper cites Dynamics-aware unsupervised discovery of skills.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals Dynamics-aware unsupervised discovery of skills

Reference 33

Resolution: unresolved; no resolver link, observed 2026-08-07T13:35:57.838023Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2bfaf8ac-1c90-41be-b83b-5dc636d75045 · outbound

This paper cites and Ghahramani, Z.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals and Ghahramani, Z

Reference 34

Resolution: unresolved; no resolver link, observed 2026-08-07T13:35:57.991830Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4f556df6-e75e-4dd2-82bd-433b831c4c86 · outbound

This paper cites A., Maheswaranathan, N., and Ganguli, S.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals A., Maheswaranathan, N., and Ganguli, S

Reference 35

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T13:36:01.236897Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation 74a4ff5c-5f11-4a29-b3ee-a4078c4e29e7 · outbound

This paper cites P., Kumar, A., Ermon, S., and Poole, B.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals P., Kumar, A., Ermon, S., and Poole, B

Reference 36

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T13:36:01.055163Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation 99b63662-9140-4512-bced-bad975eec5b8 · outbound

This paper cites an unresolved cited work.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals Unresolved cited work

Reference 37

Resolution: unresolved; no resolver link, observed 2026-08-07T13:35:58.290728Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8c8e9a2f-6a6a-463d-90e8-4dbd7dfb38bc · outbound

This paper cites an unresolved cited work.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals Unresolved cited work

Reference 38

Resolution: unresolved; raw_fallback, observed 2026-08-07T13:36:00.744444Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation d221649d-fb65-4316-9b08-a14311f96a43 · outbound

This paper cites Mujoco: A physics engine for model-based control.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals Mujoco: A physics engine for model-based control

Reference 39

Resolution: unresolved; no resolver link, observed 2026-08-07T13:35:58.599994Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation fb979ea1-644f-49fc-924f-080663b06895 · outbound

This paper cites S., Osindero, S., Schaul, T., Heess, N., Jaderberg, M., Silver, D., and Kavukcuoglu, K.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals S., Osindero, S., Schaul, T., Heess, N., Jaderberg, M., Silver, D., and Kavukcuoglu, K

Reference 40

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T13:36:00.517435Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation 32e11009-773f-4c35-996d-60899364bf8b · outbound

This paper cites I2hrl: Interactive influence-based hierarchical reinforcement learning.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals I2hrl: Interactive influence-based hierarchical reinforcement learning

Reference 41

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T13:36:00.332721Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation b3d17ffa-2a0d-4aae-be7c-7590f1897cd0 · outbound

This paper cites a m \"a r \.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals a m \"a r \

Reference 42

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T13:36:00.099311Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation da8639cb-cace-4193-97ae-140697e903e0 · outbound

This paper cites a m \" a r \.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals a m \" a r \

Reference 43

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T13:35:59.918866Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation 78491f8b-99d4-4673-ae03-2775d71fcbf6 · outbound

This paper cites J., and Zhou, M.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals J., and Zhou, M

Reference 44

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T13:35:59.643837Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation b8aed6bb-608e-4c21-bc35-87bbbc1f71cf · outbound

This paper cites an unresolved cited work.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals Unresolved cited work

Reference 45

Resolution: unresolved; no resolver link, observed 2026-08-07T13:35:58.914783Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d1bc9669-5d1f-432a-8926-07af835cf351 · outbound

This paper cites Generating adjacency-constrained subgoals in hierarchical reinforcement learning.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals Generating adjacency-constrained subgoals in hierarchical reinforcement learning

Reference 46

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T13:35:59.359210Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation 717ccf0c-692c-459d-80af-d545b16716f7 · outbound

This paper cites write newline.

Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals write newline

Reference 47

Resolution: unresolved; no resolver link, observed 2026-08-07T13:35:59.110429Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

Observation 28fcc199-88a3-4986-be84-35cf0a2bf009 · inbound

S3: Stable Subgoal Selection by Constraining Uncertainty of Coarse Dynamics in Hierarchical Reinforcement Learning cites this paper.

S3: Stable Subgoal Selection by Constraining Uncertainty of Coarse Dynamics in Hierarchical Reinforcement Learning Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals

Reference 29

Resolution: unresolved; no resolver link, observed 2026-08-01T13:10:40.745747Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.