Pith. sign in

Paper Citation Record · LEDGER

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach

As of 12 August 2026, this Paper Citation Record lists 39 of 39 outbound references and 0 inbound Pith citation observations for arXiv:2510.19528.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2510.19528 v2

Coverage vector

measured 39 of 39 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-04T08:45:52.117439Z

measured 39 of 39 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-12T06:34:41.77262+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

39 of 39 outbound references displayed

  • verified exact0
  • verified fuzzy0
  • unresolved39
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 26faff59-f6e1-4746-a6f2-4d74770fdb02 · outbound

This paper cites an unresolved cited work.

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach Unresolved cited work

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-04T08:45:47.918320Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T08:45:47.918320Z digest=sha256:5b1781b29d5440d7109f13d20d2297524156b3b057dfc74d29cca081f1c50590

Observation fbbd8599-f619-4da0-873b-2e186e9b76db · outbound

This paper cites OPAL: Offline Primitive Discovery for Accelerating Offline Reinforcement Learning.

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach OPAL: Offline Primitive Discovery for Accelerating Offline Reinforcement Learning

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-04T08:45:47.978112Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T08:45:47.978112Z digest=sha256:cb98a60625ad9881764f8da413164de25f93836de5ebcd16d362b5f84ac4a0d7

Observation 30258a52-f13a-48ca-950e-3c8d33d3dad8 · outbound

This paper cites G., Osband, I., and Munos, R.

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach G., Osband, I., and Munos, R

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-04T08:45:48.094172Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T08:45:48.094172Z digest=sha256:a635e94886bccf6f8e0040bac7511d51469cf2d6a2be06b1b179519eeb47238b

Observation 930973aa-237e-41ba-9846-bb5e1f976148 · outbound

This paper cites an unresolved cited work.

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach Unresolved cited work

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-04T08:45:48.215603Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T08:45:48.215603Z digest=sha256:34288d9b44b6d20384c9e81e2fd587509574712ea2b33be8597339674631c0c1

Observation 27eb83ec-d1e2-4d65-ad26-8b47b63e4cb3 · outbound

This paper cites B., Chernova, S., Taylor, M.

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach B., Chernova, S., Taylor, M

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-04T08:45:48.326922Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T08:45:48.326922Z digest=sha256:253fbe9894fe52a39c4c1c1a339ae22fdb5e4c3ea5508dce395d0819cdfe527d

Observation c7dcec4a-4436-42e9-a38f-57f08324a63d · outbound

This paper cites an unresolved cited work.

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach Unresolved cited work

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-04T08:45:48.447363Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T08:45:48.447363Z digest=sha256:301c0023c27adc074b03d5a58a9e416e3b88797fb4150baeea4a3480199d69bc

Observation e5da63d2-8230-4db8-8b8c-b8f70d81f1da · outbound

This paper cites an unresolved cited work.

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach Unresolved cited work

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-04T08:45:48.554736Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T08:45:48.554736Z digest=sha256:3aa0beaaf83a907daf7cfa4a3ba3d2f1667ed071e8308a9f2a6a6dd72ab8fb36

Observation c4dc1967-90fe-4c58-be7c-51b537512a22 · outbound

This paper cites V., Mohri, M., and Zimmert, J.

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach V., Mohri, M., and Zimmert, J

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-04T08:45:48.713052Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T08:45:48.713052Z digest=sha256:f6d1faacb53ba4e8cc7e1b3fa1dbe21af4f6440d1b2fb1662100b6a2498d0bdc

Observation aa7e192b-5aa7-4b7c-8d63-25dfe90b5d55 · outbound

This paper cites and Moitra, A.

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach and Moitra, A

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-04T08:45:48.889428Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T08:45:48.889428Z digest=sha256:b72bd1a9d1fe8456085b15c673e73639feec42ae9c4bd7262efe5820cde5490c

Observation 17b2e3e5-a7c8-4e3a-ae6b-d8f26c2d3b74 · outbound

This paper cites Relay Policy Learning: Solving Long-Horizon Tasks via Imitation and Reinforcement Learning.

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach Relay Policy Learning: Solving Long-Horizon Tasks via Imitation and Reinforcement Learning

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-04T08:45:48.991607Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T08:45:48.991607Z digest=sha256:b080f09554d87eaef12ce754bccec1027dc5dd03b6f378e406b802c93bf168aa

Observation 00764bb5-9eb2-4e61-a1d2-4892aa5f71a4 · outbound

This paper cites M., and Levine, S.

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach M., and Levine, S

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-04T08:45:49.061260Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T08:45:49.061260Z digest=sha256:9319a2e033dc737e0692847bb242b5e3ff836834a532180765dee87f8f4c039c

Observation 24949a45-a005-42f4-91b2-767095d58c8a · outbound

This paper cites an unresolved cited work.

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach Unresolved cited work

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-04T08:45:49.127311Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T08:45:49.127311Z digest=sha256:23eaa8cc645bed5bf760d6e0dbb5d80ca4e4e7936ae374f3acfb98e850faadf9

Observation 4c9ab088-2c3d-41b2-a4dd-5b7526c0d8d9 · outbound

This paper cites an unresolved cited work.

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach Unresolved cited work

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-04T08:45:49.196981Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T08:45:49.196981Z digest=sha256:585ae645d1b4a2b27f2096dc42493520dd7b87b21812425a62e3375dcd276b80

Observation e54c6d5c-b5b0-493c-a0d0-45b9bf2125df · outbound

This paper cites and Langford, J.

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach and Langford, J

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-04T08:45:49.321374Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T08:45:49.321374Z digest=sha256:d6dbee6628e526575d91f41c286f36d08bb74656597c5249acfdac46fc55a3bf

Observation ea33daec-e506-427a-8c43-46ad6064fd4e · outbound

This paper cites an unresolved cited work.

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach Unresolved cited work

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-04T08:45:49.434271Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T08:45:49.434271Z digest=sha256:348bf0673c4529b188499067ca756beda8edc2d3cbe3a9eb0ee89ad6664a3587

Observation 9c9c3a5e-894d-4d60-87a1-7cab5bc24e98 · outbound

This paper cites an unresolved cited work.

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach Unresolved cited work

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-04T08:45:49.503807Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T08:45:49.503807Z digest=sha256:5cb65fe2aca95db4121dd032ef3341141714f31fe08f0f59f2f2a6e72e1d4e89

Observation aa6f19cf-b96d-4963-8cc3-5743f0679797 · outbound

This paper cites an unresolved cited work.

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach Unresolved cited work

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-04T08:45:49.579361Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T08:45:49.579361Z digest=sha256:4a50084e98b4802cf43d260068cfd063498bb9046cdeeea98ded98795207fcf1

Observation 1218da08-0a7d-4eba-955c-59cd2bb67aa1 · outbound

This paper cites an unresolved cited work.

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach Unresolved cited work

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-04T08:45:49.708734Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T08:45:49.708734Z digest=sha256:c24e3cb5c941d3b4c4bb4657767e7e79c92bdbe798bc84c4a0517d6fa2ddf67e

Observation 7fbdd88a-cc9e-483d-a49c-82a7b28e62bf · outbound

This paper cites an unresolved cited work.

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach Unresolved cited work

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-04T08:45:49.843946Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T08:45:49.843946Z digest=sha256:3e464bcc52e7a6134210994fa637a603f0eb1797b65706209ce80520e9b987c3

Observation 19f02c76-fc9f-4e4f-a474-8b798a480fcc · outbound

This paper cites V., Sima, K., and Leong, T.-Y.

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach V., Sima, K., and Leong, T.-Y

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-04T08:45:49.933185Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T08:45:49.933185Z digest=sha256:3d14eca087e4c97f10c9ed2feb9b4bd4320c39c2768aaf92065f38c67c8c7966

Observation 4e086aa7-53af-46a1-86db-3441b413ebab · outbound

This paper cites and Pontil, M.

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach and Pontil, M

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-04T08:45:50.021748Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T08:45:50.021748Z digest=sha256:7261bb60b1bf9ae8babf34bc6192e047ee0f64a83004148c7fa88bbe40878dd3

Observation f3c5711f-f0e2-4970-94b0-df473b0265ef · outbound

This paper cites an unresolved cited work.

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach Unresolved cited work

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-04T08:45:50.181755Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T08:45:50.181755Z digest=sha256:8e64524f8105accec732bf8e30ae1adaf1251e055bbd44971d82c8583faa7b8e

Observation f4b0925c-3094-42a8-a9e3-bbdad5182691 · outbound

This paper cites Y., Harada, D., and Russell, S.

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach Y., Harada, D., and Russell, S

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-04T08:45:50.292706Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T08:45:50.292706Z digest=sha256:fbf4b09fe3618f68e7f43f3dd6efd66d90841558f1721015ef879a64bfabc5ef

Observation c7a544bc-06cc-4e73-ad4a-d1263b049730 · outbound

This paper cites an unresolved cited work.

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach Unresolved cited work

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-04T08:45:50.503873Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T08:45:50.503873Z digest=sha256:1df226ca45850f3e9d6abda0c86fc795c42eb0bf930abb86d4c30e507139c366

Observation 8fbed35f-f8bd-43fb-b23e-1a9834e7e22c · outbound

This paper cites an unresolved cited work.

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach Unresolved cited work

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-04T08:45:50.588535Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T08:45:50.588535Z digest=sha256:e393207195813efbc87b912b054a3705a69bb4c82def3e1d8fa385b0d4342128

Observation 4b694626-e616-412a-901f-03300034f881 · outbound

This paper cites an unresolved cited work.

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach Unresolved cited work

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-04T08:45:50.668557Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T08:45:50.668557Z digest=sha256:2563e1cced8080fe7a38f5e02d57d6746ea7affac7b566748a8fc786cf631e58

Observation a0ff7657-5b33-427f-9c6c-0207e163f845 · outbound

This paper cites and Jamieson, K.

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach and Jamieson, K

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-04T08:45:50.747186Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T08:45:50.747186Z digest=sha256:8d6a3db2bc8f88f050afb66e36f13923ac2a16f508baf2c3c4c334a274552831

Observation f2dc4c0c-1335-4d2d-9833-b78d661542cd · outbound

This paper cites Hybrid RL: Using Both Offline and Online Data Can Make RL Efficient.

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach Hybrid RL: Using Both Offline and Online Data Can Make RL Efficient

Reference 28

Resolution
unresolved
no resolver link, observed 2026-08-04T08:45:50.812731Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T08:45:50.812731Z digest=sha256:d175a53f0ecaf68a2a747232206104fc7a31fbc289355bd8b0d48e139aaa03ee

Observation f44b9ff7-9a78-49f3-a881-27ba148c28c1 · outbound

This paper cites an unresolved cited work.

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach Unresolved cited work

Reference 29

Resolution
unresolved
no resolver link, observed 2026-08-04T08:45:50.877931Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T08:45:50.877931Z digest=sha256:4ee1ae869c5169fa344e04246bec818db72857cc5af380980998251fbc19b387

Observation 8f7486e7-48e6-47b3-ba89-994a7f6edba9 · outbound

This paper cites an unresolved cited work.

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach Unresolved cited work

Reference 30

Resolution
unresolved
no resolver link, observed 2026-08-04T08:45:51.048804Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T08:45:51.048804Z digest=sha256:5e67b823da24cc51e203c28c802094e8c4a0c52038ba126a2201f3fff76526af

Observation 1ba0e4ee-c526-4190-8a8f-9661aec7f50e · outbound

This paper cites an unresolved cited work.

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach Unresolved cited work

Reference 31

Resolution
unresolved
no resolver link, observed 2026-08-04T08:45:51.219605Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T08:45:51.219605Z digest=sha256:c9c0c8f8522e3821d9bda99b0ad6ce45abb5a7306774b110d7dbbfbeb7a42140

Observation 7eae4155-74d0-4fec-8f32-a5c7f841725f · outbound

This paper cites and Brunskill, E.

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach and Brunskill, E

Reference 32

Resolution
unresolved
no resolver link, observed 2026-08-04T08:45:51.372926Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T08:45:51.372926Z digest=sha256:88b8daa4e6902787a311c99125e06ce33dcf72b961bc644d5c68c48f78ba1b07

Observation e486cfa8-ec20-4840-ab06-5169f2419768 · outbound

This paper cites an unresolved cited work.

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach Unresolved cited work

Reference 33

Resolution
unresolved
no resolver link, observed 2026-08-04T08:45:51.539180Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T08:45:51.539180Z digest=sha256:d338be03eb96d90fbc794cd82159297c7b4ddb1d7455a27d32b636190d8c6ea9

Observation 0260433f-2a14-4c85-8b06-acbcadc35ee4 · outbound

This paper cites and Wang, Z.

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach and Wang, Z

Reference 34

Resolution
unresolved
no resolver link, observed 2026-08-04T08:45:51.624774Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T08:45:51.624774Z digest=sha256:0e889339478d31dffdec1dd51b4bfe0f1b130a1f453bb219bdea6873e6db106a

Observation 6679652e-6aff-4516-98ab-81573f815b84 · outbound

This paper cites D., and Du, S.

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach D., and Du, S

Reference 35

Resolution
unresolved
no resolver link, observed 2026-08-04T08:45:51.682041Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T08:45:51.682041Z digest=sha256:8d7aabcff0db70bea3da0d03776f11edf28b34edf853d638d27100d2d4a9ff00

Observation c092147b-1149-465b-b7e0-387f8ea064f0 · outbound

This paper cites an unresolved cited work.

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach Unresolved cited work

Reference 36

Resolution
unresolved
no resolver link, observed 2026-08-04T08:45:51.763250Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T08:45:51.763250Z digest=sha256:8fe08565aff17c3f2b2bc27892201c559c1c2e10aad44712d7392886fcdc1151

Observation 559a0534-1971-4f4f-a1d6-e2c4bec86ce4 · outbound

This paper cites an unresolved cited work.

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach Unresolved cited work

Reference 37

Resolution
unresolved
no resolver link, observed 2026-08-04T08:45:51.861290Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T08:45:51.861290Z digest=sha256:da9ce7d825968a66c6700211f0687d97519ce9466c8b28d753e9ea3997d332f0

Observation 546bce27-b99c-4d42-869f-97c4d175eab2 · outbound

This paper cites an unresolved cited work.

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach Unresolved cited work

Reference 38

Resolution
unresolved
no resolver link, observed 2026-08-04T08:45:52.030979Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T08:45:52.030979Z digest=sha256:a66e82c25e91bf6cbdc11b504c8252717f3182ff0f02a250bc8828ef858ee322

Observation db7b8bc0-352f-4320-9b3e-65be8f6ca089 · outbound

This paper cites Reward Shaping via Meta-Learning.

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach Reward Shaping via Meta-Learning

Reference 39

Resolution
unresolved
no resolver link, observed 2026-08-04T08:45:52.117439Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T08:45:52.117439Z digest=sha256:9c4010dbf683a6e4b4b8bcbbd3e7f358d22c5127bdf1bd9a4c3785c49dd1c6ef

Pith citing papers

No inbound Pith citation observations are available.