Pith. sign in

Paper Citation Record · LEDGER

Proto Successor Measure: Representing the Behavior Space of an RL Agent

As of 14 August 2026, this Paper Citation Record lists 14 of 14 outbound references and 4 inbound Pith citation observations for arXiv:2411.19418.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2411.19418 v2

Coverage vector

measured 14 of 14 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-12T10:20:26.712370Z

measured 18 of 18 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-14T06:32:32.682623+00:00

measured 4 of 4 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-06T23:34:31.066415Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-04T06:09:37.534617Z

Reference resolution

14 of 14 outbound references displayed

  • verified exact0
  • verified fuzzy8
  • unresolved5
  • parse uncertain0
  • malformed identifier1
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 801803b9-7364-469e-af8a-99a33c1a26c8 · outbound

This paper cites Eigenfunctions of this graph Laplacian gives a representation for each state ϕ(s), or the state feature.

Proto Successor Measure: Representing the Behavior Space of an RL Agent Eigenfunctions of this graph Laplacian gives a representation for each state ϕ(s), or the state feature

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-08-12T10:20:26.820010Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-08-12T10:20:26.706590Z digest=sha256:944b2fd7a5c2f1c36faaa116cfe7db23dee43a46d15c3d2850847141529b54b1

Observation 34b17c1a-0c69-4efb-a023-1e26e131a7b4 · outbound

This paper cites Training for optimizing all reward functions in this class allows for state-features and successor-features to coemerge.

Proto Successor Measure: Representing the Behavior Space of an RL Agent Training for optimizing all reward functions in this class allows for state-features and successor-features to coemerge

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-08-12T10:20:26.809572Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-08-12T10:20:26.709586Z digest=sha256:bd0dfb8eecd9ef56dc6e460abd062f44bb16f64d3bf3d6b6679b88c02d02a11a

Observation 145e9650-f397-4deb-892d-e9fe77898af4 · outbound

This paper cites Eysenbach, B., Salakhutdinov, R., and Levine, S.

Proto Successor Measure: Representing the Behavior Space of an RL Agent Eysenbach, B., Salakhutdinov, R., and Levine, S

Reference 3

Resolution
verified fuzzy
raw_fallback, observed 2026-08-12T10:20:26.874864Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-08-12T10:20:26.674232Z digest=sha256:46905c2c27e75363b2bb5769c29685e3243126588b3ef9424561abb9f153e25a

Observation 33d5249a-14fa-4ad0-bde0-140264e0ab35 · outbound

This paper cites Offline Reinforcement Learning with Implicit Q-Learning.

Proto Successor Measure: Representing the Behavior Space of an RL Agent Offline Reinforcement Learning with Implicit Q-Learning

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-12T10:20:26.684362Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T10:20:26.684362Z digest=sha256:76a50fe46d631d69c3ae94b81f42dec37d2f4fe55a17f4fed13aee3df59465c0

Observation 3e17ec43-4144-41f8-99aa-aaacd7b20da6 · outbound

This paper cites The Laplacian in RL: Learning Representations with Efficient Approximations.

Proto Successor Measure: Representing the Behavior Space of an RL Agent The Laplacian in RL: Learning Representations with Efficient Approximations

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-12T10:20:26.695241Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T10:20:26.695241Z digest=sha256:53d2ea5549bdeb2af44f55177b6abbb4326570452b4e06a0312a0e5313dcc553

Observation 9993d872-9fb5-450f-b611-5fedddeaeeb2 · outbound

This paper cites Don't Change the Algorithm, Change the Data: Exploratory Data for Offline Reinforcement Learning.

Proto Successor Measure: Representing the Behavior Space of an RL Agent Don't Change the Algorithm, Change the Data: Exploratory Data for Offline Reinforcement Learning

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-12T10:20:26.699646Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T10:20:26.699646Z digest=sha256:7c9e62e49b0ff4cc68ed2ee0ae3b9e9895b71e22e318357aeaad41998a0ee4ac

Observation 4b014714-e06f-4dbd-9b1b-52227d089c9f · outbound

This paper cites 20000 tra- jectories, each of length 50, are collected.

Proto Successor Measure: Representing the Behavior Space of an RL Agent 20000 tra- jectories, each of length 50, are collected

Reference 11

Resolution
verified fuzzy
raw_fallback, observed 2026-08-12T10:20:26.832693Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-08-12T10:20:26.703461Z digest=sha256:778576d55178e80ffdd52cd82e3d11757c9389d11ceafc11fbe92e5b8e9689d5

Observation 26b5bfa1-8d63-4b0a-8162-4e1f6bee1eb5 · outbound

This paper cites sd, sd -> s.

Proto Successor Measure: Representing the Behavior Space of an RL Agent sd, sd -> s

Reference 14

Resolution
malformed identifier
raw_fallback, observed 2026-08-12T10:20:26.798172Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-08-12T10:20:26.712370Z digest=sha256:4d1c7b2636e04a911178fb5a70547c7748446669bcea7cc0cd0c8bc75be5ec90

Observation 0eeffdbb-f0a4-4a4b-a5bb-addf9405ac88 · outbound

This paper cites Dadashi, R., Taiga, A.

Proto Successor Measure: Representing the Behavior Space of an RL Agent Dadashi, R., Taiga, A

Reference 2019

Resolution
verified fuzzy
raw_fallback, observed 2026-08-12T10:20:26.887091Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-08-12T10:20:26.670536Z digest=sha256:300b104a40585f924a2e28dea03cd5265c0b46a511f6cf6ab532fd54f5404006

Observation 301a9097-5639-4da0-b875-2ad794fc7fc2 · outbound

This paper cites 9 Proto Successor Measure: Representing the Behavior Space of an RL Agent Hoang, C., Sohn, S., Choi, J., Carvalho, W.

Proto Successor Measure: Representing the Behavior Space of an RL Agent 9 Proto Successor Measure: Representing the Behavior Space of an RL Agent Hoang, C., Sohn, S., Choi, J., Carvalho, W

Reference 2020

Resolution
verified fuzzy
raw_fallback, observed 2026-08-12T10:20:26.853763Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-08-12T10:20:26.681025Z digest=sha256:ceb59e296f44f8462667072efaaaf9e03e18a2b7fffc1e8807af2b338b147275

Observation 5b3ce4fc-11f2-486c-b267-2b382ed12c5d · outbound

This paper cites Learning Successor States and Goal-Dependent Values: A Mathematical Viewpoint.

Proto Successor Measure: Representing the Behavior Space of an RL Agent Learning Successor States and Goal-Dependent Values: A Mathematical Viewpoint

Reference 2021

Resolution
unresolved
no resolver link, observed 2026-08-12T10:20:26.665450Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T10:20:26.665450Z digest=sha256:a12cfdc4d90dee75d9647c0d19d842b562f3d2dd7b89cd595d309961d943169c

Observation 88a0aeec-8076-47ba-afa2-2b6a59f87202 · outbound

This paper cites Farebrother, J., Greaves, J., Agarwal, R., Lan, C.

Proto Successor Measure: Representing the Behavior Space of an RL Agent Farebrother, J., Greaves, J., Agarwal, R., Lan, C

Reference 2022

Resolution
verified fuzzy
raw_fallback, observed 2026-08-12T10:20:26.863976Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-08-12T10:20:26.677578Z digest=sha256:b41af486bc8c32cec4f803acda94832324fae1d2179b8bc105d8e5db543a264d

Observation 684399d2-542a-4bb6-bdb5-e225e5130013 · outbound

This paper cites Warde-Farley, D., de Wiele, T.

Proto Successor Measure: Representing the Behavior Space of an RL Agent Warde-Farley, D., de Wiele, T

Reference 2023

Resolution
verified fuzzy
raw_fallback, observed 2026-08-12T10:20:26.842672Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-08-12T10:20:26.691946Z digest=sha256:5314bfe8f77e500cd0106ae9a0c9dd72f9fd2e564a7fd105f11a649b2b4d86d1

Observation 3457a125-7d69-42c0-8586-49cd62777647 · outbound

This paper cites DeepMind Control Suite.

Proto Successor Measure: Representing the Behavior Space of an RL Agent DeepMind Control Suite

Reference 9879

Resolution
unresolved
no resolver link, observed 2026-08-12T10:20:26.688224Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T10:20:26.688224Z digest=sha256:57862fa6589de1c121e6a3699651c4676ad6ce2cfdc9971543f7c60c454431f2

Pith citing papers

Observation 683c03af-f7ca-44e0-96ef-bbf2d68e1bd0 · inbound

A Survey of State Representation Learning for Deep Reinforcement Learning cites this paper.

A Survey of State Representation Learning for Deep Reinforcement Learning Proto Successor Measure: Representing the Behavior Space of an RL Agent

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-06T23:34:31.066415Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T23:34:31.066415Z digest=sha256:b8cbbf5b295de2bf4090b2ddd4d4a1691668fd0b7d9f5ac7eefd6e6baf55e582

Observation de9c8fb7-a7d3-4a08-bb9e-8f5d120c6f14 · inbound

Switching Successor Measures for Hierarchical Zero-shot Reinforcement Learning cites this paper.

Switching Successor Measures for Hierarchical Zero-shot Reinforcement Learning Proto Successor Measure: Representing the Behavior Space of an RL Agent

Reference 3

Resolution
verified exact
arxiv_id, observed 2026-05-14T20:42:58.526495Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-05-14T20:26:35.019753Z digest=sha256:5c263769fc72cbc8cd33415169cc4b9b414db4fe48ef4638b84d4662e4f0b8fe

Observation 2e741467-c68e-47aa-83d9-7dad88a6fcb9 · inbound

Learning Object Manipulation from Scratch via Contrastive Interaction cites this paper.

Learning Object Manipulation from Scratch via Contrastive Interaction Proto Successor Measure: Representing the Behavior Space of an RL Agent

Reference 66

Resolution
verified exact
arxiv_id, observed 2026-07-03T10:17:57.429411Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-06-27T10:10:21.427118Z digest=sha256:402d3e5611670a028ee472de589f1203c3ed699377ed7e4ed4100f1a7615a245

Observation 7f84f37d-8904-4e54-be59-d64501a8d9c2 · inbound

Reward-free Pretraining for Reinforcement Learning via Occupancy Coverage Maximization cites this paper.

Reward-free Pretraining for Reinforcement Learning via Occupancy Coverage Maximization Proto Successor Measure: Representing the Behavior Space of an RL Agent

Reference 4

Resolution
verified exact
arxiv_id, observed 2026-07-04T06:09:37.537474Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-06-26T14:48:19.683101Z digest=sha256:73c44bd9164d41ca205645beb76211133e71a04c0070158031e95aea764d5414