Paper Citation Record · LEDGER

When Does Reward Teach State? A Hidden-Automaton Instrument and the Group-Language Boundary

As of 8 August 2026, this Paper Citation Record lists 37 of 37 outbound references and 0 inbound Pith citation observations for arXiv:2607.11953.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2607.11953 v2

Coverage vector

measured 37 of 37 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-02T07:20:42.777432Z

measured 37 of 37 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-08T06:32:00.761636+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

37 of 37 outbound references displayed

verified exact6
verified fuzzy0
unresolved31
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation d61fb680-97ee-4070-b2e7-bfd16cc6631b · outbound

This paper cites Goal Misgeneralization in Deep Reinforcement Learning.

When Does Reward Teach State? A Hidden-Automaton Instrument and the Group-Language Boundary Goal Misgeneralization in Deep Reinforcement Learning

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-02T07:20:39.017070Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 140911e7-4a29-46ba-b69b-c6c9fecb38a0 · outbound

This paper cites Goal Misgeneralization: Why Correct Specifications Aren't Enough For Correct Goals.

When Does Reward Teach State? A Hidden-Automaton Instrument and the Group-Language Boundary Goal Misgeneralization: Why Correct Specifications Aren't Enough For Correct Goals

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-02T07:20:39.148585Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c567fd28-cc10-46ca-9f8f-540a197b882b · outbound

This paper cites Transformers Learn Shortcuts to Automata.

When Does Reward Teach State? A Hidden-Automaton Instrument and the Group-Language Boundary Transformers Learn Shortcuts to Automata

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-02T07:20:39.305688Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 73bd71ee-17b0-400e-b10e-0d158ba8ed68 · outbound

This paper cites an unresolved cited work.

When Does Reward Teach State? A Hidden-Automaton Instrument and the Group-Language Boundary Unresolved cited work

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-02T07:20:39.469103Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 83cfb748-d6aa-470b-8f55-611ec682b468 · outbound

This paper cites Krohn, J.

When Does Reward Teach State? A Hidden-Automaton Instrument and the Group-Language Boundary Krohn, J

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-02T07:20:39.577137Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 89348c1a-0030-4524-8785-d0d45c6e03ba · outbound

This paper cites What Formal Languages Can Transformers Express? A Survey.

When Does Reward Teach State? A Hidden-Automaton Instrument and the Group-Language Boundary What Formal Languages Can Transformers Express? A Survey

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-02T07:20:39.658158Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 560abdac-668a-4586-8384-5e6cb4106fdc · outbound

This paper cites Language Models Need Inductive Biases to Count Inductively.

When Does Reward Teach State? A Hidden-Automaton Instrument and the Group-Language Boundary Language Models Need Inductive Biases to Count Inductively

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-02T07:20:39.728166Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b1f74490-9223-40c8-acb6-f91918ced5a5 · outbound

This paper cites A Formal Framework for Understanding Length Generalization in Transformers.

When Does Reward Teach State? A Hidden-Automaton Instrument and the Group-Language Boundary A Formal Framework for Understanding Length Generalization in Transformers

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-02T07:20:39.812148Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a435458a-fe38-4056-ad73-8ac71438132c · outbound

This paper cites Huang, Z.

When Does Reward Teach State? A Hidden-Automaton Instrument and the Group-Language Boundary Huang, Z

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-02T07:20:39.905726Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ab15d13c-c081-44ce-aa44-bde93a5c7f76 · outbound

This paper cites Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Task.

When Does Reward Teach State? A Hidden-Automaton Instrument and the Group-Language Boundary Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Task

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-02T07:20:39.972178Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation df5dc5b4-399b-4d3d-9142-6db19f2e0a8b · outbound

This paper cites Emergent Linear Representations in World Models of Self-Supervised Sequence Models.

When Does Reward Teach State? A Hidden-Automaton Instrument and the Group-Language Boundary Emergent Linear Representations in World Models of Self-Supervised Sequence Models

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-02T07:20:40.064986Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f78b623a-a6a7-4966-af2d-3a25b9606b3e · outbound

This paper cites Designing and Interpreting Probes with Control Tasks.

When Does Reward Teach State? A Hidden-Automaton Instrument and the Group-Language Boundary Designing and Interpreting Probes with Control Tasks

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-02T07:20:40.200581Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 455229a7-a2bf-4765-b3df-aa2748773362 · outbound

This paper cites Understanding intermediate layers using linear classifier probes.

When Does Reward Teach State? A Hidden-Automaton Instrument and the Group-Language Boundary Understanding intermediate layers using linear classifier probes

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-02T07:20:40.260439Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6d4d84bb-1c77-4969-b53d-bb5e3a81d7e7 · outbound

This paper cites DeepMDP: Learning Continuous Latent Space Models for Representation Learning.

When Does Reward Teach State? A Hidden-Automaton Instrument and the Group-Language Boundary DeepMDP: Learning Continuous Latent Space Models for Representation Learning

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-02T07:20:40.388492Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 666940ed-ca11-4316-b663-587cfa4c0341 · outbound

This paper cites Learning Invariant Representations for Reinforcement Learning without Reconstruction.

When Does Reward Teach State? A Hidden-Automaton Instrument and the Group-Language Boundary Learning Invariant Representations for Reinforcement Learning without Reconstruction

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-02T07:20:40.531548Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation aade19e8-2102-4b5c-b4e0-7afadf6e6cfe · outbound

This paper cites Recurrent Model-Free RL Can Be a Strong Baseline for Many POMDPs.

When Does Reward Teach State? A Hidden-Automaton Instrument and the Group-Language Boundary Recurrent Model-Free RL Can Be a Strong Baseline for Many POMDPs

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-02T07:20:40.649329Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 30a8ef44-1c82-405a-ab56-d557f2d2ea0d · outbound

This paper cites Reinforcement Learning with Unsupervised Auxiliary Tasks.

When Does Reward Teach State? A Hidden-Automaton Instrument and the Group-Language Boundary Reinforcement Learning with Unsupervised Auxiliary Tasks

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-02T07:20:40.802032Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation dbb8f9d2-05e9-4f13-b037-3bfde2b3362b · outbound

This paper cites Toro Icarte et al.

When Does Reward Teach State? A Hidden-Automaton Instrument and the Group-Language Boundary Toro Icarte et al

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-02T07:20:40.941218Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8200f6e3-2ba5-4c7e-8e71-7f5e68e4dc73 · outbound

This paper cites an unresolved cited work.

When Does Reward Teach State? A Hidden-Automaton Instrument and the Group-Language Boundary Unresolved cited work

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-02T07:20:41.057483Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e17b4226-8914-4b24-906d-da6e85a35226 · outbound

This paper cites Oncina, P.

When Does Reward Teach State? A Hidden-Automaton Instrument and the Group-Language Boundary Oncina, P

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-02T07:20:41.115389Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3ec6d875-a65b-4b1b-ab40-7243740a6c55 · outbound

This paper cites Neural Networks and the Chomsky Hierarchy.

When Does Reward Teach State? A Hidden-Automaton Instrument and the Group-Language Boundary Neural Networks and the Chomsky Hierarchy

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-02T07:20:41.199053Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3a10fe2c-bacc-4f55-b82d-0b90134bca24 · outbound

This paper cites On the Ability and Limitations of Transformers to Recognize Formal Languages.

When Does Reward Teach State? A Hidden-Automaton Instrument and the Group-Language Boundary On the Ability and Limitations of Transformers to Recognize Formal Languages

Reference 22

Resolution: unresolved; no resolver link, observed 2026-08-02T07:20:41.341600Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4030d316-9fa7-40c1-952d-2d84142dd6bf · outbound

This paper cites On the Practical Computational Power of Finite Precision RNNs for Language Recognition.

When Does Reward Teach State? A Hidden-Automaton Instrument and the Group-Language Boundary On the Practical Computational Power of Finite Precision RNNs for Language Recognition

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-02T07:20:41.419333Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b11b8231-fb1b-49e1-9804-6c6e4dec6508 · outbound

This paper cites Representing Formal Languages: A Comparison Between Finite Automata and Recurrent Neural Networks.

When Does Reward Teach State? A Hidden-Automaton Instrument and the Group-Language Boundary Representing Formal Languages: A Comparison Between Finite Automata and Recurrent Neural Networks

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-02T07:20:41.452821Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 66f0636a-0d80-4439-bf78-2eaa02cb5b52 · outbound

This paper cites Learning Reward Machines: A Study in Partially Observable Reinforcement Learning.

When Does Reward Teach State? A Hidden-Automaton Instrument and the Group-Language Boundary Learning Reward Machines: A Study in Partially Observable Reinforcement Learning

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-02T07:20:41.610812Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 08e11add-eb9e-402b-97b9-12d0a6102bd1 · outbound

This paper cites an unresolved cited work.

When Does Reward Teach State? A Hidden-Automaton Instrument and the Group-Language Boundary Unresolved cited work

Reference 26

Resolution: unresolved; no resolver link, observed 2026-08-02T07:20:41.713699Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b5840241-7c2a-430d-acef-67371c5f3803 · outbound

This paper cites an unresolved cited work.

When Does Reward Teach State? A Hidden-Automaton Instrument and the Group-Language Boundary Unresolved cited work

Reference 27

Resolution: unresolved; no resolver link, observed 2026-08-02T07:20:41.809419Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e8a6c98c-8b86-4c82-be75-85499fa511f9 · outbound

This paper cites Causal Confusion in Imitation Learning.

When Does Reward Teach State? A Hidden-Automaton Instrument and the Group-Language Boundary Causal Confusion in Imitation Learning

Reference 28

Resolution: unresolved; no resolver link, observed 2026-08-02T07:20:41.928096Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 02afc5d4-fb72-41e5-b792-d00cf9a23a28 · outbound

This paper cites The Effects of Reward Misspecification: Mapping and Mitigating Misaligned Models.

When Does Reward Teach State? A Hidden-Automaton Instrument and the Group-Language Boundary The Effects of Reward Misspecification: Mapping and Mitigating Misaligned Models

Reference 29

Resolution: unresolved; no resolver link, observed 2026-08-02T07:20:42.024058Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 417eb3f8-4ef7-4e8b-b103-e4dd9e84ed60 · outbound

This paper cites Defining and Characterizing Reward Hacking.

When Does Reward Teach State? A Hidden-Automaton Instrument and the Group-Language Boundary Defining and Characterizing Reward Hacking

Reference 30

Resolution: unresolved; no resolver link, observed 2026-08-02T07:20:42.144350Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 39b40147-7abb-4430-91b3-d97f2a9dda2a · outbound

This paper cites an unresolved cited work.

When Does Reward Teach State? A Hidden-Automaton Instrument and the Group-Language Boundary Unresolved cited work

Reference 31

Resolution: verified exact; doi, observed 2026-08-02T07:23:24.174428Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 46d724e9-46e5-4897-8fe6-65162607923b · outbound

This paper cites an unresolved cited work.

When Does Reward Teach State? A Hidden-Automaton Instrument and the Group-Language Boundary Unresolved cited work

Reference 32

Resolution: verified exact; doi, observed 2026-08-02T07:23:24.089117Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 4be6bce4-6f46-4930-80e8-9665e1a357e2 · outbound

This paper cites an unresolved cited work.

When Does Reward Teach State? A Hidden-Automaton Instrument and the Group-Language Boundary Unresolved cited work

Reference 33

Resolution: verified exact; doi, observed 2026-08-02T07:23:24.007557Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 97a06e42-b5fb-48b8-8759-e01212d9bc70 · outbound

This paper cites an unresolved cited work.

When Does Reward Teach State? A Hidden-Automaton Instrument and the Group-Language Boundary Unresolved cited work

Reference 34

Resolution: verified exact; doi, observed 2026-08-02T07:23:23.926400Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation e137be10-7e7a-4e13-be17-1faeaadfe8eb · outbound

This paper cites Mannhardt.

When Does Reward Teach State? A Hidden-Automaton Instrument and the Group-Language Boundary Mannhardt

Reference 35

Resolution: verified exact; doi, observed 2026-08-02T07:23:23.853155Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 1e0b8361-7ec7-4ff6-aa77-dc5e6858ba9b · outbound

This paper cites de Leoni, F.

When Does Reward Teach State? A Hidden-Automaton Instrument and the Group-Language Boundary de Leoni, F

Reference 36

Resolution: verified exact; doi, observed 2026-08-02T07:23:23.782976Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation ccec93eb-6093-492d-955c-402c53032ee0 · outbound

This paper cites Mannhardt.

When Does Reward Teach State? A Hidden-Automaton Instrument and the Group-Language Boundary Mannhardt

Reference 37

Resolution: unresolved; no resolver link, observed 2026-08-02T07:20:42.777432Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

No inbound Pith citation observations are available.