Pith. sign in

Paper Citation Record · LEDGER

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling

As of 20 August 2026, this Paper Citation Record lists 16 of 16 outbound references and 0 inbound Pith citation observations for arXiv:2608.10896.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2608.10896 v1

Coverage vector

measured 16 of 16 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-12T14:57:07.035055Z

measured 16 of 16 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-20T06:33:59.587034+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

16 of 16 outbound references displayed

  • verified exact8
  • verified fuzzy1
  • unresolved6
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch1

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 379b6935-8a79-4e3d-9c95-ff6926e2547e · outbound

This paper cites Dongyan Lucy Huo, Yudong Chen, and Qiaomin Xie.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Dongyan Lucy Huo, Yudong Chen, and Qiaomin Xie

Reference 4

Resolution
verified exact
doi, observed 2026-08-12T14:57:07.188883Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-12T14:57:06.975599Z digest=sha256:37e54d81c4faf04402005b54e273630a9e26c2b7e095fddafe413b43f989d6e4

Observation b5cc44d7-cb48-4990-9911-58a6dd0f70da · outbound

This paper cites Nicholas M.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Nicholas M

Reference 5

Resolution
verified exact
raw_fallback, observed 2026-08-12T14:57:07.576569Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-12T14:57:06.980865Z digest=sha256:0f77adefafb9d015583d9d2c90487c49e0800f84279ca9fdeb3ba44ead7f99f7

Observation 36064249-498c-46dc-a493-c2c15296e0e9 · outbound

This paper cites Revisiting Step-Size Assumptions in Stochastic Approximation.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Revisiting Step-Size Assumptions in Stochastic Approximation

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-12T14:57:06.990142Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:57:06.990142Z digest=sha256:7eab624bfc92e7807350abc7bfbb6fac75dea02e9e2e74e6e5bb873d15224552

Observation 732ac268-c36f-4e81-80b6-410211f11ab2 · outbound

This paper cites Jiaqi Li, Zhipeng Lou, Stefan Richter, and Wei Biao Wu.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Jiaqi Li, Zhipeng Lou, Stefan Richter, and Wei Biao Wu

Reference 9

Resolution
verified exact
doi, observed 2026-08-12T14:57:07.141985Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-12T14:57:07.000670Z digest=sha256:2d3ca90232058ba5e571993f743eb7ed4ca19cd0d0983127344deb2a850babc7

Observation bdb5e155-f804-486f-9836-8a439edd6fa3 · outbound

This paper cites Xiaofeng Shao.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Xiaofeng Shao

Reference 13

Resolution
verified exact
doi, observed 2026-08-12T14:57:07.098203Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-12T14:57:07.020736Z digest=sha256:2ff3fbdd1014f8bf0647e8294d4d5796524ecc967c7e60609ea9776666082b43

Observation 955976bc-12f1-486c-b316-fc23c4c954f0 · outbound

This paper cites Richard S.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Richard S

Reference 1988

Resolution
unresolved
no resolver link, observed 2026-08-12T14:57:07.029905Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:57:07.029905Z digest=sha256:541a77d7a862fd1f67feaec2dbd94cb81e595c121ca9fac251d6fbe6a8ddf665

Observation ea3a4699-b3e5-43cd-ab3d-30812a2c56cb · outbound

This paper cites Statistical Inference for Policy Evaluation with Temporal Difference Learning.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Statistical Inference for Policy Evaluation with Temporal Difference Learning

Reference 1997

Resolution
unresolved
no resolver link, observed 2026-08-12T14:57:07.035055Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:57:07.035055Z digest=sha256:b52061e8a16f03da6c43a851a3618ae9db2bf22ec382ef78e0798591bcdafab0

Observation 87b0be82-5ab1-4d66-8504-42f543c2aeb0 · outbound

This paper cites Caio Kalil Lauand and Sean Meyn.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Caio Kalil Lauand and Sean Meyn

Reference 2000

Resolution
verified exact
raw_fallback, observed 2026-08-12T14:57:07.491749Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-12T14:57:06.985570Z digest=sha256:90f42661eb39786891613058a1a370283fd23bd459c420f7757f8282616ae870

Observation e4b06e77-82b8-4948-818e-4b44f093d559 · outbound

This paper cites an unresolved cited work.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Unresolved cited work

Reference 2010

Resolution
unresolved
no resolver link, observed 2026-08-12T14:57:07.025201Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:57:07.025201Z digest=sha256:0ae781dd507299e852cd44c22668177c8ee5d50dab43196a3fccb434c98d2fec

Observation 232658bc-aed1-4d42-80f9-f2d73a2a825c · outbound

This paper cites Wenlong Mou, Ashwin Pananjady, Martin J.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Wenlong Mou, Ashwin Pananjady, Martin J

Reference 2020

Resolution
verified fuzzy
raw_fallback, observed 2026-08-12T14:57:07.698778Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-12T14:57:07.015998Z digest=sha256:cf7c73300dbf0e000a2b3d7c7de6ee84de29ee5a13966cfc38ff3404f16b27fc

Observation 9ba6c88b-c72f-43f7-9c76-3a8444d83c47 · outbound

This paper cites Christoph Dann, Gerhard Neumann, and Jan Peters.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Christoph Dann, Gerhard Neumann, and Jan Peters

Reference 2021

Resolution
verified exact
raw_fallback, observed 2026-08-12T14:57:07.680106Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-12T14:57:06.965178Z digest=sha256:6b399099ed40f54ffa4f2932e3fab5ba6e737694bb77fdb64496783657ec18c9

Observation a7858fae-28e9-456b-811d-a2b403898e4f · outbound

This paper cites 27 Ilya Levin, Alexey Naumov, and Sergey Samsonov.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling 27 Ilya Levin, Alexey Naumov, and Sergey Samsonov

Reference 2022

Resolution
verified exact
doi, observed 2026-08-12T14:57:07.158083Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-12T14:57:06.995218Z digest=sha256:0c03286c6fa8ba1a7fbbd89fbd289e7b7fd400c2f55e2c32688694786c67ab1a

Observation 69bdd250-4eaf-4ef0-ab1c-b8eb66c2af0f · outbound

This paper cites an unresolved cited work.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Unresolved cited work

Reference 2023

Resolution
unresolved
no resolver link, observed 2026-08-12T14:57:07.011078Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:57:07.011078Z digest=sha256:a6f9ade7a933918035fcc626fc35b120163f7123cacbdf81d452a1e110a70b0c

Observation 2fcb3fa3-f75e-42e9-b8a7-f309e255f8ac · outbound

This paper cites Jalaj Bhandari, Daniel Russo, and Raghav Singal.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Jalaj Bhandari, Daniel Russo, and Raghav Singal

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-12T14:57:06.959519Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:57:06.959519Z digest=sha256:ab3eeaf7baaf255e9aa29f7392541b97d46ccaed19ca512556a7626b3216628f

Observation 3c81c8c1-c13e-4798-b8da-da44192d1440 · outbound

This paper cites Xiang Li, Jiadong Liang, and Zhihua Zhang.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Xiang Li, Jiadong Liang, and Zhihua Zhang

Reference 2025

Resolution
verified exact
doi, observed 2026-08-12T14:57:07.125766Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-12T14:57:07.005525Z digest=sha256:428a6327aaa6ed7423ab1dea97800b86a77f449e849e9e838cd1df3a4b55237c

Observation 04c79041-1e76-4d2c-9327-089a6e3e5a45 · outbound

This paper cites Revisiting the Constant Stepsize Stochastic Approximation with Decision-Dependent Markovian Noise.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Revisiting the Constant Stepsize Stochastic Approximation with Decision-Dependent Markovian Noise

Reference 2026

Resolution
metadata mismatch
local_arxiv, observed 2026-08-12T14:57:07.212828Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-12T14:57:06.970199Z digest=sha256:9400e5950292b0ed3eab3afc344f768119a1a05b4ad3bc3cd2c1816bb17eb85e

Pith citing papers

No inbound Pith citation observations are available.