Pith. sign in

Paper Citation Record · LEDGER

Online MDP with Transition Prototypes: A Robust Adaptive Approach

As of 12 August 2026, this Paper Citation Record lists 34 of 34 outbound references and 0 inbound Pith citation observations for arXiv:2412.14075.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2412.14075 v2

Coverage vector

measured 34 of 34 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-11T12:38:32.547517Z

measured 34 of 34 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-12T06:34:41.77262+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

34 of 34 outbound references displayed

  • verified exact1
  • verified fuzzy6
  • unresolved27
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation e0a3b406-91a4-4010-80a5-017d598ef475 · outbound

This paper cites , " * write output.state after.block = add.period write newline.

Online MDP with Transition Prototypes: A Robust Adaptive Approach , " * write output.state after.block = add.period write newline

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-11T12:38:32.177430Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T12:38:32.177430Z digest=sha256:fdfc3217a8092fcd68856e9a1e9174241358b448b90192a1a1173fc08b7f14b9

Observation b4ab0349-ebcb-43ac-8b4b-173825fc2070 · outbound

This paper cites write newline.

Online MDP with Transition Prototypes: A Robust Adaptive Approach write newline

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-11T12:38:32.181342Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T12:38:32.181342Z digest=sha256:3a98745f1b18e3dd2d86b3cbbd74ec0d1ac5e1bad348a65c6390a7af1609f2b2

Observation 677c2e43-bf96-461f-a037-dca6b1b2a0a3 · outbound

This paper cites Posterior sampling for reinforcement learning: worst-case regret bounds.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Posterior sampling for reinforcement learning: worst-case regret bounds

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-11T12:38:32.184591Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T12:38:32.184591Z digest=sha256:e3afe856bca2d6b688953ccd2e859b6e6ee0ec782dd039f14d2c9aec1fd8ae6b

Observation 037280dc-bb8e-4873-81b7-de4b190ff471 · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 4

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:33.578891Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.210663Z digest=sha256:929e61355556679f197490cd9e268bc920e5f89d663e5d668b5f36e7328fb0ba

Observation bc9ba930-a624-4c2d-9261-234207da20af · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:33.569572Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.231337Z digest=sha256:c03d37b8471fc84baf40593143403d6f553597fb2e8697cddfa0d4e576221a2c

Observation d3958e1c-5157-4154-8b1e-ab77d4e23ff3 · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 6

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:33.562354Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.264920Z digest=sha256:a41ba5d4e0cc121eb01709df7570012d4ed90ab5a6c4767029e18629e1741dd5

Observation 7410b042-2005-4c0f-940a-8f612010b704 · outbound

This paper cites G.; Osband, I.; and Munos, R.

Online MDP with Transition Prototypes: A Robust Adaptive Approach G.; Osband, I.; and Munos, R

Reference 7

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:38:33.551577Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.307993Z digest=sha256:93459170af550a729e40af2ced4aa6044a078f283278de55348f8d7342df7ba7

Observation d678adb4-74be-4631-971c-f25b8bfa62c4 · outbound

This paper cites I.; and Tennenholtz, M.

Online MDP with Transition Prototypes: A Robust Adaptive Approach I.; and Tennenholtz, M

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:38:33.480385Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.337737Z digest=sha256:fe628333bc492cf78db931b84132bba99ff36ca662156133b61ca37c240415db

Observation 2c3c9e62-1966-4389-9276-4c57411a7732 · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 9

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:33.400034Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.341947Z digest=sha256:402262c8cdcd86434da21ff231fa2374c7077f00c67041a922c672beea8a033a

Observation a193c38e-6841-449f-93cf-7455dba7cc06 · outbound

This paper cites N.; and Katehakis, M.

Online MDP with Transition Prototypes: A Robust Adaptive Approach N.; and Katehakis, M

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:38:33.391818Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.346166Z digest=sha256:f7fa0d3e3f812176522ce527452a91fd2b11819d9b47b581989fd8a0f8c0f6a5

Observation a6548d5e-c9b8-473b-91b3-fd8f1fb2fbe7 · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 11

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:33.382850Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.349466Z digest=sha256:68ceadc41eb265cbf0760dd4ba23d6a1fecc4e026481dd8d4093140ad4fe2259

Observation 6003e351-69bc-4111-857d-6e288234c082 · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 12

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:33.373117Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.352453Z digest=sha256:b097c4ec15ce96f49dc9894cae99a32eb9512d73124b79efe3aae6d9be5a6e49

Observation 66cf95d7-7694-4784-9c60-4feb38bc9caa · outbound

This paper cites D.; Flet-Berliac, Y.; Leurent, E.; M \'e nard, P.; Shang, X.; and Valko, M.

Online MDP with Transition Prototypes: A Robust Adaptive Approach D.; Flet-Berliac, Y.; Leurent, E.; M \'e nard, P.; Shang, X.; and Valko, M

Reference 13

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:38:33.262246Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.354833Z digest=sha256:0ce069e6febf2595d04aecf8fa862672a4357d6f5229e8d42f82341b3d311a34

Observation 1265e59e-ad52-4a2b-bafd-c2597f2df802 · outbound

This paper cites Online Policy Optimization for Robust MDP.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Online Policy Optimization for Robust MDP

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-11T12:38:32.357303Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T12:38:32.357303Z digest=sha256:35e017a21b2006bb23bf32ec9fb7f67ea37443ac213da4f8a73bbdb6f010091c

Observation 3f15464c-6930-4839-8de2-7b938e8076d3 · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 15

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:33.207727Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.360052Z digest=sha256:8e772360213adcbefa26a40bcafa3e5fb34247215b7737cbb301fa359f972c06

Observation 13b1f371-91f3-451c-9e35-c69ac6119d0b · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 16

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:33.201079Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.361825Z digest=sha256:91121021499aa393261a232cf40dbbe18278b3f6e62cfb5a529d15eb15ccb2a7

Observation 0f7c8835-03bd-49ba-8a04-4e6845a0e5ae · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 17

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:33.193355Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.364975Z digest=sha256:8e0023ea27ff5028ed50f55117118306a13b21686665b400f1de9c6827341414

Observation 1bfe326c-fd1f-425e-85d6-38b352734998 · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 18

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:33.185288Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.367438Z digest=sha256:cf0dd9ae2366aa28976d7b1ae622c594b97b4e1e69989dedb7676bf6e2cddea7

Observation d3974b50-b389-414f-b345-5676e78927e2 · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 19

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:33.177404Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.370936Z digest=sha256:f2d52a8e09eed73cc8f79d634d22159df4d448bd237988eafd56a3dfde2b1dc1

Observation 198201cd-6297-4bad-8bb8-42c911afe3fb · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 20

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:33.168006Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.374851Z digest=sha256:30c2bab4c0756b4d4ae8ebf6dc783253f06959fb8f1d7d9b131d3445dc362aae

Observation 4cc9059a-fe6a-40d2-9dcb-14b124dea950 · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 21

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:33.159200Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.378901Z digest=sha256:8bead82de265e2d25f19164b7aa4f3215b8062300c36f9946336d962cb57a817

Observation e408df9f-0881-4694-aafe-0c6e403e2991 · outbound

This paper cites Distributionally Robust Offline Reinforcement Learning with Linear Function Approximation.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Distributionally Robust Offline Reinforcement Learning with Linear Function Approximation

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-11T12:38:32.381723Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T12:38:32.381723Z digest=sha256:02c7690b5813fa9f92e1aea06cb18d75bfbb033d7e13630ec00ce70741fa9397

Observation d0206700-54d2-4579-a91f-fde410ad2e4d · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 23

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:33.048004Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.384656Z digest=sha256:2d3dad62a4e67e4d33d5971d19e46d9fc4b1977ca1fa32f859dc52cd7eda495a

Observation d4ca4da6-e7ca-42fb-bdd9-34e33859124c · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 24

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:32.966458Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.387393Z digest=sha256:4bc31cbfe1e1fea3718a6e728bbfdb8fc87d44773e86576572dd285ff07dee12

Observation 8b2bb797-1cd4-4506-8264-e72073d7d253 · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 25

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:32.958239Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.389729Z digest=sha256:84f12a193ee1cc04be359df4244a106bc021e6d96100f0b596fa1f80535347a4

Observation e2f314c2-b3e6-4fd8-bb18-b3b093901f03 · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 26

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:32.949663Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.392862Z digest=sha256:171eb724b654a8e07e409f182e1614c8041274f1e37d8da5479274040fe5d1be

Observation 8dd2d685-6844-4202-b19e-18ac66c22e14 · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 27

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:32.942038Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.396121Z digest=sha256:58ca117f53c4349bdee07d4ff472fb43a773fb44f92e27c0139151793aeac18a

Observation c1e3b2fd-f81b-49ad-a439-91e438ce7ef1 · outbound

This paper cites Robust Batch Policy Learning in Markov Decision Processes.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Robust Batch Policy Learning in Markov Decision Processes

Reference 28

Resolution
verified exact
local_arxiv, observed 2026-08-11T12:38:32.576180Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.422165Z digest=sha256:09921a8815677887cb689cf26a669c71d3628fd014ebf4339857a146f79756a9

Observation 59df1397-6958-4e95-a1e1-021205c121e1 · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 29

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:32.933065Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.455219Z digest=sha256:b50e6364565055ba8b74ff78657d83488e456e933a75f53bba4bbc264e6c06f9

Observation ba279a8b-f8fe-4197-a324-3a48397ed5e0 · outbound

This paper cites N.; Kaufman, D.

Online MDP with Transition Prototypes: A Robust Adaptive Approach N.; Kaufman, D

Reference 30

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:38:32.922750Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.501607Z digest=sha256:2e283aa06318b4643a2cc6e64d47cc27ccd5a96472cd94260ef9d896a0b5a709

Observation 97578bd9-0214-47a3-ad69-54db7188d89e · outbound

This paper cites S.; and Barto, A.

Online MDP with Transition Prototypes: A Robust Adaptive Approach S.; and Barto, A

Reference 31

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:38:32.815824Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.539424Z digest=sha256:f18d9e170a96cec026aadf2d040db9af5fef09bf3bffca09839ff918a726d2ff

Observation d161bee1-bc1d-49f3-80b9-d4ee7f7be4a1 · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 32

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:32.651105Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.542468Z digest=sha256:49a8c02a139b1ad30a4ff97146ab5c5dfe4b9b3a84df8e76d9c4011993a08962

Observation 646fe793-e686-4806-8ca2-7766f23bc5fd · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 33

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:32.615708Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.545393Z digest=sha256:1233ed7c02d6b404b64b1028fd221a3aa91679cf63f565afcafd2392d6338b21

Observation f1dcd06a-da8a-489f-97de-32b0c51af4d0 · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 34

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:32.606492Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.547517Z digest=sha256:d8d54ae0135da60b9d828c03993db9e202f6450d4dcb61069b0452cb49bfd0f1

Pith citing papers

No inbound Pith citation observations are available.