Paper Citation Record · LEDGER

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs

As of 19 August 2026, this Paper Citation Record lists 41 of 41 outbound references and 2 inbound Pith citation observations for arXiv:2505.09518.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2505.09518 v3

Coverage vector

measured 41 of 41 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-15T21:35:55.558707Z

measured 43 of 43 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-19T06:32:44.657259+00:00

measured 2 of 2 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-15T21:35:55.428858Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-08-15T21:35:55.594608Z

Reference resolution

41 of 41 outbound references displayed

verified exact2
verified fuzzy36
unresolved3
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 73c46f7d-ab06-4136-8156-c654c4db1fec · outbound

This paper cites Scalable internal-state policy-gradient methods for POMDPs.

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs Scalable internal-state policy-gradient methods for POMDPs

Reference 1

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T21:35:56.192886Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation b309826d-20dd-4f0c-b720-e3802eb345ac · outbound

This paper cites an unresolved cited work.

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs Unresolved cited work

Reference 2

Resolution: unresolved; raw_fallback, observed 2026-08-15T21:35:55.634870Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 54f8d2e9-253e-49ba-b2c1-f1bd9ebd7915 · outbound

This paper cites Pessimistic Iterative Planning with RNNs for Robust POMDPs.

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs Pessimistic Iterative Planning with RNNs for Robust POMDPs

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-15T21:35:55.423852Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a4f1e4b0-197e-4d8f-805c-35af3cd8efd0 · outbound

This paper cites Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs.

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs

Reference 13

Resolution: verified exact; local_arxiv, observed 2026-08-15T21:35:55.601761Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation fdffc7df-441a-4006-b79e-4f86c5a63121 · outbound

This paper cites Multi-cost bounded tradeoff analysis in MDP.

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs Multi-cost bounded tradeoff analysis in MDP

Reference 15

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T21:35:56.015726Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation acbd0d91-c95b-4aa8-bb34-e110b6fa32dd · outbound

This paper cites Gradient- descent for randomized controllers under partial observ- ability.

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs Gradient- descent for randomized controllers under partial observ- ability

Reference 16

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T21:35:56.001373Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 8e228d68-c9b8-4377-96f1-716ed4cfa995 · outbound

This paper cites Littman, and Anthony R.

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs Littman, and Anthony R

Reference 19

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T21:35:55.958050Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation f16f666b-263a-463e-b027-d6be7e8b4c54 · outbound

This paper cites PRISM 4.0: Verification of proba- bilistic real-time systems.

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs PRISM 4.0: Verification of proba- bilistic real-time systems

Reference 21

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T21:35:55.930077Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation c0719c59-751f-4806-b6ac-2f4ef02f74c8 · outbound

This paper cites Littman, Anthony R.

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs Littman, Anthony R

Reference 23

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T21:35:55.900633Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 2afd1a78-2b6c-4e13-9282-d82d62f7b4dd · outbound

This paper cites Policy iteration for bounded-parameter POMDPs.

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs Policy iteration for bounded-parameter POMDPs

Reference 27

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T21:35:55.843390Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation b3373df1-1fb0-4750-b6a8-0f2b1ef8532c · outbound

This paper cites Multiple-environment Markov decision processes.

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs Multiple-environment Markov decision processes

Reference 32

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T21:35:55.773248Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 6bb30a1b-84c7-4788-9bbe-0e9955df26e5 · outbound

This paper cites Ambiguous partially observable Markov decision processes: Structural results and applications.

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs Ambiguous partially observable Markov decision processes: Structural results and applications

Reference 34

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T21:35:55.743914Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation ee28828a-7701-4466-b203-0e3a24e381d9 · outbound

This paper cites Domain randomization for transferring deep neural net- works from simulation to the real world.

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs Domain randomization for transferring deep neural net- works from simulation to the real world

Reference 35

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T21:35:55.729256Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 635c7391-c1c8-47fb-97fb-8f765d5f07a6 · outbound

This paper cites Policy gradient in robust MDPs with global conver- gence guarantee.

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs Policy gradient in robust MDPs with global conver- gence guarantee

Reference 36

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T21:35:55.713703Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 2199623b-4390-408d-ae62-fb72a05987cb · outbound

This paper cites Robust Markov decision processes.Math.

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs Robust Markov decision processes.Math

Reference 37

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T21:35:55.697922Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation a77906f6-49cb-40d2-ae34-6185b5d699e1 · outbound

This paper cites Cost-bounded active clas- sification using partially observable markov decision pro- cesses.

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs Cost-bounded active clas- sification using partially observable markov decision pro- cesses

Reference 38

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T21:35:55.682671Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 0aa496db-49a8-4ee1-8c36-e8751e2ef1a4 · outbound

This paper cites We use a fixed step size, i.e.,αk =α> 0, that we set toα = 0.1.

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs We use a fixed step size, i.e.,αk =α> 0, that we set toα = 0.1

Reference 40

Resolution: verified exact; doi, observed 2026-08-15T21:35:55.650688Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation f7e40471-6a8c-4bf8-90de-f6ebc439a72e · outbound

This paper cites Stochastic modeling of a power-managed system: con- struction and optimization.

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs Stochastic modeling of a power-managed system: con- struction and optimization

Reference 1994

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T21:35:55.787644Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 29433022-aeac-45ba-9bd3-e40182b9ce10 · outbound

This paper cites On the undecidability of probabilistic planning and infinite-horizon partially observable Markov decision problems.

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs On the undecidability of probabilistic planning and infinite-horizon partially observable Markov decision problems

Reference 1997

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T21:35:55.886720Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation a94b119d-b5fa-446d-a28c-bfc4a981b2e3 · outbound

This paper cites Levy, and Shie Mannor.

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs Levy, and Shie Mannor

Reference 1998

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T21:35:55.944381Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation f9929093-2342-43da-b161-ec1c7fb46a85 · outbound

This paper cites Distributionally robust partially observable Markov decision process with moment-based ambiguity.

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs Distributionally robust partially observable Markov decision process with moment-based ambiguity

Reference 1999

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T21:35:55.857566Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 0870e8a6-0801-4f53-b300-40646940fd5b · outbound

This paper cites Cassandra.

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs Cassandra

Reference 2000

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T21:35:55.871844Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 3aa614ca-a362-4a61-ba66-925446c2c672 · outbound

This paper cites Policy-gradient algo- rithms for partially observable Markov decision processes.

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs Policy-gradient algo- rithms for partially observable Markov decision processes

Reference 2002

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T21:35:56.178138Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation a45b2a0f-65c1-4320-a2d4-7234c880afd7 · outbound

This paper cites Finite-state controllers based on Mealy machines for centralized and decentralized POMDPs.

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs Finite-state controllers based on Mealy machines for centralized and decentralized POMDPs

Reference 2003

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T21:35:56.163883Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation a6a331c3-c2f6-4d4b-9c77-01f151b980ee · outbound

This paper cites Finite-state controllers of POMDPs using parameter synthesis.

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs Finite-state controllers of POMDPs using parameter synthesis

Reference 2005

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T21:35:55.972994Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 0e78958a-a330-4e4c-af78-e92818e33fc4 · outbound

This paper cites PAYNT: a tool for inductive synthe- sis of probabilistic programs.

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs PAYNT: a tool for inductive synthe- sis of probabilistic programs

Reference 2010

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T21:35:56.149123Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation c41401a3-11c9-462c-9254-1d4bdec9368f · outbound

This paper cites A single-loop robust policy gradient method for robust Markov decision processes.

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs A single-loop robust policy gradient method for robust Markov decision processes

Reference 2011

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T21:35:55.915462Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation cef39d61-a77c-4c28-924c-2993cffce751 · outbound

This paper cites Optimal cost almost-sure reachability in POMDPs.

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs Optimal cost almost-sure reachability in POMDPs

Reference 2012

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T21:35:56.087288Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation dfcdf329-076c-4bc3-9d46-51ac04aebe00 · outbound

This paper cites Verification and control of partially observable probabilistic systems.

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs Verification and control of partially observable probabilistic systems

Reference 2013

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T21:35:55.829557Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation f720be2c-4868-4610-86c7-d0f1c043f6e1 · outbound

This paper cites Learning robust policies for uncertain parametric Markov decision processes.

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs Learning robust policies for uncertain parametric Markov decision processes

Reference 2014

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T21:35:55.758078Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation f0f3057b-cc8b-4aba-b49e-99520b72bf46 · outbound

This paper cites Puterman.

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs Puterman

Reference 2015

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T21:35:55.801625Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation d968f439-f515-4844-952a-5f6b7c84f780 · outbound

This paper cites Multiple-environment Markov decision processes: Efficient analysis and applications.

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs Multiple-environment Markov decision processes: Efficient analysis and applications

Reference 2016

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T21:35:56.072609Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 472ca84d-a8b2-4d1a-88df-bedc2ed73440 · outbound

This paper cites Robust partially ob- servable Markov decision process.

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs Robust partially ob- servable Markov decision process

Reference 2017

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T21:35:55.815607Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 986a5416-adb1-40ee-8150-10be8c43f907 · outbound

This paper cites Robust finite-state controllers for uncertain POMDPs.

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs Robust finite-state controllers for uncertain POMDPs

Reference 2018

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T21:35:56.043589Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 51da2508-8529-4c60-8ea3-b85a9fbb8237 · outbound

This paper cites Real-time scheduling over Markovian chan- nels: When partial observability meets hard deadlines.

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs Real-time scheduling over Markovian chan- nels: When partial observability meets hard deadlines

Reference 2019

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T21:35:55.666536Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 8eaeb912-d071-4c11-a312-8a36324d9805 · outbound

This paper cites ProFeat: feature- oriented engineering for family-based probabilistic model checking.

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs ProFeat: feature- oriented engineering for family-based probabilistic model checking

Reference 2020

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T21:35:56.058291Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 71e68da2-1b65-4016-bc78-8ba157052437 · outbound

This paper cites Search and explore: Symbiotic policy synthesis in POMDPs.

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs Search and explore: Symbiotic policy synthesis in POMDPs

Reference 2021

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T21:35:56.133548Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 64a519a1-5790-430f-93bc-09bd0a4879bb · outbound

This paper cites an unresolved cited work.

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs Unresolved cited work

Reference 2022

Resolution: unresolved; raw_fallback, observed 2026-08-15T21:35:55.987128Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 3acbbc78-ee9e-4968-ae5f-047ddc7a2a42 · outbound

This paper cites Policies grow on trees: Model checking families of MDPs.

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs Policies grow on trees: Model checking families of MDPs

Reference 2023

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T21:35:56.117553Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation bf7825fb-6186-4d00-a306-f6bc8fcbfa61 · outbound

This paper cites Martin, Samuel Nicol, R´egis Sabbadin, and Olivier Buffet.

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs Martin, Samuel Nicol, R´egis Sabbadin, and Olivier Buffet

Reference 2024

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T21:35:56.101841Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 90f01092-de56-427e-9cea-1bca99a6d7c8 · outbound

This paper cites Scalable first-order methods for robust MDPs.

Robust Finite-Memory Policy Gradients for Hidden-Model POMDPs Scalable first-order methods for robust MDPs

Reference 2025

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T21:35:56.029590Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Pith citing papers

Observation a4f1e4b0-197e-4d8f-805c-35af3cd8efd0 · inbound