pith. sign in

A vailable: https://arxiv.org/abs/1301.6720

2 Pith papers cite this work. Polarity classification is still indexing.

2 Pith papers citing it
abstract

Solving partially observable Markov decision processes (POMDPs) is highly intractable in general, at least in part because the optimal policy may be infinitely large. In this paper, we explore the problem of finding the optimal policy from a restricted set of policies, represented as finite state automata of a given size. This problem is also intractable, but we show that the complexity can be greatly reduced when the POMDP and/or policy are further constrained. We demonstrate good empirical results with a branch-and-bound method for finding globally optimal deterministic policies, and a gradient-ascent method for finding locally optimal stochastic policies.

years

2026 1 2025 1

verdicts

UNVERDICTED 2

representative citing papers

Discrete Diffusion for Codebook-Based Beam Candidate Generation

eess.SP · 2026-04-09 · unverdicted · novelty 6.0

A discrete denoising diffusion model learns from probing histories to generate promising beam candidates, yielding better SNR, lower beam-miss probability, and reduced probe regret than baselines under tight probing budgets.

citing papers explorer

Showing 2 of 2 citing papers.