REVIEW 3 cited by
On the Relationship Between Active Inference and Control as Inference
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
On the Relationship Between Active Inference and Control as Inference
read the original abstract
Active Inference (AIF) is an emerging framework in the brain sciences which suggests that biological agents act to minimise a variational bound on model evidence. Control-as-Inference (CAI) is a framework within reinforcement learning which casts decision making as a variational inference problem. While these frameworks both consider action selection through the lens of variational inference, their relationship remains unclear. Here, we provide a formal comparison between them and demonstrate that the primary difference arises from how value is incorporated into their respective generative models. In the context of this comparison, we highlight several ways in which these frameworks can inform one another.
Forward citations
Cited by 3 Pith papers
-
Mind Dreamer: Untethering Imagination via Active Causal Intervention on Latent Manifolds
Mind Dreamer adds an adversarial generator for non-continuous latent starting states plus Relay Value and Uncertainty Functions to handle credit assignment across jumps, claiming 1.67x average and 8.8x sparse-reward s...
-
Mind Dreamer: Untethering Imagination via Active Causal Intervention on Latent Manifolds
Mind Dreamer uses active causal intervention via an adversarial initial-state generator and relay value functions to untether imagination in MBRL, claiming 1.67x average and up to 8.8x sparse-reward speedups over DreamerV3.
-
Generalised Bellman recurrence and three dualities in sequential decision-making
Bellman's equation is derived from three compatibility conditions (D, R, A), and three known RL dualities are presented as faces of one unifying triangle.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.