Mind the Uncertainty: Risk-Aware and Actively Exploring Model-Based Reinforcement Learning
read the original abstract
We introduce a simple but effective method for managing risk in model-based reinforcement learning with trajectory sampling that involves probabilistic safety constraints and balancing of optimism in the face of epistemic uncertainty and pessimism in the face of aleatoric uncertainty of an ensemble of stochastic neural networks.Various experiments indicate that the separation of uncertainties is essential to performing well with data-driven MPC approaches in uncertain and safety-critical control environments.
This paper has not been read by Pith yet.
Forward citations
Cited by 2 Pith papers
-
Breaking the Epistemic Trap: Active Perception Under Compound Uncertainty
The paper defines the Epistemic Trap from interacting state and dynamics uncertainties in RL and introduces an Adaptive Safety Architecture with a Compound Uncertainty Coefficient to enable active information-seeking ...
-
Breaking the Epistemic Trap: Active Perception Under Compound Uncertainty
The paper proposes an Adaptive Safety Architecture with a mutual-information-based Compound Uncertainty Coefficient, MaxInfoRL policies, and adaptive constraints to actively resolve compound epistemic uncertainty in R...
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.