REVIEW 4 cited by
Epistemic Neural Networks
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Intelligence relies on an agent's knowledge of what it does not know. This capability can be assessed based on the quality of joint predictions of labels across multiple inputs. In principle, ensemble-based approaches produce effective joint predictions, but the computational costs of training large ensembles can become prohibitive. We introduce the epinet: an architecture that can supplement any conventional neural network, including large pretrained models, and can be trained with modest incremental computation to estimate uncertainty. With an epinet, conventional neural networks outperform very large ensembles, consisting of hundreds or more particles, with orders of magnitude less computation. The epinet does not fit the traditional framework of Bayesian neural networks. To accommodate development of approaches beyond BNNs, such as the epinet, we introduce the epistemic neural network (ENN) as an interface for models that produce joint predictions.
Forward citations
Cited by 4 Pith papers
-
NAE: Normalizing AutoEncoder
A conditional surrogate loss that always picks the gradient estimate aligned with the reconstruction loss improves flow autoencoder training and reaches state-of-the-art generative performance on molecules, tabular da...
-
EulerLoRA: Rank-Driven Jump Dynamics for Calibrated Parameter-Efficient Fine-Tuning
EulerLoRA samples over the rank-one directions of shared LoRA adapters to generate an implicit ensemble that preserves the deterministic LoRA output in expectation and matches a 16-adapter LoRA-Ensemble with 69% fewer...
-
Structurally Separated Uncertainty in Supervised Latent Variable Models
A credal concept-bottleneck model that supervises aleatoric uncertainty with annotator disagreement and epistemic uncertainty with prediction error yields near-zero correlation between the two uncertainty estimates.
-
Uncertainty Prioritized Experience Replay
UPER uses ensemble-based epistemic and aleatoric uncertainty to compute an information gain priority for experience replay, outperforming TD-error prioritization on Atari-57.
Discussion (0). Continue with ORCID to comment.