Position: Bayesian Deep Learning is Needed in the Age of Large-Scale AI
Reviewed by Pithpith:C2HFGXCXopen to challenge →
read the original abstract
In the current landscape of deep learning research, there is a predominant emphasis on achieving high predictive accuracy in supervised tasks involving large image and language datasets. However, a broader perspective reveals a multitude of overlooked metrics, tasks, and data types, such as uncertainty, active and continual learning, and scientific data, that demand attention. Bayesian deep learning (BDL) constitutes a promising avenue, offering advantages across these diverse settings. This paper posits that BDL can elevate the capabilities of deep learning. It revisits the strengths of BDL, acknowledges existing challenges, and highlights some exciting research avenues aimed at addressing these obstacles. Looking ahead, the discussion focuses on possible ways to combine large-scale foundation models with BDL to unlock their full potential.
This paper has not been read by Pith yet.
Forward citations
Cited by 3 Pith papers
-
Monte Carlo Stochastic Depth for Uncertainty Estimation in Deep Learning
Monte Carlo Stochastic Depth provides a theoretically linked and empirically competitive method for uncertainty quantification in modern deep learning models such as object detectors.
-
Scalable Bayesian Spatial Mixture Modelling for Remote Sensing Image Segmentation
POTTERS extends the Potts model with generalized spatial dependence and external priors for Bayesian remote sensing image segmentation via variational inference, without needing target-region labels.
-
Uncertainty in Physics and AI: Taxonomy, Quantification, and Validation
A unified taxonomy of uncertainty in ML for physics is introduced together with validation tools such as coverage, calibration, and proper scoring rules, illustrated on regression and classification tasks.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.