Recognition: unknown
Random design analysis of ridge regression
read the original abstract
This work gives a simultaneous analysis of both the ordinary least squares estimator and the ridge regression estimator in the random design setting under mild assumptions on the covariate/response distributions. In particular, the analysis provides sharp results on the ``out-of-sample'' prediction error, as opposed to the ``in-sample'' (fixed design) error. The analysis also reveals the effect of errors in the estimated covariance structure, as well as the effect of modeling errors, neither of which effects are present in the fixed design setting. The proofs of the main results are based on a simple decomposition lemma combined with concentration inequalities for random vectors and matrices.
This paper has not been read by Pith yet.
Forward citations
Cited by 3 Pith papers
-
Q-MMR: Off-Policy Evaluation via Recursive Reweighting and Moment Matching
Q-MMR provides a dimension-free finite-sample guarantee for off-policy evaluation under only Q^π realizability by learning data-point weights inductively via top-down moment matching against a value-function discrimin...
-
Q-MMR: Off-Policy Evaluation via Recursive Reweighting and Moment Matching
Q-MMR introduces recursive reweighting and moment matching for off-policy evaluation, delivering dimension-free error bounds under Q^π realizability alone.
-
Distributional Off-Policy Evaluation with Deep Quantile Process Regression
DQPOPE estimates the entire return distribution in off-policy evaluation via deep quantile process regression, providing statistical advantages over standard single-value methods with equivalent sample sizes.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.