pith. sign in

arxiv: 1903.07870 · v2 · pith:EU7ASP2Dnew · submitted 2019-03-19 · 💻 cs.CC · cs.DS· math.ST· stat.TH

How Hard Is Robust Mean Estimation?

classification 💻 cs.CC cs.DSmath.STstat.TH
keywords meanalgorithmsestimationpolynomial-timerobusterrorproblemrates
0
0 comments X
read the original abstract

Robust mean estimation is the problem of estimating the mean $\mu \in \mathbb{R}^d$ of a $d$-dimensional distribution $D$ from a list of independent samples, an $\epsilon$-fraction of which have been arbitrarily corrupted by a malicious adversary. Recent algorithmic progress has resulted in the first polynomial-time algorithms which achieve \emph{dimension-independent} rates of error: for instance, if $D$ has covariance $I$, in polynomial-time one may find $\hat{\mu}$ with $\|\mu - \hat{\mu}\| \leq O(\sqrt{\epsilon})$. However, error rates achieved by current polynomial-time algorithms, while dimension-independent, are sub-optimal in many natural settings, such as when $D$ is sub-Gaussian, or has bounded $4$-th moments. In this work we give worst-case complexity-theoretic evidence that improving on the error rates of current polynomial-time algorithms for robust mean estimation may be computationally intractable in natural settings. We show that several natural approaches to improving error rates of current polynomial-time robust mean estimation algorithms would imply efficient algorithms for the small-set expansion problem, refuting Raghavendra and Steurer's small-set expansion hypothesis (so long as $P \neq NP$). We also give the first direct reduction to the robust mean estimation problem, starting from a plausible but nonstandard variant of the small-set expansion problem.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Quantum Entropy Scoring for Fast Robust Mean Estimation and Improved Outlier Detection

    cs.DS 2019-06 unverdicted novelty 7.0

    QUE-scoring via quantum entropy regularization achieves optimal robust mean estimation in Õ(nd) time and outperforms prior outlier detection methods in experiments.