pith. sign in

arxiv: 2105.03594 · v1 · pith:FHIH53NFnew · submitted 2021-05-08 · 💻 cs.LG · cs.DS· stat.ML

Learning stochastic decision trees

classification 💻 cs.LG cs.DSstat.ML
keywords algorithmdecisionvarepsilonstochasticadditiveevenhypothesisknown
0
0 comments X
read the original abstract

We give a quasipolynomial-time algorithm for learning stochastic decision trees that is optimally resilient to adversarial noise. Given an $\eta$-corrupted set of uniform random samples labeled by a size-$s$ stochastic decision tree, our algorithm runs in time $n^{O(\log(s/\varepsilon)/\varepsilon^2)}$ and returns a hypothesis with error within an additive $2\eta + \varepsilon$ of the Bayes optimal. An additive $2\eta$ is the information-theoretic minimum. Previously no non-trivial algorithm with a guarantee of $O(\eta) + \varepsilon$ was known, even for weaker noise models. Our algorithm is furthermore proper, returning a hypothesis that is itself a decision tree; previously no such algorithm was known even in the noiseless setting.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.