pith. sign in

arxiv: 1503.05911 · v2 · pith:UI54U7BJnew · submitted 2015-03-19 · ⚛️ physics.data-an · cs.IT· math.IT· math.ST· stat.TH

A note on entropy estimation

classification ⚛️ physics.data-an cs.ITmath.ITmath.STstat.TH
keywords entropyestimatorbiasestimationprovestatisticalaccountbeen
0
0 comments X
read the original abstract

We compare an entropy estimator $H_z$ recently discussed in [10] with two estimators $H_1$ and $H_2$ introduced in [6][7]. We prove the identity $H_z \equiv H_1$, which has not been taken into account in [10]. Then, we prove that the statistical bias of $H_1$ is less than the bias of the ordinary likelihood estimator of entropy. Finally, by numerical simulation we verify that for the most interesting regime of small sample estimation and large event spaces, the estimator $H_2$ has a significant smaller statistical error than $H_z$.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.