Aryeh Kontorovich

We investigate bounded-memory estimators of statistical functionals. It is shown that, for nondegenerate functionals and stochastic processes, it is impossible to achieve consistent estimation with bounded memory. In the positive direction, we show that O(log(1/ε)) states suffice to achieve ε-consistent estimation for a natural class of functionals. A canonical optimal construction is conjectured for arbitrary statistical functionals.