Moshe Eliasof

Senior Academic

Estimating a Potential Without the Agony of the Partition Function

Eldad Haber, Moshe Eliasof, Luis Tenorio

Estimating a Gibbs density function given a sample is an important problem in computational statistics and statistical learning. Although the well established maximum likelihood method is commonly used, it requires the computation of the partition function (i.e., the normalization of the density). This function can be easily calculated for simple low-dimensional problems but its computation is difficult or even intractable for general densities and high-dimensional problems. In this paper we propose an alternative approach based on maximum a posteriori (MAP) estimators, which we name maximum recovery MAP, to derive estimators that do not require the computation of the partition function, and reformulate the problem as an optimization problem. We further propose a least-action type potential that allows us to quickly solve the optimization problem as a feed-forward hyperbolic neural network. We demonstrate the effectiveness of our methods on some standard data sets.

Publication language English
Pages 1005-1027
Journal SIAM Journal on Mathematics of Data Science
Volume 5
Issue number 4
Publication status Published - 01.01.2023

Keywords

Gibbs density
MAP estimate
hyperbolic neural network
partition function
potential

ASJC Scopus subject areas

Applied Mathematics
Computational Mathematics
Statistics and Probability
Access to Document
10.1137/22M1517135
Other files and links
Link to publication in Scopus