משה אליסוף

אקדמי בכיר

Estimating a Potential Without the Agony of the Partition Function

Eldad Haber, Moshe Eliasof, Luis Tenorio

Estimating a Gibbs density function given a sample is an important problem in computational statistics and statistical learning. Although the well established maximum likelihood method is commonly used, it requires the computation of the partition function (i.e., the normalization of the density). This function can be easily calculated for simple low-dimensional problems but its computation is difficult or even intractable for general densities and high-dimensional problems. In this paper we propose an alternative approach based on maximum a posteriori (MAP) estimators, which we name maximum recovery MAP, to derive estimators that do not require the computation of the partition function, and reformulate the problem as an optimization problem. We further propose a least-action type potential that allows us to quickly solve the optimization problem as a feed-forward hyperbolic neural network. We demonstrate the effectiveness of our methods on some standard data sets.

שפת פרסום אנגלית
דפים 1005-1027
כתב עת SIAM Journal on Mathematics of Data Science
כרך 5
נושא מספר 4
סטטוס פרסום פורסם - 01.01.2023

Keywords

Gibbs density
MAP estimate
hyperbolic neural network
partition function
potential

ASJC Scopus subject areas

Applied Mathematics
Computational Mathematics
Statistics and Probability
גישה למסמך
10.1137/22M1517135
קבצים וקישורים אחרים
Link to publication in Scopus