July 2nd, 2006, 9:38 am
Is KL minimisation = min(sum-of-sqr error between densities) ?Let's say I have a parametric way of descrbing a probability distribution, and I am trying to choose parameter values such that I want to minimize the Kullback-Leibler distance between the distribution implied by my parameter choice and some prior.If I am able to calc the density of the parametrically specified distribution at values of the random variable with some regular spacing (-3,-2.9,-2.8,...0,0.1,0.2,...,2.9,3.0), and just run some kind of nonlinear optimiser to minimise the sum-of-sqr error between a column vector of density values between the distribution implied by parameter choices and the known density values, could one say that is equivalent to KL minimisation ?Thanks