Statistics

Optimality in Noisy Importance Sampling

Authors: F. Llorente, L. Martino, J. Read, D. Delgado
Comments: 14 Pages. Signal Processing, Volume 194, 2022, 108455 - doi:10.1016/j.sigpro.2022.108455

Many applications in signal processing and machine learning require the study of probability density functions (pdfs) that can only be accessed through noisy evaluations. In this work, we analyze the noisy importance sampling (IS), i.e., IS working with noisy evaluations of the target density. We present the general framework and derive optimal proposal densities for noisy IS estimators. The optimal proposals incorporate the information of the variance of the noisy realizations, proposing points in regions where the noise power is higher. We also compare the use of the optimal proposals with previous optimality approaches considered in a noisy IS framework.
Category: Statistics