pipette
ESEspañol

Consistency considerations for rare-event importance sampling

Jason Beh, Emilien Flayac, Jerome Morio, and Florian Simatos

Preprint

In the authors' words

We consider the problem of estimating a small probability by importance sampling with auxiliary density , where is drawn according to some density . We establish a simple necessary and sufficient condition for the consistency of the importance sampling estimator in triangular schemes where the dimension, the densities and and the set may evolve. It allows to refine the results of Chatterjee and Diaconis [Ann. Appl. Probab. 28 (2018), no. 2, 1099-1135] by establishing the exact minimal sample size required for consistency. Moreover, it allows to study the regime which, despite being the relevant mathematical regime for rare-event estimations, has received very little attention so far. We perform an in-depth study of the hyperplane case with Gaussian densities, showing that in this case, the optimal importance sampling density considerably improves consistency compared to the standard Monte Carlo estimator. However, we conclude the paper with moment considerations which suggest that, whenever the Monte Carlo and optimal importance sampling estimators both converge, convergence may occur faster for the Monte Carlo estimator.

Main resultLimitation the authors admit

Appeared: Tuesday, November 10. arXiv. Preprint, not yet peer-reviewed.