Heavy tails in Gaussian-process surrogates: process-level profiling degeneracy versus observation-level identifiability
En palabras de los autores
In this article, we study heavy-tailed alternatives to Gaussian-process surrogates, namely Student- processes, -stable processes and Gaussian processes with heavy-tailed noise. These are Gaussian scale mixtures, and the position of the mixing variable decides whether the tails can be learned from a single realization. For process-level mixtures with a free amplitude, the profile likelihood of the mixing law is data-free and is maximized by the Gaussian law, the plug-in predictive is a data-free transformation of the Gaussian-process predictive, and no estimator can be consistent for the mixing law over the model along one path. For observation-level mixtures with symmetric -stable noise, the tail index is identifiable. Further, for one-dimensional inputs under fixed-domain asymptotics with and compact hyperparameter sets, a cross-fitted plug-in estimator and the Laplace marginal-likelihood estimate computed at the global posterior mode attain the efficiency bound of the model with a known regression function, also for Mat\'ern- sample paths. We also characterize small-sample failures of the Laplace approximation as folds of a posterior-mode branch and give a diagnostic. Finally, in a repeated Bayesian optimization study, observation-level tails reduced regret under gross outliers, as did Student- noise, and no degradation was detected under Gaussian noise.
Apareció: martes, 10 de noviembre. arXiv. Preprint, todavía sin revisión por pares.
Comentario de los autores: Extended 4 November 2026 version, with supplementary material included