ArXiv

Asymptotically Log-Optimal Bayes-Assisted Confidence Sequences for Bounded Means

Authors
Valentin Kilian, Stefano Cortinovis, François Caron
Categories
stat.ML, cs.LG
arXiv
https://arxiv.org/abs/2605.07964v1
PDF
https://arxiv.org/pdf/2605.07964v1

Brief

Asymptotically Log-Optimal Bayes-Assisted Confidence Sequences for Bounded Means introduces a Bayes-assisted method that uses a Bayesian working predictive model to choose one-step martingale updates maximizing predictive expected log-growth, yielding time-uniform confidence sequences for bounded IID means. The authors prove Wasserstein-consistency of the predictive implies asymptotic log-optimality (matching an oracle per-sample log-growth). They instantiate methods with Dirichlet-process mixtures and Bayesian exponentially tilted empirical likelihood and demonstrate reduced interval widths and sampling in synthetic and real tasks (LLM best-arm, prediction-powered inference).

Why it matters

Valentin Kilian, Stefano Cortinovis, and François Caron (ArXiv 2026-05-08) introduce a Bayes-assisted framework that adaptively constructs time-uniform confidence sequences for the mean of bounded IID observations by using a Bayesian working predictive to select one-step martingale factors that maximize predictive expected log-growth while preserving validity under misspecification.

Key details

  • They prove that if the predictive distribution is Wasserstein-consistent the procedure is asymptotically log-optimal, matching the per-sample log-growth rate of an oracle that knows the true data distribution.
  • The framework is instantiated with Dirichlet-process mixture predictives and Bayesian exponentially tilted empirical likelihood; experiments on synthetic data, sequential best-arm identification for LLM evaluation, and prediction-powered inference show informative priors can substantially reduce confidence-sequence width and sampling effort while retaining anytime-valid coverage.
Source evidence

Abstract

Confidence sequences based on test martingales provide time-uniform uncertainty quantification for the mean of bounded IID observations without parametric distributional assumptions. Their practical efficiency, however, depends strongly on the choice of martingale updates, and many existing constructions do not exploit prior information about plausible data-generating distributions or mean values. We propose a Bayes-assisted framework that uses a Bayesian working predictive model to adaptively construct confidence sequences.For each candidate mean and time point, the predictive distribution selects, among valid one-step martingale factors, the update maximising predictive expected log-growth; validity is therefore preserved even when the prior or working model is misspecified. We prove that if the predictive distribution is Wasserstein-consistent, the resulting procedure is asymptotically log-optimal, matching the per-sample log-growth of an oracle procedure with access to the true distribution. We instantiate the framework using robust predictives based on Dirichlet-process mixtures and Bayesian exponentially tilted empirical likelihood. Experiments on synthetic data, sequential best-arm identification for LLM evaluation, and prediction-powered inference show that informative priors can substantially reduce confidence-sequence width and sampling effort while retaining anytime-valid coverage.

Comment: Valentin and Stefano are equal first author