pipette
ESEspañol

Convergence of the critical probabilities for stopping near the top of a random walk

Jos\'e \'Angel Islas

Preprint

In the authors' words

Let \((S_n)_{n\ge0}\) be a Bernoulli random walk with \(P(X_i=1)=p\) and \(P(X_i=-1)=q=1-p\), and let \(M_n=\max\{S_0,\ldots,S_n\}\). We consider the semi-best selection problem of maximizing \(P(M_N-S_\tau\le1)\) over stopping times \(\tau\le N\). Allaart showed that the optimal decision in the critical state \((n,1)\) is determined by a sequence of critical probabilities \(\{p_n\}\), and conjectured that \(p_n\to1/2\). We prove this conjecture. For every fixed \(p<1/2\), the stopping value converges to \(\nu=1-(p/q)^2\), while the continuation value converges to \(2p\nu\). Since \(2p\nu<\nu\), stopping is optimal in state \((n,1)\) for all sufficiently large \(n\). Together with the known bound \(p_n<1/2\) for \(n\ge4\), this yields \(\lim_{n\to\infty}p_n=1/2\).

Main resultThe abstract does not state a limitation.

Appeared: Tuesday, October 20. arXiv. Preprint, not yet peer-reviewed.

Authors' comment: 5 pages. Resolves a conjecture of Allaart on the critical probabilities for the semi-best selection problem