pipette
ENEnglish

Improved Lower Bounds on the Capacity of the Binary Deletion Channel via a Learning Approach to Run-Length Inputs

Hassan Khodaiemehr, Chen Feng, and Tolga M. Duman

Preprint

En palabras de los autores

The capacity of the i.i.d. binary deletion channel exists by Dobrushin's information-stability theorem, but no closed form is known. Classical constructive lower bounds from i.i.d. run-length coding have been evaluated only for one- or two-parameter families (geometric, Markov, or Morse-type). We show that the same infinite-blocklength functionals become strictly stronger when the run-length law is treated as a free distribution and optimized by learning. We reduce the Drinea--Mitzenmacher functional to a bilinear form in and prove that finite-support truncation is one-sided, so computed values remain valid lower bounds. We extend the Venkataramanan et al. reductions from geometric runs to arbitrary finite-support laws, including a residual-run HMM for output-bit entropy. Softmax gradient ascent searches ; every reported number is a fresh one-sided evaluation of the formula, with no Monte Carlo and no finite length-entropy penalty. The envelope of the two optimized bounds exceeds Gallager's (for ) and the tabulated bounds of Drinea--Mitzenmacher, Venkataramanan et al., and Rubinstein--Con at every tested . Representative values: , , , , , , , at , , , , , , , . The largest absolute gain over that record is bits (at ); the largest relative gain is (at ). For the envelope is the free- Venkataramanan functional; from it is the learned Drinea--Mitzenmacher law. At large the optimizer finds sparse run-length combs that parametric families cannot represent. A concurrent enclosure of Papailiopoulos is stronger on much of , but our envelope remains larger at high (e.g. vs at ; vs at ).

Resultado principalLimitación que admiten los autores

Apareció: martes, 22 de septiembre. arXiv. Preprint, todavía sin revisión por pares.

Comentario de los autores: 19 pages, 11 figures and a preliminary conference version of parts of this work was presented at CWIT 2024