pipette
ESEspañol

Neural Network Verification for Deep Joint Source-Channel Coding

Thanh Le, Hai Duong, Takeshi Matsumura, ThanhVu Nguyen

PreprintClaims a big stepReal-world use

In the authors' words

Deep joint source-channel coding (DeepJSCC) transmits data end-to-end over wireless channels using a neural encoder-decoder, but reconstruction quality can degrade sharply under adversarial perturbations and channel disturbances; no method formally bounds this degradation for DeepJSCC. We present the first bound-propagation framework for verifying DeepJSCC's decoder, bounding worst-case reconstruction error over a given wireless channel's noise region. Current deep neural network (DNN) verifiers do not support three DeepJSCC decoder components: parametric rectified linear activations (PReLU), transposed convolutions, and Rayleigh fading. We extend state-of-the-art techniques for optimization of linear relaxation in DNN verification for PReLU, replace the transposed convolution with its restricted upsample-then-convolution form, and formulate Rayleigh fading as a structural perturbation prepended directly into the decoder, thereby reducing the dimensionality of the verification problem. We also instantiate Lipschitz-regularized global robustness training, denoted GloRo, improving global robustness and enabling tight certification of DeepJSCC models for the first time. On DeepJSCC model for image transmission, this global robustness training procedure combined with structural encoding lowers the median certified bound by up to 41% and certifies about ten times more safe cases (192 against 19) than GloRo with interval encoding at a 10-degree error in channel estimation. Over-the-air validation with an orthogonal frequency-division multiplexing (OFDM) implementation on software-defined radio devices confirm the certificate holds on real hardware, with a worst observed error on radio link at 0.082 against a certified bound of 0.128.

Main resultThe abstract does not state a limitation.

In plain words AI summary

Deep joint source-channel coding uses neural networks to send data wirelessly, but reconstruction quality can drop sharply under attacks and channel noise. The authors created the first method to formally bound worst-case reconstruction error for this system. They adapted existing verification techniques to handle three challenging components: parametric rectified linear activations, transposed convolutions, and Rayleigh fading. They also used Lipschitz-regularized global robustness training, which improved robustness and enabled tight certification for the first time. On image transmission models, their approach lowered median certified bounds by up to 41% and certified about ten times more safe cases than prior methods. Real-world tests on radio hardware confirmed the certificates hold, with worst observed error at 0.082 against a certified bound of 0.128.

Written by Kimi K2.5 using only the abstract above. Jev checked that every sentence is supported by the abstract sentences it cites, and removed any that were not. Point at a sentence to highlight its source.

Appeared: Friday, October 9. arXiv. Preprint, not yet peer-reviewed.