pipette
ENEnglish

Energy Consumption Analysis of Discrete Diffusion and Autoregressive Language Models

Boris Ruf, Marcin Detyniecki

Preprint con versión publicadaUso en el mundo real

En palabras de los autores

As Large Language Models (LLMs) continue to scale, their energy consumption during inference has become a critical concern. While Autoregressive (AR) models are the industry standard, Diffusion Language Models (DLLMs) have emerged as a promising alternative capable of parallel token generation. In this paper, we perform a comparative energy benchmark of diffusion models (LLaDA-8B, Dream-7B) against AR counterparts (Llama-3.1-8B, Qwen-2.5-7B). We analyze the trade-offs between model architecture, KV-cache optimization, and Joules-per-token efficiency. Our results show that at longer sequences (200--600 tokens), diffusion models achieve 2.5--2.7 J/token, approximately 2 more efficient than AR models with KV-cache (5.3--5.7 J/token). KV-cache provides substantial benefits for AR models at longer sequences (50--70% energy reduction).

Resultado principalEl resumen no menciona limitaciones.

Apareció: jueves, 15 de octubre. arXiv. Preprint con versión publicada.

DOI: 10.1145/3802973.3804458

Versión publicada: GreenSys '26: Proceedings of the 2nd International Workshop on Systems and Methods for Sustainable Large-Scale AI, 2026, pp. 7-12