pipette
ESEspañol

TokWatt: an open, boundary-annotated database of AI inference energy, from chat answers to agents

Abderaouf Bahi

PreprintReal-world useCode available

In the authors' words

Electricity supply is becoming a binding constraint on the deployment of artificial intelligence (AI), yet public evidence on the energy used by a single AI task is scattered and hard to compare. Published figures for one chatbot answer differ by two orders of magnitude, largely because studies count different parts of the system and measure different units of work. We present TokWatt, an open database of 134 published estimates of AI inference energy drawn from 13 sources (2023-2026) and covering 20 tasks, from classic machine-learning inferences to chat answers, reasoning answers, long-document queries, image and video generation, and coding agents. Each estimate records its functional unit, five measurement-boundary components, method, reported interval, and the location of the value in its source. A reproducible procedure scales estimates to a common server-plus-facility boundary and derives per-task reference values with ranges. The reference values span six orders of magnitude: 0.34 Wh for a short chat answer (range 0.16-0.99 Wh), 4.7 Wh for a reasoning answer, 124 Wh for a short video clip, and 150 Wh for one task delegated to a coding agent. Five independent estimates for default production chat systems agree within a factor of 1.8, and the reference values shift by at most 12% under alternative harmonization parameters. A simple identity links personal use to grid load: E watt-hours per person per day across one billion people corresponds to an average draw of E/24 gigawatts. Data and code are released at https://github.com/AraoufBh/tokwatt, and an online calculator at https://araoufbh.github.io/tokwatt/.

Main resultThe abstract does not state a limitation.

In plain words AI summary

Electricity limits AI growth, but public data on energy per AI task is scattered and hard to compare. The authors built TokWatt, an open database of 134 published estimates from 13 sources covering 20 AI tasks. Each estimate records its functional unit, five measurement boundaries, method, reported interval, and source location. Reference values span six orders of magnitude: 0.34 Wh for a short chat answer, 4.7 Wh for reasoning, 124 Wh for a short video, and 150 Wh for a coding agent task.

Written by Kimi K2.5 using only the abstract above. Jev checked that every sentence is supported by the abstract sentences it cites, and removed any that were not. Point at a sentence to highlight its source. 1 sentence was removed for not being supported by the abstract.

Appeared: Friday, October 30. arXiv. Preprint, not yet peer-reviewed.