Least efficient open image generation model, Power Hungry Processing
- 11.49 Wh per image generated (published as: 11.49 kWh for 1,000 inferences; converted from kWh per 1,000 to Wh per one)
Power Hungry Processing: Watts Driving the Cost of AI Deployment?ACM FAccT '24 (arXiv 2311.16863), peer-reviewed paper, 2024-06
Details
whereas the least efficient image generation model uses as much energy as 522 smartphone charges (11.49 kWh), or around half a charge per image generation
- What one action is
- 1,000 image generations, run sequentially without batching, with the least efficient of the eight image generation models tested
- Scope
- servers
- Counts
- GPU, CPU and RAM energy measured with Code Carbon
- Model or version
- not stated (the sentence does not name the model)
- Place
- AWS us-west-2 (Oregon)
- Method
- Each model ran 1,000 inferences on each of three datasets, ten times, on a node of 8 NVIDIA A100-SXM4-80GB GPUs, with energy measured by the Code Carbon package.
- Claimed by
- Company: Alexandra Sasha Luccioni, Yacine Jernite (Hugging Face) and Emma Strubell (Carnegie Mellon University)
History
- Added.