Single-Node Power Demand During AI Training: Measurements on an 8-GPU NVIDIA H100 System

Single-Node Power Demand During AI Training: Measurements on an 8-GPU NVIDIA H100 System

The expansion of artificial intelligence (AI) applications has driven substantial investment in computational infrastructure, especially by cloud computing providers. Quantifying the energy footprint of this infrastructure requires models parameterized by the power demand of AI hardware during train...

Full description

Saved in:
Bibliographic Details
Main Authors: Imran Latif, Alex C. Newkirk, Matthew R. Carbone, Arslan Munir, Yuewei Lin, Jonathan Koomey, Xi Yu, Zhihua Dong
Format: Article
Language:English
Published: IEEE 2025-01-01
Series:IEEE Access
Subjects:
AI training
sustainable computing
GPU power measurements
large language models
Online Access:https://ieeexplore.ieee.org/document/10938551/
Tags: Add Tag
No Tags, Be the first to tag this record!

Internet

https://ieeexplore.ieee.org/document/10938551/

Similar Items