Synapse
⌘+K
Synapse
PulseExploreJournal ClubResearchersJournals
Instagram
HomeJournal ClubExplore
September 10, 2025ACM SIGEnergy Energy Informatics Review

A Thermal-Aware Workload Scheduler for High-Performance LLM Inference in Cooling-Regulated Datacenters

View Full Paper
Ask AI
Bookmark
Share

Authors

RLRui LuDWDan Wang

Discussion

Loading...

Member takes

Overview

Observational analysis shows a new scheduling method reduces thermal throttling risk in GPUs, suggesting enhanced performance.

Key Points

  • A thermal-aware workload scheduler increases the throughput of LLM inference by 40.94% at 41°C ambient temperature.
  • Existing schedulers can increase the probability of thermal throttling by 10 times and degrade performance by 34.2%.
  • Effective cooling regulation is crucial for high-performance computing, particularly for GPU workloads in AI datacenters.
  • The proposed solution accounts for GPU voltage and frequency to optimize job assignments in thermal-regulated environments.

Cite This Study

Lu et al. (2025) studied this question.

synapsesocial.com/papers/68c1b81f54b1d3bfb60ec799https://doi.org/10.1145/3757892.3757906
View Full Paper
Ask AI
Bookmark
Share