Renewable-Aware Frequency Scaling Approach for Energy-Efficient Deep Learning Clusters

  • Hyuk Gyu Park
  • , Dong Ki Kang*
  • *Corresponding author for this work

    Research output: Contribution to journalJournal articlepeer-review

    Abstract

    Recently, renewable energy has emerged as an attractive means to reduce energy consumption costs for deep learning (DL) job processing in modern GPU-based clusters. In this paper, we propose a novel Renewable-Aware Frequency Scaling (RA-FS) approach for energy-efficient DL clusters. We have developed a real-time GPU core and memory frequency scaling method that finely tunes the training performance of DL jobs while maximizing renewable energy utilization. We introduce quantitative metrics: Deep Learning Job Requirement (DJR) and Deep Learning Job Completion per Slot (DJCS) to accurately evaluate the service quality of DL job processing. Additionally, we present a log-transformation technique to convert our non-convex optimization problem into a solvable one, ensuring the rigorous optimality of the derived solution. Through experiments involving deep neural network (DNN) model training jobs such as SqueezeNet, PreActResNet, and SEResNet on NVIDIA GPU devices like RTX3060, RTX3090, and RTX4090, we validate the superiority of our RA-FS approach. The experimental results show that our approach significantly improves performance requirement satisfaction by about 71% and renewable energy utilization by about 31% on average, compared to recent competitors.

    Original languageEnglish
    Article number776
    JournalApplied Sciences (Switzerland)
    Volume14
    Issue number2
    DOIs
    StatePublished - 2024.01

    UN SDGs

    This output contributes to the following UN Sustainable Development Goals (SDGs)

    1. SDG 7 - Affordable and Clean Energy
      SDG 7 Affordable and Clean Energy

    Keywords

    • deep learning
    • deep neural network
    • frequency scaling
    • graphic processing unit
    • renewable energy

    Quacquarelli Symonds(QS) Subject Topics

    • Materials Science
    • Computer Science & Information Systems
    • Engineering - Petroleum
    • Data Science
    • Engineering - Chemical
    • Physics & Astronomy

    Fingerprint

    Dive into the research topics of 'Renewable-Aware Frequency Scaling Approach for Energy-Efficient Deep Learning Clusters'. Together they form a unique fingerprint.

    Cite this