EC-NAS: Energy Consumption Aware Tabular Benchmarks for Neural Architecture Search

Publikation: Bidrag til bog/antologi/rapportKonferencebidrag i proceedingsForskningfagfællebedømt

Dokumenter

  • Fulltext

    Accepteret manuskript, 6,51 MB, PDF-dokument

Energy consumption from the selection, training, and deployment of deep learning models has seen a significant uptick recently. This work aims to facilitate the design of energy-efficient deep learning models that require less computational resources and prioritize environmental sustainability by focusing on the energy consumption. Neural architecture search (NAS) benefits from tabular benchmarks, which evaluate NAS strategies cost-effectively through pre-computed performance statistics. We advocate for including energy efficiency as an additional performance criterion in NAS. To this end, we introduce an enhanced tabular benchmark encompassing data on energy consumption for varied architectures. The benchmark, designated as EC-NAS1, has been made available in an open-source format to advance research in energy-conscious NAS. EC-NAS incorporates a surrogate model to predict energy consumption, aiding in diminishing the energy expenditure of the dataset creation. Our findings emphasize the potential of EC-NAS by leveraging multi-objective optimization algorithms, revealing a balance between energy usage and accuracy. This suggests the feasibility of identifying energy-lean architectures with little or no compromise in performance.

OriginalsprogEngelsk
Titel2024 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2024 - Proceedings
Antal sider5
ForlagIEEE
Publikationsdato2024
Sider5660-5664
ISBN (Elektronisk)9798350344851
DOI
StatusUdgivet - 2024
Begivenhed49th IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2024 - Seoul, Sydkorea
Varighed: 14 apr. 202419 apr. 2024

Konference

Konference49th IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2024
LandSydkorea
BySeoul
Periode14/04/202419/04/2024
SponsorThe Institute of Electrical and Electronics Engineers Signal Processing Society

Bibliografisk note

Funding Information:
The authors acknowledge funding received under European Union's Horizon Europe Research and Innovation programme under grant agreements No. 101070284 and No. 101070408.

Publisher Copyright:
© 2024 IEEE.

ID: 395155031