Comparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (2024)

Comparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (2)

Advanced Search

e-energy

research-article

Open Access

  • Authors:
  • Tom Hilgers IT Center, RWTH Aachen University, Germany

    IT Center, RWTH Aachen University, Germany

    Comparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (3)0000-0002-7501-3936

    Search about this author

    ,
  • Radita Liem IT Center, RWTH Aachen University, Germany

    IT Center, RWTH Aachen University, Germany

    Comparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (4)0000-0002-2506-1841

    Search about this author

e-Energy '24: Proceedings of the 15th ACM International Conference on Future and Sustainable Energy SystemsJune 2024Pages 560–568https://doi.org/10.1145/3632775.3662162

Published:31 May 2024Publication HistoryComparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (5)

  • 0citation
  • 0
  • Downloads

Metrics

Total Citations0Total Downloads0

Last 12 Months0

Last 6 weeks0

  • PDF

e-Energy '24: Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems

Comparability and Reproducibility in HPC Applications' Energy Consumption Characterization

Pages 560–568

PreviousChapterNextChapter

Comparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (6)

ABSTRACT

The computational power of HPC systems continues to grow, and improving their energy efficiency is a critical issue for the field in the face of climate change and energy crises. One major aspect of energy optimization lies in the applications run on the systems themselves. In this work, we are looking into comparing energy consumption between different systems using a characterization process based on the recent energy characterization paper as a reference and starting point for other data centers to assess their application’s energy patterns. We demonstrated that we could use the methods from the starting paper, replicate the findings, and extend the work to more applications and more systems. Our work acts as a proof of concept for a repository of HPC applications’ energy patterns in our future work.

References

  1. MarkJames Abraham, Teemu Murtola, Roland Schulz, Szilárd Páll, JeremyC. Smith, Berk Hess, and Erik Lindahl. 2015. GROMACS: High performance molecular simulations through multi-level parallelism from laptops to supercomputers. SoftwareX 1-2 (2015), 19–25. https://doi.org/10.1016/j.softx.2015.06.001Google ScholarComparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (7)Cross Ref
  2. Advanced Micro Devices Inc.2018. ROCm System Management Interface (ROCm SMI) Library. https://github.com/ROCm/rocm_smi_libGoogle ScholarComparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (9)
  3. Advanced Micro Devices Inc.2021. ROC profiler library. https://github.com/ROCm/rocprofilerGoogle ScholarComparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (10)
  4. Ghazanfar Ali, Mert Side, Sridutt Bhalachandra, NicholasJ. Wright, and Yong Chen. 2023. Performance-Aware Energy-Efficient GPU Frequency Selection Using DNN-Based Models. In Proceedings of the 52nd International Conference on Parallel Processing(ICPP ’23). Association for Computing Machinery, New York, NY, USA, 433–442. https://doi.org/10.1145/3605573.3605600Google ScholarComparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (11)Digital Library
  5. Lukas Alt. 2023. Performance metrics for access pattern-aware analysis of heterogeneous memory power consumption in HPC. Masterarbeit. RWTH Aachen University, Aachen. https://doi.org/10.18154/RWTH-2023-10152 Veröffentlicht auf dem Publikationsserver der RWTH Aachen University; Masterarbeit, RWTH Aachen University, 2023.Google ScholarComparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (13)Cross Ref
  6. Shajulin Benedict. 2012. Energy-aware performance analysis methodologies for HPC architectures—An exploratory study. Journal of Network and Computer Applications 35, 6 (2012), 1709–1719. https://doi.org/10.1016/j.jnca.2012.08.003Google ScholarComparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (15)Digital Library
  7. Enrico Calore, Alessandro Gabbana, SebastianoFabio Schifano, and Raffaele Tripiccione. 2020. ThunderX2 Performance and Energy-Efficiency for HPC Workloads. Computation 8, 1 (2020). https://doi.org/10.3390/computation8010020Google ScholarComparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (17)Cross Ref
  8. Stefano Corda, Bram Veenboer, and Emma Tolley. 2022. PMT: Power Measurement Toolkit. In 2022 IEEE/ACM International Workshop on HPC User Support Tools (HUST). 44–47. https://doi.org/10.1109/HUST56722.2022.00011Google ScholarComparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (19)Cross Ref
  9. Robert Curtis, Chris Peterson, David Moss, David Hardy, Rick Eiland, Tim Shedd, Eric Tunks, Hasnain Shabbir, and Todd Mottershead. 2023. The Future of Server Cooling - Part 2: New IT hardware Features and Power Trends. Retrieved March 22, 2024 from https://infohub.delltechnologies.com/p/the-future-of-server-cooling-part-2-new-it-hardware-features-and-power-trends-1/Google ScholarComparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (21)
  10. Olivier Desjardins, Guillaume Blanquart, Guillaume Balarac, and Heinz Pitsch. 2008. High order conservative finite difference scheme for variable density low Mach number turbulent flows. Journal of Computational Physics 227, 15 (2008), 7125–7159. https://doi.org/10.1016/j.jcp.2008.03.027Google ScholarComparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (22)Digital Library
  11. BlakeW. Ford and Ziliang Zong. 2021. PortAuthority: Integrating energy efficiency analysis into cross-platform development cycles via dynamic program analysis. Sustainable Computing: Informatics and Systems 30 (2021), 100530. https://doi.org/10.1016/j.suscom.2021.100530Google ScholarComparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (24)Cross Ref
  12. Daniel Hackenberg, Robert Schöne, Daniel Molka, MatthiasS Müller, and Andreas Knüpfer. 2010. Quantifying power consumption variations of HPC systems using SPEC MPI benchmarks. Computer Science-Research and Development 25 (2010), 155–163. https://doi.org/10.1007/s00450-010-0118-0Google ScholarComparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (26)Cross Ref
  13. Thomas Ilsche. 2020. Energy Measurements of High Performance Computing Systems: From Instrumentation to Analysis. Ph.D. Dissertation. Technische Universität Dresden. https://nbn-resolving.org/urn:nbn:de:bsz:14-qucosa2-716000Google ScholarComparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (28)
  14. Intel Corporation. 2013. Intel Xeon Processor E5-2697 v2. Retrieved December 05, 2023 from https://ark.intel.com/content/www/us/en/ark/products/75283/intel-xeon-processor-e5-2697-v2-30m-cache-2-70-ghz.htmlGoogle ScholarComparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (29)
  15. Intel Corporation. 2023. Intel Xeon CPU Platinum 8468 Processor. Retrieved February 07, 2024 from https://www.intel.com/content/www/us/en/products/sku/231735/intel-xeon-platinum-8468-processor-105m-cache-2-10-ghz/specifications.htmlGoogle ScholarComparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (30)
  16. Y. Jiao, H. Lin, P. Balaji, and W. Feng. 2010. Power and Performance Characterization of Computational Kernels on the GPU. In 2010 IEEE/ACM Int’l Conference on Green Computing and Communications & Int’l Conference on Cyber, Physical and Social Computing. 221–228. https://doi.org/10.1109/GreenCom-CPSCom.2010.143Google ScholarComparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (31)Digital Library
  17. Hamidreza Khaleghzadeh. 2019. Novel Data-Partitioning Algorithms for Performance and Energy Optimization of Data-Parallel Applications on Modern Heterogeneous HPC Platforms. Ph.D. Dissertation. University College Dublin. https://hcl.ucd.ie/system/files/thesis-hamid.pdfGoogle ScholarComparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (33)
  18. Karlo Kraljic, Daniel Kerger, and Martin Schulz. 2022. Energy Efficient Frequency Scaling on GPUs in Heterogeneous HPC Systems. In Architecture of Computing Systems (ARCS 2022). Springer International Publishing, Cham, 3–16. https://doi.org/10.1007/978-3-031-21867-5_1Google ScholarComparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (34)Digital Library
  19. A. Kreuzer, E. Suarez, N. Eicker, and Th. Lippert (Eds.). 2021. Porting applications to a Modular Supercomputer-Experiences from the DEEP-EST project. Schriften des Forschungszentrums Jülich IAS Series, Vol.48. Forschungszentrum Jülich, Jülich. https://juser.fz-juelich.de/record/905738Google ScholarComparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (36)
  20. Carsten Kutzner. [n. d.]. A free GROMACS benchmark set. Dept. of Theoretical and Computational Biophysics, Max Planck Institute for Multidisciplinary Sciences. Retrieved March 23, 2024 from https://www.mpinat.mpg.de/grubmueller/benchGoogle ScholarComparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (37)
  21. Radita Liem, Sebastian Oeste, Jay Lofstead, and Julian Kunkel. 2023. Mango-IO: I/O Metrics Consistency Analysis. In 2023 IEEE International Conference on Cluster Computing Workshops (CLUSTER Workshops). 18–24. https://doi.org/10.1109/CLUSTERWorkshops61457.2023.00013Google ScholarComparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (38)Cross Ref
  22. Matthias Maiterth, Gregory Koenig, Kevin Pedretti, Siddhartha Jana, Natalie Bates, Andrea Borghesi, Dave Montoya, Andrea Bartolini, and Milos Puzovic. 2018. Energy and Power Aware Job Scheduling and Resource Management: Global Survey — Initial Analysis. In 2018 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW). 685–693. https://doi.org/10.1109/IPDPSW.2018.00111Google ScholarComparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (40)Cross Ref
  23. JohnD McCalpin. 1995. Memorybandwidthandmachinebalanceincurrenthighperformancecomputers. IEEE computer society technical committee on computer architecture (TCCA) newsletter 2, 19-25 (1995).Google ScholarComparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (42)
  24. Nafiseh Moti, André Brinkmann, Marc-André Vef, Philippe Deniel, Jesus Carretero, Philip Carns, Jean-Thomas Acquaviva, and Reza Salkhordeh. 2023. The I/O Trace Initiative: Building a Collaborative I/O Archive to Advance HPC. In Proceedings of the SC’23 Workshops of The International Conference on High Performance Computing, Network, Storage, and Analysis. 1216–1222. https://doi.org/10.1145/3624062.3624192Google ScholarComparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (43)Digital Library
  25. Ludovico Nista, Christoph Schumann, Temistocle Grenga, Antonio Attili, and Heinz Pitsch. 2023. Investigation of the generalization capability of a generative adversarial network for large eddy simulation of turbulent premixed reacting flows. Proceedings of the Combustion Institute 39, 4 (2023), 5279–5288. https://doi.org/10.1016/j.proci.2022.07.244Google ScholarComparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (45)Cross Ref
  26. NVIDIA Corporation. 2016. nvidia-smi documentation. Retrieved December 07, 2023 from https://developer.download.nvidia.com/compute/DCGM/docs/nvidia-smi-367.38.pdfGoogle ScholarComparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (47)
  27. NVIDIA Corporation. 2024. NVML API Reference Guide: GPU Deployment and Management Documentation. Retrieved May 2, 2024 from https://docs.nvidia.com/deploy/nvml-api/index.htmlGoogle ScholarComparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (48)
  28. Armen Poghosyan, Hrachya Astsatryan, Wahi Narsisian, and Yevgeni Mamasakhlisov. 2017. On the Performance and Energy Consumption of Molecular Dynamics Applications for Heterogeneous CPU-GPU Platforms Based on Gromacs. Cybernetics and Information Technologies 17, 5 (2017), 68–80. https://doi.org/10.1515/cait-2017-0056Google ScholarComparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (49)Digital Library
  29. Thomas Röhl, Jan Treibig, Georg Hager, and Gerhard Wellein. 2014. Overhead Analysis of Performance Counter Measurements. In 2014 43rd International Conference on Parallel Processing Workshops. 176–185. https://doi.org/10.1109/ICPPW.2014.34Google ScholarComparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (51)Digital Library
  30. Shuaiwen Song, Rong Ge, Xizhou Feng, and KirkW. Cameron. 2009. Energy Profiling and Analysis of the HPC Challenge Benchmarks. The International Journal of High Performance Computing Applications 23, 3 (2009), 265–276. https://doi.org/10.1177/1094342009106193Google ScholarComparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (53)Digital Library
  31. top500.org. [n. d.]. Performance Development. Retrieved March 22, 2024 from https://www.top500.org/statistics/perfdevel/Google ScholarComparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (55)
  32. Wendy Torell. 2019. It’s not just about chip density: Considering liquid cooling for your data center. Retrieved March 22, 2024 from https://www.datacenterdynamics.com/en/opinions/its-not-just-about-chip-density-considering-liquid-cooling-for-your-data-center/Google ScholarComparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (56)
  33. Wallace Witkowski. 2022. ‘Moore’s Law’s dead,’ Nvidia CEO Jensen Huang says in justifying gaming-card price hike. Retrieved December 05, 2023 from https://www.marketwatch.com/story/moores-laws-dead-nvidia-ceo-jensen-says-in-justifying-gaming-card-price-hike-11663798618Google ScholarComparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (57)
  34. AndrewJ. Younge, RyanE. Grant, JamesH. Laros, Michael Levenhagen, StephenL. Olivier, Kevin Pedretti, and Lee Ward. 2019. Small scale to extreme: Methods for characterizing energy efficiency in supercomputing applications. Sustainable Computing: Informatics and Systems 21 (2019), 90–102. https://doi.org/10.1016/j.suscom.2018.11.005Google ScholarComparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (58)Cross Ref

Cited By

View all

Comparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (60)

    Index Terms

    1. Comparability and Reproducibility in HPC Applications' Energy Consumption Characterization

      1. General and reference

        1. Cross-computing tools and techniques

          1. Measurement

        2. Hardware

          1. Power and energy

            1. Energy distribution

              1. Energy metering

        Recommendations

        • Predicting the Energy and Power Consumption of Strong and Weak Scaling HPC Applications

          Keeping energy costs in budget and operating within available capacities of power distribution and cooling systems is becoming an important requirement for High Performance Computing HPC data centers. It is even more important when considering the ...

          Read More

        • Towards Energy Budget Control in HPC

          CCGrid '17: Proceedings of the 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing

          Energy consumption has become one of the most critical issues in the evolution of High Performance Computing systems (HPC). Controlling the energy consumption of HPC platforms is not only a way to control the cost but also a step forward on the road ...

          Read More

        • Modeling CPU Energy Consumption of HPC Applications on the IBM POWER7

          PDP '14: Proceedings of the 2014 22nd Euromicro International Conference on Parallel, Distributed, and Network-Based Processing

          Energy consumption optimization of HPC applications inherently requires measurements for reference and comparison. However, most of today's systems lack the necessary hardware support for power or energy measurements. Furthermore, in-band data ...

          Read More

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        Get this Publication

        • Information
        • Contributors
        • Published in

          Comparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (61)

          e-Energy '24: Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems

          June 2024

          704 pages

          ISBN:9798400704802

          DOI:10.1145/3632775

          Copyright © 2024 Owner/Author

          This work is licensed under a Creative Commons Attribution International 4.0 License.

          Sponsors

            In-Cooperation

              Publisher

              Association for Computing Machinery

              New York, NY, United States

              Publication History

              • Published: 31 May 2024

              Check for updates

              Comparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (62)

              Author Tags

              • Energy Analysis
              • Energy Consumption Characterization
              • HPC

              Qualifiers

              • research-article
              • Research
              • Refereed limited

              Conference

              Acceptance Rates

              Overall Acceptance Rate160of446submissions,36%

              Funding Sources

              • Comparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (63)

                Other Metrics

                View Article Metrics

              • Bibliometrics
              • Citations0
              • Article Metrics

                • Total Citations

                  View Citations
                • Total Downloads

                • Downloads (Last 12 months)0
                • Downloads (Last 6 weeks)0

                Other Metrics

                View Author Metrics

              • Cited By

                This publication has not been cited yet

              PDF Format

              View or Download as a PDF file.

              PDF

              eReader

              View online with eReader.

              eReader

              Digital Edition

              View this article in digital edition.

              View Digital Edition

              HTML Format

              View this article in HTML Format .

              View HTML Format

              • Figures
              • Other

                Close Figure Viewer

                Browse AllReturn

                Caption

                View Table of Contents

                Export Citations

                  Your Search Results Download Request

                  We are preparing your search results for download ...

                  We will inform you here when the file is ready.

                  Download now!

                  Your Search Results Download Request

                  Your file of search results citations is now ready.

                  Download now!

                  Your Search Results Download Request

                  Your search export query has expired. Please try again.

                  Comparability and Reproducibility in HPC Applications' Energy Consumption Characterization | Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems (2024)
                  Top Articles
                  Latest Posts
                  Article information

                  Author: Nicola Considine CPA

                  Last Updated:

                  Views: 5577

                  Rating: 4.9 / 5 (49 voted)

                  Reviews: 80% of readers found this page helpful

                  Author information

                  Name: Nicola Considine CPA

                  Birthday: 1993-02-26

                  Address: 3809 Clinton Inlet, East Aleisha, UT 46318-2392

                  Phone: +2681424145499

                  Job: Government Technician

                  Hobby: Calligraphy, Lego building, Worldbuilding, Shooting, Bird watching, Shopping, Cooking

                  Introduction: My name is Nicola Considine CPA, I am a determined, witty, powerful, brainy, open, smiling, proud person who loves writing and wants to share my knowledge and understanding with you.