HPCTESTS 2023

First International Workshop on HPC Testing and Evaluation of Systems, Tools, and Software

https://olcf.github.io/hpc-system-test-wg/hpctests/hpctests2023

Details

Description

This workshop brings together HPC researchers, practitioners, and vendors from around the globe to present and discuss state-of-the-art HPC system testing methodologies, tools, benchmarks, tests, procedures, and best practices. The increasing complexity of HPC architectures requires a larger number of tests in order to thoroughly evaluate the status of the system after its installation or before a software upgrade is applied to production systems. Therefore, HPC centers and vendors use different methodologies to evaluate their systems during its lifetime, not only at the beginning during the installation and acceptance time, but also regularly during maintenance windows. This workshop will provide a venue to present and discuss the latest HPC system test technologies and methodologies including, but not limited to, tools used for testing, new test suites and benchmarks developed to assist testing efforts, lessons learned from acceptance and regression testing experiences, and evaluations of new hardware and software that showcase testing best practices.

The event will include a keynote focused on current HPC system testing topics, followed by a series of paper presentations from peer-reviewed accepted submissions, and will conclude with a panel discussion.

Call for Papers

Workshop scope

The First International Workshop on HPC Testing and Evaluation of Systems, Tools, and Software (HPCTESTS 2023), held in conjunction with SC23 (Denver, CO, USA), will bring together experts from high performance computing (HPC) centers around the globe to present and discuss state-of-the-art HPC system testing methodologies, tools, benchmarks, and best practices. The workshop will encourage submissions that highlight current benchmarks, tests, and procedures utilized to evaluate today’s HPC systems. This event will provide an avenue to showcase newly developed tools and methodologies, as well as those that are being actively designed to allow authors to gather feedback from the community that could help guide their project. As machine learning (ML) and deep learning (DL) become more prevalent workloads, HPC centers must provide a wider range of services and more robust and resilient resources in order to support both traditional HPC and ML/DL workloads. The workshop will also invite submissions that are looking ahead at the post-exascale future of HPC system testing to help the community develop alternate mechanisms that could be used to adapt to the evolving and emerging workloads. The event will invite and welcome international participation from HPC centers, academic institutions, as well as representatives from vendors in the supercomputing space.

In addition to discussing procedures and tools utilized, submissions can describe challenges, lessons learned, and best practices used for regression testing, acceptance testing, and hardware evaluations. Furthermore, the workshop aims to encourage submissions that explore testbed evaluations as a means to gather preliminary results on system readiness to assist system design and deployment efforts.

HPCTESTS 2023 will provide the first technical venue for HPC researchers and practitioners to submit their findings, early works, results, new tools, and more. The workshop encourages innovative works in HPC system testing to improve and rethink the mechanisms used for acceptance and regression testing of HPC systems, their software stack, and their user environment to help the community prepare for the post-exascale era.

Workshop topics

Topics of interest include, but are not limited to:

Paper Submissions

The workshop will publish its proceedings in the SC23 Workshops Proceedings following these guidelines:

Workshop Deadlines

Organizing Committees

HPCTESTS 2023 General Chairs

HPCTESTS 2023 Steering Committee

HPCTESTS 2023 Program Committee

Agenda