Share
FollowNERSC-10 Benchmark Suite
Benchmarks will play a critical role in evaluation of the system. The NERSC-10 Benchmark Suite comprises tests for varying levels of the system architecture that range from microbenchmarks to workflow component benchmarks.
The NERSC-10 benchmark run rules should be reviewed before running benchmarks to understand allowed modifications to the benchmarks and result submission.
All benchmark results must be reported in the accompanying “NERSC-10 Benchmark Results” worksheet.
The Workflow-SSI metric will be used to evaluate system performance.
The metric is described by the Workflow_SSI.pdf document and can be computed using the "NERSC-10 Benchmark Results" worksheet.
This site will be maintained with updated information throughout the proposal response period, including updates to instructions for build and execution. Updates will be recorded in the CHANGELOG.
Questions related to the benchmarks should be sent to N10benchmarks@lbl.gov.
Workflow Component Benchmarks
The workflow component benchmarks have been carefully chosen to represent performance-critical components of the expected NERSC-10 scientific workflows, which include simulation of complex scientific problems using diverse computational techniques at high degrees of parallelism, large-scale analysis of experimental or observational data, machine learning, and the data-flow and control-flow needed to couple these activities in productive and efficient workflows.
Each benchmark distribution contains a README file that provides links to the benchmark source code distribution, instructions for compiling, executing, verifying numerical correctness and reporting results for each benchmark. Multiple input problems and sample output from existing NERSC systems (i.e. Perlmutter) are included to facilitate profiling at reduced scale. The README files specify a target problem size which must be used to report benchmark performance.
- Optical Properties of Materials Workflow
- Materials by Design Workflow
- Metagenome Annotation Workflow
- Lattice QCD Workflow
- DeepCAM AI Workflow
- TOAST3 Cosmic Microwave Background Workflow
Micro-benchmarks
The microbenchmarks are simple, focused tests that are easily compiled and executed. The results allow a uniform comparison of features and provide an estimation of system balance. Descriptions and requirements for each test are included in the source distribution for each microbenchmark.
