pragmatic-benchmarking
A public version of our benchmarking suite.
Science Score: 75.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
✓CITATION.cff file
Found CITATION.cff file -
✓codemeta.json file
Found codemeta.json file -
✓.zenodo.json file
Found .zenodo.json file -
✓DOI references
Found 1 DOI reference(s) in README -
✓Academic publication links
Links to: ieee.org -
○Academic email domains
-
✓Institutional organization owner
Organization bu-rcs has institutional domain (www.bu.edu) -
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (3.7%) to scientific vocabulary
Repository
A public version of our benchmarking suite.
Basic Info
- Host: GitHub
- Owner: bu-rcs
- License: gpl-3.0
- Language: Shell
- Default Branch: main
- Size: 1.14 MB
Statistics
- Stars: 0
- Watchers: 10
- Forks: 1
- Open Issues: 0
- Releases: 0
Metadata Files
README.md
pragmatic-benchmarking
A public version of our benchmarking framework. The framework is described in the paper cited below.
Setup
This needs to be customized for your benchmarks. The model_bench benchmark demonstrates how to set up the directory structure. The STREAM benchmark is included as an example.
Paper
D. Milechin, A. Aly, J. Bevan, C. Jahnke, Y. Shen and B. Gregor, "Pragmatic Benchmarking for Research Computing," 2021 IEEE High Performance Extreme Computing Conference (HPEC), Waltham, MA, USA, 2021, pp. 1-6, doi: 10.1109/HPEC49654.2021.9622797. URL: https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=9622797&isnumber=9622741
Owner
- Name: Boston University Research Computing
- Login: bu-rcs
- Kind: organization
- Location: Boston
- Website: http://www.bu.edu/tech/support/research/
- Repositories: 3
- Profile: https://github.com/bu-rcs
Research Computing Projects
Citation (CITATION.cff)
cff-version: 1.2.0
title: pragmatic-benchmarking
message: >-
If you use this software, please cite it using the
metadata from this file.
type: software
authors:
- given-names: Dennis
family-names: Milechin
affiliation: Boston University
orcid: 0000-0001-9318-3907
- given-names: Ahmed
family-names: Aly
affiliation: Boston University
- given-names: Josh
family-names: Bevan
affiliation: Boston University
- given-names: Charlie
family-names: Jahnke
affiliation: Boston University
- given-names: Yun
family-names: Shen
affiliation: Boston University
- given-names: Brian
family-names: Gregor
affiliation: Boston University
orcid: 'https://orcid.org/0009-0004-9640-0574'
identifiers:
- type: doi
value: 10.1109/HPEC49654.2021.9622797
repository-code: 'https://github.com/bu-rcs/pragmatic-benchmarking'
abstract: >-
The Research Computing Services (RCS) group at Boston
University (BU), developed a benchmark suite to evaluate
the performance of newer hardware under consideration for
purchase for the BU Shared Computing Cluster (SCC). The
custom suite of benchmarks is used to generate performance
metrics that are representative of the highly diverse
types of jobs run on the cluster. The results of the
benchmarks are used to make informed decisions about
hardware upgrades in order to provide the best balance of
performance and value for cluster users. In this paper we
discuss the present reasons for creating a custom
benchmark suite, the general architecture of the suite,
and provide sample results from selected benchmarks that
we ran on our cluster.
license: GPL-3.0