super_bench
Science Score: 31.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
✓CITATION.cff file
Found CITATION.cff file -
✓codemeta.json file
Found codemeta.json file -
○.zenodo.json file
-
○DOI references
-
○Academic publication links
-
○Academic email domains
-
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (6.1%) to scientific vocabulary
Repository
Basic Info
- Host: GitHub
- Owner: w11nd
- License: mit
- Language: Python
- Default Branch: main
- Size: 3.51 MB
Statistics
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
- Releases: 0
Metadata Files
README.md
SuperBench
| Azure Pipelines | Build Status |
|--------------------------|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| cpu-unit-test | |
| cuda-unit-test |
|
| ansible-integration-test |
|
SuperBench is a validation and profiling tool for AI infrastructure.
📢 v0.11.0 has been released!
Check aka.ms/superbench for more details.
Citations
To cite SuperBench in your publications:
bib
@inproceedings {superbench,
author = {Yifan Xiong and Yuting Jiang and Ziyue Yang and Lei Qu and Guoshuai Zhao and Shuguang Liu and Dong Zhong and Boris Pinzur and Jie Zhang and Yang Wang and Jithin Jose and Hossein Pourreza and Jeff Baxter and Kushal Datta and Prabhat Ram and Luke Melton and Joe Chau and Peng Cheng and Yongqiang Xiong and Lidong Zhou},
title = {{SuperBench}: Improving Cloud {AI} Infrastructure Reliability with Proactive Validation},
booktitle = {2024 USENIX Annual Technical Conference (USENIX ATC 24)},
year = {2024},
isbn = {978-1-939133-41-0},
address = {Santa Clara, CA},
pages = {835--850},
url = {https://www.usenix.org/conference/atc24/presentation/xiong},
publisher = {USENIX Association},
month = jul
}
Trademarks
This project may contain trademarks or logos for projects, products, or services. Authorized use of Microsoft trademarks or logos is subject to and must follow Microsoft's Trademark & Brand Guidelines. Use of Microsoft trademarks or logos in modified versions of this project must not cause confusion or imply Microsoft sponsorship. Any use of third-party trademarks or logos are subject to those third-party's policies.
Owner
- Login: w11nd
- Kind: user
- Repositories: 1
- Profile: https://github.com/w11nd
Citation (CITATION.bib)
@inproceedings {superbench,
author = {Yifan Xiong and Yuting Jiang and Ziyue Yang and Lei Qu and Guoshuai Zhao and Shuguang Liu and Dong Zhong and Boris Pinzur and Jie Zhang and Yang Wang and Jithin Jose and Hossein Pourreza and Jeff Baxter and Kushal Datta and Prabhat Ram and Luke Melton and Joe Chau and Peng Cheng and Yongqiang Xiong and Lidong Zhou},
title = {{SuperBench}: Improving Cloud {AI} Infrastructure Reliability with Proactive Validation},
booktitle = {2024 USENIX Annual Technical Conference (USENIX ATC 24)},
year = {2024},
isbn = {978-1-939133-41-0},
address = {Santa Clara, CA},
pages = {835--850},
url = {https://www.usenix.org/conference/atc24/presentation/xiong},
publisher = {USENIX Association},
month = jul
}
GitHub Events
Total
- Push event: 1
- Create event: 1
Last Year
- Push event: 1
- Create event: 1
Dependencies
- actions/checkout v2 composite
- docker/build-push-action v2 composite
- docker/login-action v1 composite
- docker/setup-buildx-action v1 composite
- docker/setup-qemu-action v1 composite
- actions/checkout v2 composite
- actions/checkout v3 composite
- github/codeql-action/analyze v2 composite
- github/codeql-action/autobuild v2 composite
- github/codeql-action/init v2 composite
- actions/checkout v2 composite
- actions/setup-node v2 composite
- webfactory/ssh-agent v0.5.0 composite
- actions/checkout v2 composite
- 1287 dependencies
- @docusaurus/core 2.0.0-beta.1
- @docusaurus/preset-classic 2.0.0-beta.1
- @docusaurus/theme-search-algolia ^2.0.0-beta.4
- @mdx-js/react ^1.6.21
- @svgr/webpack ^5.5.0
- clsx ^1.1.1
- file-loader ^6.2.0
- prism-react-renderer ^1.2.1
- react ^17.0.1
- react-dom ^17.0.1
- url-loader ^4.1.1
- Microsoft.AI.DirectML 1.11.0
- ansible_base >=2.10.9
- ansible_runner >=2.0.0rc1,
- colorlog >=6.7.0
- importlib_metadata *
- jinja2 >=2.10.1
- joblib >=1.0.1
- jsonlines >=2.0.0
- knack >=0.7.2
- markdown >=3.3.0
- matplotlib >=3.0.0
- natsort >=7.1.1
- networkx >=2.5
- numpy >=1.19.2
- omegaconf ==2.3.0
- openpyxl >=3.0.7
- packaging >=21.0
- pandas >=1.1.5
- protobuf <=3.20.3
- pssh *
- pyyaml >=5.3
- requests >=2.27.1
- seaborn >=0.11.2
- tcping >=0.1.1rc1
- types-requests *
- urllib3 >=1.26.9
- xlrd >=2.0.1
- xlsxwriter >=1.3.8
- xmltodict >=0.12.0
- apex *
- black ==21.4b0
- einops *
- isort >=5.5.4
- mpi4py *
- nltk *
- parameterized *
- pybind11 *
- regex *
- sentencepiece *
- six *
- tqdm *
- typing_extensions ==4.9.0
- wandb *