BenchmarkProfiles
Performance and data profiles
https://github.com/juliasmoothoptimizers/benchmarkprofiles.jl
Science Score: 77.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
✓CITATION.cff file
Found CITATION.cff file -
✓codemeta.json file
Found codemeta.json file -
✓.zenodo.json file
Found .zenodo.json file -
✓DOI references
Found 18 DOI reference(s) in README -
✓Academic publication links
Links to: acm.org, zenodo.org -
✓Committers with academic emails
2 of 17 committers (11.8%) from academic institutions -
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (13.8%) to scientific vocabulary
Keywords
Keywords from Contributors
Repository
Performance and data profiles
Basic Info
- Host: GitHub
- Owner: JuliaSmoothOptimizers
- License: other
- Language: Julia
- Default Branch: main
- Size: 1.28 MB
Statistics
- Stars: 30
- Watchers: 3
- Forks: 22
- Open Issues: 12
- Releases: 15
Topics
Metadata Files
README.md
BenchmarkProfiles
A simple Julia package to plot performance and data profiles.
| Citation | Documentation | Linux/macOS/Windows/FreeBSD | Coverage |
|:-----------------:|:-----------------:|:----------------------------------------------:|:------------:|
| 
| 
| 
|
This package contains Julia translations of original scripts by Elizabeth Dolan, Jorge Moré and Stefan Wild. See http://www.mcs.anl.gov/~wild/dfo/benchmarking.
The original code was not accompanied by an open-source license. Jorge Moré and Stefan Wild have kindly provided their consent in writing to allow distribution of this Julia translation.
See the consent folder for a full transcription.
It appears that performance profiles date back to at least 1996!
Watch out for the pitfalls of profiles!
How to Install
julia
julia> Pkg.add("BenchmarkProfiles")
No plotting backend is loaded by default so the user can choose among several available plotting backends. Currently, Plots.jl and UnicodePlots.jl are supported. Backends become available when the corresponding package is imported.
Example
julia
julia> using BenchmarkProfiles
julia> T = 10 * rand(25,3); # 25 problems, 3 solvers
julia> performance_profile(PlotsBackend(), T, ["Solver 1", "Solver 2", "Solver 3"], title="Celebrity Deathmatch")
ERROR: ArgumentError: The backend PlotsBackend() is not loaded. Please load the corresponding AD package.
julia> using Plots
julia> performance_profile(PlotsBackend(), T, ["Solver 1", "Solver 2", "Solver 3"], title="Celebrity Deathmatch") # Success!
References
- A. L. Tits and Y. Yang, Globally convergent algorithms for robust pole assignment by state feedback, IEEE Transactions on Automatic Control, 41(10), pages 1432–1452, 1996. DOI 10.1109/9.539425.
- E. Dolan and J. Moré, Benchmarking Optimization Software with Performance Profiles, Mathematical Programming 91, pages 201–213, 2002. DOI 10.1007/s101070100263.
- J. J. Moré and S. M. Wild, Benchmarking Derivative-Free Optimization Algorithms, SIAM Journal on Optimization, 20(1), pages 172–191, 2009. DOI 10.1137/080724083.
How to Cite
If you use BenchmarkProfiles.jl in your work, please cite using the format given in CITATION.bib.
Owner
- Name: JuliaSmoothOptimizers
- Login: JuliaSmoothOptimizers
- Kind: organization
- Location: DOI: 10.5281/zenodo.2655082
- Website: https://juliasmoothoptimizers.github.io
- Repositories: 63
- Profile: https://github.com/JuliaSmoothOptimizers
Infrastructure and Solvers for Continuous Optimization in Julia
Citation (CITATION.cff)
# This CITATION.cff file was generated with cffinit.
# Visit https://bit.ly/cffinit to generate yours today!
cff-version: 1.2.0
title: >-
BenchmarkProfiles.jl: A Simple Julia Package to Plot
Performance and Data Profiles
message: >-
If you use this software, please cite it using the
metadata from this file.
type: software
authors:
- given-names: Dominique
family-names: Orban
email: dominique.orban@gerad.ca
affiliation: >-
GERAD and Department of Mathematics and
Industrial Engineering, Polytechnique Montréal,
QC, Canada
orcid: 'https://orcid.org/0000-0002-8017-7687'
- given-names: contributors
identifiers:
- type: doi
value: 10.5281/zenodo.4630955
repository-code: >-
https://github.com/JuliaSmoothOptimizers/BenchmarkProfiles.jl
license: MPL-2.0
version: 0.4.4
date-released: '2023-10-19'
GitHub Events
Total
- Watch event: 1
- Delete event: 3
- Issue comment event: 4
- Push event: 11
- Pull request event: 6
- Create event: 3
Last Year
- Watch event: 1
- Delete event: 3
- Issue comment event: 4
- Push event: 11
- Pull request event: 6
- Create event: 3
Committers
Last synced: 8 months ago
Top Committers
| Name | Commits | |
|---|---|---|
| Dominique Orban | d****n@g****m | 50 |
| Abel Soares Siqueira | a****a@g****m | 31 |
| tmigot | t****t@g****m | 22 |
| github-actions[bot] | 4****] | 6 |
| Asbjørn Nilsen Riseth | a****h@g****m | 5 |
| d-monnet | 7****t | 4 |
| Goysa2 | s****e@u****a | 3 |
| Geoffroy Leconte | g****0@g****m | 2 |
| Luiz-Rafael Santos | l****1 | 2 |
| Monssaf Toukal | t****f@g****m | 2 |
| Lea Kapelevich | l****e@L****u | 2 |
| Alexis Montoison | a****n@p****a | 1 |
| Elliot Saba | s****t@g****m | 1 |
| JSOBot | 6****t | 1 |
| Julia TagBot | 5****t | 1 |
| Asbjørn Nilsen Riseth | r****h@m****k | 1 |
| Tony Kelman | t****y@k****t | 1 |
Committer Domains (Top 20 + Academic)
Issues and Pull Requests
Last synced: 4 months ago
All Time
- Total issues: 27
- Total pull requests: 93
- Average time to close issues: 3 months
- Average time to close pull requests: 17 days
- Total issue authors: 7
- Total pull request authors: 16
- Average comments per issue: 1.74
- Average comments per pull request: 2.42
- Merged pull requests: 86
- Bot issues: 0
- Bot pull requests: 12
Past Year
- Issues: 0
- Pull requests: 3
- Average time to close issues: N/A
- Average time to close pull requests: about 14 hours
- Issue authors: 0
- Pull request authors: 2
- Average comments per issue: 0
- Average comments per pull request: 1.33
- Merged pull requests: 3
- Bot issues: 0
- Bot pull requests: 1
Top Authors
Issue Authors
- dpo (11)
- abelsiqueira (5)
- tmigot (4)
- lrsantos11 (3)
- d-monnet (2)
- lkapelevich (1)
- JuliaTagBot (1)
Pull Request Authors
- dpo (26)
- tmigot (24)
- abelsiqueira (14)
- github-actions[bot] (13)
- d-monnet (5)
- Goysa2 (3)
- anriseth (3)
- lrsantos11 (3)
- JSOBot (2)
- tkelman (1)
- staticfloat (1)
- lkapelevich (1)
- geoffroyleconte (1)
- amontoison (1)
- Egmara (1)
Top Labels
Issue Labels
Pull Request Labels
Packages
- Total packages: 1
-
Total downloads:
- julia 9 total
- Total dependent packages: 1
- Total dependent repositories: 1
- Total versions: 13
juliahub.com: BenchmarkProfiles
Performance and data profiles
- Documentation: https://docs.juliahub.com/General/BenchmarkProfiles/stable/
- License: MPL-2.0
-
Latest release: 0.4.6
published over 1 year ago
Rankings
Dependencies
- actions/cache v1 composite
- actions/checkout v2 composite
- actions/download-artifact v2 composite
- actions/upload-artifact v2 composite
- julia-actions/julia-buildpkg v1 composite
- julia-actions/setup-julia v1 composite
- actions/github-script v3.1.0 composite
- actions/github-script v3 composite
- julia-actions/setup-julia latest composite
- actions/checkout v2 composite
- julia-actions/setup-julia latest composite
- JuliaRegistries/TagBot v1 composite
- actions/cache v1 composite
- actions/checkout v2 composite
- codecov/codecov-action v1 composite
- julia-actions/julia-buildpkg v1 composite
- julia-actions/julia-processcoverage v1 composite
- julia-actions/julia-runtest v1 composite
- julia-actions/setup-julia v1 composite
- actions/checkout v2 composite
- peter-evans/create-pull-request v3 composite