iohanalyzer

Performance analyzer for Iterative Optimization Heuristics.

https://github.com/iohprofiler/iohanalyzer

Science Score: 20.0%

This score indicates how likely this project is to be science-related based on various indicators:

○
CITATION.cff file
○
codemeta.json file
○
.zenodo.json file
○
DOI references
✓
Academic publication links
Links to: arxiv.org
✓
Committers with academic emails
1 of 10 committers (10.0%) from academic institutions
○
Institutional organization owner
○
JOSS paper metadata
○
Scientific vocabulary similarity
Low similarity (12.5%) to scientific vocabulary

Last synced: 11 months ago · JSON representation

Repository

Performance analyzer for Iterative Optimization Heuristics.

Basic Info

Host: GitHub
Owner: IOHprofiler
License: other
Language: R
Default Branch: master
Homepage:
Size: 43.7 MB

Statistics

Stars: 15
Watchers: 8
Forks: 7
Open Issues: 3
Releases: 2

Created almost 8 years ago · Last pushed over 2 years ago

Metadata Files

Readme License

IOHanalyzer

The performance analyzer for Iterative Optimization Heuristics (IOHs).

Documentation: https://arxiv.org/abs/2007.03953
Wiki page: https://iohprofiler.github.io/IOHanalyzer/
Bug reports: https://github.com/IOHprofiler/IOHAnalyzer/issues
Online service: https://iohanalyzer.liacs.nl
General Contact: mailto:iohprofiler@liacs.leidenuniv.nl

It provides:

a web-based graphical user interface (GUI) to analyze and visualize the empirical performance of IOHs,
interactive plotting,
statistical evaluation,
report generation, and
a command-line interface (CLI) for the R console allowing for fine-grained controls.

It is built mainly on:

R packages Shiny, Plotly and Rcpp.

It is available through:

a free online service that you can use right away, or
the local installation of the package.

Online Service

A free server https://iohanalyzer.liacs.nl running the stable version of IOHanalyzer is hosted in Leiden Institute of Advanced Computer Science. You're welcome to check it out!

Installation

Software dependency

[mandatory] R As IOHanalyzer is written as a R package, the R environment has to be installed first. The binary file and installation manual for R can be found here https://cran.r-project.org/.
[optional] either kaleido (recommended) or orca (will be depricated) is required to download plotly figures. Please see Kaleido or Orca for their respective installation instructions.

Stable version

Please start up an R console and install the stable version as:

r R> install.packages('IOHanalyzer')

which is maintained on CRAN (Comprehensive R Archive Network).

Lastest version

The lastest development is always hosted on Github. In case you'd like to try out this version, the R package devtool is needed:

r R> install.packages('devtools') R> devtools::install_github('IOHprofiler/IOHanalyzer')

Development version

If you want to run the version on which you develop:

r R> devtools::install_git("/path/to/your/IOHanalyzer/git/repo")

Runinng the Web Interface locally

The IOHanalyzer package can be loaded using the following commands:

r R> library('IOHanalyzer') R> runServer()

It should open a browser on the localhost server, using a random port number. Of course, you could also specify the port number directly:

r R> runServer(port = 1234)

Have fun! For the complete reference on usage, please check out our Wiki page.

Host it online

We provide a docker file for deploying IOHanalyzer on the server. Please see https://github.com/IOHprofiler/IOHanalyzer-docker for details.

Supported Data Format

Specific formats are required to load your benchmark data to IOHanalyzer. If your data sets are generated in the format of

COCO/BBOB data format as regulated in https://inria.hal.science/inria-00362649,
Nevergrad data format (explained in https://github.com/facebookresearch/nevergrad), or
IOHprofiler data format, which is motivated and modified from COCO data format,

then you just need to compress the data folder obtained from the experiment into a zip file and uploaded it. However, you are encouraged to convert your own benchmark data to the format regulated here!. The supported data format is specified in this page. Please follow the instruction there to convert your data sets.

Our Team

Hao Wang, Sorbonne Université, LIP6, France.
Diederick Vermetten, Leiden Institute of Advanced Computer Science, The Netherlands.
Furong Ye, Leiden Institute of Advanced Computer Science, The Netherlands.
Ofer M. Shir, Tel-Hai College, Israel.
Carola Doerr, Sorbonne Université, CNRS, LIP6, France.
Thomas Bäck, Leiden Institute of Advanced Computer Science, The Netherlands.

When using IOHprofiler and parts thereof, please kindly cite this work as

Hao Wang, Diederick Vermettern, Furong Ye, Carola Doerr and Thomas Bäck: IOHanalyzer: Performance Analysis for Iterative Optimization Heuristic, arXiv e-prints:2007.03953, 2020.

bibtex @ARTICLE{IOHprofiler, author = {Hao Wang and Diederick Vermettern and Furong Ye and Carola Doerr and Thomas B{\"a}ck}, title = {{IOHanalyzer: Performance Analysis for Iterative Optimization Heuristic}}, journal = {arXiv e-prints:2007.03953}, archivePrefix = "arXiv", eprint = {2007.03953}, year = 2020, month = July, keywords = {Computer Science - Neural and Evolutionary Computing}, url = {https://arxiv.org/abs/2007.03953} }

License

This application is governed by the BSD 3-Clause license.

BSD 3-Clause License

Redistribution and use in source and binary forms, with or without modification, are permitted provided that the following conditions are met:

Redistributions of source code must retain the above copyright notice, this list of conditions and the following disclaimer.
Redistributions in binary form must reproduce the above copyright notice, this list of conditions and the following disclaimer in the documentation and/or other materials provided with the distribution.
Neither the name of the copyright holder nor the names of its contributors may be used to endorse or promote products derived from this software without specific prior written permission.

THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.

Owner

Name: IOHprofiler
Login: IOHprofiler
Kind: organization
Email: IOHprofiler@liacs.leidenuniv.nl

Repositories: 6
Profile: https://github.com/IOHprofiler

Iterative Optimization Heuristics Profiler

GitHub Events

Total

Issues event: 1
Watch event: 6

Last Year

Issues event: 1
Watch event: 6

Committers

Last synced: almost 3 years ago

All Time

Total Commits: 830
Total Committers: 10
Avg Commits per committer: 83.0
Development Distribution Score (DDS): 0.455

Past Year

Commits: 44
Committers: 2
Avg Commits per committer: 22.0
Development Distribution Score (DDS): 0.023

Top Committers

Name	Email	Commits
Diederick Vermetten	d**n@g**m	452
Hao Wang	w**n@g**m	237
diederick vermetten	d**n@h**m	107
EtorArza	e**a@g**m	11
Ivan	p**r@m**u	6
Etor Arza	e**a@f**m	6
Thomas Weise	t**e@h**n	5
CarolaDoerr	4****r	4
nojhan	n**n@n**t	1
root	r**t@p**l	1

Committer Domains (Top 20 + Academic)

postprocessing.liacs.nl: 1 nojhan.net: 1 hfuu.edu.cn: 1 fmail.com: 1 mail.ru: 1

Issues and Pull Requests

Last synced: almost 2 years ago

All Time

Total issues: 11
Total pull requests: 98
Average time to close issues: 3 months
Average time to close pull requests: 24 days
Total issue authors: 7
Total pull request authors: 9
Average comments per issue: 1.82
Average comments per pull request: 0.27
Merged pull requests: 86
Bot issues: 0
Bot pull requests: 0

Past Year

Issues: 0
Pull requests: 4
Average time to close issues: N/A
Average time to close pull requests: 13 days
Issue authors: 0
Pull request authors: 1
Average comments per issue: 0
Average comments per pull request: 0.0
Merged pull requests: 4
Bot issues: 0
Bot pull requests: 0

View more stats

Top Authors

Issue Authors

nojhan (5)
mbuzdalov (1)
AntKirill (1)
natasa409 (1)
borisalmonacid (1)
mariohevia (1)
MLopez-Ibanez (1)
thomasWeise (1)

Pull Request Authors

Dvermetten (81)
nojhan (4)
wangronin (4)
Pohvalister (2)
thomasWeise (2)
teftimov (1)
mbuzdalov (1)
musabkilic (1)
EtorArza (1)

Top Labels

Issue Labels

bug (1)

Pull Request Labels

Packages

Total packages: 1
Total downloads:
- cran 361 last-month

Total dependent packages: 0
Total dependent repositories: 0
Total versions: 10
Total maintainers: 1

cran.r-project.org: IOHanalyzer

Data Analysis Part of 'IOHprofiler'

Homepage: https://iohanalyzer.liacs.nl
Documentation: http://cran.r-project.org/web/packages/IOHanalyzer/IOHanalyzer.pdf
License: BSD_3_clause + file LICENSE
Latest release: 0.1.4
published about 6 years ago

Versions: 10
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 361 Last month

Rankings

Forks count: 9.1%

Stargazers count: 14.6%

Average: 24.8%

Dependent packages count: 29.8%

Downloads: 35.3%

Dependent repos count: 35.5%

Maintainers (1)

d.l.vermetten@liacs.leidenuniv.nl

Last synced: 11 months ago

Dependencies

DESCRIPTION cran

R >= 2.10 depends
RColorBrewer * imports
colorRamps * imports
colorspace * imports
data.table * imports
dplyr * imports
ggplot2 * imports
httr * imports
knitr * imports
magrittr * imports
methods * imports
plotly * imports
reshape2 * imports
shiny * imports
stringi * imports
ComplexHeatmap * suggests
DT * suggests
PlayerRatings * suggests
RVCompare * suggests
Rcpp * suggests
bsplus * suggests
colourpicker * suggests
grid * suggests
igraph * suggests
kableExtra * suggests
keyring * suggests
markdown * suggests
shinydashboard * suggests
shinyjs * suggests
testthat * suggests
withr * suggests
xtable * suggests

.github/workflows/R-CMD-check.yaml actions

actions/cache v2 composite
actions/checkout v2 composite
actions/upload-artifact main composite
r-lib/actions/setup-pandoc v1 composite
r-lib/actions/setup-r v1 composite

iohanalyzer

Science Score: 20.0%

Repository

Basic Info

Statistics

Metadata Files

README.md

IOHanalyzer

Online Service

Installation

Software dependency

Stable version

Lastest version

Development version

Runinng the Web Interface locally

Host it online

Supported Data Format

Our Team

License

Owner

GitHub Events

Total

Last Year

Committers

All Time

Past Year

Top Committers

Committer Domains (Top 20 + Academic)

Issues and Pull Requests

All Time

Past Year

Top Authors

Issue Authors

Pull Request Authors

Top Labels

Issue Labels

Pull Request Labels

Packages

cran.r-project.org: IOHanalyzer

Rankings

Maintainers (1)

Dependencies