radical.pilot

RADICAL-Pilot

https://github.com/radical-cybertools/radical.pilot

Science Score: 54.0%

This score indicates how likely this project is to be science-related based on various indicators:

✓
CITATION.cff file
Found CITATION.cff file
✓
codemeta.json file
Found codemeta.json file
✓
.zenodo.json file
Found .zenodo.json file
○
DOI references
○
Academic publication links
✓
Committers with academic emails
24 of 61 committers (39.3%) from academic institutions
○
Institutional organization owner
○
JOSS paper metadata
○
Scientific vocabulary similarity
Low similarity (4.0%) to scientific vocabulary

Keywords

hacktoberfest

Last synced: 6 months ago · JSON representation ·

Repository

RADICAL-Pilot

Basic Info

Host: GitHub
Owner: radical-cybertools
License: other
Language: Python
Default Branch: devel
Homepage: http://radical-cybertools.github.io/radical-pilot/index.html
Size: 129 MB

Statistics

Stars: 63
Watchers: 16
Forks: 24
Open Issues: 103
Releases: 3

Topics

hacktoberfest

Created over 12 years ago · Last pushed 7 months ago

Metadata Files

Readme Changelog License Citation

README.dragon

## Using the RP Dragon executor

The Dragon executor requires Python 3.10 *or lower* - Python 3.11 conflicts with
how json serialization is used (https://github.com/DragonHPC/dragon/issues/9).

In order to correctly install Dragon, we had to change
`.devcontainer/constraints.txt`:

  - remove the `attrs=22.1.0` dependency
  - remove the `pytest=7.2.0` dependency

Also ensure that `radical.utils` is installed from the `fix/dragon` branch which
avoids some logger lambdas which conflicted with the used serialization scheme.

The simplest setup is to carefully prepare a virtualenv as described above, and
then configure RP so that the pilot agent and the tasks use the very same
environment.  In the resource config, set `rp_version=installed` and
`virtenv_mode=local`, for task descriptions set `named_env=rp`.

Owner

Name: RADICAL Cybertools Project
Login: radical-cybertools
Kind: organization

Website: https://radical-cybertools.github.io/
Repositories: 58
Profile: https://github.com/radical-cybertools

Citation (CITATION.cff)

cff-version: 1.2.0
title: RADICAL-Pilot
message: >-
  If you use this software, please cite it using the
  metadata from this file.
type: software
authors:
  - given-names: Andre
    family-names: Merzky
  - given-names: Matteo
    family-names: Turilli
  - given-names: Mikhail
    family-names: Titov
  - given-names: Aymen
    family-names: Al-Saadi
  - given-names: Shantenu
    family-names: Jha
identifiers:
  - type: url
    value: 'https://github.com/radical-cybertools/radical.pilot'
    description: GitHub repository
  - type: doi
    value: 10.1109/TPDS.2021.3105994
repository-code: 'https://github.com/radical-cybertools/radical.pilot'
url: 'https://radicalpilot.readthedocs.io/'
abstract: >-
  RADICAL-Pilot (RP) is a Pilot system written in Python and
  specialized in executing applications composed of many
  computational tasks on high performance computing (HPC)
  platforms. As a Pilot system, RP separates resource
  acquisition from using those resources to execute
  application tasks. Resources are acquired by submitting a
  job to the batch system of an HPC machine. Once the job is
  scheduled on the requested resources, RP can directly
  schedule and launch application tasks on those resources.
  Thus, tasks are not scheduled via the batch system of the
  HPC platform, but directly on the acquired resources.
keywords:
  - High Performance Computing (HPC)
  - Pilot Job
  - Scientific Computing
license: MIT
references:
  - type: article
    scope: Cite this paper if you want to reference the general concepts of the software.
    authors:
      - family-names: Merzky
        given-names: Andre
        orcid: 'https://orcid.org/0000-0002-7228-4327'
      - family-names: Turilli
        given-names: Matteo
        orcid: 'https://orcid.org/0000-0003-0527-1435'
      - family-names: Titov
        given-names: Mikhail
        orcid: 'https://orcid.org/0000-0003-2357-7382'
      - family-names: Al-Saadi
        given-names: Aymen
        orcid: 'https://orcid.org/0000-0001-7491-4946'
      - family-names: Jha
        given-names: Shantenu
        orcid: 'https://orcid.org/0000-0002-5040-026X'
    title: "Design and Performance Characterization of RADICAL-Pilot on Leadership-Class Platforms"
    year: 2022
    journal: IEEE Transactions on Parallel and Distributed Systems
    volume: 33
    issue: 4
    pages: 818-829
    doi: 10.1109/TPDS.2021.3105994

GitHub Events

Total

Create event: 92
Commit comment event: 2
Issues event: 87
Watch event: 9
Delete event: 78
Issue comment event: 220
Push event: 965
Pull request review event: 196
Pull request review comment event: 146
Pull request event: 129
Fork event: 1

Last Year

Create event: 92
Commit comment event: 2
Issues event: 87
Watch event: 9
Delete event: 78
Issue comment event: 220
Push event: 965
Pull request review event: 196
Pull request review comment event: 146
Pull request event: 129
Fork event: 1

Committers

Last synced: almost 3 years ago

All Time

Total Commits: 7,339
Total Committers: 61
Avg Commits per committer: 120.311
Development Distribution Score (DDS): 0.472

Past Year

Commits: 558
Committers: 8
Avg Commits per committer: 69.75
Development Distribution Score (DDS): 0.534

Top Committers

Name	Email	Commits
Andre Merzky	a**e@m**t	3,878
Mark Santcroos	m**1@s**u	1,105
Ole Weidner	o**r@r**u	517
Mikhail Titov	m**v@g**m	504
Ioannis Paraskevakos	i**v@r**u	280
Matteo Turilli	m**i@g**m	140
AymenFJA	a**i@r**u	107
Ioannis Paraskevakos	i**s@r**u	97
Ioannis Paraskevakos	g**v@r**u	83
kartikmodi	k**t@m**v	79
Ole Weidner	o**r@i**m	77
M. Eric Irrgang	e**g@g**m	56
Mark Santcroos	m**s@r**u	53
vivek-bala	b**1@g**m	49
Giorgos Chantzialexiou	g**8@g**m	47
Vivekanandan (Vivek) Balasubramanian	v**n@r**u	38
Aymen Alsaadi	2**A@u**m	31
Aymen	a**l@y**m	29
Hyungro Lee	h**e@g**m	17
AntonsT	a**6@s**u	16
George Koubbe	g**e@o**m	13
Mark Santcroos	m**k@s**t	12
Shantenu	s**a@r**u	11
AntonsT	a**s@r**u	10
Ioannis Paraskevakos	i**k@u**m	9
aydinsaribudak	a**9@s**u	9
chengwill97	c**7@g**m	7
itomaldonado	m**o@g**m	7
Jumana Dakka	j**a@g**m	6
Iain Bethune	i**e@u**m	6
and 31 more...

Committer Domains (Top 20 + Academic)

rutgers.edu: 10 two.radical-project.org: 4 scarletmail.rutgers.edu: 3 merzky.net: 1 modi.dev: 1 santcroos.net: 1 js-17-185.jetstream-cloud.org: 1 radical.3: 1 lumc.nl: 1 bnl.gov: 1 ucl.ac.uk: 1 comet-ln2.sdsc.edu: 1 amarel2.amarel.rutgers.edu: 1 br011.ib.bridges2.psc.edu: 1 polaris-login-02.hsn.cm.polaris.alcf.anl.gov: 1 login1.stampede2.tacc.utexas.edu: 1 choderalab.org: 1 cheyenne2.ib0.cheyenne.ucar.edu: 1 umich.edu: 1 ugent.be: 1 uwaterloo.ca: 1 login4.frontera.tacc.utexas.edu: 1

Issues and Pull Requests

Last synced: 6 months ago

All Time

Total issues: 299
Total pull requests: 316
Average time to close issues: 9 months
Average time to close pull requests: 20 days
Total issue authors: 21
Total pull request authors: 9
Average comments per issue: 2.52
Average comments per pull request: 2.23
Merged pull requests: 274
Bot issues: 0
Bot pull requests: 0

Past Year

Issues: 55
Pull requests: 112
Average time to close issues: 29 days
Average time to close pull requests: 10 days
Issue authors: 6
Pull request authors: 3
Average comments per issue: 1.44
Average comments per pull request: 1.38
Merged pull requests: 84
Bot issues: 0
Bot pull requests: 0

View more stats

Top Authors

Issue Authors

andre-merzky (107)
mtitov (54)
AymenFJA (53)
eirrgang (30)
mturilli (27)
mgoliyad (9)
AlexReedy (4)
okilic1 (3)
kartikmodi (3)
GKNB (2)
laszewsk (2)
vivek-bala (2)
iparask (1)
dz24 (1)
ejjordan (1)

Pull Request Authors

andre-merzky (234)
mtitov (94)
AymenFJA (44)
mturilli (13)
eirrgang (12)
ejjordan (3)
dyokelson (1)
kartikmodi (1)
GKNB (1)

Top Labels

Issue Labels

layer:rp (135) type:bug (109) priority:medium (58) type:enhancement (57) type:feature (56) priority:high (54) external (53) topic:documentation (48) internal (45) comp:raptor (30) priority:critical (28) topic:resource (24) topic:execution (21) comp:agent:scheduler (20) priority:low (20) topic:configuration (20) topic:communication (20) topic:api (19) comp:agent:executor (19) topic:deployment (18) comp:session (16) topic:data (13) comp:agent (12) comp:agent:bootstrapper (11) type:question (11) topic:testing (11) type:performance (10) comp:pmgr:launcher (10) type:refactor (8) comp:agent:stager (7)

Pull Request Labels

external (163) internal (132) type:bug (128) type:enhancement (118) priority:high (95) priority:medium (83) topic:documentation (71) topic:configuration (64) comp:agent:executor (57) priority:critical (51) topic:execution (51) topic:resource (45) topic:api (41) topic:deployment (37) comp:raptor (36) type:feature (34) topic:communication (33) comp:agent (30) comp:agent:scheduler (29) topic:data (28) comp:session (28) priority:low (25) comp:agent:bootstrapper (20) topic:testing (17) topic:termination (17) comp:pmgr:launcher (17) layer:rp (16) comp:tmgr (15) comp:agent:stager (13) comp:pmgr (9)

Packages

Total packages: 2
Total downloads:
- pypi 1,614 last-month
Total docker downloads: 445

Total dependent packages: 5
(may contain duplicates)
Total dependent repositories: 9
(may contain duplicates)
Total versions: 261
Total maintainers: 2

pypi.org: radical.pilot

RADICAL-Cybertools Pilot Job Framework

Homepage: http://radical-cybertools.github.io/radical.pilot/
Documentation: https://radicalpilot.readthedocs.io/en/latest/
License: MIT
Latest release: 1.102.0
published 9 months ago

Versions: 197
Dependent Packages: 3
Dependent Repositories: 9
Downloads: 1,614 Last month
Docker Downloads: 445

Rankings

Dependent packages count: 2.4%

Docker downloads count: 2.8%

Dependent repos count: 4.9%

Downloads: 5.0%

Average: 5.5%

Forks count: 8.7%

Stargazers count: 9.2%

Maintainers (2)

andre.merzky mtitov

Last synced: 7 months ago

conda-forge.org: radical.pilot

RADICAL-Pilot (RP) is a flexible pilot-based system that provides a simple and scalable approach for executing many concurrent simulations and their data requirements on high performance computing (HPC) platforms. RP separates resource acquisition from using those resources to execute application tasks.

Homepage: https://github.com/radical-cybertools/radical.pilot
License: MIT
Latest release: 1.18.1
published over 3 years ago

Versions: 64
Dependent Packages: 2
Dependent Repositories: 0

Rankings

Dependent packages count: 19.5%

Average: 31.6%

Dependent repos count: 34.0%

Forks count: 35.4%

Stargazers count: 37.3%

Last synced: 7 months ago

Dependencies

.github/workflows/bridges.yml actions

actions/checkout v2 composite
actions/setup-python v2 composite

.github/workflows/summit.yml actions

actions/checkout v2 composite
actions/setup-python v2 composite

requirements-docs.txt pypi

sphinx >=5.1
sphinxcontrib-napoleon *

requirements.txt pypi

dill *
pymongo <4
radical.gtod *
radical.saga >=1.12
radical.utils >=1.12
setproctitle *

.github/workflows/ci.yml actions

actions/checkout v3 composite
actions/setup-python v4 composite
actions/upload-artifact v3 composite
codecov/codecov-action v3 composite

.github/workflows/docs.yml actions

.github/workflows/run-rp-notebook.yml actions

actions/checkout v3 composite
actions/setup-python v4 composite
actions/upload-artifact v3 composite

requirements-ci.txt pypi

coverage *
dill *
flake8 *
flake8-per-file-ignores *
psutil *
pudb *
pylint *
pytest *
pytest-timeout *
setproctitle *

requirements-docs-ci.txt pypi

docutils ==0.17.1
ipykernel *
ipython *
myst_parser *
nbsphinx ==0.8.12
python-dotenv *
sphinx ==5.3.0
sphinx_copybutton *
sphinx_rtd_theme >=0.5.1

setup.py pypi

environment.yml pypi