https://github.com/climate-ref/wp1-prototype
A strawman concept for how WP1 could work
Science Score: 13.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
○CITATION.cff file
-
✓codemeta.json file
Found codemeta.json file -
○.zenodo.json file
-
○DOI references
-
○Academic publication links
-
○Academic email domains
-
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (4.4%) to scientific vocabulary
Last synced: 9 months ago
·
JSON representation
Repository
A strawman concept for how WP1 could work
Basic Info
- Host: GitHub
- Owner: Climate-REF
- Language: Python
- Default Branch: main
- Size: 2.93 KB
Statistics
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 0
- Releases: 0
Created over 1 year ago
· Last pushed over 1 year ago
Metadata Files
Readme
README.md
A Strawman Prototype for WP1
I could not get this out of my mind, and so I wrote this little code showing how a very basic workflow could function that uses the MPIPoolExecutor from mpi4py to do a simple map-reduce. Essentially, a single process is used as a master and allocates work from a list as other processes become available. Comments are inline which explain what I was thinking.
Alternatives
I think what we need is possibly quite simple, but we could also just use a package. I found a few resources:
- https://github.com/celery/celery
- https://github.com/inveniosoftware-contrib/workflow
- https://github.com/pditommaso/awesome-pipeline
Owner
- Name: Climate REF
- Login: Climate-REF
- Kind: organization
- Email: cmip-ipo@esa.int
- Repositories: 1
- Profile: https://github.com/Climate-REF
Climate Rapid Evaluation Framework