https://github.com/astrazeneca/magnus-extensions
Extensions packages for magnus
Science Score: 26.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
○CITATION.cff file
-
✓codemeta.json file
Found codemeta.json file -
✓.zenodo.json file
Found .zenodo.json file -
○DOI references
-
○Academic publication links
-
○Committers with academic emails
-
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (6.5%) to scientific vocabulary
Repository
Extensions packages for magnus
Basic Info
- Host: GitHub
- Owner: AstraZeneca
- License: apache-2.0
- Language: Python
- Default Branch: main
- Size: 2.74 MB
Statistics
- Stars: 3
- Watchers: 1
- Forks: 1
- Open Issues: 5
- Releases: 15
Metadata Files
README.md
Welcome to Magnus Extensions
Documentation of the extensions are available at: https://astrazeneca.github.io/magnus-extensions/
This repository provides all the extensions to magnus core package.
Magnus provides 5 essential services:
- Executor: A way to define and execute/transpile dag definition.
- Catalog: An artifact store used to log and store data files generated during a pipeline execution.
- Secrets Handler: A framework to handle secrets from different providers.
- Logging: A comprehensive and automatic logging framework to capture essential information of a pipeline execution.
- Experiment Tracking: A framework to interact with different experiment tracking tools.
Below is the table of all the available extensions to the above services:
| Service | Description | Availability |
| :---------: | :----------------------------------: | :-------------: |
| Executors | | |
| Local | Run the pipeline on local machine (default) | Part of Magnus core |
| Local Containers | Run the pipeline on local containers | Part of Magnus core |
| Catalog | | |
| Do Nothing | Provides no cataloging functionality | Part of Magnus core |
| File System | Uses local file system (default) | Part of Magnus core |
| S3 | Uses S3 as a catalog | magnusextensioncatalogs3 |
| Secrets | | |
| Do Nothing | Provides no secrets handler (default) | Part of Magnus core |
| Dot Env | Uses a file as secrets | Part of Magnus core |
| Environment Variables | Gets secrets from Environmental variables | Part of Magnus core |
| Logging | | |
| Buffered | Uses the run time buffer as logger (default) | Part of Magnus core |
| File System | Uses a file system as run log store | Part of Magnus core |
| S3 | Uses S3 to store logs | magnusextensiondatastores3 |
| Experiment Tracking | | |
| Do Nothing | Provides no experiment tracking (default) | Part of Magnus core |
Owner
- Name: AstraZeneca
- Login: AstraZeneca
- Kind: organization
- Location: Global
- Website: https://www.astrazeneca.com/
- Repositories: 33
- Profile: https://github.com/AstraZeneca
Data and AI: Unlocking new science insights
GitHub Events
Total
Last Year
Committers
Last synced: over 3 years ago
All Time
- Total Commits: 72
- Total Committers: 2
- Avg Commits per committer: 36.0
- Development Distribution Score (DDS): 0.083
Top Committers
| Name | Commits | |
|---|---|---|
| Vijay Vammi | v****i@a****m | 66 |
| Vignesh Ramakrishnan | v****3@a****m | 6 |
Committer Domains (Top 20 + Academic)
Packages
- Total packages: 6
-
Total downloads:
- pypi 140 last-month
-
Total dependent packages: 0
(may contain duplicates) -
Total dependent repositories: 0
(may contain duplicates) - Total versions: 15
- Total maintainers: 1
pypi.org: magnus-extension-datastore-db
Magnus extension for DB as run log store
- Homepage: https://github.com/AstraZeneca/magnus-extensions/
- Documentation: https://magnus-extension-datastore-db.readthedocs.io/
- License: Apache-2.0
- Status: removed
-
Latest release: 0.1.1
published almost 4 years ago
Rankings
Maintainers (1)
pypi.org: magnus-extension-k8s-poller
Description you want to give
- Homepage: https://github.com/AstraZeneca/magnus-extensions/
- Documentation: https://magnus-extension-k8s-poller.readthedocs.io/
- License: Apache-2.0
- Status: removed
-
Latest release: 0.1.3
published almost 4 years ago
Rankings
Maintainers (1)
pypi.org: magnus-extension-aws-secrets-manager
Description you want to give
- Homepage: https://github.com/AstraZeneca/magnus-extensions/
- Documentation: https://magnus-extension-aws-secrets-manager.readthedocs.io/
- License: Apache-2.0
- Status: removed
-
Latest release: 0.1.0
published over 4 years ago
Rankings
Maintainers (1)
pypi.org: magnus-extension-datastore-s3
Magnus extension for S3 as run log store
- Homepage: https://github.com/AstraZeneca/magnus-extensions/
- Documentation: https://magnus-extension-datastore-s3.readthedocs.io/
- License: Apache-2.0
- Status: removed
-
Latest release: 0.2.0
published over 3 years ago
Rankings
Maintainers (1)
pypi.org: magnus-extension-catalog-s3
Magnus extension to provide S3 Catalog functionality
- Homepage: https://github.com/AstraZeneca/magnus-extensions/
- Documentation: https://magnus-extension-catalog-s3.readthedocs.io/
- License: Apache-2.0
- Status: removed
-
Latest release: 0.2.0
published over 3 years ago
Rankings
Maintainers (1)
pypi.org: magnus-extension-kubeflow
Kubeflow executor
- Homepage: https://github.com/AstraZeneca/magnus-extensions/
- Documentation: https://magnus-extension-kubeflow.readthedocs.io/
- License: Apache-2.0
- Status: removed
-
Latest release: 0.1.0
published over 3 years ago
Rankings
Maintainers (1)
Dependencies
- actions/checkout v2 composite
- actions/setup-python v2 composite
- actions/checkout v3 composite
- actions/setup-python v4 composite
- actions/checkout v3 composite
- actions/github-script v6 composite
- actions/setup-python v4 composite
- 157 dependencies
- autopep8 * develop
- commit-linter ^1.0.2 develop
- mkdocs * develop
- mkdocs-material * develop
- mypy ^0.931 develop
- pre-commit * develop
- pylint * develop
- pytest * develop
- pytest-cov * develop
- pytest-mock * develop
- python-semantic-release ^7.33.1 develop
- tox ^3.24.5 develop
- boto3 *
- kfp ^1.8.18
- kubernetes *
- magnus ^0.4.12
- mlflow-skinny *
- python ^3.7
- sqlalchemy *