https://github.com/plynx-team/plynx
PLynx is a domain agnostic platform for managing reproducible experiments and data-oriented workflows.
Science Score: 13.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
○CITATION.cff file
-
✓codemeta.json file
Found codemeta.json file -
○.zenodo.json file
-
○DOI references
-
○Academic publication links
-
○Committers with academic emails
-
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (13.4%) to scientific vocabulary
Keywords
Keywords from Contributors
Repository
PLynx is a domain agnostic platform for managing reproducible experiments and data-oriented workflows.
Basic Info
- Host: GitHub
- Owner: plynx-team
- License: apache-2.0
- Language: JavaScript
- Default Branch: master
- Homepage: https://plynx.com
- Size: 23.2 MB
Statistics
- Stars: 312
- Watchers: 12
- Forks: 43
- Open Issues: 27
- Releases: 5
Topics
Metadata Files
README.md
Plynx
Website and demo: plynx.com.
Docs: docs.
PLynx is a domain agnostic platform for managing reproducible experiments and data-oriented workflows.
Features
Workflow Editor
Interactive User Interface. You can clone successful experiment and reuse it or create one from scratch. PLynx manages history of the experiments and they can be reproduced.
Operations editor
Operations can be customized independently from the platform. Users can define their own Operations or reuse existing ones.
Monitor progress
Track the progress of the experiment. Each of intermediate operations produce results that you can inspect.
Preview the results
View the results right in the browser.
Scalable architecture
Execution Engine is based on scalable pub/sub model. Each Worker performs their jobs independently from each other and can publish subtasks back to the queue. Executers are plugins themselves and can support multiple scenarios from "compile to binary code" to "deploy and serve" to "run in a cluster using as many distributed workers as possible".
Requirements
Plugins work on python3. User Interface is based on React. PLynx is using MongoDB as a primary metadata storage. In order to meet diverse data storage requirements, its own storage plugins to store the artifacts. It supports multiple data storages such as AWS S3, Google Cloud Storage and traditional filesystems.
In order to reduce complexity we recommend to install docker and run make command to start local cluster.
Get started
Usage
Make sure you install docker first. Get started with Docker
tl;dr ``` git clone https://github.com/plynx-team/plynx.git # Clone the repo
cd plynx
cp template_config.yaml config.yaml # Make a copy of a config make up # to start production services ```
Then go to http://localhost:3001
By default it will start the following services:
- MongoDB instance
- PLynx User Interface
- Backend
- Several workers
Other make commands:
make build- build all docker images.make run_tests- build docker images and run the tests.make up- run the services locally.make dev- run developer version of PLynx.
Config
Most of the parameters can be set in command line when the services are called. For example: ``` $ plynx exec --help usage: -c exec [-h] [-v] -f FILENAME [--storage-prefix STORAGE_PREFIX]
optional arguments: -h, --help show this help message and exit -v, --verbose Set logging output more verbose -f FILENAME, --filename FILENAME Path to file --storage-prefix STORAGE_PREFIX Storage prefix ```
But we recommend to store the config in a separate file.
Plynx config location is can be set in env variable PLYNX_CONFIG_PATH. Default value is ./config.yaml.
Install PLynx with dev requirements
Run: ``` pip install -e .[all]
pre-commit install ```
External links
- PLynx.com demo and main page.
- github page.
- Organizing data science experiments with PLynx
GitHub Events
Total
- Watch event: 11
- Delete event: 1
- Push event: 14
- Pull request event: 2
- Fork event: 4
- Create event: 1
Last Year
- Watch event: 11
- Delete event: 1
- Push event: 14
- Pull request event: 2
- Fork event: 4
- Create event: 1
Committers
Last synced: about 2 years ago
Top Committers
| Name | Commits | |
|---|---|---|
| Ivan Khomyakov | k****s@g****m | 405 |
| dependabot[bot] | 4****] | 3 |
| Philipp Trautmann | m****l@n****e | 1 |
| khaxis@gmail.com | k****s@m****l | 1 |
| Frank | 1****o | 1 |
| Justin Jeffery | 9****f | 1 |
Committer Domains (Top 20 + Academic)
Issues and Pull Requests
Last synced: 6 months ago
All Time
- Total issues: 14
- Total pull requests: 98
- Average time to close issues: 6 months
- Average time to close pull requests: 3 months
- Total issue authors: 10
- Total pull request authors: 5
- Average comments per issue: 2.57
- Average comments per pull request: 0.43
- Merged pull requests: 58
- Bot issues: 0
- Bot pull requests: 40
Past Year
- Issues: 0
- Pull requests: 1
- Average time to close issues: N/A
- Average time to close pull requests: about 11 hours
- Issue authors: 0
- Pull request authors: 1
- Average comments per issue: 0
- Average comments per pull request: 0.0
- Merged pull requests: 1
- Bot issues: 0
- Bot pull requests: 0
Top Authors
Issue Authors
- thoth291 (3)
- fwanghe (2)
- vivkvv (2)
- samN3Hub (1)
- wallyell (1)
- khaxis (1)
- gifts1912 (1)
- justinjeffery-ipf (1)
- IAmStoxe (1)
- mbalsam-refind (1)
Pull Request Authors
- khaxis (58)
- dependabot[bot] (40)
- justinjeffery-ipf (1)
- Nostix (1)
- fwanghe (1)
Top Labels
Issue Labels
Pull Request Labels
Packages
- Total packages: 2
-
Total downloads:
- pypi 76 last-month
-
Total dependent packages: 0
(may contain duplicates) -
Total dependent repositories: 1
(may contain duplicates) - Total versions: 62
- Total maintainers: 1
proxy.golang.org: github.com/plynx-team/plynx
- Documentation: https://pkg.go.dev/github.com/plynx-team/plynx#section-documentation
- License: apache-2.0
-
Latest release: v1.11.1
published over 2 years ago
Rankings
pypi.org: plynx
ML platform
- Homepage: https://plynx.com
- Documentation: https://plynx.readthedocs.io/
- License: Apache Software License
-
Latest release: 1.11.1
published over 2 years ago