polyaxon

MLOps Tools For Managing & Orchestrating The Machine Learning LifeCycle

Science Score: 44.0%

This score indicates how likely this project is to be science-related based on various indicators:

✓
CITATION.cff file
Found CITATION.cff file
✓
codemeta.json file
Found codemeta.json file
✓
.zenodo.json file
Found .zenodo.json file
○
DOI references
○
Academic publication links
○
Committers with academic emails
○
Institutional organization owner
○
JOSS paper metadata
○
Scientific vocabulary similarity
Low similarity (11.2%) to scientific vocabulary

Keywords

artificial-intelligence caffe data-science deep-learning hyperparameter-optimization jupyter jupyterlab k8s keras kubernetes machine-learning ml mlops mxnet notebook pipelines pytorch reinforcement-learning tensorflow workflow

Keywords from Contributors

distribution deep-neural-networks closember jax cryptocurrencies json-schema pydantic data-mining interpretability annotation

Last synced: 4 months ago · JSON representation ·

Repository

MLOps Tools For Managing & Orchestrating The Machine Learning LifeCycle

Basic Info

Host: GitHub
Owner: polyaxon
License: apache-2.0
Default Branch: master
Homepage: https://polyaxon.com
Size: 121 MB

Statistics

Stars: 3,671
Watchers: 76
Forks: 320
Open Issues: 123
Releases: 0

Topics

Created about 9 years ago · Last pushed 4 months ago

Metadata Files

Readme Contributing License Code of conduct Citation

README.md

Reproduce, Automate, Scale your data science

Welcome to Polyaxon, a platform for building, training, and monitoring large scale deep learning applications. We are making a system to solve reproducibility, automation, and scalability for machine learning applications.

Polyaxon deploys into any data center, cloud provider, or can be hosted and managed by Polyaxon, and it supports all the major deep learning frameworks such as Tensorflow, MXNet, Caffe, Torch, etc.

Polyaxon makes it faster, easier, and more efficient to develop deep learning applications by managing workloads with smart container and node management. And it turns GPU servers into shared, self-service resources for your team or organization.

demo

Install

TL;DR;

Install CLI

```bash

Install Polyaxon CLI

$ pip install -U polyaxon ```
- Create a deployment
```bash

Create a namespace

$ kubectl create namespace polyaxon

Add Polyaxon charts repo

$ helm repo add polyaxon https://charts.polyaxon.com

Deploy Polyaxon

$ polyaxon admin deploy -f config.yaml

Access API

$ polyaxon port-forward ```

Please check polyaxon installation guide

Quick start

TL;DR;

Start a project

```bash

Create a project

$ polyaxon project create --name=quick-start --description='Polyaxon quick start.' ```
Train and track logs & resources

```bash

Upload code and start experiments

$ polyaxon run -f experiment.yaml -u -l ```
Dashboard

```bash

Start Polyaxon dashboard

$ polyaxon dashboard

Dashboard page will now open in your browser. Continue? [Y/n]: y ```

compare dashboards

Notebook bash # Start Jupyter notebook for your project $ polyaxon run --hub notebook

compare

Tensorboard bash # Start TensorBoard for a run's output $ polyaxon run --hub tensorboard -P uuid=UUID

tensorboard

Please check our quick start guide to start training your first experiment.

Distributed job

Polyaxon supports and simplifies distributed jobs. Depending on the framework you are using, you need to deploy the corresponding operator, adapt your code to enable the distributed training, and update your polyaxonfile.

Here are some examples of using distributed training:

Hyperparameters tuning

Polyaxon has a concept for suggesting hyperparameters and managing their results very similar to Google Vizier called experiment groups. An experiment group in Polyaxon defines a search algorithm, a search space, and a model to train.

Parallel executions

You can run your processing or model training jobs in parallel, Polyaxon provides a mapping abstraction to manage concurrent jobs.

DAGs and workflows

Polyaxon DAGs is a tool that provides container-native engine for running machine learning pipelines. A DAG manages multiple operations with dependencies. Each operation is defined by a component runtime. This means that operations in a DAG can be jobs, services, distributed jobs, parallel executions, or nested DAGs.

Architecture

Polyaxon architecture

Documentation

Check out our documentation to learn more about Polyaxon.

Dashboard

Polyaxon comes with a dashboard that shows the projects and experiments created by you and your team members.

To start the dashboard, just run the following command in your terminal

bash $ polyaxon dashboard -y

Project status

Polyaxon is stable and it's running in production mode at many startups and Fortune 500 companies.

Contributions

Please follow the contribution guide line: Contribute to Polyaxon.

Research

If you use Polyaxon in your academic research, we would be grateful if you could cite it.

Feel free to contact us, we would love to learn about your project and see how we can support your custom need.

Owner

Name: polyaxon
Login: polyaxon
Kind: organization
Email: contact@polyaxon.com
Location: Germany

Website: https://polyaxon.com
Twitter: polyaxonAI
Repositories: 43
Profile: https://github.com/polyaxon

A platform for reproducible and scalable machine learning and deep learning

Citation (CITATION)

@misc{polyaxon,
  title             = {Polyaxon: Cloud native machine learning platform},
  howpublished      = {Web page},
  year              = {2018},
  note              = {Software available from polyaxon.com},
  url               = {https://github.com/polyaxon/polyaxon},
  author            = {Mourafiq, Mourad},
}

GitHub Events

Total

Issues event: 2
Watch event: 100
Issue comment event: 7
Push event: 39
Fork event: 11
Create event: 14

Last Year

Issues event: 2
Watch event: 100
Issue comment event: 7
Push event: 39
Fork event: 11
Create event: 14

Committers

Last synced: 7 months ago

All Time

Total Commits: 10,035
Total Committers: 97
Avg Commits per committer: 103.454
Development Distribution Score (DDS): 0.14

Past Year

Commits: 49
Committers: 1
Avg Commits per committer: 49.0
Development Distribution Score (DDS): 0.0

Top Committers

Name	Email	Commits
mouradmourafiq	m**q@g**m	8,626
polyaxon-ci	ci@p****m	686
polyaxon-team	c**t@p**m	267
Mourad	m****q	75
gzc	z**o@l**m	52
dependabot[bot]	4****]	48
Lukas Geiger	l**4@g**m	29
vfdev	v**5@g**m	25
José Vidal	j**n@g**m	17
William Buchwalter	w**r@g**m	13
pyup-bot	g**t@p**o	12
Rinat Shigapov	r**v@g**m	12
Anton Friberg	A****g	7
Ryan Armstrong	r**g@o**m	7
Yu ISHIKAWA	y**a@g**m	6
Shotaro Kohama	k**8@g**m	5
Ricardo Barros	r**s@h**m	5
Denis Oliveira	d**c@g**m	5
j-kohn	4****n	4
Nathan DeMaria	n**a@g**m	4
Axel Perschmann	a**n@g**m	4
Ashton Sidhu	a**4@g**m	4
Ed Shelton	ed@b****i	4
claytantor	c**r@g**m	3
Natalie Prange	f**h@g**m	3
Yaser Martinez Palenzuela	y**z@g**m	3
Toubi	a**t@s**m	3
Tom Forbes	t**m@t**s	3
Timo Rohner	3****r	3
Siddharth Gupta	s**d@g**i	3
and 67 more...

Committer Domains (Top 20 + Academic)

polyaxon.com: 3 linkdoc.com: 1 pyup.io: 1 overstock.com: 1 benevolent.ai: 1 sicara.com: 1 tomforb.es: 1 granular.ai: 1 geekbox.info: 1 student.hpi.de: 1 innoq.com: 1 zuehlke.com: 1 lightricks.com: 1 vaerek.net: 1 retresco.de: 1 gmx.de: 1 evolved.io: 1 ensta.org: 1

Issues and Pull Requests

Last synced: 4 months ago

All Time

Total issues: 98
Total pull requests: 8
Average time to close issues: 8 months
Average time to close pull requests: 2 months
Total issue authors: 27
Total pull request authors: 4
Average comments per issue: 0.97
Average comments per pull request: 1.0
Merged pull requests: 2
Bot issues: 0
Bot pull requests: 5

Past Year

Issues: 2
Pull requests: 0
Average time to close issues: N/A
Average time to close pull requests: N/A
Issue authors: 1
Pull request authors: 0
Average comments per issue: 0.0
Average comments per pull request: 0
Merged pull requests: 0
Bot issues: 0
Bot pull requests: 0

View more stats

Top Authors

Issue Authors

mmourafiq (34)
polyaxon-team (24)
ehsanmok (9)
hongqing1986 (4)
MrPleom-sirius (2)
boniek83 (2)
shotarok (2)
JacobJeppesen (2)
HaoLiuHust (1)
NathanDeMaria (1)
ClementMaliet (1)
Oodapow (1)
wangtingwei1995 (1)
Syakyr (1)
MatthiasKohl (1)

Pull Request Authors

dependabot[bot] (5)
TrellixVulnTeam (1)
bobvdvelde (1)
pyup-bot (1)

Top Labels

Issue Labels

planned (32) enhancement (28) fixed (27) area/ui (27) roadmap (23) feature (22) area/cli (18) area/api (12) question (12) core (10) commercial (9) area/client (9) bug (9) area/visualization (8) area/compiler (7) area/tracking (6) area/specification (6) area/hub (5) area/scheduler (5) area/agents (5) stale (4) area/docs (4) area/operator (3) area/helm-charts (3) area/initializers (3) area/registry (3) technical-debt (3) regression (3) area/schedules (2) area/connections (2)

Pull Request Labels

dependencies (5) python (4) github_actions (1)

Packages

Total packages: 8
Total downloads:
- pypi 11,965 last-month
Total docker downloads: 72

Total dependent packages: 7
(may contain duplicates)
Total dependent repositories: 43
(may contain duplicates)
Total versions: 681
Total maintainers: 2

pypi.org: polyaxon

Command Line Interface (CLI) and client to interact with Polyaxon API.

Homepage: https://github.com/polyaxon/polyaxon
Documentation: https://polyaxon.readthedocs.io/
License: Apache 2.0
Latest release: 2.10.0
published 4 months ago

Versions: 480
Dependent Packages: 5
Dependent Repositories: 24
Downloads: 11,684 Last month
Docker Downloads: 72

Rankings

Stargazers count: 1.3%

Downloads: 1.4%

Dependent packages count: 1.6%

Average: 2.2%

Forks count: 2.9%

Dependent repos count: 3.0%

Docker downloads count: 3.0%

Maintainers (2)

mmourafiq polyaxonbot

Last synced: 4 months ago

proxy.golang.org: github.com/polyaxon/polyaxon/sdks

Homepage: https://github.com/polyaxon/polyaxon
Documentation: https://pkg.go.dev/github.com/polyaxon/polyaxon/sdks#section-documentation
License: Apache-2.0
Latest release: v0.0.0-20211111225436-873903bf0bbb
published about 4 years ago

Versions: 11
Dependent Packages: 1
Dependent Repositories: 2

Rankings

Stargazers count: 1.2%

Forks count: 1.6%

Average: 3.0%

Dependent repos count: 3.5%

Dependent packages count: 5.8%

Last synced: 5 months ago

proxy.golang.org: github.com/polyaxon/polyaxon

Documentation: https://pkg.go.dev/github.com/polyaxon/polyaxon#section-documentation
License: apache-2.0
Latest release: v2.5.2+incompatible
published about 1 year ago

Versions: 153
Dependent Packages: 0
Dependent Repositories: 1

Rankings

Stargazers count: 1.2%

Forks count: 1.6%

Average: 4.3%

Dependent repos count: 4.7%

Dependent packages count: 9.6%

Last synced: about 1 year ago

pypi.org: polyaxon-deploy

Polyaxon deployment and serving tools: streams, sandbox, ML-API, and spaces.

Homepage: https://github.com/polyaxon/polyaxon
Documentation: https://polyaxon-deploy.readthedocs.io/
License: Apache 2.0
Latest release: 1.0.3
published over 3 years ago

Versions: 33
Dependent Packages: 1
Dependent Repositories: 13
Downloads: 211 Last month

Rankings

Stargazers count: 1.3%

Forks count: 2.9%

Dependent repos count: 4.0%

Average: 4.5%

Dependent packages count: 4.8%

Downloads: 9.4%

Maintainers (2)

mmourafiq polyaxonbot

Last synced: 4 months ago

proxy.golang.org: github.com/polyaxon/polyaxon/operator

Homepage: https://github.com/polyaxon/polyaxon
Documentation: https://pkg.go.dev/github.com/polyaxon/polyaxon/operator#section-documentation
License: Apache-2.0
Latest release: v0.0.0-20211111225436-873903bf0bbb
published about 4 years ago

Versions: 1
Dependent Packages: 0
Dependent Repositories: 0

Rankings

Stargazers count: 0.7%

Forks count: 1.0%

Average: 4.5%

Dependent packages count: 7.0%

Dependent repos count: 9.3%

Last synced: 5 months ago

pypi.org: polyai

Polyaxon ai.

Homepage: https://github.com/polyaxon/polyaxon
Documentation: https://polyai.readthedocs.io/
License: Apache 2.0
Latest release: 0.0.0
published over 5 years ago

Versions: 1
Dependent Packages: 0
Dependent Repositories: 1
Downloads: 12 Last month

Rankings

Stargazers count: 1.3%

Forks count: 2.9%

Dependent packages count: 10.1%

Average: 17.8%

Dependent repos count: 21.5%

Downloads: 53.1%

Maintainers (1)

mmourafiq

Last synced: 4 months ago

pypi.org: polyml

Polyaxon model management.

Homepage: https://github.com/polyaxon/polyaxon
Documentation: https://polyml.readthedocs.io/
License: Apache 2.0
Latest release: 0.0.0
published over 5 years ago

Versions: 1
Dependent Packages: 0
Dependent Repositories: 1
Downloads: 51 Last month

Rankings

Stargazers count: 1.3%

Forks count: 2.9%

Dependent packages count: 10.1%

Average: 20.0%

Dependent repos count: 21.5%

Downloads: 64.4%

Maintainers (1)

mmourafiq

Last synced: 4 months ago

pypi.org: polyx

Polyaxon x dist.

Homepage: https://github.com/polyaxon/polyaxon
Documentation: https://polyx.readthedocs.io/
License: Apache 2.0
Latest release: 0.0.0
published over 5 years ago

Versions: 1
Dependent Packages: 0
Dependent Repositories: 1
Downloads: 7 Last month

Rankings

Stargazers count: 1.3%

Forks count: 2.9%

Dependent packages count: 10.1%

Dependent repos count: 21.5%

Average: 24.4%

Downloads: 85.9%

Maintainers (1)

mmourafiq

Last synced: 4 months ago

Dependencies

.github/workflows/charts.yml actions

actions/checkout v4 composite
actions/setup-python v4 composite
azure/setup-helm v3.5 composite
helm/chart-testing-action v2.4.0 composite
helm/kind-action v1.8.0 composite

.github/workflows/cla.yml actions

cla-assistant/github-action v2.1.3-beta composite

.github/workflows/cli.yml actions

actions/checkout v4 composite
actions/setup-python v4 composite

.github/workflows/haupt.yml actions

actions/checkout v4 composite
actions/setup-python v4 composite

.github/workflows/hypertune.yml actions

actions/checkout v4 composite
actions/setup-python v4 composite

.github/workflows/mloperator.yml actions

actions/checkout v4 composite
actions/setup-go v4 composite
helm/kind-action v1.8.0 composite

.github/workflows/traceml.yml actions

actions/checkout v4 composite
actions/setup-python v4 composite

polyaxon

Science Score: 44.0%

Keywords

Keywords from Contributors

Repository

Basic Info

Statistics

Topics

Metadata Files

README.md

Reproduce, Automate, Scale your data science

Install

TL;DR;

Install Polyaxon CLI

Create a namespace

Add Polyaxon charts repo

Deploy Polyaxon

Access API

Quick start

TL;DR;

Create a project

Upload code and start experiments

Start Polyaxon dashboard

Distributed job

Hyperparameters tuning

Parallel executions

DAGs and workflows

Architecture

Documentation

Dashboard

Project status

Contributions

Research

Owner

Citation (CITATION)

GitHub Events

Total

Last Year

Committers

All Time

Past Year

Top Committers

Committer Domains (Top 20 + Academic)

Issues and Pull Requests

All Time

Past Year

Top Authors

Issue Authors

Pull Request Authors

Top Labels

Issue Labels

Pull Request Labels

Packages

pypi.org: polyaxon

Rankings

Maintainers (2)

proxy.golang.org: github.com/polyaxon/polyaxon/sdks

Rankings

proxy.golang.org: github.com/polyaxon/polyaxon

Rankings

pypi.org: polyaxon-deploy

Rankings

Maintainers (2)

proxy.golang.org: github.com/polyaxon/polyaxon/operator

Rankings

pypi.org: polyai

Rankings

Maintainers (1)

pypi.org: polyml

Rankings

Maintainers (1)

pypi.org: polyx

Rankings

Maintainers (1)

Dependencies