Data

Tools

Indexes

Applications

Experiments

Open Source Science

https://github.com/kubeflow/pipelines

Machine Learning Pipelines for Kubeflow

https://github.com/kubeflow/pipelines

Science Score: 36.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ○
    CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ○
    DOI references
  • ○
    Academic publication links
  • ✓
    Committers with academic emails
    8 of 466 committers (1.7%) from academic institutions
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (14.0%) to scientific vocabulary

Keywords

data-science kubeflow kubeflow-pipelines kubernetes machine-learning mlops pipeline

Keywords from Contributors

jax distributed automl neural-architecture-search hyperparameter-tuning huggingface langchain deep-neural-networks agents transformers
Last synced: 6 months ago · JSON representation

Repository

Machine Learning Pipelines for Kubeflow

Basic Info
Statistics
  • Stars: 3,922
  • Watchers: 102
  • Forks: 1,778
  • Open Issues: 294
  • Releases: 171
Topics
data-science kubeflow kubeflow-pipelines kubernetes machine-learning mlops pipeline
Created almost 8 years ago · Last pushed 6 months ago
Metadata Files
Readme Changelog Contributing License Security Roadmap Authors

README.md

Kubeflow Pipelines

Coverage Status SDK Documentation Status SDK Package version SDK Supported Python versions OpenSSF Best Practices Ask DeepWiki

Overview of the Kubeflow pipelines service

Kubeflow is a machine learning (ML) toolkit that is dedicated to making deployments of ML workflows on Kubernetes simple, portable, and scalable.

Kubeflow pipelines are reusable end-to-end ML workflows built using the Kubeflow Pipelines SDK.

The Kubeflow pipelines service has the following goals:

  • End to end orchestration: enabling and simplifying the orchestration of end to end machine learning pipelines
  • Easy experimentation: making it easy for you to try numerous ideas and techniques, and manage your various trials/experiments.
  • Easy re-use: enabling you to re-use components and pipelines to quickly cobble together end to end solutions, without having to re-build each time.

Installation

  • Kubeflow Pipelines can be installed as part of the Kubeflow Platform. Alternatively you can deploy Kubeflow Pipelines as a standalone service.

  • The Docker container runtime has been deprecated on Kubernetes 1.20+. Kubeflow Pipelines has switched to use Emissary Executor by default from Kubeflow Pipelines 1.8. Emissary executor is Container runtime agnostic, meaning you are able to run Kubeflow Pipelines on Kubernetes cluster with any Container runtimes.

Dependencies Compatibility Matrix

| Dependency | Versions | | -------------- | ---------- | | Argo Workflows | v3.5, v3.6 | | MySQL | v8 |

Documentation

Get started with your first pipeline and read further information in the Kubeflow Pipelines overview.

See the various ways you can use the Kubeflow Pipelines SDK.

See the Kubeflow Pipelines API doc for API specification.

Consult the Python SDK reference docs when writing pipelines using the Python SDK.

Deep Wiki

Check out our AI Powered repo documentation on DeepWiki.

:warning: Please note, this is AI generated and may not have completely accurate information.

Contributing to Kubeflow Pipelines

Before you start contributing to Kubeflow Pipelines, read the guidelines in How to Contribute. To learn how to build and deploy Kubeflow Pipelines from source code, read the developer guide.

Kubeflow Pipelines Community

Community Meeting

The Kubeflow Pipelines Community Meeting occurs every other Wed 10-11AM (PST).

Calendar Invite

Direct Meeting Link

Meeting notes

Slack

We also have a slack channel (#kubeflow-pipelines) on the Cloud Native Computing Foundation Slack workspace. You can find more details at https://www.kubeflow.org/docs/about/community/#kubeflow-slack-channels

Architecture

Details about the KFP Architecture can be found at Architecture.md

Blog posts

Acknowledgments

Kubeflow pipelines uses Argo Workflows by default under the hood to orchestrate Kubernetes resources. The Argo community has been very supportive and we are very grateful.

Owner

  • Name: Kubeflow
  • Login: kubeflow
  • Kind: organization

Kubeflow is an open, community driven project to make it easy to deploy and manage an ML stack on Kubernetes

Committers

Last synced: 9 months ago

All Time
  • Total Commits: 6,278
  • Total Committers: 466
  • Avg Commits per committer: 13.472
  • Development Distribution Score (DDS): 0.902
Past Year
  • Commits: 455
  • Committers: 79
  • Avg Commits per committer: 5.759
  • Development Distribution Score (DDS): 0.881
Top Committers
Name Email Commits
Alexey Volkov a****v@a****m 614
Yuan (Bob) Gong g****4@g****m 522
Chen Sun c****n 478
Connor McCarthy m****s@g****m 465
Googler n****y@g****m 366
IronPan y****a@g****m 319
Ning n****o@g****m 183
Jiaxiao Zheng j****g@g****m 177
James Liu 3****y 157
sina chavoshi s****i@g****m 109
Joe Li 5****i 100
dependabot[bot] 4****] 99
hongye-sun 4****n 98
Riley Bauer 3****r 87
jingzhang36 j****z@g****m 81
You Quan Chong y****g@g****m 81
Ajay Gopinathan a****n@g****m 74
Jason Dai j****i@g****m 71
gkcalat 3****t 59
Humair Khan H****K 58
Kevin Naughton k****n@g****m 58
Helber Belmiro h****o@g****m 55
Yasser Elsayed y****m 53
Yaqi Ji j****2@g****m 48
Michael Hu h****l@g****m 47
Niklas Hansson n****n@g****m 47
Lingqing Gan l****n@g****m 47
Pascal Vicaire 2****e 46
Rui Fang 3****i 45
Renmin r****o 44
and 436 more...
Committer Domains (Top 20 + Academic)
google.com: 43 redhat.com: 9 amazon.com: 7 us.ibm.com: 4 ibm.com: 3 arrikto.com: 3 qq.com: 3 cn.ibm.com: 3 163.com: 3 microsoft.com: 2 vmware.com: 2 il.ibm.com: 2 nutanix.com: 2 whitesourcesoftware.com: 1 mercari.com: 1 student.uva.nl: 1 iguaz.io: 1 provectus.com: 1 d2iq.com: 1 lilida.org: 1 utexas.edu: 1 berkeley.edu: 1 umich.edu: 1 hmc.edu: 1

Issues and Pull Requests

Last synced: 6 months ago

All Time
  • Total issues: 1,435
  • Total pull requests: 3,121
  • Average time to close issues: over 1 year
  • Average time to close pull requests: 4 months
  • Total issue authors: 724
  • Total pull request authors: 270
  • Average comments per issue: 4.78
  • Average comments per pull request: 4.56
  • Merged pull requests: 1,555
  • Bot issues: 7
  • Bot pull requests: 1,183
Past Year
  • Issues: 282
  • Pull requests: 1,104
  • Average time to close issues: about 1 month
  • Average time to close pull requests: 11 days
  • Issue authors: 143
  • Pull request authors: 105
  • Average comments per issue: 0.89
  • Average comments per pull request: 3.65
  • Merged pull requests: 666
  • Bot issues: 1
  • Bot pull requests: 179
View more stats
Top Authors
Issue Authors
  • hbelmiro (77)
  • Bobgy (54)
  • chensun (36)
  • HumairAK (34)
  • Ark-kun (19)
  • zijianjoy (17)
  • axel7083 (15)
  • Linchin (15)
  • droctothorpe (15)
  • rimolive (15)
  • DharmitD (14)
  • gkcalat (14)
  • mprahl (13)
  • thesuperzapper (13)
  • connor-mccarthy (11)
Pull Request Authors
  • copybara-service[bot] (881)
  • dependabot[bot] (302)
  • HumairAK (161)
  • connor-mccarthy (140)
  • hbelmiro (122)
  • chensun (106)
  • mprahl (98)
  • Tomcli (52)
  • Ark-kun (49)
  • VaniHaripriya (45)
  • DharmitD (45)
  • droctothorpe (44)
  • rimolive (42)
  • gregsheremeta (32)
  • dandawg (32)
Top Labels
Issue Labels
kind/bug (720) lifecycle/stale (645) kind/feature (417) area/backend (354) area/sdk (282) area/frontend (152) lifecycle/frozen (100) status/triaged (59) help wanted (57) area/components (48) area/testing (43) priority/p2 (25) needs more info (23) priority/p1 (22) good first issue (15) kind/question (14) area/pipelines (13) area/samples (11) area/docs (11) kind/discussion (9) area/sdk/dsl (9) needs-ok-to-test (6) upstream_issue (5) area/sdk/components (5) size/L (4) size/XS (4) area/deployment/marketplace (4) status/backlog (4) kind/misc (4) Stale (3)
Pull Request Labels
needs-ok-to-test (1,208) lgtm (1,204) approved (1,148) size/XS (958) Stale (562) ok-to-test (552) size/S (511) size/L (498) size/M (451) dependencies (302) size/XXL (253) size/XL (199) javascript (154) do-not-merge/work-in-progress (145) cla: yes (124) ci-passed (117) python (107) do-not-merge/hold (78) lifecycle/stale (78) go (41) area/backend (13) area/components (12) area/sdk/components (9) lifecycle/frozen (8) cherrypick-approved (7) cla: no (7) area/testing (6) area/deployment/marketplace (6) cherrypicked (5) area/sdk/dsl/compiler (4)

Packages

  • Total packages: 19
  • Total downloads:
    • pypi 20,828,246 last-month
  • Total docker downloads: 3,863,794
  • Total dependent packages: 85
    (may contain duplicates)
  • Total dependent repositories: 1,194
    (may contain duplicates)
  • Total versions: 1,017
  • Total maintainers: 10
pypi.org: kfp

Kubeflow Pipelines SDK

  • Versions: 146
  • Dependent Packages: 48
  • Dependent Repositories: 714
  • Downloads: 10,507,383 Last month
  • Docker Downloads: 2,829,353
Rankings
Downloads: 0.1%
Dependent packages count: 0.4%
Dependent repos count: 0.5%
Average: 0.7%
Docker downloads count: 0.9%
Forks count: 1.1%
Stargazers count: 1.3%
Maintainers (2)
google_opensource kubeflow-pipelines
Last synced: 6 months ago
pypi.org: kfp-server-api

Kubeflow Pipelines API

  • Versions: 84
  • Dependent Packages: 6
  • Dependent Repositories: 235
  • Downloads: 4,036,000 Last month
  • Docker Downloads: 505,400
Rankings
Downloads: 0.1%
Docker downloads count: 0.9%
Dependent repos count: 1.0%
Average: 1.1%
Forks count: 1.1%
Stargazers count: 1.3%
Dependent packages count: 1.9%
Maintainers (2)
kubeflow-pipelines AlexeyVolkov
Last synced: 6 months ago
pypi.org: kfp-pipeline-spec

Kubeflow Pipelines pipeline spec

  • Versions: 28
  • Dependent Packages: 6
  • Dependent Repositories: 143
  • Downloads: 5,059,252 Last month
  • Docker Downloads: 497,535
Rankings
Downloads: 0.1%
Docker downloads count: 0.9%
Forks count: 1.1%
Average: 1.2%
Dependent repos count: 1.3%
Stargazers count: 1.3%
Dependent packages count: 2.4%
Maintainers (1)
kubeflow-pipelines
Last synced: 6 months ago
proxy.golang.org: github.com/kubeflow/pipelines/api
  • Versions: 0
  • Dependent Packages: 5
  • Dependent Repositories: 38
  • Docker Downloads: 1,057
Rankings
Forks count: 0.6%
Dependent repos count: 0.9%
Stargazers count: 1.2%
Docker downloads count: 1.3%
Average: 1.3%
Dependent packages count: 2.5%
Last synced: 6 months ago
proxy.golang.org: github.com/kubeflow/pipelines/third_party/ml-metadata
  • Versions: 0
  • Dependent Packages: 3
  • Dependent Repositories: 22
  • Docker Downloads: 1,010
Rankings
Forks count: 0.6%
Dependent repos count: 1.2%
Stargazers count: 1.2%
Docker downloads count: 1.3%
Average: 1.5%
Dependent packages count: 3.4%
Last synced: 6 months ago
proxy.golang.org: github.com/kubeflow/pipelines
  • Versions: 1
  • Dependent Packages: 5
  • Dependent Repositories: 2
  • Docker Downloads: 28,717
Rankings
Forks count: 0.7%
Docker downloads count: 0.8%
Stargazers count: 1.2%
Average: 1.7%
Dependent packages count: 2.5%
Dependent repos count: 3.5%
Last synced: 6 months ago
pypi.org: google-cloud-pipeline-components

This SDK enables a set of First Party (Google owned) pipeline components that allow users to take their experience from Vertex AI SDK and other Google Cloud services and create a corresponding pipeline using KFP or Managed Pipelines.

  • Versions: 104
  • Dependent Packages: 2
  • Dependent Repositories: 28
  • Downloads: 1,140,102 Last month
  • Docker Downloads: 97
Rankings
Downloads: 0.6%
Forks count: 1.1%
Stargazers count: 1.3%
Average: 2.0%
Dependent repos count: 2.7%
Docker downloads count: 2.9%
Dependent packages count: 3.2%
Maintainers (1)
google-cloud-components-pypi
Last synced: 6 months ago
proxy.golang.org: github.com/kubeflow/pipelines/kubernetes_platform
  • Versions: 551
  • Dependent Packages: 1
  • Dependent Repositories: 1
  • Docker Downloads: 320
Rankings
Forks count: 0.6%
Stargazers count: 1.2%
Docker downloads count: 2.2%
Average: 2.9%
Dependent repos count: 4.7%
Dependent packages count: 5.8%
Last synced: 6 months ago
proxy.golang.org: github.com/kubeflow/pipelines/v2
  • Versions: 0
  • Dependent Packages: 0
  • Dependent Repositories: 2
  • Docker Downloads: 74
Rankings
Forks count: 0.6%
Stargazers count: 1.2%
Docker downloads count: 1.7%
Average: 3.3%
Dependent repos count: 3.5%
Dependent packages count: 9.6%
Last synced: 6 months ago
proxy.golang.org: github.com/kubeflow/pipelines/test/tools/project-cleaner
  • Versions: 0
  • Dependent Packages: 0
  • Dependent Repositories: 0
Rankings
Forks count: 0.5%
Stargazers count: 1.1%
Average: 4.5%
Dependent packages count: 7.0%
Dependent repos count: 9.3%
Last synced: 6 months ago
pypi.org: kfp-dsl

A KFP SDK subpackage containing the DSL and runtime code.

  • Versions: 3
  • Dependent Packages: 0
  • Dependent Repositories: 1
  • Downloads: 14,389 Last month
  • Docker Downloads: 223
Rankings
Forks count: 1.1%
Stargazers count: 1.3%
Docker downloads count: 2.4%
Downloads: 3.4%
Average: 6.7%
Dependent packages count: 10.1%
Dependent repos count: 21.5%
Maintainers (4)
kubeflow-pipelines humairak chesu droctothorpe
Last synced: 6 months ago
pypi.org: kfp-kubernetes

Kubernetes platform configuration library and generated protos.

  • Versions: 8
  • Dependent Packages: 3
  • Dependent Repositories: 0
  • Downloads: 70,876 Last month
  • Docker Downloads: 8
Rankings
Forks count: 1.1%
Stargazers count: 1.3%
Dependent packages count: 7.1%
Average: 10.0%
Dependent repos count: 30.3%
Maintainers (1)
kubeflow-pipelines
Last synced: 6 months ago
conda-forge.org: kfp

Kubeflow is a machine learning (ML) toolkit that is dedicated to making deployments of ML workflows on Kubernetes simple, portable, and scalable. Kubeflow pipelines are reusable end-to-end ML workflows built using the Kubeflow Pipelines SDK.

  • Versions: 58
  • Dependent Packages: 4
  • Dependent Repositories: 2
Rankings
Forks count: 4.0%
Stargazers count: 7.2%
Average: 11.0%
Dependent packages count: 12.5%
Dependent repos count: 20.3%
Last synced: 6 months ago
pypi.org: pytorch-kfp-components

PyTorch Kubeflow Pipeline

  • Versions: 3
  • Dependent Packages: 0
  • Dependent Repositories: 1
  • Downloads: 36 Last month
Rankings
Forks count: 1.1%
Stargazers count: 1.3%
Dependent packages count: 10.1%
Average: 14.3%
Dependent repos count: 21.5%
Downloads: 37.5%
Maintainers (1)
chauhang
Last synced: 6 months ago
conda-forge.org: kfp-server-api

Generated python client for the KF Pipelines server API

  • Versions: 20
  • Dependent Packages: 1
  • Dependent Repositories: 2
Rankings
Forks count: 4.0%
Stargazers count: 7.2%
Average: 15.1%
Dependent repos count: 20.3%
Dependent packages count: 29.0%
Last synced: 6 months ago
conda-forge.org: kfp-pipeline-spec
  • Versions: 6
  • Dependent Packages: 1
  • Dependent Repositories: 2
Rankings
Forks count: 4.0%
Stargazers count: 7.2%
Average: 15.1%
Dependent repos count: 20.3%
Dependent packages count: 29.0%
Last synced: 6 months ago
pypi.org: mongs-kfp

KubeFlow Pipelines SDK

  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 1
  • Downloads: 6 Last month
Rankings
Forks count: 1.1%
Stargazers count: 1.3%
Dependent packages count: 10.1%
Dependent repos count: 21.5%
Average: 21.8%
Downloads: 75.1%
Maintainers (1)
hoochimong
Last synced: 6 months ago
pypi.org: humair-test-pkg

Kubeflow Pipelines SDK

  • Versions: 3
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 11 Last month
Rankings
Dependent packages count: 10.1%
Average: 33.4%
Dependent repos count: 56.8%
Maintainers (1)
humairak
Last synced: 6 months ago
pypi.org: kfp-leinao

Kubeflow Pipelines SDK

  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 191 Last month
Rankings
Dependent packages count: 9.4%
Average: 35.8%
Dependent repos count: 62.1%
Maintainers (1)
kingstone95
Last synced: 6 months ago

Dependencies

.github/workflows/stale.yml actions
  • actions/stale v5 composite
backend/Dockerfile docker
  • debian stable build
  • golang 1.20.4-buster build
  • python 3.7 build
backend/api/Dockerfile docker
  • golang 1.15.10 build
backend/metadata_writer/Dockerfile docker
  • python 3.8 build
backend/src/cache/deployer/Dockerfile docker
  • gcr.io/google.com/cloudsdktool/google-cloud-cli alpine build
backend/src/v2/test/Dockerfile docker
  • python 3.7-slim build
components/aws/athena/Dockerfile docker
  • ubuntu 16.04 build
components/aws/emr/Dockerfile docker
  • ubuntu 16.04 build
components/aws/sagemaker/Dockerfile docker
  • public.ecr.aws/amazonlinux/amazonlinux 2 build
components/aws/sagemaker/tests/integration_tests/Dockerfile docker
  • public.ecr.aws/lts/ubuntu 18.04_stable build
components/aws/sagemaker/tests/unit_tests/Dockerfile docker
  • public.ecr.aws/amazonlinux/amazonlinux 2 build
components/azure/azuredevops/queue-pipeline/Dockerfile docker
  • python 3.7-slim build
components/azure/azureml/aml-register-model/Dockerfile docker
  • python 3.7-slim build
components/azure/azuresynapse/runsparkjob/Dockerfile docker
  • mcr.microsoft.com/azure-cli latest build
components/contrib/arena/docker/Dockerfile docker
  • golang 1.10-stretch build
  • python 3.7-alpine3.9 build
components/contrib/openvino/model_convert/containers/Dockerfile docker
  • ubuntu 16.04 build
go.mod go
  • github.com/Masterminds/squirrel v0.0.0-20190107164353-fa735ea14f09
  • github.com/VividCortex/mysqlerr v0.0.0-20170204212430-6c6b55f8796f
  • github.com/argoproj/argo-workflows/v3 v3.3.10
  • github.com/aws/aws-sdk-go v1.42.50
  • github.com/cenkalti/backoff v2.2.1+incompatible
  • github.com/eapache/go-resiliency v1.2.0
  • github.com/elazarl/goproxy v0.0.0-20181111060418-2ce16c963a8a
  • github.com/emicklei/go-restful v2.16.0+incompatible
  • github.com/erikstmartin/go-testdb v0.0.0-20160219214506-8d10e4a1bae5
  • github.com/fsnotify/fsnotify v1.5.1
  • github.com/go-openapi/errors v0.20.2
  • github.com/go-openapi/runtime v0.21.1
  • github.com/go-openapi/strfmt v0.21.1
  • github.com/go-openapi/swag v0.19.15
  • github.com/go-openapi/validate v0.20.3
  • github.com/go-sql-driver/mysql v1.6.0
  • github.com/golang/glog v1.0.0
  • github.com/golang/protobuf v1.5.2
  • github.com/google/addlicense v0.0.0-20200906110928-a0294312aa76
  • github.com/google/cel-go v0.9.0
  • github.com/google/go-cmp v0.5.7
  • github.com/google/uuid v1.3.0
  • github.com/gorilla/mux v1.8.0
  • github.com/grpc-ecosystem/go-grpc-middleware v1.3.0
  • github.com/grpc-ecosystem/grpc-gateway v1.16.0
  • github.com/jackc/pgx/v5 v5.4.2
  • github.com/jinzhu/gorm v1.9.1
  • github.com/jinzhu/inflection v1.0.0
  • github.com/jinzhu/now v1.1.4
  • github.com/kubeflow/pipelines/api v0.0.0-20230331215358-758c91f76784
  • github.com/kubeflow/pipelines/kubernetes_platform v0.0.0-20230404213301-bd9f74e34de6
  • github.com/kubeflow/pipelines/third_party/ml-metadata v0.0.0-20230810215105-e1f0c010f800
  • github.com/lestrrat-go/strftime v1.0.4
  • github.com/mattn/go-sqlite3 v1.14.16
  • github.com/minio/minio-go/v6 v6.0.57
  • github.com/peterhellberg/duration v0.0.0-20191119133758-ec6baeebcd10
  • github.com/pkg/errors v0.9.1
  • github.com/prometheus/client_golang v1.12.1
  • github.com/robfig/cron v1.2.0
  • github.com/sirupsen/logrus v1.8.1
  • github.com/spf13/viper v1.10.1
  • github.com/stretchr/testify v1.8.1
  • gocloud.dev v0.22.0
  • golang.org/x/net v0.10.0
  • google.golang.org/genproto v0.0.0-20220310185008-1973136f34c6
  • google.golang.org/grpc v1.44.0
  • google.golang.org/grpc/cmd/protoc-gen-go-grpc v1.1.0
  • google.golang.org/protobuf v1.27.1
  • gopkg.in/yaml.v3 v3.0.1
  • k8s.io/api v0.24.3
  • k8s.io/apimachinery v0.24.3
  • k8s.io/client-go v0.24.3
  • k8s.io/code-generator v0.23.3
  • k8s.io/kubernetes v0.17.9
  • k8s.io/kubernetes=>k8s.io/kubernetes v1.11.1
  • sigs.k8s.io/controller-runtime v0.11.1
  • sigs.k8s.io/controller-tools=>sigs.k8s.io/controller-tools v0.2.9
  • sigs.k8s.io/yaml v1.3.0
go.sum go
  • 2032 dependencies
components/contrib/openvino/ovms-deployer/containers/Dockerfile docker
  • intelpython/intelpython3_core latest build
components/contrib/openvino/predict/containers/Dockerfile docker
  • ubuntu 16.04 build
components/contrib/openvino/tf-slim/containers/Dockerfile docker
  • intelpython/intelpython3_core latest build
components/contrib/presto/query/Dockerfile docker
  • python 3.7 build
components/contrib/sample/keras/train_classifier/Dockerfile docker
  • tensorflow/tensorflow $BASE_IMAGE_TAG build
components/google-cloud/Dockerfile docker
  • marketplace.gcr.io/google/ubuntu2004 latest build
components/ibm-components/commons/config/Dockerfile docker
  • python 3.6-slim build
components/ibm-components/ffdl/serve/Dockerfile docker
  • python 3.6-slim build
components/ibm-components/ffdl/train/Dockerfile docker
  • python 3.6-slim build
components/ibm-components/spark/data_preprocess_spark/Dockerfile docker
  • aipipeline/pyspark spark-2.1 build
components/ibm-components/spark/store_spark_model/Dockerfile docker
  • aipipeline/pyspark spark-2.1 build
components/ibm-components/spark/train_spark/Dockerfile docker
  • python 3.6.8-stretch build
components/ibm-components/watson/deploy/Dockerfile docker
  • python 3.6-slim build
components/ibm-components/watson/manage/monitor_fairness/Dockerfile docker
  • python 3.6.8-stretch build
components/ibm-components/watson/manage/monitor_quality/Dockerfile docker
  • python 3.6.8-stretch build
components/ibm-components/watson/manage/subscribe/Dockerfile docker
  • python 3.6.8-stretch build
components/ibm-components/watson/store/Dockerfile docker
  • python 3.6-slim build
components/ibm-components/watson/train/Dockerfile docker
  • python 3.6-slim build
components/kserve/Dockerfile docker
  • python 3.9-slim-bullseye build
components/kubeflow/deployer/Dockerfile docker
  • debian latest build
components/kubeflow/dnntrainer/Dockerfile docker
  • tensorflow/tensorflow $TF_TAG build
components/kubeflow/katib-launcher/Dockerfile docker
  • python 3.6 build
components/kubeflow/kfserving/Dockerfile docker
  • python 3.6-slim build
components/kubeflow/launcher/Dockerfile docker
  • python 3.6 build
components/kubeflow/pytorch-launcher/Dockerfile docker
  • python 3.6 build
components/local/base/Dockerfile docker
  • python 3.7 build
components/local/confusion_matrix/Dockerfile docker
  • ml-pipeline-local-base latest build
components/local/roc/Dockerfile docker
  • ml-pipeline-local-base latest build
frontend/Dockerfile docker
  • node 14.21.3 build
  • node 14.21.3-alpine3.17 build
manifests/gcp_marketplace/deployer/Dockerfile docker
  • gcr.io/cloud-marketplace-tools/k8s/deployer_helm/onbuild 0.11.3 build
proxy/Dockerfile docker
  • gcr.io/inverting-proxy/agent@sha256 694d6c1bf299585b530c923c3728cd2c45083f3b396ec83ff799cef1c9dc7474 build
samples/contrib/image-captioning-gcp/src/Dockerfile docker
  • tensorflow/tensorflow 2.0.0b0-py3 build
samples/contrib/nvidia-resnet/components/inference_server_launcher/Dockerfile docker
  • ubuntu 16.04 build
samples/contrib/nvidia-resnet/components/preprocess/Dockerfile docker
  • nvcr.io/nvidia/tensorflow 19.03-py3 build
samples/contrib/nvidia-resnet/components/train/Dockerfile docker
  • nvcr.io/nvidia/tensorflow 19.03-py3 build
samples/contrib/nvidia-resnet/components/webapp/Dockerfile docker
  • base-trtis-client latest build
samples/contrib/nvidia-resnet/components/webapp_launcher/Dockerfile docker
  • ubuntu 16.04 build
samples/contrib/nvidia-resnet/pipeline/Dockerfile docker
  • python 3.6 build
samples/contrib/pytorch-samples/Dockerfile docker
  • ${BASE_IMAGE} latest build
samples/contrib/pytorch-samples/common/tensorboard/Dockerfile docker
  • gcr.io/deeplearning-platform-release/tf2-cpu.2-2 latest build
samples/contrib/versioned-pipeline-ci-samples/helloworld-ci-sample/helloworld/Dockerfile docker
  • python 3 build
samples/contrib/versioned-pipeline-ci-samples/kaggle-ci-sample/download_dataset/Dockerfile docker
  • python 3.7 build
samples/contrib/versioned-pipeline-ci-samples/kaggle-ci-sample/submit_result/Dockerfile docker
  • python 3.7 build
samples/contrib/versioned-pipeline-ci-samples/kaggle-ci-sample/train_model/Dockerfile docker
  • python 3.7 build
samples/contrib/versioned-pipeline-ci-samples/kaggle-ci-sample/visualize_html/Dockerfile docker
  • tensorflow/tensorflow 2.0.0-py3 build
samples/contrib/versioned-pipeline-ci-samples/kaggle-ci-sample/visualize_table/Dockerfile docker
  • python 3.7 build
samples/contrib/versioned-pipeline-ci-samples/mnist-ci-sample/tensorboard/Dockerfile docker
  • python 3.7-slim build
samples/contrib/versioned-pipeline-ci-samples/mnist-ci-sample/train/Dockerfile docker
  • tensorflow/tensorflow 2.0.0-py3 build
test/api-integration-test/Dockerfile docker
  • golang 1.20.4 build
test/frontend-integration-test/Dockerfile docker
  • gcr.io/ml-pipeline-test/selenium-standalone-chrome-gcloud-nodejs v20230322-2.0.0b11-144-g87e1c5fcf-dirty-2ca4f7 build
test/frontend-integration-test/selenium-standalone-chrome-gcloud-nodejs.Docker/Dockerfile docker
  • selenium/standalone-chrome 110.0.5481.177-chromedriver-110.0.5481.77 build
test/imagebuilder/Dockerfile docker
  • google/cloud-sdk 279.0.0 build
test/images/Dockerfile docker
  • gcr.io/k8s-testimages/kubekins-e2e v20200204-8eefa86-master build
test/initialization-test/Dockerfile docker
  • golang 1.20.4 build
test/sample-test/Dockerfile docker
  • google/cloud-sdk 352.0.0 build
third_party/metadata_envoy/Dockerfile docker
  • envoyproxy/envoy v1.12.2 build
third_party/minio/Dockerfile docker
  • alpine latest build
  • minio/minio RELEASE.2019-08-14T20-37-41Z build
tools/bazel_builder/Dockerfile docker
  • gcr.io/cloud-marketplace/google/rbe-ubuntu16-04@sha256 69c9f1652941d64a46f6f7358a44c1718f25caa5cb1ced4a58ccc5281cd183b5 build
api/go.mod go
  • google.golang.org/genproto v0.0.0-20211026145609-4688e4c4e024
  • google.golang.org/protobuf v1.27.1
api/go.sum go
  • 118 dependencies
kubernetes_platform/go.mod go
  • google.golang.org/genproto v0.0.0-20211026145609-4688e4c4e024
  • google.golang.org/protobuf v1.27.1
test/tools/project-cleaner/go.mod go
  • cloud.google.com/go v0.89.0
  • github.com/golang/groupcache v0.0.0-20210331224755-41bb18bfe9da
  • golang.org/x/net v0.0.0-20210726213435-c6fcb2dbf985
  • google.golang.org/api v0.52.0
  • google.golang.org/genproto v0.0.0-20210729151513-df9385d47c1b
  • gopkg.in/yaml.v2 v2.4.0
test/tools/project-cleaner/go.sum go
  • 516 dependencies
third_party/ml-metadata/go.mod go
  • golang.org/x/net v0.0.0-20211216030914-fe4d6282115f
  • golang.org/x/sys v0.0.0-20211216021012-1d35b9e2eb4e
  • golang.org/x/text v0.3.7
  • google.golang.org/genproto v0.0.0-20211221231510-d629cc9a93d5
  • google.golang.org/grpc v1.43.0
  • google.golang.org/protobuf v1.27.1
third_party/ml-metadata/go.sum go
  • 132 dependencies
components/google-cloud/docs/source/versions.json meteor
frontend/mock-backend/package-lock.json npm
  • @types/body-parser 1.17.0
  • @types/connect 3.4.32
  • @types/events 1.2.0
  • @types/express 4.16.0
  • @types/express-serve-static-core 4.16.0
  • @types/mime 2.0.0
  • @types/node 10.11.6
  • @types/range-parser 1.2.2
  • @types/serve-static 1.13.2
  • accepts 1.3.8
  • array-flatten 1.1.1
  • body-parser 1.19.2
  • bytes 3.1.2
  • content-disposition 0.5.4
  • content-type 1.0.4
  • cookie 0.4.2
  • cookie-signature 1.0.6
  • debug 2.6.9
  • depd 1.1.2
  • destroy 1.0.4
  • ee-first 1.1.1
  • encodeurl 1.0.2
  • escape-html 1.0.3
  • etag 1.8.1
  • express 4.17.3
  • finalhandler 1.1.2
  • forwarded 0.2.0
  • fresh 0.5.2
  • http-errors 1.8.1
  • iconv-lite 0.4.24
  • inherits 2.0.4
  • ipaddr.js 1.9.1
  • media-typer 0.3.0
  • merge-descriptors 1.0.1
  • methods 1.1.2
  • mime 1.6.0
  • mime-db 1.52.0
  • mime-types 2.1.35
  • ms 2.1.3
  • ms 2.0.0
  • negotiator 0.6.3
  • on-finished 2.3.0
  • parseurl 1.3.3
  • path-to-regexp 0.1.7
  • proxy-addr 2.0.7
  • qs 6.9.7
  • range-parser 1.2.1
  • raw-body 2.4.3
  • safe-buffer 5.2.1
  • safer-buffer 2.1.2
  • send 0.17.2
  • serve-static 1.14.2
  • setprototypeof 1.2.0
  • statuses 1.5.0
  • toidentifier 1.0.1
  • type-is 1.6.18
  • unpipe 1.0.0
  • utils-merge 1.0.1
  • vary 1.1.2
frontend/mock-backend/package.json npm
  • @types/express ^4.16.0
  • express ^4.16.3
frontend/package-lock.json npm
  • 2487 dependencies
frontend/package.json npm
  • @google-cloud/storage ^4.1.3 development
  • @storybook/addon-actions ^6.3.6 development
  • @storybook/addon-essentials ^6.3.6 development
  • @storybook/addon-links ^6.3.6 development
  • @storybook/node-logger ^6.3.6 development
  • @storybook/preset-create-react-app ^3.2.0 development
  • @storybook/react ^6.3.6 development
  • @testing-library/dom ^8.6.0 development
  • @testing-library/react ^11.2.6 development
  • @testing-library/user-event ^13.2.1 development
  • @types/d3 ^5.0.0 development
  • @types/d3-dsv ^1.0.33 development
  • @types/dagre ^0.7.40 development
  • @types/enzyme ^3.10.3 development
  • @types/enzyme-adapter-react-16 ^1.0.5 development
  • @types/express ^4.16.0 development
  • @types/google-protobuf ^3.7.2 development
  • @types/http-proxy-middleware ^0.17.5 development
  • @types/jest ^27.5.1 development
  • @types/js-yaml ^3.12.3 development
  • @types/lodash >=4.14.117 development
  • @types/markdown-to-jsx ^6.9.0 development
  • @types/node ^10.17.60 development
  • @types/prettier ^1.19.0 development
  • @types/react ^16.9.22 development
  • @types/react-dom ^16.9.5 development
  • @types/react-router-dom ^4.3.1 development
  • @types/react-test-renderer ^16.0.2 development
  • @types/react-virtualized ^9.18.7 development
  • autoprefixer ^10.4.1 development
  • browserslist 4.16.5 development
  • coveralls ^3.0.2 development
  • enzyme ^3.10.0 development
  • enzyme-adapter-react-16 ^1.15.1 development
  • enzyme-to-json ^3.3.4 development
  • fs 0.0.1-security development
  • jest-environment-jsdom-sixteen ^2.0.0 development
  • postcss ^8.4.5 development
  • prettier 1.19.1 development
  • react-router-test-context ^0.1.0 development
  • react-scripts ^5.0.0 development
  • react-test-renderer ^16.5.2 development
  • snapshot-diff ^0.6.1 development
  • swagger-ts-client ^0.9.6 development
  • tailwindcss ^3.0.11 development
  • ts-node ^7.0.1 development
  • ts-node-dev ^1.1.8 development
  • tsconfig-paths ^3.10.1 development
  • tslint-config-prettier ^1.18.0 development
  • typescript ^3.8.3 development
  • webpack-bundle-analyzer ^3.6.1 development
  • yaml ^2.2.2 development
  • @craco/craco ^6.2.0
  • @material-ui/core ^3.9.1
  • @material-ui/icons ^3.0.1
  • @types/lodash.groupby ^4.6.6
  • @types/pako ^1.0.3
  • brace ^0.11.1
  • d3 ^5.7.0
  • d3-dsv ^1.0.10
  • dagre ^0.8.2
  • google-protobuf ^3.11.2
  • grpc-web ^1.2.1
  • http-proxy-middleware ^0.19.0
  • immer ^9.0.6
  • js-yaml ^3.14.1
  • lodash ^4.17.21
  • lodash.debounce ^4.0.8
  • lodash.flatten ^4.4.0
  • lodash.groupby ^4.6.0
  • lodash.isfunction ^3.0.9
  • markdown-to-jsx ^6.10.3
  • pako ^2.0.4
  • portable-fetch ^3.0.0
  • proto3-json-serializer ^0.1.6
  • protobufjs ~6.11.2
  • re-resizable ^4.9.0
  • react ^16.12.0
  • react-ace ^7.0.2
  • react-dom ^16.12.0
  • react-dropzone ^5.1.0
  • react-flow-renderer ^9.6.3
  • react-query ^3.16.0
  • react-router-dom ^4.3.1
  • react-svg-line-chart ^2.0.2
  • react-textarea-autosize ^8.3.3
  • react-virtualized ^9.20.1
  • react-vis ^1.11.2
  • request ^2.88.2
  • runtypes ^6.3.0
  • ts-proto ^1.95.0
  • typestyle ^2.0.4
frontend/server/package-lock.json npm
  • 747 dependencies
frontend/server/package.json npm
  • @types/crypto-js ^3.1.43 development
  • @types/express ^4.11.1 development
  • @types/gunzip-maybe ^1.4.0 development
  • @types/http-proxy-middleware ^0.19.3 development
  • @types/jest ^24.9.1 development
  • @types/minio ~7.0.3 development
  • @types/node ^14.14.20 development
  • @types/node-fetch ^2.1.2 development
  • @types/supertest ^2.0.8 development
  • @types/tar ^4.0.3 development
  • @types/tar-stream ^1.6.1 development
  • jest ^25.3.0 development
  • prettier 1.19.1 development
  • supertest ^4.0.2 development
  • ts-jest ^25.2.1 development
  • tslint ^5.20.1 development
  • typescript ^3.6.4 development
  • @aws-sdk/credential-providers ^3.359.0
  • @google-cloud/storage ^2.5.0
  • @kubernetes/client-node ^0.8.2
  • axios >=0.21.1
  • crypto-js ^3.1.8
  • express ^4.17.3
  • gunzip-maybe ^1.4.1
  • http-proxy-middleware ^0.18.0
  • lodash >=4.17.21
  • minio ~7.0.0
  • node-fetch ^2.6.7
  • peek-stream ^1.1.3
  • portable-fetch ^3.0.0
  • tar-stream ^2.1.0
package-lock.json npm
  • 230 dependencies
package.json npm
  • standard-version ^8.0.0 development
samples/contrib/pytorch-samples/package.json npm
  • npm ^8.11.0
  • yarn ^1.22.10
test/frontend-integration-test/package-lock.json npm
  • 470 dependencies
test/frontend-integration-test/package.json npm
  • @wdio/cli ^8.3.2
  • @wdio/junit-reporter ^8.3.0
  • @wdio/local-runner ^8.3.3
  • @wdio/mocha-framework ^8.3.0
  • @wdio/selenium-standalone-service ^8.3.2
  • @wdio/spec-reporter ^8.3.0
  • mocha ^10.2.0
  • wait-port ^1.0.4
  • webdriverio ^8.3.2
api/v2alpha1/python/setup.py pypi
  • protobuf >=3.13.0,<4
backend/api/v1beta1/python_http_client/requirements.txt pypi
  • certifi >=14.05.14
  • future *
  • python_dateutil >=2.5.3
  • setuptools >=21.0.0
  • six >=1.10
  • urllib3 >=1.15.1
backend/api/v1beta1/python_http_client/setup.py pypi
backend/api/v1beta1/python_http_client/test-requirements.txt pypi
  • pytest * test
  • pytest-cov >=2.8.1 test
  • pytest-randomly ==1.2.3 test
backend/api/v2beta1/python_http_client/requirements.txt pypi
  • certifi >=14.05.14
  • future *
  • python_dateutil >=2.5.3
  • setuptools >=21.0.0
  • six >=1.10
  • urllib3 >=1.15.1