cortex

Production infrastructure for machine learning at scale

https://github.com/cortexlabs/cortex

Science Score: 23.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
  • codemeta.json file
    Found codemeta.json file
  • .zenodo.json file
  • DOI references
  • Academic publication links
  • Committers with academic emails
    1 of 25 committers (4.0%) from academic institutions
  • Institutional organization owner
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (6.5%) to scientific vocabulary

Keywords

infrastructure machine-learning

Keywords from Contributors

transformer distributed embedded interactive serializer packaging network-simulation shellcodes hacking autograding
Last synced: 6 months ago · JSON representation

Repository

Production infrastructure for machine learning at scale

Basic Info
  • Host: GitHub
  • Owner: cortexlabs
  • License: apache-2.0
  • Language: Go
  • Default Branch: master
  • Homepage: https://cortexlabs.com/
  • Size: 11 MB
Statistics
  • Stars: 8,033
  • Watchers: 142
  • Forks: 607
  • Open Issues: 131
  • Releases: 63
Topics
infrastructure machine-learning
Created about 7 years ago · Last pushed over 1 year ago
Metadata Files
Readme Contributing License

README.md

DocsSlack



Note: This project is no longer actively maintained by its original authors.

Production infrastructure for machine learning at scale

Deploy, manage, and scale machine learning models in production.


Serverless workloads

Realtime - respond to requests in real-time and autoscale based on in-flight request volumes.

Async - process requests asynchronously and autoscale based on request queue length.

Batch - run distributed and fault-tolerant batch processing jobs on-demand.


Automated cluster management

Autoscaling - elastically scale clusters with CPU and GPU instances.

Spot instances - run workloads on spot instances with automated on-demand backups.

Environments - create multiple clusters with different configurations.


CI/CD and observability integrations

Provisioning - provision clusters with declarative configuration or a Terraform provider.

Metrics - send metrics to any monitoring tool or use pre-built Grafana dashboards.

Logs - stream logs to any log management tool or use the pre-built CloudWatch integration.


Built for AWS

EKS - Cortex runs on top of EKS to scale workloads reliably and cost-effectively.

VPC - deploy clusters into a VPC on your AWS account to keep your data private.

IAM - integrate with IAM for authentication and authorization workflows.

Owner

  • Name: Cortex Labs
  • Login: cortexlabs
  • Kind: organization
  • Email: hello@cortex.dev

GitHub Events

Total
  • Issues event: 1
  • Watch event: 56
  • Pull request event: 1
  • Fork event: 3
Last Year
  • Issues event: 1
  • Watch event: 56
  • Pull request event: 1
  • Fork event: 3

Committers

Last synced: 9 months ago

All Time
  • Total Commits: 2,326
  • Total Committers: 25
  • Avg Commits per committer: 93.04
  • Development Distribution Score (DDS): 0.45
Past Year
  • Commits: 0
  • Committers: 0
  • Avg Commits per committer: 0.0
  • Development Distribution Score (DDS): 0.0
Top Committers
Name Email Commits
David Eliahu d****u 1,279
Vishal Bollu v****u@g****m 396
Robert Lucian Chiriac r****c@g****m 254
Omer Spillinger o****r 220
Miguel Varela Ramos m****l@c****m 74
Ivan Zhang i****n@i****a 51
tim gretler g****m@g****m 10
Caleb Kaiser 4****r 7
Ivan Zhang i****s@g****m 6
Zou Nengren z****n@c****m 4
Jack Collins j****s@g****m 3
dependabot[bot] 4****] 3
Daniel Suess d****l@d****e 2
Miguel Varela Ramos m****2@g****m 2
Wing-Kam w****e@g****m 2
Zou Nengren z****9@g****m 2
ismaelc c****l@g****m 2
BlueWhale 6****o 2
Charles Bensimon c****n@g****m 1
Hassen Taidirt h****t@g****m 1
Arkin Dharawat a****2@i****u 1
Andrei Lapanik a****i@a****o 1
Kevin Huang 4****g 1
Yang Hau v****8@g****m 1
rbromley10 4****0 1
Committer Domains (Top 20 + Academic)

Issues and Pull Requests

Last synced: 6 months ago

All Time
  • Total issues: 58
  • Total pull requests: 51
  • Average time to close issues: 3 months
  • Average time to close pull requests: 6 days
  • Total issue authors: 27
  • Total pull request authors: 10
  • Average comments per issue: 1.33
  • Average comments per pull request: 0.75
  • Merged pull requests: 33
  • Bot issues: 0
  • Bot pull requests: 9
Past Year
  • Issues: 1
  • Pull requests: 2
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Issue authors: 1
  • Pull request authors: 1
  • Average comments per issue: 0.0
  • Average comments per pull request: 0.0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Top Authors
Issue Authors
  • RobertLucian (13)
  • deliahu (9)
  • vishalbollu (4)
  • BlueWhaleKo (4)
  • nellaG (3)
  • 17Ants (2)
  • creatorrr (2)
  • nyxfqq (2)
  • miguelvr (1)
  • dipen-epi (1)
  • riquellopes (1)
  • ratovarius (1)
  • ShantanuNair (1)
  • tfriedel (1)
  • benharvie (1)
Pull Request Authors
  • RobertLucian (15)
  • deliahu (13)
  • dependabot[bot] (9)
  • jackmpcollins (3)
  • AlexThondan (3)
  • tfriedel (3)
  • BlueWhaleKo (2)
  • ismaelc (1)
  • vishalbollu (1)
  • miguelvr (1)
Top Labels
Issue Labels
enhancement (23) bug (12) question (12) research (8) provisioning (2) metrics (2) good first issue (1) performance (1) AsyncAPI (1)
Pull Request Labels
dependencies (9) go (8) bug (7) tests (2) enhancement (1) docs (1) python (1) performance (1) BatchAPI (1) example (1) ux (1) RealtimeAPI (1)

Packages

  • Total packages: 3
  • Total downloads:
    • pypi 309 last-month
  • Total dependent packages: 1
    (may contain duplicates)
  • Total dependent repositories: 10
    (may contain duplicates)
  • Total versions: 93
  • Total maintainers: 2
pypi.org: cortex

Cost-effective serverless computing

  • Versions: 29
  • Dependent Packages: 1
  • Dependent Repositories: 9
  • Downloads: 305 Last month
Rankings
Stargazers count: 0.3%
Forks count: 2.1%
Average: 3.9%
Dependent packages count: 4.7%
Dependent repos count: 4.9%
Downloads: 7.4%
Maintainers (2)
Last synced: 6 months ago
proxy.golang.org: github.com/cortexlabs/cortex
  • Versions: 63
  • Dependent Packages: 0
  • Dependent Repositories: 0
Rankings
Dependent packages count: 7.0%
Average: 8.2%
Dependent repos count: 9.3%
Last synced: 6 months ago
pypi.org: cortex-deploy

Model serving at scale

  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 1
  • Downloads: 4 Last month
Rankings
Stargazers count: 0.3%
Forks count: 2.1%
Dependent packages count: 10.0%
Average: 18.9%
Dependent repos count: 21.7%
Downloads: 60.6%
Maintainers (1)
Last synced: 6 months ago