Data

Tools

Indexes

Applications

Experiments

Open Source Science

https://github.com/awslabs/llm-hosting-container

Large Language Model Hosting Container

https://github.com/awslabs/llm-hosting-container

Science Score: 26.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ○
    CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ○
    DOI references
  • ○
    Academic publication links
  • ○
    Academic email domains
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (3.2%) to scientific vocabulary
Last synced: 10 months ago · JSON representation

Repository

Large Language Model Hosting Container

Basic Info
  • Host: GitHub
  • Owner: awslabs
  • License: apache-2.0
  • Language: Dockerfile
  • Default Branch: main
  • Homepage:
  • Size: 318 KB
Statistics
  • Stars: 90
  • Watchers: 5
  • Forks: 46
  • Open Issues: 18
  • Releases: 0
Created about 3 years ago · Last pushed 11 months ago
Metadata Files
Readme Contributing License Code of conduct Codeowners

README.md

LLM Hosting Container

Welcome to the LLM Hosting Container GitHub repository!

This repository contains the Dockerfiles and associated resources for building and hosting containers for large language models and embedding models.

  • Hugging Face Text Generation Inference (TGI) container
  • Hugging Face Text Embeddings Inference (TEI) container

Security

See CONTRIBUTING for more information.

License

This project is licensed under the Apache-2.0 License.

Owner

  • Name: Amazon Web Services - Labs
  • Login: awslabs
  • Kind: organization
  • Location: Seattle, WA

AWS Labs

GitHub Events

Total
  • Create event: 7
  • Issues event: 3
  • Watch event: 13
  • Delete event: 5
  • Member event: 2
  • Issue comment event: 5
  • Push event: 38
  • Pull request review comment event: 26
  • Pull request review event: 70
  • Pull request event: 92
  • Fork event: 9
Last Year
  • Create event: 7
  • Issues event: 3
  • Watch event: 13
  • Delete event: 5
  • Member event: 2
  • Issue comment event: 5
  • Push event: 38
  • Pull request review comment event: 26
  • Pull request review event: 70
  • Pull request event: 92
  • Fork event: 9

Issues and Pull Requests

Last synced: 10 months ago

All Time
  • Total issues: 9
  • Total pull requests: 105
  • Average time to close issues: 11 days
  • Average time to close pull requests: 5 days
  • Total issue authors: 9
  • Total pull request authors: 27
  • Average comments per issue: 1.56
  • Average comments per pull request: 0.67
  • Merged pull requests: 72
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 1
  • Pull requests: 45
  • Average time to close issues: N/A
  • Average time to close pull requests: 6 days
  • Issue authors: 1
  • Pull request authors: 17
  • Average comments per issue: 0.0
  • Average comments per pull request: 0.04
  • Merged pull requests: 27
  • Bot issues: 0
  • Bot pull requests: 0
View more stats
Top Authors
Issue Authors
  • shenshaoyong (1)
  • kiowajackson (1)
  • philschmid (1)
  • yanivg10 (1)
  • chrstfu (1)
  • nth-attempt (1)
  • weiZhenkun (1)
  • ma3842 (1)
  • existeundelta (1)
  • austinmw (1)
Pull Request Authors
  • philschmid (25)
  • dacorvo (15)
  • amzn-choeric (13)
  • jinyoung-lim (12)
  • kc1998dp (11)
  • xyang16 (11)
  • haixiw (10)
  • fgbelidji (8)
  • Captainia (6)
  • e-davidson (5)
  • timkuo-amazon (5)
  • varunmoris (4)
  • IshaChid76 (4)
  • bnpaws (3)
  • bencrabtree (2)
Top Labels
Issue Labels
Pull Request Labels

Dependencies

.github/workflows/build-huggingface.yml actions
  • actions/checkout v3 composite
  • aws-actions/amazon-ecr-login v1 composite
  • aws-actions/configure-aws-credentials v2 composite
  • docker/build-push-action v4 composite
  • docker/setup-buildx-action v2 composite
  • rlespinasse/github-slug-action v4.4.1 composite
tests/huggingface/requirements.txt pypi
  • sagemaker >=2.153.0 test
huggingface/pytorch/tgi/docker/1.1.0/gpu/Dockerfile docker
  • base latest build
  • chef latest build
  • debian bullseye-slim build
  • kernel-builder latest build
  • lukemathwalker/cargo-chef latest-rust-1.71 build
  • nvidia/cuda 11.8.0-base-ubuntu20.04 build
  • pytorch-install latest build
huggingface/pytorch/tgi/docker/1.0.3/gpu/Dockerfile docker
  • base latest build
  • chef latest build
  • debian bullseye-slim build
  • kernel-builder latest build
  • lukemathwalker/cargo-chef latest-rust-1.71 build
  • nvidia/cuda 11.8.0-base-ubuntu20.04 build
  • pytorch-install latest build
huggingface/pytorch/tgi/docker/1.2.0/gpu/Dockerfile docker
  • base latest build
  • chef latest build
  • kernel-builder latest build
  • lukemathwalker/cargo-chef latest-rust-1.71 build
  • nvidia/cuda 12.1.0-devel-ubuntu20.04 build
  • nvidia/cuda 12.1.0-base-ubuntu20.04 build
  • pytorch-install latest build
huggingface/pytorch/tgi/docker/1.3.1/gpu/Dockerfile docker
  • base latest build
  • chef latest build
  • kernel-builder latest build
  • lukemathwalker/cargo-chef latest-rust-1.71 build
  • nvidia/cuda 12.1.0-devel-ubuntu20.04 build
  • nvidia/cuda 12.1.0-base-ubuntu20.04 build
  • pytorch-install latest build
huggingface/pytorch/tgi/docker/1.3.3/gpu/Dockerfile docker
  • base latest build
  • chef latest build
  • kernel-builder latest build
  • lukemathwalker/cargo-chef latest-rust-1.71 build
  • nvidia/cuda 12.1.0-devel-ubuntu20.04 build
  • nvidia/cuda 12.1.0-base-ubuntu20.04 build
  • pytorch-install latest build