Data

Tools

Indexes

Applications

Experiments

Open Source Science

https://github.com/bentoml/llm-bench

https://github.com/bentoml/llm-bench

Science Score: 26.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ○
    CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ○
    DOI references
  • ○
    Academic publication links
  • ○
    Academic email domains
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (2.5%) to scientific vocabulary
Last synced: 10 months ago · JSON representation

Repository

Basic Info
  • Host: GitHub
  • Owner: bentoml
  • Language: Python
  • Default Branch: main
  • Size: 7.94 MB
Statistics
  • Stars: 50
  • Watchers: 9
  • Forks: 8
  • Open Issues: 6
  • Releases: 0
Created almost 3 years ago · Last pushed over 1 year ago
Metadata Files
Readme

README.md

BentoCloud Benchmark Client

Usage

1. Set up environment variables

Make sure you have logged into Huggingface

bash huggingface-cli login

Set environment variables for benchmarking

bash export BASE_URL=<BentoCloud Service URL> export SYSTEM_PROMPT=1 // 1 or 0

2. Run benchmark

bash python benchmark.py --max_users 10 --session_time 300 --ping_correction

  • max_users is the max number of concurrent users to spawn
  • session_time is the duration of the benchmark sesssion, in seconds
  • ping_correction is a flag that determines whether ping latency should be deducted from the metrics

Owner

  • Name: BentoML
  • Login: bentoml
  • Kind: organization
  • Location: San Francisco

The most flexible way to serve AI models in production

GitHub Events

Total
  • Issues event: 1
  • Watch event: 24
  • Pull request event: 3
  • Fork event: 6
  • Create event: 1
Last Year
  • Issues event: 1
  • Watch event: 24
  • Pull request event: 3
  • Fork event: 6
  • Create event: 1

Issues and Pull Requests

Last synced: over 1 year ago

All Time
  • Total issues: 5
  • Total pull requests: 8
  • Average time to close issues: 5 minutes
  • Average time to close pull requests: 29 days
  • Total issue authors: 5
  • Total pull request authors: 4
  • Average comments per issue: 0.2
  • Average comments per pull request: 0.0
  • Merged pull requests: 5
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 5
  • Pull requests: 8
  • Average time to close issues: 5 minutes
  • Average time to close pull requests: 29 days
  • Issue authors: 5
  • Pull request authors: 4
  • Average comments per issue: 0.2
  • Average comments per pull request: 0.0
  • Merged pull requests: 5
  • Bot issues: 0
  • Bot pull requests: 0
View more stats
Top Authors
Issue Authors
  • akaihaoshuai (1)
  • AIvashov (1)
  • Amber-Believe (1)
  • huangh12 (1)
  • zhanggzh (1)
Pull Request Authors
  • larme (7)
  • rickzx (2)
  • kunwar31 (2)
  • XunchaoZ (2)
  • dependabot[bot] (1)
Top Labels
Issue Labels
Pull Request Labels
dependencies (1)