llmswitcher

Routes to the most performant and cost efficient LLM based on your prompt [ 🚧 WIP ]

https://github.com/plowsai/llmswitcher

Science Score: 44.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
    Found CITATION.cff file
  • codemeta.json file
    Found codemeta.json file
  • .zenodo.json file
    Found .zenodo.json file
  • DOI references
  • Academic publication links
  • Academic email domains
  • Institutional organization owner
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (2.6%) to scientific vocabulary

Keywords

llm-agent llm-router llms prompt-engineering
Last synced: 6 months ago · JSON representation ·

Repository

Routes to the most performant and cost efficient LLM based on your prompt [ 🚧 WIP ]

Basic Info
  • Host: GitHub
  • Owner: plowsai
  • License: mit
  • Language: Python
  • Default Branch: main
  • Homepage:
  • Size: 48.8 KB
Statistics
  • Stars: 4
  • Watchers: 2
  • Forks: 2
  • Open Issues: 4
  • Releases: 0
Topics
llm-agent llm-router llms prompt-engineering
Created almost 2 years ago · Last pushed over 1 year ago
Metadata Files
Readme License Citation

README.md

LLM-Switcher 🎛️

Route between different LLM's based on a prompt. This helps reduce the cost of using an LLM that might be more expensive and or less performant on the task being prompted

Install [Coming Soon]

pip install llm-switcher

Disclaimer

This is for pure experimental purposes. If you find this useful or want to make it better feel free to open a PR

Owner

  • Name: Jordan Plows
  • Login: plowsai
  • Kind: user
  • Location: San Fransisco, CA

Making LLM's reliable.

Citation (Citation.cff)

cff-version: 1.2.0
message: "If you use this software, please cite it as below."
authors:
- family-names: "Plows"
  given-names: "Jordan"
title: "llm-switcher"
version: 1.0.0
date-released: 2024-04-21
url: "https://github.com/stableagents/llm-switcher"

GitHub Events

Total
Last Year

Dependencies

requirements.txt pypi
  • PyYAML ==6.0.1
  • annotated-types ==0.6.0
  • anyio ==4.3.0
  • certifi ==2024.2.2
  • charset-normalizer ==3.3.2
  • distro ==1.9.0
  • filelock ==3.13.4
  • fsspec ==2024.3.1
  • h11 ==0.14.0
  • httpcore ==1.0.5
  • httpx ==0.27.0
  • huggingface-hub ==0.22.2
  • idna ==3.7
  • openai ==1.23.2
  • packaging ==24.0
  • pydantic ==2.7.0
  • pydantic_core ==2.18.1
  • python-dotenv ==1.0.1
  • requests ==2.31.0
  • sniffio ==1.3.1
  • tqdm ==4.66.2
  • typing ==3.7.4.3
  • typing_extensions ==4.11.0
  • urllib3 ==2.2.1