Updated 6 months ago

bentoml • Rank 26.1 • Science 54%

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

Updated 6 months ago

mosec • Rank 20.4 • Science 54%

A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine

Updated 5 months ago

https://github.com/bentoml/clip-api-service • Rank 9.2 • Science 13%

CLIP as a service - Embed image and sentences, object recognition, visual reasoning, image classification and reverse image search

Updated 5 months ago

https://github.com/bentoml/transformers-nlp-service • Science 13%

Online Inference API for NLP Transformer models - summarization, text classification, sentiment analysis and more