https://github.com/bentoml/bentowhisperx

https://github.com/bentoml/bentowhisperx

Science Score: 26.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
  • codemeta.json file
    Found codemeta.json file
  • .zenodo.json file
    Found .zenodo.json file
  • DOI references
  • Academic publication links
  • Academic email domains
  • Institutional organization owner
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (12.8%) to scientific vocabulary
Last synced: 10 months ago · JSON representation

Repository

Basic Info
  • Host: GitHub
  • Owner: bentoml
  • Language: Python
  • Default Branch: main
  • Size: 808 KB
Statistics
  • Stars: 16
  • Watchers: 4
  • Forks: 5
  • Open Issues: 10
  • Releases: 0
Created over 2 years ago · Last pushed over 1 year ago
Metadata Files
Readme

README.md

Serving WhisperX with BentoML

WhisperX provides fast automatic speech recognition with word-level timestamps and speaker diarization.

This is a BentoML example project, demonstrating how to build a speech recognition inference API server, using the WhisperX project. See here for a full list of BentoML example projects.

Prerequisites

If you want to test the project locally, install FFmpeg on your system.

Install dependencies

```bash git clone https://github.com/bentoml/BentoWhisperX.git cd BentoWhisperX

Recommend Python 3.11

pip install -r requirements.txt ```

Run the BentoML Service

We have defined a BentoML Service in service.py. Run bentoml serve in your project directory to start the Service. Please note that you may need to request access to pyannote/segmentation-3.0 and pyannote/speaker-diarization-3.1, then provide your Hugging Face token when running the Service.

```python $ HF_TOKEN= bentoml serve .

2024-01-18T09:01:15+0800 [INFO] [cli] Starting production HTTP BentoServer from "service:BentoWhisperX" listening on http://localhost:3000 (Press CTRL+C to quit) ```

The server is now active at http://localhost:3000. You can interact with it using the Swagger UI or in other different ways.

CURL

bash curl -s \ -X POST \ -F 'audio_file=@female.wav' \ http://localhost:3000/transcribe

Python client

```python from pathlib import Path import bentoml

with bentoml.SyncHTTPClient('http://localhost:3000') as client: audiourl = 'https://example.org/female.wav' response = client.transcribe(audiofile=audio_url) print(response) ```

Deploy to BentoCloud

After the Service is ready, you can deploy the application to BentoCloud for better management and scalability. Sign up if you haven't got a BentoCloud account.

Make sure you have logged in to BentoCloud and set your Hugging Face access token in bentofile.yaml, then run the following command to deploy it.

bash bentoml deploy .

Once the application is up and running on BentoCloud, you can access it via the exposed URL.

Note: For custom deployment in your own infrastructure, use BentoML to generate an OCI-compliant image.

Owner

  • Name: BentoML
  • Login: bentoml
  • Kind: organization
  • Location: San Francisco

The most flexible way to serve AI models in production

GitHub Events

Total
  • Issues event: 2
  • Watch event: 5
  • Delete event: 4
  • Push event: 5
  • Pull request event: 6
  • Pull request review event: 4
  • Create event: 2
Last Year
  • Issues event: 2
  • Watch event: 5
  • Delete event: 4
  • Push event: 5
  • Pull request event: 6
  • Pull request review event: 4
  • Create event: 2

Issues and Pull Requests

Last synced: 10 months ago

All Time
  • Total issues: 2
  • Total pull requests: 19
  • Average time to close issues: N/A
  • Average time to close pull requests: 3 days
  • Total issue authors: 2
  • Total pull request authors: 4
  • Average comments per issue: 0.0
  • Average comments per pull request: 0.0
  • Merged pull requests: 11
  • Bot issues: 0
  • Bot pull requests: 8
Past Year
  • Issues: 2
  • Pull requests: 4
  • Average time to close issues: N/A
  • Average time to close pull requests: about 5 hours
  • Issue authors: 2
  • Pull request authors: 2
  • Average comments per issue: 0.0
  • Average comments per pull request: 0.0
  • Merged pull requests: 4
  • Bot issues: 0
  • Bot pull requests: 0
Top Authors
Issue Authors
  • rivaon (1)
  • mru4913 (1)
  • Sherlock113 (1)
Pull Request Authors
  • dependabot[bot] (10)
  • Sherlock113 (9)
  • larme (8)
  • ssheng (2)
Top Labels
Issue Labels
documentation (1)
Pull Request Labels
dependencies (10) documentation (2)