https://github.com/devidw/inferit
Visual inference exploration & experimentation playground
Science Score: 26.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
○CITATION.cff file
-
✓codemeta.json file
Found codemeta.json file -
✓.zenodo.json file
Found .zenodo.json file -
○DOI references
-
○Academic publication links
-
○Committers with academic emails
-
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (7.8%) to scientific vocabulary
Keywords
Repository
Visual inference exploration & experimentation playground
Basic Info
- Host: GitHub
- Owner: devidw
- License: agpl-3.0
- Language: Svelte
- Default Branch: main
- Homepage: https://inferit.index.garden
- Size: 2.33 MB
Statistics
- Stars: 96
- Watchers: 3
- Forks: 4
- Open Issues: 1
- Releases: 0
Topics
Metadata Files
README.md
inferit
inferit is a visual take on llm inference. Most inference frontends are limited to a single visual input/output "thread". This makes it hard to compare output from different models, prompts and sampler settings. inferit solves this with its UI that allows for an unlimited number of side-by-side generations. This makes it a perfect fit to compare and experiment with different models, prompts and sampler settings.
Some example use cases:
- model exploration and comparison
- prompt engineering
- sampler setting optimizations
Supported Backends:
- Any local or remote backend that is compatible with the OpenAI API
- Chrome's built-in llm (Gemini Nano)
run it
- I've deployed an instance for instant access here: https://inferit.index.garden (online)
- Same code also ships as browser extension to run local and offline w/o having to start a process: https://chromewebstore.google.com/detail/inferit/celkhcifjknihgjlieolcmchofdloagk
- Run it locally from this repo:
bash pnpm install pnpm build pnpm preview
once running, set your api creds in the settings (stored on your device, window.localStorage) and u are good to go
development
bash
pnpm dev
Contributions of any kind are warmly welcomed!
<3
Owner
- Name: David Wolf
- Login: devidw
- Kind: user
- Location: The Zone
- Website: https://david.wolf.gdn
- Repositories: 159
- Profile: https://github.com/devidw
// uncommenting
GitHub Events
Total
- Issues event: 7
- Watch event: 80
- Issue comment event: 2
- Push event: 19
- Fork event: 2
- Create event: 2
Last Year
- Issues event: 7
- Watch event: 80
- Issue comment event: 2
- Push event: 19
- Fork event: 2
- Create event: 2
Issues and Pull Requests
Last synced: 11 months ago
All Time
- Total issues: 4
- Total pull requests: 0
- Average time to close issues: 3 days
- Average time to close pull requests: N/A
- Total issue authors: 1
- Total pull request authors: 0
- Average comments per issue: 0.5
- Average comments per pull request: 0
- Merged pull requests: 0
- Bot issues: 0
- Bot pull requests: 0
Past Year
- Issues: 4
- Pull requests: 0
- Average time to close issues: 3 days
- Average time to close pull requests: N/A
- Issue authors: 1
- Pull request authors: 0
- Average comments per issue: 0.5
- Average comments per pull request: 0
- Merged pull requests: 0
- Bot issues: 0
- Bot pull requests: 0
Top Authors
Issue Authors
- devidw (4)
Pull Request Authors
Top Labels
Issue Labels
Pull Request Labels
Dependencies
- @iconify-json/eva ^1.2.0 development
- @sveltejs/adapter-auto ^3.0.0 development
- @sveltejs/adapter-node ^5.2.9 development
- @sveltejs/kit ^2.0.0 development
- @sveltejs/vite-plugin-svelte ^4.0.0 development
- @unocss/reset ^0.63.6 development
- @unocss/transformer-directives ^0.63.6 development
- @xyflow/svelte ^0.1.23 development
- character-card-utils ^2.0.3 development
- copy-text-to-clipboard ^3.2.0 development
- openai ^4.70.2 development
- pocketbase ^0.21.5 development
- svelte ^5.0.0 development
- svelte-autosize ^1.1.0 development
- svelte-check ^4.0.0 development
- typescript ^5.0.0 development
- unocss ^0.63.6 development
- vite ^5.0.3 development
- 254 dependencies