rakfort-promptfoo
Science Score: 26.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
○CITATION.cff file
-
✓codemeta.json file
Found codemeta.json file -
✓.zenodo.json file
Found .zenodo.json file -
○DOI references
-
○Academic publication links
-
○Academic email domains
-
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (5.9%) to scientific vocabulary
Last synced: 10 months ago
·
JSON representation
Repository
Basic Info
- Host: GitHub
- Owner: Walker31
- License: mit
- Language: TypeScript
- Default Branch: main
- Size: 89.6 MB
Statistics
- Stars: 0
- Watchers: 0
- Forks: 0
- Open Issues: 0
- Releases: 0
Created about 1 year ago
· Last pushed 12 months ago
Metadata Files
Readme
Contributing
Funding
License
Citation
Security
README.md
Quick Start
```sh
clone the project into your local system
gh repo clone Walker31/RakFort-Promptfoo
open the repo
cd RakFort-Promptfoo
Install pnpm
sudo npm install -g pnpm
command to install everythign inside the repo
pnpm install
To Start the hot‑reload dev server
pnpm dev ```
TO access the UI in the browser: http://localhost:3000
What can you do?
- Test your prompts and models with automated evaluations
- Secure your LLM apps with red teaming and vulnerability scanning
- Compare models side-by-side (OpenAI, Anthropic, Azure, Bedrock, Ollama, and more)
- Automate checks in CI/CD
- Share results with your team
Here's what it looks like in action:
It works on the command line too:
It also can generate security vulnerability reports:
Owner
- Name: Aditya
- Login: Walker31
- Kind: user
- Location: Chennai , India
- Website: https://linktr.ee/aditya3174
- Twitter: aditya_3174
- Repositories: 1
- Profile: https://github.com/Walker31
GitHub Events
Total
- Push event: 9
- Pull request event: 2
- Create event: 1
Last Year
- Push event: 9
- Pull request event: 2
- Create event: 1
Dependencies
.github/workflows/deploy-launcher.yml
actions
- actions/checkout v4 composite
- actions/setup-node v4 composite
- cloudflare/wrangler-action v3 composite
.github/workflows/docker.yml
actions
- actions/checkout v4 composite
- docker/build-push-action v6 composite
- docker/login-action v3 composite
- docker/metadata-action v5 composite
- docker/setup-buildx-action v3 composite
- docker/setup-qemu-action v3 composite
.github/workflows/image-actions.yml
actions
- actions/checkout v4 composite
- calibreapp/image-actions main composite
.github/workflows/main.yml
actions
- actions/checkout v4 composite
- actions/setup-go v5 composite
- actions/setup-node v4 composite
- actions/setup-python v5 composite
- luizm/action-sh-checker 17bd25a6ee188d2b91f677060038f4ba37ba14b2 composite
- raven-actions/actionlint v2 composite
.github/workflows/npm-release.yml
actions
- actions/checkout v4 composite
- actions/setup-node v4 composite
.github/workflows/tag.yml
actions
- actions/checkout v4 composite
- actions/setup-node v4 composite
.github/workflows/validate-pr-title.yml
actions
- amannn/action-semantic-pull-request v5 composite
.devcontainer/docker-compose.yml
docker
Dockerfile
docker
- base latest build
- node 22.14.0-alpine build
examples/golang-provider/go.mod
go
- github.com/sashabaranov/go-openai v1.37.0
examples/golang-provider/go.sum
go
- github.com/sashabaranov/go-openai v1.37.0
src/golang/go.mod
go
examples/http-provider-auth-signature/package.json
npm
- express ^4.21.2
- promptfoo ^0.100.5
examples/jest-integration/package.json
npm
- @types/jest ^29.5.14 development
- jest ^29.7.0 development
- ts-jest ^29.2.5 development
- typescript ^5.7.3 development
- vitest ^3.0.5 development
examples/node-package/package.json
npm
examples/node-package-typescript/package.json
npm
- promptfoo file:../promptfoo
examples/redteam-chatbot/package.json
npm
- express ^4.21.2
- promptfoo ^0.100.5
examples/websockets/test-server/package.json
npm
- ws ^8.18.0
package-lock.json
npm
- 2553 dependencies
package.json
npm
- @aws-sdk/client-bedrock-runtime ^3.787.0 development
- @aws-sdk/credential-provider-sso ^3.787.0 development
- @azure/identity ^4.8.0 development
- @eslint/js ^9.24.0 development
- @libsql/client ^0.14.0 development
- @swc/cli ^0.6.0 development
- @swc/core ^1.11.21 development
- @swc/jest ^0.2.37 development
- @trivago/prettier-plugin-sort-imports ^5.2.2 development
- @types/async ^3.2.24 development
- @types/better-sqlite3 ^7.6.13 development
- @types/cache-manager ^4.0.6 development
- @types/cache-manager-fs-hash ^0.0.4 development
- @types/cli-progress ^3.11.6 development
- @types/compression ^1.7.5 development
- @types/cors ^2.8.17 development
- @types/debounce ^1.2.4 development
- @types/express ^5.0.1 development
- @types/glob ^8.1.0 development
- @types/inquirer ^9.0.7 development
- @types/jest ^29.5.14 development
- @types/js-yaml ^4.0.9 development
- @types/nunjucks ^3.2.6 development
- @types/opener ^1.4.3 development
- @types/pdf-parse ^1.1.5 development
- @types/semver ^7.7.0 development
- @types/source-map-support ^0.5.10 development
- @types/supertest ^6.0.3 development
- @types/uuid ^10.0.0 development
- @typescript-eslint/eslint-plugin ^8.29.1 development
- @typescript-eslint/parser ^8.29.1 development
- check-dependency-version-consistency ^5.0.0 development
- cloudflare 3.4.0 development
- concurrently ^9.1.2 development
- drizzle-kit ^0.31.0 development
- eslint ^9.24.0 development
- eslint-plugin-jest ^28.11.0 development
- eslint-plugin-react-hooks ^5.2.0 development
- eslint-plugin-react-refresh ^0.4.19 development
- eslint-plugin-unicorn ^58.0.0 development
- eslint-plugin-unused-imports ^4.1.4 development
- jest ^29.7.0 development
- madge ^8.0.0 development
- nock ^14.0.3 development
- nodemon ^3.1.9 development
- prettier ^3.5.3 development
- shx ^0.4.0 development
- source-map-support ^0.5.21 development
- supertest ^7.1.0 development
- ts-node ^10.9.2 development
- typescript ^5.8.3 development
- typescript-eslint ^8.29.1 development
- zod-to-json-schema ^3.24.5 development
- @anthropic-ai/sdk ^0.39.0
- @apidevtools/json-schema-ref-parser ^12.0.1
- @googleapis/sheets ^9.6.0
- @types/ws ^8.18.1
- ajv ^8.17.1
- ajv-formats ^3.0.1
- async ^3.2.6
- better-sqlite3 ^11.9.1
- cache-manager ^4.1.0
- cache-manager-fs-hash ^1.0.0
- chalk ^4.1.2
- chokidar 4.0.3
- cli-progress ^3.12.0
- cli-table3 ^0.6.5
- commander ^12.1.0
- compression ^1.8.0
- cors ^2.8.5
- csv-parse ^5.6.0
- csv-stringify ^6.5.2
- debounce ^2.2.0
- dedent ^1.5.3
- dotenv ^16.5.0
- drizzle-orm ^0.39.2
- express ^4.21.2
- fast-deep-equal ^3.1.3
- fast-xml-parser ^4.5.1
- fastest-levenshtein ^1.0.16
- glob ^10.4.3
- http-z ^7.1.3
- inquirer ^11.1.0
- js-rouge ^3.0.0
- js-yaml ^4.1.0
- mathjs ^14.4.0
- node-cache ^5.1.2
- nunjucks ^3.2.4
- openai ^4.93.0
- opener ^1.5.2
- proxy-agent ^6.5.0
- python-shell ^5.0.0
- replicate ^0.34.1
- rfdc ^1.4.1
- semver ^7.7.1
- socket.io ^4.8.1
- tsx ^4.19.3
- undici ^7.8.0
- uuid ^11.1.0
- winston ^3.17.0
- ws ^8.18.1
- zod ^3.24.2
- zod-validation-error ^3.4.0
pnpm-lock.yaml
npm
- 834 dependencies
site/package.json
npm
- @calcom/embed-react ^1.5.2 development
- @docusaurus/core ^3.7.0 development
- @docusaurus/module-type-aliases ^3.7.0 development
- @docusaurus/plugin-client-redirects ^3.7.0 development
- @docusaurus/plugin-content-docs ^3.7.0 development
- @docusaurus/plugin-google-gtag ^3.7.0 development
- @docusaurus/preset-classic ^3.7.0 development
- @docusaurus/theme-mermaid ^3.7.0 development
- @docusaurus/theme-search-algolia ^3.7.0 development
- @mdx-js/react ^3.1.0 development
- @monaco-editor/react ^4.7.0 development
- @mui/icons-material ^6.1.10 development
- @segment/ajv-human-errors ^2.15.0 development
- @tsconfig/docusaurus ^2.0.3 development
- canvas-confetti ^1.9.3 development
- clsx ^2.1.1 development
- dedent ^1.5.3 development
- docusaurus-plugin-image-zoom ^2.0.0 development
- framer-motion ^11.13.3 development
- lucide-react ^0.468.0 development
- prism-react-renderer ^2.4.1 development
- react ^18.3.1 development
- react-dom ^18.3.1 development
- typescript ^5.8.3 development
- swiper ^11.2.6
src/app/package.json
npm
- @emotion/react ^11.14.0 development
- @emotion/styled ^11.14.0 development
- @eslint/js ^9.24.0 development
- @kurkle/color ^0.3.4 development
- @mui/icons-material ^6.1.10 development
- @mui/material ^6.1.10 development
- @mui/system ^6.1.10 development
- @mui/x-charts ^7.23.1 development
- @mui/x-data-grid ^7.28.2 development
- @tanstack/react-table ^8.20.6 development
- @testing-library/dom ^10.4.0 development
- @testing-library/jest-dom ^6.6.3 development
- @testing-library/react ^16.2.0 development
- @testing-library/user-event ^14.6.1 development
- @types/diff ^6.0.0 development
- @types/fuzzysearch ^1.0.2 development
- @types/js-yaml ^4.0.9 development
- @types/node ^22.13.10 development
- @types/prismjs ^1.26.5 development
- @types/react ^18.3.13 development
- @types/react-dom ^18.3.1 development
- @types/react-router-dom ^5.3.3 development
- @types/react-syntax-highlighter ^15.5.13 development
- @types/uuid ^10.0.0 development
- @vitejs/plugin-react ^4.3.4 development
- @vitest/coverage-v8 ^3.1.1 development
- ansi-to-html ^0.7.2 development
- chart.js ^4.4.8 development
- csv-parse ^5.6.0 development
- csv-stringify ^6.5.2 development
- diff ^7.0.0 development
- eslint ^9.24.0 development
- eslint-plugin-react-hooks ^5.2.0 development
- eslint-plugin-react-refresh ^0.4.19 development
- fuzzysearch ^1.0.3 development
- globals ^15.14.0 development
- html2canvas ^1.4.1 development
- idb-keyval ^6.2.1 development
- js-yaml ^4.1.0 development
- jsdom ^25.0.1 development
- jspdf ^3.0.1 development
- prismjs ^1.30.0 development
- react ^18.3.1 development
- react-dom ^18.3.1 development
- react-error-boundary ^4.1.2 development
- react-markdown ^9.0.3 development
- react-router-dom ^6.28.0 development
- react-simple-code-editor ^0.14.1 development
- react-syntax-highlighter ^15.6.1 development
- recharts ^2.15.1 development
- remark-gfm ^4.0.0 development
- socket.io-client ^4.8.1 development
- tinyspy ^3.0.2 development
- typescript ^5.8.3 development
- typescript-eslint ^8.29.1 development
- use-debounce ^10.0.4 development
- vite ^6.2.5 development
- vite-plugin-node-polyfills ^0.23.0 development
- vitest ^3.1.1 development
- zustand ^5.0.3 development
examples/docker-code-generation-sandbox/requirements.txt
pypi
- certifi ==2024.7.4
- charset-normalizer ==3.3.2
- docker ==7.1.0
- epicbox ==1.1.0
- idna ==3.7
- python-dateutil ==2.9.0.post0
- requests ==2.32.3
- six ==1.16.0
- structlog ==24.2.0
- urllib3 ==1.26.19
examples/f-score/requirements.txt
pypi
- datasets >=3.1.0
- pandas >=2.2.3
examples/image-classification/requirements.txt
pypi
- numpy ==1.26.4
- pandas ==2.2.2
- pillow ==10.4.0
- tensorflow ==2.17.0
examples/langchain-python/requirements.txt
pypi
- langchain ==0.3.5
- langchain-community ==0.3.3
- langchain-openai ==0.2.4
- numexpr ==2.10.1
examples/python-provider/requirements.txt
pypi
- annotated-types ==0.6.0
- anyio ==4.2.0
- certifi ==2024.7.4
- distro ==1.9.0
- exceptiongroup ==1.2.0
- h11 ==0.14.0
- httpcore ==1.0.2
- httpx ==0.26.0
- idna ==3.7
- openai ==1.35.7
examples/rag-full/requirements.txt
pypi
- chromadb >=0.5.17
- langchain >=0.3.6
- langchain-chroma >=0.1.4
- langchain-community >=0.3.4
- langchain-openai >=0.2.5
- pypdf >=5.1.0
- tqdm >=4.66.6
examples/redteam-langchain/requirements.txt
pypi
- PyYAML ==6.0.2
- SQLAlchemy ==2.0.37
- aiohappyeyeballs ==2.4.4
- aiohttp ==3.11.11
- aiosignal ==1.3.2
- annotated-types ==0.7.0
- anyio ==4.8.0
- attrs ==24.3.0
- certifi ==2024.12.14
- charset-normalizer ==3.4.1
- dataclasses-json ==0.6.7
- distro ==1.9.0
- frozenlist ==1.5.0
- h11 ==0.14.0
- httpcore ==1.0.7
- httpx ==0.28.1
- httpx-sse ==0.4.0
- idna ==3.10
- jiter ==0.8.2
- jsonpatch ==1.33
- jsonpointer ==3.0.0
- langchain ==0.3.14
- langchain-community ==0.3.14
- langchain-core ==0.3.30
- langchain-openai ==0.3.0
- langchain-text-splitters ==0.3.5
- langsmith ==0.2.11
- marshmallow ==3.25.1
- multidict ==6.1.0
- mypy-extensions ==1.0.0
- numpy ==2.2.1
- openai ==1.59.8
- orjson ==3.10.15
- packaging ==24.2
- propcache ==0.2.1
- pydantic ==2.10.5
- pydantic-settings ==2.7.1
- pydantic_core ==2.27.2
- python-dotenv ==1.0.1
- regex ==2024.11.6
- requests ==2.32.3
- requests-toolbelt ==1.0.0
- sniffio ==1.3.1
- tenacity ==9.0.0
- tiktoken ==0.8.0
- tqdm ==4.67.1
- typing-inspect ==0.9.0
- typing_extensions ==4.12.2
- urllib3 ==2.3.0
- yarl ==1.18.3