pyrit

The Python Risk Identification Tool for generative AI (PyRIT) is an open source framework built to empower security professionals and engineers to proactively identify risks in generative AI systems.

https://github.com/azure/pyrit

Science Score: 46.0%

This score indicates how likely this project is to be science-related based on various indicators:

○
CITATION.cff file
✓
codemeta.json file
Found codemeta.json file
✓
.zenodo.json file
Found .zenodo.json file
○
DOI references
✓
Academic publication links
Links to: arxiv.org
✓
Committers with academic emails
4 of 75 committers (5.3%) from academic institutions
○
Institutional organization owner
○
JOSS paper metadata
○
Scientific vocabulary similarity
Low similarity (8.7%) to scientific vocabulary

Keywords

ai-red-team generative-ai red-team-tools responsible-ai

Keywords from Contributors

agents large-language-models transformers multi-agent cryptocurrencies ai-system reinforcement-learning document-parser openai-api palm2

Last synced: 6 months ago · JSON representation

Repository

The Python Risk Identification Tool for generative AI (PyRIT) is an open source framework built to empower security professionals and engineers to proactively identify risks in generative AI systems.

Basic Info

Host: GitHub
Owner: Azure
License: mit
Language: Python
Default Branch: main
Homepage: https://azure.github.io/PyRIT/
Size: 143 MB

Statistics

Stars: 2,851
Watchers: 36
Forks: 552
Open Issues: 89
Releases: 14

Topics

ai-red-team generative-ai red-team-tools responsible-ai

Created about 2 years ago · Last pushed 6 months ago

Metadata Files

Readme License Code of conduct Citation Security Support Notice

Python Risk Identification Tool for generative AI (PyRIT)

The Python Risk Identification Tool for generative AI (PyRIT) is an open source framework built to empower security professionals and engineers to proactively identify risks in generative AI systems.

Check out our website for more information about how to use, install, or contribute to PyRIT.
Visit our Discord server to chat with the team and community.

Trademarks

This project may contain trademarks or logos for projects, products, or services. Authorized use of Microsoft trademarks or logos is subject to and must follow Microsoft's Trademark & Brand Guidelines. Use of Microsoft trademarks or logos in modified versions of this project must not cause confusion or imply Microsoft sponsorship. Any use of third-party trademarks or logos are subject to those third-party's policies.

Citing PyRIT

If you use PyRIT in your research, please cite our preprint paper as follows:

@misc{munoz2024pyritframeworksecurityrisk, title={PyRIT: A Framework for Security Risk Identification and Red Teaming in Generative AI Systems}, author={Gary D. Lopez Munoz and Amanda J. Minnich and Roman Lutz and Richard Lundeen and Raja Sekhar Rao Dheekonda and Nina Chikanov and Bolor-Erdene Jagdagdorj and Martin Pouliot and Shiven Chawla and Whitney Maxwell and Blake Bullwinkel and Katherine Pratt and Joris de Gruyter and Charlotte Siska and Pete Bryan and Tori Westerhoff and Chang Kawaguchi and Christian Seifert and Ram Shankar Siva Kumar and Yonatan Zunger}, year={2024}, eprint={2410.02828}, archivePrefix={arXiv}, primaryClass={cs.CR}, url={https://arxiv.org/abs/2410.02828}, }

Additionally, please cite the tool itself following the CITATION.cff file in the root of this repository.

Owner

Name: Microsoft Azure
Login: Azure
Kind: organization
Location: United States of America

Website: https://docs.microsoft.com/en-us/azure/
Twitter: Azure
Repositories: 2,270
Profile: https://github.com/Azure

APIs, SDKs and open source projects from Microsoft Azure

Committers

Last synced: 10 months ago

All Time

Total Commits: 608
Total Committers: 75
Avg Commits per committer: 8.107
Development Distribution Score (DDS): 0.73

Past Year

Commits: 442
Committers: 66
Avg Commits per committer: 6.697
Development Distribution Score (DDS): 0.769

Top Committers

Name	Email	Commits
rlundeen2	1****2	164
Roman Lutz	r**3@g**m	100
Nina Chikanov	1****t	45
Raja Sekhar Rao Dheekonda	4****a	44
jbolor21	8****1	37
jsong468	s**n@m**m	35
Volkan Kutal	5****n	24
Paulina Kalicka	7****3	17
Bashir Partovi	b**i@g**m	14
Eugenia Kim	1****m	12
Gary	d**y@o**m	7
Jacky Luo	j**8@g**m	6
Blake Bullwinkel	b**l@g**m	5
Microsoft Open Source	m****e	5
Joris de Gruyter	j**e@m**m	4
Shiven Chawla	c**s@u**u	4
Andrew Elgert	e****m	4
Adrian Gavrila	5****1	4
AlexRRR	r**c@a**m	3
Christian Seifert	c**t@m**m	3
Richard Edgar	r**r@m**m	3
SafwanA02	1****2	3
pgrek001	1****1	3
whackswell	w**y@m**g	2
Aleks	a****v	2
Ameen Gulistan	3****d	2
Emilie Rajka	e**a@g**m	2
Martin Pouliot	m**7@g**m	2
NaijingGuo	8****o	2
Pete Bryan	p**n@m**m	2
and 45 more...

Committer Domains (Top 20 + Academic)

microsoft.com: 7 usc.edu: 1 anu.edu.au: 1 drstrange.wtf: 1 vanderbilt.edu: 1 maxwellfamily.org: 1 adobe.com: 1 uw.edu: 1

Issues and Pull Requests

Last synced: 6 months ago

All Time

Total issues: 223
Total pull requests: 1,193
Average time to close issues: 22 days
Average time to close pull requests: 5 days
Total issue authors: 68
Total pull request authors: 110
Average comments per issue: 1.28
Average comments per pull request: 0.74
Merged pull requests: 890
Bot issues: 1
Bot pull requests: 3

Past Year

Issues: 180
Pull requests: 852
Average time to close issues: 16 days
Average time to close pull requests: 5 days
Issue authors: 49
Pull request authors: 90
Average comments per issue: 1.26
Average comments per pull request: 0.72
Merged pull requests: 616
Bot issues: 0
Bot pull requests: 0

View more stats

Top Authors

Issue Authors

romanlutz (79)
nina-msft (25)
rlundeen2 (12)
wadhwasahil (6)
KutalVolkan (5)
rdheekonda (4)
eugeniavkim (4)
riedgar-ms (4)
shivenchawla (4)
corporate87 (4)
jbolor21 (3)
AlexRRR (3)
gerimisc (3)
jsdlm (3)
paulinek13 (3)

Pull Request Authors

rlundeen2 (256)
romanlutz (164)
jbolor21 (91)
nina-msft (86)
jsong468 (77)
rdheekonda (63)
KutalVolkan (48)
bashirpartovi (44)
paulinek13 (39)
eugeniavkim (29)
AdrGav941 (13)
dlmgary (10)
hannahwestra25 (9)
blakebullwinkel (9)
whackswell (8)

Top Labels

Issue Labels

help wanted (69) enhancement (52) good first issue (45) datasets (14) bug (13) documentation (12) converters (8) question (7) not ready yet (6) dependencies (1)

Pull Request Labels

documentation (4) dependencies (3) enhancement (3) converters (1)

Packages

Total packages: 2
Total downloads: unknown

Total dependent packages: 0
(may contain duplicates)
Total dependent repositories: 0
(may contain duplicates)
Total versions: 30

proxy.golang.org: github.com/azure/pyrit

Documentation: https://pkg.go.dev/github.com/azure/pyrit#section-documentation
License: mit
Latest release: v0.9.0
published 10 months ago

Versions: 15
Dependent Packages: 0
Dependent Repositories: 0

Rankings

Dependent packages count: 6.5%

Average: 6.7%

Dependent repos count: 7.0%

Last synced: 6 months ago

proxy.golang.org: github.com/Azure/PyRIT

Documentation: https://pkg.go.dev/github.com/Azure/PyRIT#section-documentation
License: mit
Latest release: v0.9.0
published 10 months ago

Versions: 15
Dependent Packages: 0
Dependent Repositories: 0

Rankings

Dependent packages count: 6.5%

Average: 6.7%

Dependent repos count: 7.0%

Last synced: 6 months ago

Dependencies

.github/workflows/build_and_test.yml actions

EnricoMi/publish-unit-test-result-action v2 composite
actions/checkout v3 composite
actions/setup-python v3 composite
irongut/CodeCoverageSummary v1.3.0 composite

pyproject.toml pypi

azure-ai-ml ==1.13.0
azure-core >=1.26.1
azure-identity >=1.12.0
ipykernel >=6.22.0
jsonpickle >=3.0.2
jupyter >=1.0.0
logzero >=1.7.0
numpy >=1.26.2
onnx >=1.14.0
onnxruntime >=1.14.1
openai >=1.5.0
pydantic >2
python-dotenv >=1.0.0
scikit-learn >=1.3.2
tenacity >=8.2.2
termcolor >=2.3.0
tokenizers >=0.15.0
torch ==2.1.2
transformers >=4.36.0
types-requests >=2.31.0.2

pyrit

Science Score: 46.0%

Keywords

Keywords from Contributors

Repository

Basic Info

Statistics

Topics

Metadata Files

README.md

Python Risk Identification Tool for generative AI (PyRIT)

Trademarks

Citing PyRIT

Owner

Committers

All Time

Past Year

Top Committers

Committer Domains (Top 20 + Academic)

Issues and Pull Requests

All Time

Past Year

Top Authors

Issue Authors

Pull Request Authors

Top Labels

Issue Labels

Pull Request Labels

Packages

proxy.golang.org: github.com/azure/pyrit

Rankings

proxy.golang.org: github.com/Azure/PyRIT

Rankings

Dependencies