LangFair
LangFair: A Python Package for Assessing Bias and Fairness in Large Language Model Use Cases - Published in JOSS (2025)
mcboost
mcboost: Multi-Calibration Boosting for R - Published in JOSS (2021)
fairlearn
A Python package to assess and improve fairness of machine learning models.
ethicml
Package for evaluating the performance of methods which aim to increase fairness, accountability and/or transparency
thetis
Service to examine data processing pipelines (e.g., machine learning or deep learning pipelines) for uncertainty consistency (calibration), fairness, and other safety-relevant aspects.
pre-em-bias
Official implementation of the IEEE Big Data 2024 paper "Evaluating Blocking Biases in Entity Matching"
image-crop-analysis
Code for reproducing our analysis in the paper titled: Image Cropping on Twitter: Fairness Metrics, their Limitations, and the Importance of Representation, Design, and Agency
https://github.com/amazon-science/bold
Dataset associated with "BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generation" paper