kcompher / GerryFair

library for fair auditing and learning of classifiers with respect to rich subgroup fairness.

GerryFair: Auditing and Learning for Subgroup Fairness

Fairness Gerrymandering: when "a classifier appears to be fair on each individual group, but badly violates the fairness constraint on one or more structured subgroups defined over the protected attributes" (from Kearns et al., https://arxiv.org/abs/1711.05144)

This repository contains python code for:

• learning fair classifiers subject to subgroup fairness constraints (as described in https://arxiv.org/abs/1711.05144)
• auditing standard classifiers from sklearn for fairness violations
• visualizing tradeoffs between error and fairness metrics
• fairness sensitive datasets for experiments (as used in https://arxiv.org/abs/1808.08166)

Prerequisites

To install the package and prepare for use, run:

git clone https://github.com/algowatchPenn/GerryFair.git
pip install -r requirements.txt

The current iteration of the package uses the following python packages: pandas, numpy, sklearn, matplotlib If you already have these installed, you can forgo the requirements step.

Using our package

For demonstration of the GerryFair API, please see our jupyter notebook

Datasets

communities: http://archive.ics.uci.edu/ml/datasets/communities+and+crime

lawschool: https://eric.ed.gov/?id=ED469370

adult: https://archive.ics.uci.edu/ml/datasets/adult

student: https://archive.ics.uci.edu/ml/datasets/student+performance (math grades)

License

• GerryFair/license.txt
• Maintained by: Seth Neel ([e-mail]), William Brown, Adel Boyarsky, Arnab Sarker, Aaron Hallac.
• Property of: Michael Kearns, Seth Neel, Aaron Roth, Z. Steven Wu.
• For questions or concerns, contact Algowatch Project ([e-mail]).