Answered step by step
Verified Expert Solution
Question
1 Approved Answer
Assignment 4 : Fairness with IBM AIF 3 6 0 The goal of this assignment is to study algorithmic fairness concepts using the AIF 3
Assignment : Fairness with IBM AIF
The goal of this assignment is to study algorithmic fairness concepts using the AIF tool. In this assignment, we will be using the COMPAS dataset.
Exercise
In groupbased definitions of algorithmic fairness, we define protected groups based on values on a protected attribute, like race, sex, and then measure the discrepancy of some metric among the protected groups in some observed outcomes. For example, we might compute the difference of the positive rate between males and females. In intersectional fairness, we are interested at what happens among groups that are defined based on intersections of attributes. For example, we might study what is the positive rate difference between males and females for those aged less than Or what is the positive rate difference between the four groups defined by race AfricanAmerican and Caucasian and sex males and females
In the first exercise:
Consider race to be the protected attribute, fix the bias using the reweighing preprocessing technique, and measure the bias assuming sex is the protected attribute.
Consider sex to be the protected attribute, fix the bias using the reweighing preprocessing technique, and measure the bias assuming race is the protected attribute.
Repeat these measurements considering age groups, to investigate questions like: is there unfairness with respect to either sex or race between those aged less than
In all cases, you should train a simple logistic regression classifier, and measure bias on a test set. Document and present your findings in a report.
Exercise
Consider the MultiDimensional Subset Scan MDSS method from that is implemented in AIF and showcased in the demomdssclassifiermetric.ipynb example notebook. The MDSS method is able to detect unfairness instances in subpopulations. In the second exercise
: Examine the privileged and unprivileged groups that MDSS identifies. For each of them, measure its bias and compare it to a group that has the opposite race or sex. For example, it a group is defined as age less than and race is Caucasian you should compare it to the group age less than and race is African American
Step by Step Solution
There are 3 Steps involved in it
Step: 1
Get Instant Access to Expert-Tailored Solutions
See step-by-step solutions with expert insights and AI powered tools for academic success
Step: 2
Step: 3
Ace Your Homework with AI
Get the answers you need in no time with our AI-driven, step-by-step assistance
Get Started