Chapter 4 MODELING AND ANALYSIS 8 th Edition 12nd semester 2010 Dr. Qusai Abuein.
Model-based Discrimination Analysis: A Position...
Transcript of Model-based Discrimination Analysis: A Position...
![Page 1: Model-based Discrimination Analysis: A Position …fairware.cs.umass.edu/slides/ramadan.pdfModel-based Discrimination Analysis: A Position Paper @FairWare 2018 Qusai Ramadan 15 Backup!slides!](https://reader034.fdocuments.in/reader034/viewer/2022043006/5f8f4b2170957206141a522d/html5/thumbnails/1.jpg)
Model-based Discrimination Analysis: A Position Paper
1 Model-based Discrimination Analysis: A Position Paper @FairWare 2018 Qusai Ramadan
Qusai Ramadan1, Shayan Ahmadian1, Daniel Strüber1, Jan Jürjens1,2 and Steffen Staab1,3
1 University of Koblenz-Landau, Koblenz, Germany 2 Fraunhofer-Institute for Software and Systems Engineering ISST, Dortmund, Germany
3University of Southampton, UK
Tuesday 29th May 2018, Sweden, Gothenburg
![Page 2: Model-based Discrimination Analysis: A Position …fairware.cs.umass.edu/slides/ramadan.pdfModel-based Discrimination Analysis: A Position Paper @FairWare 2018 Qusai Ramadan 15 Backup!slides!](https://reader034.fdocuments.in/reader034/viewer/2022043006/5f8f4b2170957206141a522d/html5/thumbnails/2.jpg)
Basics
2 Model-based Discrimination Analysis: A Position Paper @FairWare 2018 Qusai Ramadan
§ Decision-making software may lead to undesirable discrimination: Ø exploiting sensitive data (e.g., race) Ø learning correlations between a set of data.
Black box approaches
White box approaches
1
2 Require the software to be implemented.
How to discover potential discrimination during the software design phase? (i.e., before having a faulty implementation)
![Page 3: Model-based Discrimination Analysis: A Position …fairware.cs.umass.edu/slides/ramadan.pdfModel-based Discrimination Analysis: A Position Paper @FairWare 2018 Qusai Ramadan 15 Backup!slides!](https://reader034.fdocuments.in/reader034/viewer/2022043006/5f8f4b2170957206141a522d/html5/thumbnails/3.jpg)
3 Model-based Discrimination Analysis: A Position Paper @FairWare 2018 Qusai Ramadan
Ø Bank offers three services Ø Zero-Fee Money Transfer (for international merchants) Ø Vacancies Announcement (for domestic persons educated in
accounting). Ø Apply for a loan.
Motivating Example 1
§ Policy: The bank disallows discriminating between the loans applicants based on their citizenship.
Loan decision-making software
Risky
Safe Input Xi: <needed amount of money, purpose> Business Analyst
![Page 4: Model-based Discrimination Analysis: A Position …fairware.cs.umass.edu/slides/ramadan.pdfModel-based Discrimination Analysis: A Position Paper @FairWare 2018 Qusai Ramadan 15 Backup!slides!](https://reader034.fdocuments.in/reader034/viewer/2022043006/5f8f4b2170957206141a522d/html5/thumbnails/4.jpg)
4 Model-based Discrimination Analysis: A Position Paper @FairWare 2018 Qusai Ramadan
Business Analyst
Motivating Example 1
Loan decision-making software
Risky
Safe Potential Input Xi: <needed amount of money, purpose>
Customers database
Other Data
![Page 5: Model-based Discrimination Analysis: A Position …fairware.cs.umass.edu/slides/ramadan.pdfModel-based Discrimination Analysis: A Position Paper @FairWare 2018 Qusai Ramadan 15 Backup!slides!](https://reader034.fdocuments.in/reader034/viewer/2022043006/5f8f4b2170957206141a522d/html5/thumbnails/5.jpg)
5 Model-based Discrimination Analysis: A Position Paper @FairWare 2018 Qusai Ramadan
Roadmap: Model-based Analysis
A Domain Expert and a Business Analyst Business Analyst
![Page 6: Model-based Discrimination Analysis: A Position …fairware.cs.umass.edu/slides/ramadan.pdfModel-based Discrimination Analysis: A Position Paper @FairWare 2018 Qusai Ramadan 15 Backup!slides!](https://reader034.fdocuments.in/reader034/viewer/2022043006/5f8f4b2170957206141a522d/html5/thumbnails/6.jpg)
6 Model-based Discrimination Analysis: A Position Paper @FairWare 2018 Qusai Ramadan
Action
Data object
Data Store Control flow
Information Flow Analysis
<<critical>> {nationality}
![Page 7: Model-based Discrimination Analysis: A Position …fairware.cs.umass.edu/slides/ramadan.pdfModel-based Discrimination Analysis: A Position Paper @FairWare 2018 Qusai Ramadan 15 Backup!slides!](https://reader034.fdocuments.in/reader034/viewer/2022043006/5f8f4b2170957206141a522d/html5/thumbnails/7.jpg)
7 Model-based Discrimination Analysis: A Position Paper @FairWare 2018 Qusai Ramadan
Database Schema § Information about whether a data object is derived or not can be represented
in the database schema.
Derived Property
Ø But it does not tell how it is derived.
![Page 8: Model-based Discrimination Analysis: A Position …fairware.cs.umass.edu/slides/ramadan.pdfModel-based Discrimination Analysis: A Position Paper @FairWare 2018 Qusai Ramadan 15 Backup!slides!](https://reader034.fdocuments.in/reader034/viewer/2022043006/5f8f4b2170957206141a522d/html5/thumbnails/8.jpg)
8 Model-based Discrimination Analysis: A Position Paper @FairWare 2018 Qusai Ramadan
Information Flow Analysis
There is indirect leakage of the citizenship data to the result data object.
![Page 9: Model-based Discrimination Analysis: A Position …fairware.cs.umass.edu/slides/ramadan.pdfModel-based Discrimination Analysis: A Position Paper @FairWare 2018 Qusai Ramadan 15 Backup!slides!](https://reader034.fdocuments.in/reader034/viewer/2022043006/5f8f4b2170957206141a522d/html5/thumbnails/9.jpg)
9 Model-based Discrimination Analysis: A Position Paper @FairWare 2018 Qusai Ramadan
Roadmap: Model-based Analysis
![Page 10: Model-based Discrimination Analysis: A Position …fairware.cs.umass.edu/slides/ramadan.pdfModel-based Discrimination Analysis: A Position Paper @FairWare 2018 Qusai Ramadan 15 Backup!slides!](https://reader034.fdocuments.in/reader034/viewer/2022043006/5f8f4b2170957206141a522d/html5/thumbnails/10.jpg)
10 Model-based Discrimination Analysis: A Position Paper @FairWare 2018 Qusai Ramadan
Motivating Example 2
§ What about dependencies with the gender?
Business Analyst
P(Female | ¬(">3k" €∩ international ∩ merchant) ∩ accounting) = 66.67% (i.e., given a national customer with educational background in accounting and the other data objects are not true)
Ø The nationality and the education background in this context can act as a proxy for the gender.
![Page 11: Model-based Discrimination Analysis: A Position …fairware.cs.umass.edu/slides/ramadan.pdfModel-based Discrimination Analysis: A Position Paper @FairWare 2018 Qusai Ramadan 15 Backup!slides!](https://reader034.fdocuments.in/reader034/viewer/2022043006/5f8f4b2170957206141a522d/html5/thumbnails/11.jpg)
11 Model-based Discrimination Analysis: A Position Paper @FairWare 2018 Qusai Ramadan
Roadmap: Model-based Analysis
![Page 12: Model-based Discrimination Analysis: A Position …fairware.cs.umass.edu/slides/ramadan.pdfModel-based Discrimination Analysis: A Position Paper @FairWare 2018 Qusai Ramadan 15 Backup!slides!](https://reader034.fdocuments.in/reader034/viewer/2022043006/5f8f4b2170957206141a522d/html5/thumbnails/12.jpg)
12 Model-based Discrimination Analysis: A Position Paper @FairWare 2018 Qusai Ramadan
Conclusion
A Domain Expert and a Business Analyst Business Analyst
![Page 13: Model-based Discrimination Analysis: A Position …fairware.cs.umass.edu/slides/ramadan.pdfModel-based Discrimination Analysis: A Position Paper @FairWare 2018 Qusai Ramadan 15 Backup!slides!](https://reader034.fdocuments.in/reader034/viewer/2022043006/5f8f4b2170957206141a522d/html5/thumbnails/13.jpg)
13 Model-based Discrimination Analysis: A Position Paper @FairWare 2018 Qusai Ramadan
Challenges
§ Information about the derived data are distributed in multiples diagrams.
§ How to measure the discrimination by proxy? (e.g., information gain)
![Page 14: Model-based Discrimination Analysis: A Position …fairware.cs.umass.edu/slides/ramadan.pdfModel-based Discrimination Analysis: A Position Paper @FairWare 2018 Qusai Ramadan 15 Backup!slides!](https://reader034.fdocuments.in/reader034/viewer/2022043006/5f8f4b2170957206141a522d/html5/thumbnails/14.jpg)
14 Model-based Discrimination Analysis: A Position Paper @FairWare 2018 Qusai Ramadan
Conclusion
![Page 15: Model-based Discrimination Analysis: A Position …fairware.cs.umass.edu/slides/ramadan.pdfModel-based Discrimination Analysis: A Position Paper @FairWare 2018 Qusai Ramadan 15 Backup!slides!](https://reader034.fdocuments.in/reader034/viewer/2022043006/5f8f4b2170957206141a522d/html5/thumbnails/15.jpg)
15 Model-based Discrimination Analysis: A Position Paper @FairWare 2018 Qusai Ramadan
Backup slides
![Page 16: Model-based Discrimination Analysis: A Position …fairware.cs.umass.edu/slides/ramadan.pdfModel-based Discrimination Analysis: A Position Paper @FairWare 2018 Qusai Ramadan 15 Backup!slides!](https://reader034.fdocuments.in/reader034/viewer/2022043006/5f8f4b2170957206141a522d/html5/thumbnails/16.jpg)
Protected Characteristics
16 Model-based Discrimination Analysis: A Position Paper @FairWare 2018 Qusai Ramadan
§ legally protected characteristics (e.g., age, gender, race, …).
§ But not limited to those listed by the laws and regulations.
Ø Example: a bank may disallow discriminating between the loans applicants based on their citizenship.
![Page 17: Model-based Discrimination Analysis: A Position …fairware.cs.umass.edu/slides/ramadan.pdfModel-based Discrimination Analysis: A Position Paper @FairWare 2018 Qusai Ramadan 15 Backup!slides!](https://reader034.fdocuments.in/reader034/viewer/2022043006/5f8f4b2170957206141a522d/html5/thumbnails/17.jpg)
Initial Statistical Analysis
17 Model-based Discrimination Analysis: A Position Paper @FairWare 2018 Qusai Ramadan
P(international | zero_Fee ∩ vac_Ann ∩ high_Income)
Ø a societal fact (e.g., a taxi driver in Saudi Arabia).
Ø They could be derived from processing the citizenship information.