Barocas - Algorithms and Explanation

18
Understanding Inscrutability Solon Barocas Microsoft Research @s010n

Transcript of Barocas - Algorithms and Explanation

UnderstandingInscrutabilitySolonBarocas

MicrosoftResearch@s010n

Performance/Interpretability

DARPA’sExplainableArtificialIntelligence(XAI)

SourcesofInscrutability

Linear

LengthofEmployment

Cred

itScore

Nonlinear

LengthofEmployment

Cred

itScore

Non-Monotonic

LengthofEmployment

Cred

itScore

MultidimensionalLinear

MultidimensionalNonlinear

MultidimensionalNon-Monotonic

MultidimensionalNon-Monotonic

4-LayerNeuralNetwork

Accountingforadecision

Steppingthroughthelogic

Defendingthebasisofdecision-making

Features

Learningmethods

Monotonicity

Post-hocexplanations

Istherereallyatrade-off?

UnderstandingInscrutabilityThankssomuchtoChandlerMay!

SolonBarocasMicrosoftResearch

@s010n