Probabilities Probability Distribution Predictor Variables Prior Information New Data

20
•Probabilities •Probability Distribution •Predictor Variables •Prior Information •New Data •Prior and New Data Overview

description

Overview. Probabilities Probability Distribution Predictor Variables Prior Information New Data Prior and New Data. Medieval Times: Dice and Gambling. Modern Times: Dice and Games/ Gambing. Dice Probabilities. 1 6. Dice Outcome are Independent. =. 16.7%. Sum. 6 3 6. =. 16.78%. - PowerPoint PPT Presentation

Transcript of Probabilities Probability Distribution Predictor Variables Prior Information New Data

Page 1: Probabilities Probability Distribution Predictor Variables Prior Information New Data

• Probabilities• Probability Distribution• Predictor Variables• Prior Information• New Data• Prior and New Data

Overview

Page 2: Probabilities Probability Distribution Predictor Variables Prior Information New Data

Medieval Times: Dice and Gambling

Page 3: Probabilities Probability Distribution Predictor Variables Prior Information New Data

Modern Times: Dice and Games/Gambing

Page 4: Probabilities Probability Distribution Predictor Variables Prior Information New Data

Dice Probabilities

16

= 16.7%

1 2 3 4 5 6

1 2 3 4 5 6 7

2 3 4 5 6 7 8

3 4 5 6 7 8 9

4 5 6 7 8 9 10

5 6 7 8 9 10 11

6 7 8 9 10 11 12

136 = 2.78%

636

= 16.78%

Dice Outcome are Independent

Sum

Page 5: Probabilities Probability Distribution Predictor Variables Prior Information New Data

Dice Probabilities

1 2 3 4 5 61 2 3 4 5 6 7

2 3 4 5 6 7 8

3 4 5 6 7 8 9

4 5 6 7 8 9 10

5 6 7 8 9 10 11

6 7 8 9 10 11 12

Probability Distribution

Page 6: Probabilities Probability Distribution Predictor Variables Prior Information New Data

Blaise Pascal

1600’s: Probability & Gambling

one "6" in four rolls  one double-six in 24 throws

Do these have equal probabilities?

Chevalier de Méré

Page 7: Probabilities Probability Distribution Predictor Variables Prior Information New Data

Prediction Model: Dice

16

= 16.7%

Y = ?

No Predictor Variables

Page 8: Probabilities Probability Distribution Predictor Variables Prior Information New Data

Prediction Model: Heights

ChildHeight = FatherHeight + MotherHeight + Gender + ƐPredictor Variables!!!

Linear Regression invented in 1877 by Francis Galton

Page 9: Probabilities Probability Distribution Predictor Variables Prior Information New Data

Prediction Model: LogisticLogistic Regression invented in 1838 by Pierre-Francois Verhulst

Page 10: Probabilities Probability Distribution Predictor Variables Prior Information New Data

Probability & Classification: Gender ~ HeightLet’s Invert the Problem – “Given Child Height What is the Gender?”

and Pretend its 1761 – Before Logistic Regression

49% 51%

female male

Gender ChildHeight(Categorical) (Continuous)

Page 11: Probabilities Probability Distribution Predictor Variables Prior Information New Data

1761: Bayesian

Probability Distribution

New Data

ProbabilityFemale

ProbabilityMale

Height of the Person

=

DataPrior (X) Prior (X)

DataPrior (X)

60 67.5 75

=

Gender

Prior (X)

Child Height

66.5

Page 12: Probabilities Probability Distribution Predictor Variables Prior Information New Data

Bayesian Formulas

0.49

0.51

Same for both female and male

Page 13: Probabilities Probability Distribution Predictor Variables Prior Information New Data

Normal Distribution and Probability

D

D

69.2

65.5

61.3

2.6

Page 14: Probabilities Probability Distribution Predictor Variables Prior Information New Data

Bayesian Formulas

60

67.575

66.56.8848775.549099

D

D

D

Page 15: Probabilities Probability Distribution Predictor Variables Prior Information New Data

Bayesian Formulas – ExcelD

Page 16: Probabilities Probability Distribution Predictor Variables Prior Information New Data

Naïve Bayes

84.1%

Page 17: Probabilities Probability Distribution Predictor Variables Prior Information New Data

Naïve Bayes

Page 18: Probabilities Probability Distribution Predictor Variables Prior Information New Data

Probability: Gender ~ Height + Weight + FootSize

Page 19: Probabilities Probability Distribution Predictor Variables Prior Information New Data

Probability: Gender ~ Height + Weight + FootSize

Page 20: Probabilities Probability Distribution Predictor Variables Prior Information New Data

Probability: Gender ~ Height + Weight + FootSize