Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools
description
Transcript of Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools
![Page 1: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/1.jpg)
1
Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools
5.1 Introduction
5.2 Input Selection
5.3 Stopped Training
5.4 Other Modeling Tools (Self-Study)
![Page 2: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/2.jpg)
2
Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools
5.1 Introduction 5.1 Introduction
5.2 Input Selection
5.3 Stopped Training
5.4 Other Modeling Tools (Self-Study)
![Page 3: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/3.jpg)
3
Model Essentials – Neural Networks
Predict new cases.
Select useful inputs.
Optimize complexity.
...
![Page 4: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/4.jpg)
4
Model Essentials – Neural Networks
Stoppedtraining
None
Predict new cases.
Select useful inputs
Optimize complexity
Select useful inputs.
Optimize complexity.
...
![Page 5: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/5.jpg)
5
Model Essentials – Neural Networks
Stoppedtraining
None
Predict new cases.
Select useful inputs.
Optimize complexity.
...
![Page 6: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/6.jpg)
6
Neural Network Prediction Formula
predictionestimate
weightestimate
hidden unit
biasestimate
0
1
5-5
-1
tanh
...
activationfunction
...
![Page 7: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/7.jpg)
8
Neural Network Binary Prediction Formula
0
1
5-5
-1
tanh
0 1
5
-5
logitlink function
...
![Page 8: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/8.jpg)
9
Neural Network Diagram
y
targetlayer
H1
H2
H3
hiddenlayer
x2
inputlayer
x1
...
![Page 9: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/9.jpg)
10
Neural Network Diagram
y
targetlayer
H1
H2
H3
hiddenlayer
x2
inputlayer
x1
...
![Page 10: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/10.jpg)
11
Prediction Illustration – Neural Networks
...
logit equation
0.0 0.50.1 0.2 0.3 0.4 0.6 0.7 0.8 0.9 1.0
x1
0.0
0.5
0.1
0.2
0.3
0.4
0.6
0.7
0.8
0.9
1.0
x2
![Page 11: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/11.jpg)
12
Prediction Illustration – Neural Networks
...
logit equation
Need weight estimates.
0.0 0.50.1 0.2 0.3 0.4 0.6 0.7 0.8 0.9 1.0
x1
0.0
0.5
0.1
0.2
0.3
0.4
0.6
0.7
0.8
0.9
1.0
x2
![Page 12: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/12.jpg)
13
Prediction Illustration – Neural Networks
...
logit equation
Log-likelihood Function
Weight estimates found by maximizing:
0.0 0.50.1 0.2 0.3 0.4 0.6 0.7 0.8 0.9 1.0
x1
0.0
0.5
0.1
0.2
0.3
0.4
0.6
0.7
0.8
0.9
1.0
x2
![Page 13: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/13.jpg)
14
Prediction Illustration – Neural Networks
...
logit equation 0.70
0.60
0.50
0.40
0.40
0.60
0.50
0.50
0.60
0.30
Probability estimates are obtained by solving the logit equation for p for each (x1, x2).^
0.0 0.50.1 0.2 0.3 0.4 0.6 0.7 0.8 0.9 1.0
x1
0.0
0.5
0.1
0.2
0.3
0.4
0.6
0.7
0.8
0.9
1.0
x2
![Page 14: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/14.jpg)
15
Neural Nets: Beyond the Prediction Formula
Interpret the modelInterpret the model.
Handle extreme or unusual values
Use non-numeric inputs
Account for nonlinearities
Manage missing values.
Handle extreme or unusual values.
Use non-numeric inputs.
Account for nonlinearities.
...
![Page 15: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/15.jpg)
17
Training a Neural Network
This demonstration illustrates using the Neural Network tool.
![Page 16: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/16.jpg)
18
Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools
5.1 Introduction
5.2 Input Selection5.2 Input Selection
5.3 Stopped Training
5.4 Other Modeling Tools (Self-Study)
![Page 17: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/17.jpg)
19
Model Essentials – Neural Networks
Predictionformula
Best modelfrom sequence
Sequentialselection
Predict new cases.
Select useful inputs
Optimize complexity.
Select useful inputs.
![Page 18: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/18.jpg)
20
![Page 19: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/19.jpg)
21
5.01 Multiple Answer PollWhich of the following are true about neural networks in SAS Enterprise Miner?
a. Neural networks are universal approximators.
b. Neural networks have no internal, automated process for selecting useful inputs.
c. Neural networks are easy to interpret and thus are very useful in highly regulated industries.
d. Neural networks cannot model nonlinear relationships.
![Page 20: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/20.jpg)
22
5.01 Multiple Answer Poll – Correct AnswersWhich of the following are true about neural networks in SAS Enterprise Miner?
a. Neural networks are universal approximators.
b. Neural networks have no internal, automated process for selecting useful inputs.
c. Neural networks are easy to interpret and thus are very useful in highly regulated industries.
d. Neural networks cannot model nonlinear relationships.
![Page 21: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/21.jpg)
23
Selecting Neural Network Inputs
This demonstration illustrates how to use a logistic regression to select inputs for a neural network.
![Page 22: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/22.jpg)
24
Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools
5.1 Introduction
5.2 Input Selection
5.3 Stopped Training5.3 Stopped Training
5.4 Other Modeling Tools (Self-Study)
![Page 23: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/23.jpg)
25
Model Essentials – Neural Networks
Predict new cases.
Select useful inputs.
Optimize complexity.
Predictionformula
Sequentialselection
...
![Page 24: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/24.jpg)
26
Fit Statistic versus Optimization Iteration
^logit(ρ1)logit( p ) = ^
H1 = tanh(-1.5 - .03x1 - .07x2)
H2 = tanh( .79 - .17x1 - .16x2)
H3 = tanh( .57 + .05x1 +.35x2 )
logit(0.5)0
initial hidden unit weights
+ 0·H1 + 0·H2 + 0·H3
...
![Page 25: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/25.jpg)
27
Fit Statistic versus Optimization Iteration
H1 = tanh(-1.5 - .03x1 - .07x2)
H2 = tanh( .79 - .17x1 - .16x2)
H3 = tanh( .57 + .05x1 +.35x2 )
H1 = tanh(-1.5 - .03x1 - .07x2)
H2 = tanh( .79 - .17x1 - .16x2)
H3 = tanh( .57 + .05x1 +.35x2 )
logit( p ) = ^ 0 + 0·H1 + 0·H2 + 0·H3
random initial input weights and biases
...
![Page 26: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/26.jpg)
28
Fit Statistic versus Optimization Iteration
H1 = tanh(-1.5 - .03x1 - .07x2)
H2 = tanh( .79 - .17x1 - .16x2)
H3 = tanh( .57 + .05x1 +.35x2 )
H1 = tanh(-1.5 - .03x1 - .07x2)
H2 = tanh( .79 - .17x1 - .16x2)
H3 = tanh( .57 + .05x1 +.35x2 )
logit( p ) = ^ 0 + 0·H1 + 0·H2 + 0·H3
random initial input weights and biases
...
![Page 27: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/27.jpg)
29
Fit Statistic versus Optimization Iteration
0 5 15 20Iteration10
...
![Page 28: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/28.jpg)
30
Fit Statistic versus Optimization Iteration
0 5 15 20
validationtraining
ASE
Iteration1 10
...
![Page 29: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/29.jpg)
31
Fit Statistic versus Optimization Iteration
0 5 15 20
validationtraining
ASE
Iteration2 10
...
![Page 30: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/30.jpg)
32
Fit Statistic versus Optimization Iteration
0 5 15 20
validationtraining
ASE
Iteration3 10
...
![Page 31: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/31.jpg)
33
Fit Statistic versus Optimization Iteration
0 5 15 20
validationtraining
ASE
Iteration4 10
...
![Page 32: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/32.jpg)
34
Fit Statistic versus Optimization Iteration
0 5 15 20
validationtraining
ASE
Iteration10
...
![Page 33: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/33.jpg)
35
Fit Statistic versus Optimization Iteration
0 5 15 20
validationtraining
ASE
Iteration6 10
...
![Page 34: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/34.jpg)
36
Fit Statistic versus Optimization Iteration
0 5 15 20
validationtraining
ASE
Iteration7 10
...
![Page 35: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/35.jpg)
37
Fit Statistic versus Optimization Iteration
0 5 10 15 20
validationtraining
ASE
Iteration8
...
![Page 36: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/36.jpg)
38
Fit Statistic versus Optimization Iteration
0 5 10 15 20
validationtraining
ASE
Iteration9
...
![Page 37: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/37.jpg)
39
Fit Statistic versus Optimization Iteration
0 5 15 20
validationtraining
ASE
Iteration10
...
![Page 38: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/38.jpg)
40
Fit Statistic versus Optimization Iteration
0 5 15 20
validationtraining
ASE
Iteration1011
...
![Page 39: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/39.jpg)
41
Fit Statistic versus Optimization Iteration
0 5 15 20
validationtraining
ASE
Iteration10 12
...
![Page 40: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/40.jpg)
42
Fit Statistic versus Optimization Iteration
0 5 15 20
validationtraining
ASE
Iteration10 13
...
![Page 41: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/41.jpg)
43
Fit Statistic versus Optimization Iteration
0 5 15 20
validationtraining
ASE
Iteration10 14
...
![Page 42: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/42.jpg)
44
Fit Statistic versus Optimization Iteration
0 5 15 20
validationtraining
ASE
Iteration10
...
![Page 43: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/43.jpg)
45
Fit Statistic versus Optimization Iteration
0 5 20
validationtraining
ASE
Iteration1510 16
...
![Page 44: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/44.jpg)
46
Fit Statistic versus Optimization Iteration
0 5 20
validationtraining
ASE
Iteration1510 17
...
![Page 45: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/45.jpg)
47
Fit Statistic versus Optimization Iteration
0 5 20
validationtraining
ASE
Iteration1510 18
...
![Page 46: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/46.jpg)
48
Fit Statistic versus Optimization Iteration
0 5 20
validationtraining
ASE
Iteration1510 19
...
![Page 47: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/47.jpg)
49
Fit Statistic versus Optimization Iteration
0 5
validationtraining
ASE
Iteration201510
...
![Page 48: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/48.jpg)
50
Fit Statistic versus Optimization Iteration
0 5
validationtraining
ASE
Iteration201510 21
...
![Page 49: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/49.jpg)
51
Fit Statistic versus Optimization Iteration
0 5
validationtraining
ASE
Iteration201510 22
...
![Page 50: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/50.jpg)
52
Fit Statistic versus Optimization Iteration
0 5
validationtraining
ASE
Iteration201510 23
...
![Page 51: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/51.jpg)
53
Fit Statistic versus Optimization Iteration
ASE
Iteration
0.70
0.60
0.50
0.40
0.40
0.60
0.50
0.50
0.60
0.30
0 5 15 2010 12
...
![Page 52: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/52.jpg)
54
Increasing Network Flexibility
This demonstration illustrates how to further improve neural network performance.
![Page 53: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/53.jpg)
55
Using the AutoNeural Tool (Self-Study)
This demonstration illustrates how to use the AutoNeural tool.
![Page 54: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/54.jpg)
56
Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools
5.1 Introduction
5.2 Input Selection
5.3 Stopped Training
5.4 Other Modeling Tools (Self-Study)5.4 Other Modeling Tools (Self-Study)
![Page 55: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/55.jpg)
57
Model Essentials – Rule Induction
Predict new cases.
Select useful inputs.
Optimize complexity.
![Page 56: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/56.jpg)
58
Rule Induction Predictions
0.0 0.50.1 0.2 0.3 0.4 0.6 0.7 0.8 0.9 1.0
x1
0.0
0.5
0.1
0.2
0.3
0.4
0.6
0.7
0.8
0.9
1.0
x2
0.74
0.39
[Rips create prediction rules.]
A binary model sequentially classifies and removes correctly classified cases.
[A neural network predicts remaining cases.]
![Page 57: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/57.jpg)
59
Model Essentials – Dmine Regression
Predict new cases.
Select useful inputs.
Optimize complexity.
![Page 58: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/58.jpg)
60
Dmine Regression Predictions Interval inputs binned,
categorical inputs grouped
Forward selection picks from binned and original inputs
![Page 59: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/59.jpg)
61
Model Essentials – DMNeural
Predict new cases.
Select useful inputs.
Optimize complexity.
![Page 60: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/60.jpg)
62
DMNeural Predictions
0.0 0.50.1 0.2 0.3 0.4 0.6 0.7 0.8 0.9 1.0
x1
0.0
0.5
0.1
0.2
0.3
0.4
0.6
0.7
0.8
0.9
1.0 Up to three PCs with highest target R square are selected.
One of eight continuous transformations are selected and applied to selected PCs.
The process is repeated three times with residuals from each stage.
![Page 61: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/61.jpg)
63
Model Essentials – Least Angle Regression
Predict new cases.
Select useful inputs.
Optimize complexity.
![Page 62: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/62.jpg)
64
Least Angle Regression Predictions
1.0
Inputs are selected using a generalization of forward selection.
An input combination in the sequence with optimal, penalized validation assessment is selected by default.
0.0 0.50.1 0.2 0.3 0.4 0.6 0.7 0.8 0.9
x1
0.0
0.5
0.1
0.2
0.3
0.4
0.6
0.7
0.8
0.9
1.0
![Page 63: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/63.jpg)
65
Model Essentials – MBR
Predict new cases.
Select useful inputs.
Optimize complexity.
![Page 64: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/64.jpg)
66
MBR Prediction Estimates
0.0 0.50.1 0.2 0.3 0.4 0.6 0.7 0.8 0.9 1.0
0.0
0.5
0.1
0.2
0.3
0.4
0.6
0.7
0.8
0.9
1.0
x1
Sixteen nearest training data cases predict the target for each point in the input space.
Scoring requires training data and the PMBR procedure.
![Page 65: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/65.jpg)
67
Model Essentials – Partial Least Squares
Predict new cases.
Select useful inputs.
Optimize complexity.
![Page 66: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/66.jpg)
68
Partial Least Squares Predictions
0.0 0.50.1 0.2 0.3 0.4 0.6 0.7 0.8 0.9 1.0
x1
0.0
0.5
0.1
0.2
0.3
0.4
0.6
0.7
0.8
0.9
1.0 Input combinations (factors) that optimally account for both predictor and response variation are successively selected.
Factor count with a minimum validation PRESS statistic is selected.
Inputs with small VIP are rejected for subsequent diagram nodes.
![Page 67: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/67.jpg)
69
Exercises
This exercise reinforces the concepts discussed previously.
![Page 68: Chapter 5: Introduction to Predictive Modeling: Neural Networks and Other Modeling Tools](https://reader033.fdocuments.in/reader033/viewer/2022061506/56814641550346895db34b85/html5/thumbnails/68.jpg)
70
Neural Network Tool ReviewCreate a multi-layer perceptron on selected inputs. Control complexity with stopped training and hidden unit count.