MA8701 General Statistical Methods - NTNU · The Elements of Statistical Learning Partly using...

31
MA8701 General Statistical Methods 5 February 2019 Smoothing and splines Bo Lindqvist

Transcript of MA8701 General Statistical Methods - NTNU · The Elements of Statistical Learning Partly using...

Page 1: MA8701 General Statistical Methods - NTNU · The Elements of Statistical Learning Partly using slides from STAT 315a (Stanford) ... Statistical Learning Data Mining, Inference, and

MA8701 General Statistical Methods

5 February 2019

Smoothing and splines

Bo Lindqvist

Page 2: MA8701 General Statistical Methods - NTNU · The Elements of Statistical Learning Partly using slides from STAT 315a (Stanford) ... Statistical Learning Data Mining, Inference, and

The lecture is based on Chapter 5 of

Hastie et al.: The Elements of Statistical Learning

Partly using slides from STAT 315a (Stanford) Produced by Rob Tibshirani

and

Slides from TMA4268 Statistical Learningby Andreas Strand

Page 3: MA8701 General Statistical Methods - NTNU · The Elements of Statistical Learning Partly using slides from STAT 315a (Stanford) ... Statistical Learning Data Mining, Inference, and
Page 4: MA8701 General Statistical Methods - NTNU · The Elements of Statistical Learning Partly using slides from STAT 315a (Stanford) ... Statistical Learning Data Mining, Inference, and
Page 5: MA8701 General Statistical Methods - NTNU · The Elements of Statistical Learning Partly using slides from STAT 315a (Stanford) ... Statistical Learning Data Mining, Inference, and
Page 6: MA8701 General Statistical Methods - NTNU · The Elements of Statistical Learning Partly using slides from STAT 315a (Stanford) ... Statistical Learning Data Mining, Inference, and
Page 7: MA8701 General Statistical Methods - NTNU · The Elements of Statistical Learning Partly using slides from STAT 315a (Stanford) ... Statistical Learning Data Mining, Inference, and
Page 8: MA8701 General Statistical Methods - NTNU · The Elements of Statistical Learning Partly using slides from STAT 315a (Stanford) ... Statistical Learning Data Mining, Inference, and

Restriction methods

Page 9: MA8701 General Statistical Methods - NTNU · The Elements of Statistical Learning Partly using slides from STAT 315a (Stanford) ... Statistical Learning Data Mining, Inference, and

Selection methods

Page 10: MA8701 General Statistical Methods - NTNU · The Elements of Statistical Learning Partly using slides from STAT 315a (Stanford) ... Statistical Learning Data Mining, Inference, and

Piecewise Constant and Linear

Page 11: MA8701 General Statistical Methods - NTNU · The Elements of Statistical Learning Partly using slides from STAT 315a (Stanford) ... Statistical Learning Data Mining, Inference, and

Piecewise Cubic Polynomials

Page 12: MA8701 General Statistical Methods - NTNU · The Elements of Statistical Learning Partly using slides from STAT 315a (Stanford) ... Statistical Learning Data Mining, Inference, and
Page 13: MA8701 General Statistical Methods - NTNU · The Elements of Statistical Learning Partly using slides from STAT 315a (Stanford) ... Statistical Learning Data Mining, Inference, and

A nice introduction to use of splines is given in: https://datascienceplus.com/cubic-and-smoothing-splines-in-r/

Example uses cubic splines for Wage data in ISLRx=age, y=wage, k=3 knots

Page 14: MA8701 General Statistical Methods - NTNU · The Elements of Statistical Learning Partly using slides from STAT 315a (Stanford) ... Statistical Learning Data Mining, Inference, and
Page 15: MA8701 General Statistical Methods - NTNU · The Elements of Statistical Learning Partly using slides from STAT 315a (Stanford) ... Statistical Learning Data Mining, Inference, and
Page 16: MA8701 General Statistical Methods - NTNU · The Elements of Statistical Learning Partly using slides from STAT 315a (Stanford) ... Statistical Learning Data Mining, Inference, and
Page 17: MA8701 General Statistical Methods - NTNU · The Elements of Statistical Learning Partly using slides from STAT 315a (Stanford) ... Statistical Learning Data Mining, Inference, and

Natural Cubic Splines

Page 18: MA8701 General Statistical Methods - NTNU · The Elements of Statistical Learning Partly using slides from STAT 315a (Stanford) ... Statistical Learning Data Mining, Inference, and
Page 19: MA8701 General Statistical Methods - NTNU · The Elements of Statistical Learning Partly using slides from STAT 315a (Stanford) ... Statistical Learning Data Mining, Inference, and
Page 20: MA8701 General Statistical Methods - NTNU · The Elements of Statistical Learning Partly using slides from STAT 315a (Stanford) ... Statistical Learning Data Mining, Inference, and
Page 21: MA8701 General Statistical Methods - NTNU · The Elements of Statistical Learning Partly using slides from STAT 315a (Stanford) ... Statistical Learning Data Mining, Inference, and

Smoothing Splines

Page 22: MA8701 General Statistical Methods - NTNU · The Elements of Statistical Learning Partly using slides from STAT 315a (Stanford) ... Statistical Learning Data Mining, Inference, and
Page 23: MA8701 General Statistical Methods - NTNU · The Elements of Statistical Learning Partly using slides from STAT 315a (Stanford) ... Statistical Learning Data Mining, Inference, and
Page 24: MA8701 General Statistical Methods - NTNU · The Elements of Statistical Learning Partly using slides from STAT 315a (Stanford) ... Statistical Learning Data Mining, Inference, and
Page 25: MA8701 General Statistical Methods - NTNU · The Elements of Statistical Learning Partly using slides from STAT 315a (Stanford) ... Statistical Learning Data Mining, Inference, and
Page 26: MA8701 General Statistical Methods - NTNU · The Elements of Statistical Learning Partly using slides from STAT 315a (Stanford) ... Statistical Learning Data Mining, Inference, and
Page 27: MA8701 General Statistical Methods - NTNU · The Elements of Statistical Learning Partly using slides from STAT 315a (Stanford) ... Statistical Learning Data Mining, Inference, and
Page 28: MA8701 General Statistical Methods - NTNU · The Elements of Statistical Learning Partly using slides from STAT 315a (Stanford) ... Statistical Learning Data Mining, Inference, and
Page 29: MA8701 General Statistical Methods - NTNU · The Elements of Statistical Learning Partly using slides from STAT 315a (Stanford) ... Statistical Learning Data Mining, Inference, and
Page 30: MA8701 General Statistical Methods - NTNU · The Elements of Statistical Learning Partly using slides from STAT 315a (Stanford) ... Statistical Learning Data Mining, Inference, and
Page 31: MA8701 General Statistical Methods - NTNU · The Elements of Statistical Learning Partly using slides from STAT 315a (Stanford) ... Statistical Learning Data Mining, Inference, and