Data mining and statistical learning, lecture 5 Outline Summary of regressions on correlated inputs Ridge regression PCR (principal components regression)