Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf ›...

45
http://www.jstor.org Greedy Function Approximation: A Gradient Boosting Machine Author(s): Jerome H. Friedman Source: The Annals of Statistics, Vol. 29, No. 5 (Oct., 2001), pp. 1189-1232 Published by: Institute of Mathematical Statistics Stable URL: http://www.jstor.org/stable/2699986 Accessed: 05/09/2008 10:04 Your use of the JSTOR archive indicates your acceptance of JSTOR's Terms and Conditions of Use, available at http://www.jstor.org/page/info/about/policies/terms.jsp. JSTOR's Terms and Conditions of Use provides, in part, that unless you have obtained prior permission, you may not download an entire issue of a journal or multiple copies of articles, and you may use content in the JSTOR archive only for your personal, non-commercial use. Please contact the publisher regarding any further use of this work. Publisher contact information may be obtained at http://www.jstor.org/action/showPublisher?publisherCode=ims. Each copy of any part of a JSTOR transmission must contain the same copyright notice that appears on the screen or printed page of such transmission. JSTOR is a not-for-profit organization founded in 1995 to build trusted digital archives for scholarship. We work with the scholarly community to preserve their work and the materials they rely upon, and to build a common research platform that promotes the discovery and use of these resources. For more information about JSTOR, please contact [email protected].

Transcript of Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf ›...

Page 1: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting

http://www.jstor.org

Greedy Function Approximation: A Gradient Boosting MachineAuthor(s): Jerome H. FriedmanSource: The Annals of Statistics, Vol. 29, No. 5 (Oct., 2001), pp. 1189-1232Published by: Institute of Mathematical StatisticsStable URL: http://www.jstor.org/stable/2699986Accessed: 05/09/2008 10:04

Your use of the JSTOR archive indicates your acceptance of JSTOR's Terms and Conditions of Use, available at

http://www.jstor.org/page/info/about/policies/terms.jsp. JSTOR's Terms and Conditions of Use provides, in part, that unless

you have obtained prior permission, you may not download an entire issue of a journal or multiple copies of articles, and you

may use content in the JSTOR archive only for your personal, non-commercial use.

Please contact the publisher regarding any further use of this work. Publisher contact information may be obtained at

http://www.jstor.org/action/showPublisher?publisherCode=ims.

Each copy of any part of a JSTOR transmission must contain the same copyright notice that appears on the screen or printed

page of such transmission.

JSTOR is a not-for-profit organization founded in 1995 to build trusted digital archives for scholarship. We work with the

scholarly community to preserve their work and the materials they rely upon, and to build a common research platform that

promotes the discovery and use of these resources. For more information about JSTOR, please contact [email protected].

Page 2: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 3: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 4: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 5: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 6: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 7: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 8: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 9: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 10: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 11: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 12: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 13: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 14: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 15: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 16: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 17: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 18: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 19: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 20: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 21: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 22: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 23: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 24: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 25: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 26: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 27: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 28: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 29: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 30: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 31: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 32: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 33: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 34: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 35: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 36: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 37: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 38: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 39: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 40: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 41: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 42: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 43: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 44: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting
Page 45: Greedy Function Approximation: A Gradient Boosting Machine ...luthuli.cs.uiuc.edu › ~daf › courses › Optimization › ... · Greedy Function Approximation: A Gradient Boosting