Active learning
8
Data Mining and Machine Learning- in a nutshell Arizona State University Data Mining and Machine Learning Lab Active Learning 1 DATA MINING AND MACHINE LEARNING IN A NUTSHELL ACTIVE LEARNING Mohammad-Ali Abbasi http://www.public.asu.edu/~mabbasi2/ SCHOOL OF COMPUTING, INFORMATICS, AND DECISION SYSTEMS ENGINEERING ARIZONA STATE UNIVERSITY http://dmml.asu.edu/
-
Upload
mohammad-ali-abbasi -
Category
Engineering
-
view
976 -
download
2
description
Transcript of Active learning
Data Mining and Machine Learning- in a nutshellArizona State University Data Mining and Machine Learning Lab Active Learning 1
DATA MINING AND MACHINE LEARNINGIN A NUTSHELL
ACTIVE LEARNING
Mohammad-Ali Abbasihttp://www.public.asu.edu/~mabbasi2/
SCHOOL OF COMPUTING, INFORMATICS, AND DECISION SYSTEMS ENGINEERINGARIZONA STATE UNIVERSITY
http://dmml.asu.edu/
Data Mining and Machine Learning- in a nutshellArizona State University Data Mining and Machine Learning Lab Active Learning 2
What is Active Learning
The process of guiding the sampling process by querying for certain types of instances based upon the data that we have seen
so far
Data Mining and Machine Learning- in a nutshellArizona State University Data Mining and Machine Learning Lab Active Learning 3
The importance of Active learning
• The process of labeling the training data is not only time-consuming but also very expensive
• Less training data we need, more we will save
Data Mining and Machine Learning- in a nutshellArizona State University Data Mining and Machine Learning Lab Active Learning 4
Applications
• Text classification
• Web page classification
• Junk mail recognition
Data Mining and Machine Learning- in a nutshellArizona State University Data Mining and Machine Learning Lab Active Learning 5
Methods
• Neural Networks
• Bayesian rule
• SVM
No matter which method will be used, the core problem will be the same
•The core problem is how to select training points actively?
•In other words, which training points will be informative to the model?
Data Mining and Machine Learning- in a nutshellArizona State University Data Mining and Machine Learning Lab Active Learning 6
Active vs. Passive Learning
• Passive:– Randomly select training samples
• Active– Use an automated method to select training
samples
Data Mining and Machine Learning- in a nutshellArizona State University Data Mining and Machine Learning Lab Active Learning 7
References
• Theory, Methods and Applications of Active Learning
– Robert Nowak, Department of Electrical and Computer Engineering, University of Wisconsin - Madison
– Rui Castro, Department of Electrical Engineering, Columbia University
– Published: July 30, 2009, recorded: June 2009– http://videolectures.net/mlss09us_nowak_castro_tmaal/
Data Mining and Machine Learning- in a nutshellArizona State University Data Mining and Machine Learning Lab Active Learning 8
Mohammad-Ali Abbasi (Ali), Ali, is a Ph.D student at Data Mining and Machine Learning Lab, Arizona State University. His research interests include Data Mining, Machine Learning, Social Computing, and Social Media Behavior Analysis.
http://www.public.asu.edu/~mabbasi2/
