An Introduction to WEKA Explorer -...
Transcript of An Introduction to WEKA Explorer -...
![Page 1: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/1.jpg)
In part from: Yizhou Sun 2008
An Introduction to WEKA Explorer
![Page 2: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/2.jpg)
What is WEKA? � Waikato Environment for Knowledge Analysis
� It’s a data mining/machine learning tool developed by Department of Computer Science, University of Waikato, New Zealand.
� Weka is also a bird found only on the islands of New Zealand.
2 22/01/16
![Page 3: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/3.jpg)
Download and Install WEKA � Website:
http://www.cs.waikato.ac.nz/~ml/weka/index.html � Support multiple platforms (written in java):
� Windows, Mac OS X and Linux
3 22/01/16
![Page 4: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/4.jpg)
Main Features � 49 data preprocessing tools � 76 classification/regression algorithms � 8 clustering algorithms � 3 algorithms for finding association rules � 15 attribute/subset evaluators + 10 search algorithms
for feature selection
4 22/01/16
![Page 5: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/5.jpg)
Main GUI � Three graphical user interfaces
� “The Explorer” (exploratory data analysis) � “The Experimenter” (experimental
environment) � “The KnowledgeFlow” (new process model
inspired interface) � Simple CLI- provides users without a graphic
interface option the ability to execute commands from a terminal window
5 22/01/16
![Page 6: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/6.jpg)
Explorer � The Explorer:
� Preprocess data � Classification � Clustering � Association Rules � Attribute Selection � Data Visualization
� References and Resources
6 22/01/16
![Page 7: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/7.jpg)
22/01/16 7
Explorer: pre-processing the data � Data can be imported from a file in various formats: ARFF,
CSV, C4.5, binary � Data can also be read from a URL or from an SQL database
(using JDBC) � Pre-processing tools in WEKA are called “filters” � WEKA contains filters for:
� Discretization, normalization, resampling, attribute selection, transforming and combining attributes, …
![Page 8: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/8.jpg)
22/01/16 8
@relation heart-disease-simplified @attribute age numeric @attribute sex { female, male} @attribute chest_pain_type { typ_angina, asympt, non_anginal, atyp_angina} @attribute cholesterol numeric @attribute exercise_induced_angina { no, yes} @attribute class { present, not_present} @data 63,male,typ_angina,233,no,not_present 67,male,asympt,286,yes,present 67,male,asympt,229,yes,present 38,female,non_anginal,?,no,not_present ...
WEKA only deals with “flat” files
![Page 9: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/9.jpg)
22/01/16 9
@relation heart-disease-simplified @attribute age numeric @attribute sex { female, male} @attribute chest_pain_type { typ_angina, asympt, non_anginal, atyp_angina} @attribute cholesterol numeric @attribute exercise_induced_angina { no, yes} @attribute class { present, not_present} @data 63,male,typ_angina,233,no,not_present 67,male,asympt,286,yes,present 67,male,asympt,229,yes,present 38,female,non_anginal,?,no,not_present ...
WEKA only deals with “flat” files
![Page 10: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/10.jpg)
22/01/16 University of Waikato 10
![Page 11: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/11.jpg)
22/01/16 University of Waikato 11
![Page 12: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/12.jpg)
![Page 13: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/13.jpg)
![Page 14: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/14.jpg)
IRIS dataset � 5 attributes, one is the classification � 3 classes: setosa, versicolor, virginica
![Page 15: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/15.jpg)
22/01/16 University of Waikato 15
![Page 16: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/16.jpg)
Attribute data � Min, max and average value of attributes � distribution of values :number of items for which:
� class: distribution of attribute values in the classes
ai = v j | ai ∈ A,v j ∈V
![Page 17: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/17.jpg)
![Page 18: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/18.jpg)
22/01/16 University of Waikato 18
![Page 19: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/19.jpg)
22/01/16 University of Waikato 19
![Page 20: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/20.jpg)
22/01/16 University of Waikato 20
![Page 21: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/21.jpg)
22/01/16 University of Waikato 21
![Page 22: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/22.jpg)
Filtering attributes � Once the initial data has been selected and loaded the user
can select options for refining the experimental data. � The options in the preprocess window include selection of
optional filters to apply and the user can select or remove different attributes of the data set as necessary to identify specific information.
� The user can modify the attribute selection and change the relationship among the different attributes by deselecting different choices from the original data set.
� There are many different filtering options available within the preprocessing window and the user can select the different options based on need and type of data present.
![Page 23: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/23.jpg)
22/01/16 University of Waikato 23
![Page 24: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/24.jpg)
22/01/16 University of Waikato 24
![Page 25: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/25.jpg)
22/01/16 University of Waikato 25
![Page 26: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/26.jpg)
22/01/16 University of Waikato 26
![Page 27: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/27.jpg)
22/01/16 University of Waikato 27
![Page 28: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/28.jpg)
22/01/16 University of Waikato 28
![Page 29: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/29.jpg)
22/01/16 University of Waikato 29
![Page 30: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/30.jpg)
22/01/16 University of Waikato 30
![Page 31: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/31.jpg)
22/01/16 University of Waikato 31
Discretizes in 10 bins of equal frequency
![Page 32: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/32.jpg)
22/01/16 University of Waikato 32
Discretizes in 10 bins of equal frequency
![Page 33: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/33.jpg)
22/01/16 University of Waikato 33
Discretizes in 10 bins of equal frequency
![Page 34: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/34.jpg)
22/01/16 University of Waikato 34
![Page 35: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/35.jpg)
22/01/16 University of Waikato 35
![Page 36: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/36.jpg)
22/01/16 University of Waikato 36
![Page 37: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/37.jpg)
22/01/16 37
Explorer: building “classifiers” � “Classifiers” in WEKA are machine learning algorithmsfor
predicting nominal or numeric quantities � Implemented learning algorithms include:
� Conjunctive rules, decision trees and lists, instance-based classifiers, support vector machines, multi-layer perceptrons, logistic regression, Bayes’ nets, …
![Page 38: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/38.jpg)
Explore Conjunctive Rules learner
Need a simple dataset with few attributes , let’s select the weather dataset
![Page 39: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/39.jpg)
Select a Classifier
![Page 40: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/40.jpg)
Select training method
![Page 41: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/41.jpg)
Right-click to select parameters
numAntds= number of antecedents, -1= empty rule
![Page 42: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/42.jpg)
Select numAntds=10
![Page 43: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/43.jpg)
Results are shown in the right window (can be scrolled)
![Page 44: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/44.jpg)
Can change the right hand side variable
![Page 45: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/45.jpg)
Performance data
![Page 46: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/46.jpg)
Decision Trees with WEKA
![Page 47: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/47.jpg)
22/01/16 University of Waikato 47
![Page 48: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/48.jpg)
22/01/16 University of Waikato 48
![Page 49: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/49.jpg)
22/01/16 University of Waikato 49
![Page 50: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/50.jpg)
22/01/16 University of Waikato 50
![Page 51: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/51.jpg)
22/01/16 University of Waikato 51
![Page 52: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/52.jpg)
22/01/16 University of Waikato 52
![Page 53: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/53.jpg)
22/01/16 University of Waikato 53
![Page 54: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/54.jpg)
22/01/16 University of Waikato 54
![Page 55: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/55.jpg)
22/01/16 University of Waikato 55
![Page 56: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/56.jpg)
22/01/16 University of Waikato 56
![Page 57: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/57.jpg)
22/01/16 University of Waikato 57
![Page 58: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/58.jpg)
22/01/16 University of Waikato 58
![Page 59: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/59.jpg)
22/01/16 University of Waikato 59
![Page 60: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/60.jpg)
22/01/16 University of Waikato 60
![Page 61: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/61.jpg)
22/01/16 University of Waikato 61
![Page 62: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/62.jpg)
22/01/16 University of Waikato 62
![Page 63: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/63.jpg)
22/01/16 University of Waikato 63
![Page 64: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/64.jpg)
22/01/16 University of Waikato 64
![Page 65: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/65.jpg)
22/01/16 University of Waikato 65
![Page 66: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/66.jpg)
22/01/16 University of Waikato 66
![Page 67: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/67.jpg)
22/01/16 University of Waikato 67
![Page 68: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/68.jpg)
22/01/16 University of Waikato 68
![Page 69: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/69.jpg)
22/01/16 69
Explorer: clustering data � WEKA contains “clusterers” for finding groups of similar
instances in a dataset � Implemented schemes are:
� k-Means, EM, Cobweb, X-means, FarthestFirst
� Clusters can be visualized and compared to “true” clusters (if given)
� Evaluation based on loglikelihood if clustering scheme produces a probability distribution
![Page 70: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/70.jpg)
gennaio 22, 2016 70
� Given k, the k-means algorithm is implemented in four steps:
� Partition objects into k nonempty subsets
� Compute seed points as the centroids of the clusters of the
current partition (the centroid is the center, i.e., mean point, of the cluster)
� Assign each object to the cluster with the nearest seed point
� Go back to Step 2, stop when no more new assignment
The K-Means Clustering Method
![Page 71: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/71.jpg)
![Page 72: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/72.jpg)
right click: visualize cluster assignement
![Page 73: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/73.jpg)
22/01/16 73
Explorer: finding associations � WEKA contains an implementation of the Apriori algorithm
for learning association rules � Works only with discrete data
� Can identify statistical dependencies between groups of attributes: � milk, butter ⇒ bread, eggs (with confidence 0.9 and support
2000)
� Apriori can compute all rules that have a given minimum support and exceed a given confidence
![Page 74: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/74.jpg)
gennaio 22, 2016 74
Basic Concepts: Frequent Patterns
� itemset: A set of one or more items � k-itemset X = {x1, …, xk} � (absolute) support, or, support count of X:
Frequency or occurrence of an itemset X
� (relative) support, s, is the fraction of transactions that contains X (i.e., the probability that a transaction contains X)
� An itemset X is frequent if X’s support is no less than a minsup threshold
Customer buys diaper
Customer buys both
Customer buys beer
Tid Items bought
10 Beer, Nuts, Diaper
20 Beer, Coffee, Diaper
30 Beer, Diaper, Eggs
40 Nuts, Eggs, Milk
50 Nuts, Coffee, Diaper, Eggs, Milk
![Page 75: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/75.jpg)
gennaio 22, 2016 75
Basic Concepts: Association Rules
� Find all the rules X à Y with minimum support and confidence � support, s, probability that a
transaction contains X ∪ Y � confidence, c, conditional probability
that a transaction having X also contains Y
Let minsup = 50%, minconf = 50%
Freq. Pat.: Beer:3, Nuts:3, Diaper:4, Eggs:3, {Beer, Diaper}:3
Customer buys diaper
Customer buys both
Customer buys beer
Nuts, Eggs, Milk 40 Nuts, Coffee, Diaper, Eggs, Milk 50
Beer, Diaper, Eggs 30
Beer, Coffee, Diaper 20
Beer, Nuts, Diaper 10
Items bought Tid
n Association rules: (many more!) n Beer à Diaper (60%, 100%) n Diaper à Beer (60%, 75%)
![Page 76: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/76.jpg)
![Page 77: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/77.jpg)
22/01/16 University of Waikato 77
![Page 78: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/78.jpg)
22/01/16 University of Waikato 78
![Page 79: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/79.jpg)
22/01/16 University of Waikato 79
![Page 80: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/80.jpg)
22/01/16 University of Waikato 80
![Page 81: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/81.jpg)
22/01/16 University of Waikato 81
![Page 82: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/82.jpg)
1. adoption-of-the-budget-resolution=y physician-fee-freeze=n 219 ==> Class=democrat 219 conf:(1)
2. adoption-of-the-budget-resolution=y physician-fee-freeze=n aid-to-nicaraguan-contras=y 198 ==> Class=democrat 198 conf:(1)
3. physician-fee-freeze=n aid-to-nicaraguan-contras=y 211 ==> Class=democrat 210 conf:(1)
ecc.
![Page 83: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/83.jpg)
22/01/16 83
Explorer: attribute selection � Panel that can be used to investigate which (subsets of)
attributes are the most predictive ones � Attribute selection methods contain two parts:
� A search method: best-first, forward selection, random, exhaustive, genetic algorithm, ranking
� An evaluation method: correlation-based, wrapper, information gain, chi-squared, …
� Very flexible: WEKA allows (almost) arbitrary combinations of these two
![Page 84: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/84.jpg)
22/01/16 University of Waikato 84
![Page 85: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/85.jpg)
22/01/16 University of Waikato 85
![Page 86: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/86.jpg)
22/01/16 University of Waikato 86
![Page 87: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/87.jpg)
22/01/16 University of Waikato 87
![Page 88: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/88.jpg)
22/01/16 University of Waikato 88
![Page 89: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/89.jpg)
22/01/16 University of Waikato 89
![Page 90: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/90.jpg)
22/01/16 University of Waikato 90
![Page 91: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/91.jpg)
22/01/16 University of Waikato 91
![Page 92: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/92.jpg)
22/01/16 92
Explorer: data visualization � Visualization very useful in practice: e.g. helps to determine
difficulty of the learning problem � WEKA can visualize single attributes (1-d) and pairs of
attributes (2-d) � To do: rotating 3-d visualizations (Xgobi-style)
� Color-coded class values � “Jitter” option to deal with nominal attributes (and to detect “hidden” data points)
� “Zoom-in” function
![Page 93: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/93.jpg)
![Page 94: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/94.jpg)
22/01/16 University of Waikato 94
![Page 95: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/95.jpg)
22/01/16 University of Waikato 95
![Page 96: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/96.jpg)
22/01/16 University of Waikato 96
![Page 97: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/97.jpg)
22/01/16 University of Waikato 97
![Page 98: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/98.jpg)
22/01/16 University of Waikato 98
click on a cell
![Page 99: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/99.jpg)
22/01/16 University of Waikato 99
![Page 100: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/100.jpg)
22/01/16 University of Waikato 100
![Page 101: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/101.jpg)
22/01/16 University of Waikato 101
![Page 102: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/102.jpg)
22/01/16 University of Waikato 102
![Page 103: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/103.jpg)
22/01/16 University of Waikato 103
![Page 104: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKAEngl.pdf · A presentation which explains how to use Weka for exploratory data mining.](https://reader034.fdocuments.in/reader034/viewer/2022042222/5ec910d01b72bc186b68c2f5/html5/thumbnails/104.jpg)
References and Resources � References:
� WEKA website: http://www.cs.waikato.ac.nz/~ml/weka/index.html
� WEKA Tutorial: � Machine Learning with WEKA: A presentation demonstrating all graphical user
interfaces (GUI) in Weka. � A presentation which explains how to use Weka for exploratory data mining.
� WEKA Data Mining Book: � Ian H. Witten and Eibe Frank, Data Mining: Practical Machine Learning Tools
and Techniques (Second Edition) � WEKA Wiki: http://weka.sourceforge.net/wiki/index.php/
Main_Page � Others:
� Jiawei Han and Micheline Kamber, Data Mining: Concepts and Techniques, 2nd ed.