Modeling Data the different views on Data Mining.

22
Modeling Data the different views on Data Mining

TAGS:

Transcript of Modeling Data the different views on Data Mining.

Page 1: Modeling Data the different views on Data Mining.

Modeling Data

the different views on Data Mining

Page 2: Modeling Data the different views on Data Mining.

Views on Data Mining

Fitting the data Density Estimation Learning

being able to perform a task more accurately than before Prediction

use the data to predict future data Compressing the data

capture the essence of the data discard the noise and details

Page 3: Modeling Data the different views on Data Mining.

Views on Data Mining

Fitting the data Density Estimation Learning

being able to perform a task more accurately than before Prediction

use the data to predict future data Compressing the data

capture the essence of the data discard the noise and details

Page 4: Modeling Data the different views on Data Mining.

Data fitting

Very old concept Capture function between variables Often

few variables simple models

Functions step-functions linear quadratic

Trade-off between complexity of model and fit (generalization)

Page 5: Modeling Data the different views on Data Mining.

responseto newdrug

body weight

Page 6: Modeling Data the different views on Data Mining.

responseto newdrug

body weight

Page 7: Modeling Data the different views on Data Mining.

moneyspent

income

¾ ratio

Page 8: Modeling Data the different views on Data Mining.

Kleiber’s Law of Metabolic Rate

Page 9: Modeling Data the different views on Data Mining.

Views on Data Mining

Fitting the data Density Estimation Learning

being able to perform a task more accurately than before Prediction

use the data to predict future data Compressing the data

capture the essence of the data discard the noise and details

Page 10: Modeling Data the different views on Data Mining.

Density Estimation

Dataset describes a sample from a distribution Describe distribution is simple terms

prototypes

Page 11: Modeling Data the different views on Data Mining.

Density Estimation

Other methods also take into account the spatial relationships between prototypes

Self-Organizing Map (SOM)

Page 12: Modeling Data the different views on Data Mining.

Views on Data Mining

Fitting the data Density Estimation Learning

being able to perform a task more accurately than before Prediction

use the data to predict future data Compressing the data

capture the essence of the data discard the noise and details

Page 13: Modeling Data the different views on Data Mining.

Learning

Perform a task more accurately than before Learn to perform a task (at all)

Suggests an interaction between model and domain perform some action in domain observe performance update model to reflect desirability of action

Often includes some form of experimentation

Not so common in Data Mining often static data (warehouse), observational data

Page 14: Modeling Data the different views on Data Mining.

Views on Data Mining

Fitting the data Density Estimation Learning

being able to perform a task more accurately than before Prediction

use the data to predict future data Compressing the data

capture the essence of the data discard the noise and details

Page 15: Modeling Data the different views on Data Mining.

Prediction: learning a decision boundary

++

+

++

+

+

+

+

--

-

-

-

-

-

-

-

-

-

--

-

Page 16: Modeling Data the different views on Data Mining.

Views on Data Mining

Fitting the data Density Estimation Learning

being able to perform a task more accurately than before Prediction

use the data to predict future data Compressing the data

capture the essence of the data discard the noise and details

Page 17: Modeling Data the different views on Data Mining.

Compression

Compression is possible when data contains structure (repeting patterns)

Compression algorithms will discover structure and replace that by short code

Code table forms interesting set of patterns

A B C D E F

1 0 1 1 0 0

1 1 1 1 1 0

0 1 0 1 1 0

1…

1…

1…

1…

0…

1…

•Pattern ACD appears frequently

•ACD helps to compress the data

•ACD is a relevant pattern to report

Page 18: Modeling Data the different views on Data Mining.

Compression

Paul Vitanyi (CWI, Amsterdam) Software to unzip identity of unknown composers

Beethoven, Miles Davis, Jimmy Hendrix

SARS virus similarity

internet worms, viruses intruder attack traffic images, video, …

http://homepages.cwi.nl/~paulv/images/paulv70s.gif
Page 19: Modeling Data the different views on Data Mining.

Mobile calls: modeling duration of calls

Page 20: Modeling Data the different views on Data Mining.

More data: linear model

Page 21: Modeling Data the different views on Data Mining.

Even more data: still linear?

Page 22: Modeling Data the different views on Data Mining.

Hmmm


Www.csiro.au Managing different views of data Simon Cox CSIRO Exploration and Mining 29 November 2006.

Www.csiro.au Managing different views of data Simon Cox CSIRO Exploration and Mining 29 November 2006.

WEB DATA MINING: VIEWS OF CRIMINAL ACTIVITIES B.M ... · WEB DATA MINING: VIEWS OF CRIMINAL ACTIVITIES ... Web usage mining in the study and analysis of criminology becomes very challenging

WEB DATA MINING: VIEWS OF CRIMINAL ACTIVITIES B.M ... · WEB DATA MINING: VIEWS OF CRIMINAL ACTIVITIES ... Web usage mining in the study and analysis of criminology becomes very challenging

DATA MINING WITH - Lagout Mining/Data Mining with Decision... · Library of Congress Cataloging-in-Publication Data Rokach, Lior. Data mining with ... Data mining is the science,

DATA MINING WITH - Lagout Mining/Data Mining with Decision... · Library of Congress Cataloging-in-Publication Data Rokach, Lior. Data mining with ... Data mining is the science,

Data Mining - The opportunity lies with Data!Data mining

Data Mining - The opportunity lies with Data!Data mining

Data Mining: Introduction. Chapter 1. Introduction zMotivation: Why data mining? zWhat is data mining? zData Mining: On what kind of data? zData mining.

Data Mining: Introduction. Chapter 1. Introduction zMotivation: Why data mining? zWhat is data mining? zData Mining: On what kind of data? zData mining.

Data Mining LECTURE # 01 Introduction to Data Mining

Data Mining LECTURE # 01 Introduction to Data Mining

CS590D: Data Mining Chris Clifton - Purdue University · Data Mining: Classification Schemes • General functionality – Descriptive data mining – Predictive data mining ... –

CS590D: Data Mining Chris Clifton - Purdue University · Data Mining: Classification Schemes • General functionality – Descriptive data mining – Predictive data mining ... –

Secure Data Processing - uni-leipzig.de · PRIVACY-PRESERVING DATA MINING 12 Local Data Local Data Local Data Warehouse Data Mining Local Data Mining Local Data Mining Combiner Local

Secure Data Processing - uni-leipzig.de · PRIVACY-PRESERVING DATA MINING 12 Local Data Local Data Local Data Warehouse Data Mining Local Data Mining Local Data Mining Combiner Local

Course : Data mining - Lecture : Mining data streams

Course : Data mining - Lecture : Mining data streams

Lecture 2: Data Mining 1. Roadmap What is data mining? Data Mining Tasks – Classification/Decision Tree – Clustering – Association Mining Data Mining.

Lecture 2: Data Mining 1. Roadmap What is data mining? Data Mining Tasks – Classification/Decision Tree – Clustering – Association Mining Data Mining.

EE3J2 Data Mining EE3J2 Data Mining

EE3J2 Data Mining EE3J2 Data Mining

VISUAL DATA MINING OF - USI Informatics · We propose a visual data mining approach based on polymetric views to tackle the problem of extracting information from software evolution

VISUAL DATA MINING OF - USI Informatics · We propose a visual data mining approach based on polymetric views to tackle the problem of extracting information from software evolution

Stakeholders’ Views of Mining and

Stakeholders’ Views of Mining and

What is Data Mining? Data Mining Motivation Data Mining Applications Applications of Data Mining in CRM Data Mining Taxonomy Data Mining Techniques.

What is Data Mining? Data Mining Motivation Data Mining Applications Applications of Data Mining in CRM Data Mining Taxonomy Data Mining Techniques.

Gufran Ahmad. Contents What is Data Mining? Data Mining / KDD process Different aspects of Data Mining Why Data Mining? Data Mining in Business Examples.

Gufran Ahmad. Contents What is Data Mining? Data Mining / KDD process Different aspects of Data Mining Why Data Mining? Data Mining in Business Examples.

DATA MINING AND ANALYSIS - doc.lagout.org Mining/Data Mining and Analysis... · DATA MINING AND ANALYSIS The fundamental algorithms in data mining and analysis form the basis ...

DATA MINING AND ANALYSIS - doc.lagout.org Mining/Data Mining and Analysis... · DATA MINING AND ANALYSIS The fundamental algorithms in data mining and analysis form the basis ...

Mining Disclosure Best Practices · Mining Disclosure Best Practices Exploration to Production ... “The views expressed in this presentation are the personal views of the ... CIM

Mining Disclosure Best Practices · Mining Disclosure Best Practices Exploration to Production ... “The views expressed in this presentation are the personal views of the ... CIM

UNIT - I Data Mining. UNIT - I Introduction : Fundamentals of data mining, Data Mining Functionalities, Classification of Data Mining systems, Major issues.

UNIT - I Data Mining. UNIT - I Introduction : Fundamentals of data mining, Data Mining Functionalities, Classification of Data Mining systems, Major issues.

October 18, 2015 Data Mining: Concepts and Techniques 1 DATA MINING Motivation: Why data mining? What is data mining? Data Mining: On what kind of data?

October 18, 2015 Data Mining: Concepts and Techniques 1 DATA MINING Motivation: Why data mining? What is data mining? Data Mining: On what kind of data?

Data Mining Chapter 1 Introduction -- Basic Data Mining Tasks -- Related Concepts -- Data Mining Techniques.

Data Mining Chapter 1 Introduction -- Basic Data Mining Tasks -- Related Concepts -- Data Mining Techniques.