Presentation Title: DATA MINING
description
Transcript of Presentation Title: DATA MINING
Department of Computer Science Sir Syed University of Engineering
&Technology, Karachi-Pakistan.
Presentation Title: DATA MINING
Submitted By Osama Ghulam Mohammad. (2010-CS-20)Noureen Chagani (2010-CS-11)Naveed Usman (2010-CS-23)
TABLE OF CONTENTS
What is data mining ? Data mining consists of five major
elements Why Mine Data?Commercial ViewpointScientific Viewpoint Some of the techniques used for
data mining
What is data mining ?
Data Mining, also known as Knowledge-Discovery in Databases (KDD), is the process of automatically searching large volumes of data for patterns.
It is the process of extraction of knowledge from large datasets.
Extremely large datasets.Useful knowledge that can improve
processes.
Data mining consists of five major elements: Extract, transform, and load
transaction data onto the data warehouse system.
Store and manage the data in a multidimensional database system.
Provide data access to business analysts and information technology professionals.
Analyze the data by application software.
Present the data in a useful format, such as a graph or table.
Why Mine Data? Commercial Viewpoint Lots of data is being collected
and warehoused Web data, e-commerce purchases at department/
grocery stores Bank/Credit Card
transactions Computers have become cheaper and
more powerful Competitive Pressure is Strong
Provide better, customized services for an edge (e.g. in Customer Relationship Management)
Why Mine Data? Scientific Viewpoint Data collected and stored at
enormous speeds (GB/hour). remote sensors on a satellite telescopes scanning the skies microarrays generating gene
expression data scientific simulations
generating terabytes of data Traditional techniques
infeasible for raw data. Data mining may help
scientists . in classifying and segmenting data
Some of the techniques used for data mining are:Artificial neural networks - Neural
networks are useful for pattern recognition or data classification, through a learning process. Non-linear predictive models that learn through training and resemble biological neural networks in structure.
Neural Network Neural Networks map a
set of input-nodes to a set of output-nodes
Number of inputs/outputs is variable
The Network itself is composed of an arbitrary number of nodes with an arbitrary topology
Neural Network
Input 0 Input 1 Input n...
Output 0 Output 1 Output m...
Decision tree
Tree-shaped structures that represent sets of decisions. These decisions generate
rules for the classification of a dataset.
Decision tree (data)height hair eyes classshort blond blue Atall blond brown Btall red blue Ashort dark blue Btall dark blue Btall blond blue Atall dark brown Bshort blond brown B
hair
eyesB
B
A
A
darkred
blond
blue brown
The Nearest neighborhood method
A classification technique that classifies each record based on the records most similar to it in an historical
database.
An important technique for Data Mining is:
CLUSTU
RING
Clustering : (Definition)• Clustering can be considered the most important
unsupervised learning technique; so, as every other problem of this kind, it deals with finding a structure in a collection of unlabeled data.
• Clustering is “the process of organizing objects into groups whose members are similar in some way”.
• A cluster is therefore a collection of objects which are “similar” between them and are “dissimilar” to the objects belonging to other clusters.
Clustering
The greater the similarity (or homogeneity) within a group, and the greater the difference between groups, the “better” or more distinct the clustering.
Why clustering?
A few good reasons ...
Simplifications Pattern detection
The K-Means Clustering MethodBasic K-means Algorithm for finding K
clusters:1. Select K points as the initial
centroids.2. Assign all points to the closest
centroid.3. Recompute the centroid of each
cluster.4. Repeat steps 2 and 3 until the
centroids don’t change.
Figure 10a shows the case when the cluster centers coincidewith the circle centers. This is a global minimum. Figure 10b shows a local minima.
Cluster Example
“The key in business is to know something that nobody else knows.”
— Aristotle Onassis “To understand is to perceive patterns.”
— Sir Isaiah Berlin
Thank You