Intelligent Database Systems Lab Presenter : Chang,Chun-Chih Authors : CHRISTOS BOURAS, VASSILIS...

Intelligent Database Systems Lab

Presenter : Chang,Chun-Chih

Authors : CHRISTOS BOURAS , VASSILIS TSOGKAS

2012, KBS

A clustering technique for news articles using WordNet


Outlines

MotivationObjectivesMethodologyExperimentsConclusionsComments


Motivation

• Document clustering is a powerful technique that has been widely.

• That some of the problems like synonymy, ambiguity and lack of a descriptive content marking of the generated clusters.


Objectives

• We are proposing the enhancement of standard k-means algorithm using the external knowledge from WordNet hypernyms .

• The proposed method enabled significantly improves k-means generating also useful and high quality cluster.


Methodology-Framework


Methodology -Euclidian Distance & City-block Distance


Methodology - Pearson


Methodology - Cosine Distance


Methodology - Spearman-rank Distance


Methodology -Kendall Distance


Methodology - Comparison of various methods

Euclidian

City-Block

Cosine

Kendall Spearman

Pearson


Methodology - heuristic function

For Example for ‘fruit’ d=9 , f=2 then W=0.9954 For Example for ‘edible fruit’ d=7 , f=1 then W=0.8915’

For Example for ‘food’ d=5 , f=1 then W=0.6534


Methodology - Enriching news articles using WordNet hypernyms


Methodology - Labeling clusters using WordNet hypernyms


Methodology - News article’s clustering using W-k means


Experiments


Experiments

With WordNet use

Without WordNet use

0.0001 →

←0.0010

1.000


Experiments


Conclusions

• From the plethora of similarity measures that have been used, the appliance of Euclidian and cosine

k-means produced the best results.

• We have also presented a novel algorithmic approach towards enhancing the k-means algorithm using knowledge from an external database, WordNet.


Comments

• Advantages -The resulting labels are with high precision• Applications -News clustering -Cluster labeling

Intelligent Database Systems Lab Presenter : Chang,Chun-Chih Authors : CHRISTOS BOURAS, VASSILIS...

Documents

Transcript of Intelligent Database Systems Lab Presenter : Chang,Chun-Chih Authors : CHRISTOS BOURAS, VASSILIS...