Massive data twitter and semantic analysis in Reador.NET project

40
Twitter data & the reador.net project, the futur semantic tweetdeck? Christophe DESCLAUX In massive data we trust 21 november 2013 @descl3 @readornet #datas #curation #veille #massivedata #fossa2013

description

demo: https://vimeo.com/74277156

Transcript of Massive data twitter and semantic analysis in Reador.NET project

Page 1: Massive data twitter and semantic analysis in Reador.NET project

Twitter data & the reador.net project, the futur semantic tweetdeck?

Christophe DESCLAUX

In massive data we trust21 november 2013

@descl3 @readornet #datas #curation #veille #massivedata #fossa2013

Page 2: Massive data twitter and semantic analysis in Reador.NET project

Christophe Desclaux@descl3

Page 3: Massive data twitter and semantic analysis in Reador.NET project

Christophe Desclaux@descl3

Page 4: Massive data twitter and semantic analysis in Reador.NET project

Christophe Desclaux@descl3

Page 5: Massive data twitter and semantic analysis in Reador.NET project

WHY a new aggregating tool ?

Hello, I'm a semantic news aggregating tool

Page 6: Massive data twitter and semantic analysis in Reador.NET project

data!Because  there  aremore and more

Page 7: Massive data twitter and semantic analysis in Reador.NET project

   

Page 8: Massive data twitter and semantic analysis in Reador.NET project

   

Page 9: Massive data twitter and semantic analysis in Reador.NET project

   

Page 10: Massive data twitter and semantic analysis in Reador.NET project
Page 11: Massive data twitter and semantic analysis in Reador.NET project

   

Page 12: Massive data twitter and semantic analysis in Reador.NET project
Page 13: Massive data twitter and semantic analysis in Reador.NET project
Page 14: Massive data twitter and semantic analysis in Reador.NET project

Cc-By-Sa Ed Yourdon

lets focus onNEWS forcasting

Page 15: Massive data twitter and semantic analysis in Reador.NET project

    SOLUTIONS exist

Page 16: Massive data twitter and semantic analysis in Reador.NET project

   FOCUSED on twitter©TweetDeck

Page 17: Massive data twitter and semantic analysis in Reador.NET project

TRUST in providers

Google News

©Google News

Page 18: Massive data twitter and semantic analysis in Reador.NET project

PERSONAL aggregation©Feedly

Page 19: Massive data twitter and semantic analysis in Reador.NET project

Social media FILTERING©Scoopit

Page 20: Massive data twitter and semantic analysis in Reador.NET project

   AUTOMATIC filtering©YahooPipes

Page 21: Massive data twitter and semantic analysis in Reador.NET project

WHY a new aggregating tool ?

Because of data

Page 22: Massive data twitter and semantic analysis in Reador.NET project

to dataBecause we need to add

MEANING

Page 23: Massive data twitter and semantic analysis in Reador.NET project

   

GOOGLE and his knowledge graph

Page 24: Massive data twitter and semantic analysis in Reador.NET project

The TRUE Semantic Web

Page 25: Massive data twitter and semantic analysis in Reador.NET project

Content accessible to computers

Interconnected sources

Shared vocabularies

The TRUE Semantic Web

Page 26: Massive data twitter and semantic analysis in Reador.NET project

Country http://wikipedia.org/wiki/Paris

Name Caliméro

Hair

Tatoo NO, he has rabies!

short

Breed http://wikipedia.org/wiki/Maine_coon

http://www.reador.net/cats#Calimero

Brother http://www.reador.net/cats#Médor

Name

TatooYES

BirthDay22­10­2012

Médor

Subject relation object

Page 27: Massive data twitter and semantic analysis in Reador.NET project

Country http://wikipedia.org/wiki/Paris

Name Caliméro

Hair

Tatoo NO, he has rabies!

short

Breed http://wikipedia.org/wiki/Maine_coon

http://www.reador.net/cats#Calimero

Brother http://www.reador.net/cats#Médor

Subject relation object

<rdf:RDF xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:chat="http://www.reador.net/TheCats/1.1/"> <rdf:Description rdf:about="http://www.reador.net/cats#Médor"> <rdf:label>Caliméro</rdf:label> <cat:tatoo>no</cat:tatoo> <cat:hair>22-10-2012</cat:hair> <cat:breed>http://wikipedia.org/wiki/Maine_coon</cat:breed> <cat:country>http://wikipedia.org/wiki/Paris</cat:country> <foaf:brother>http://www.reador.net/cats#Médor</foaf:brother> </rdf:Description></rdf:RDF>

Page 28: Massive data twitter and semantic analysis in Reador.NET project

How to make quickly a website with a lot of informations about beautifuls cats and photos?

Lets use it ! BeautifulsCats.com

Page 29: Massive data twitter and semantic analysis in Reador.NET project

select distinct * where { ?uri rdf:type <http://dbpedia.org/class/yago/CatBreeds>. ?uri dbpedia-owl:thumbnail ?thumbnail. ?uri dbpprop:country ?country. ?uri dbpprop:name ?name. FILTER(lang(?name) = "en")} LIMIT 100

The answer

Page 30: Massive data twitter and semantic analysis in Reador.NET project

   

Page 31: Massive data twitter and semantic analysis in Reador.NET project

WHY a new aggregating tool ?To add meaning

Because of data

Page 32: Massive data twitter and semantic analysis in Reador.NET project

source

Because we needopen

Page 33: Massive data twitter and semantic analysis in Reador.NET project
Page 34: Massive data twitter and semantic analysis in Reador.NET project

Open Source

Personalaggregation

Filte

rin

g

News clustering

Semantic

Newsprovider

social

automatic

Goo

gle

new

s

Feed

ly

Scoo

p.it!

Yaho

o Pi

pes

Reador.N

ET

Page 35: Massive data twitter and semantic analysis in Reador.NET project

DEMO

®nuitinfo12.thumblr.com

Page 36: Massive data twitter and semantic analysis in Reador.NET project

Is it a massive data service ?Yes/no?

2 000 000 news extracted yet100 000 news extracted / day20Go of datas3 servers (30Go of ram+ 9 cores)

Page 37: Massive data twitter and semantic analysis in Reador.NET project

Let's go to $$$

Page 38: Massive data twitter and semantic analysis in Reador.NET project

Let's go to $$$Pub

CrowdfundingB2BB2C

Partnership

Page 39: Massive data twitter and semantic analysis in Reador.NET project

Open Source

Personalaggregation

Filte

rin

g

News clustering

Semantic

Newsprovider

social

automatic

Reador.NET

A POWERFUL and OPENSOURCE tool which help you to filter NEWS in order to ORGANIZE your NEWS and connectedto ...

Page 40: Massive data twitter and semantic analysis in Reador.NET project

Code : www.zone-project.orgDemo: www.reador.net

I need youTest it

Say us bugsTalk with us

@descl3 @readornet #datas #curation #veille #massivedata #fossa2013