Robert Engels NRK ORIGO ORIGO enterprise architecture group ...

63
Robert Engels NRK ORIGO ORIGO enterprise architecture group Project leader Metadatabank / Archive [email protected] +47-99544481

Transcript of Robert Engels NRK ORIGO ORIGO enterprise architecture group ...

Page 1: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...

Robert EngelsNRK

ORIGO

ORIGO enterprise architecture groupProject leader Metadatabank / Archive

[email protected]+47-99544481

Page 2: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...
Page 3: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...
Page 4: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...
Page 5: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...

EBUCoreEBU CCDM

Page 6: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...
Page 7: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...
Page 8: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...
Page 9: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...
Page 10: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...
Page 11: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...
Page 12: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...
Page 13: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...
Page 14: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...
Page 15: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...
Page 16: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...

Semantic WebUnder the

hood

with a little help from Ivan Herman's intro course to the semantic web

Page 17: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...

RDF triples (cont.)

• An RDF Triple (s,p,o) is such that:

– “s”, “p” are URI-s, ie, resources on the Web; “o” is a URI or a literal

• “s”, “p”, and “o” stand for “subject”, “property”, and “object”

– here is the complete triple:

• RDF is a general model for such triples (with machine readable formats like RDF/XML, Turtle, N3, RXR, …)

(<http://…isbn…6682>, <http://…/original>, <http://…isbn…409X>)(<http://…isbn…6682>, <http://…/original>, <http://…isbn…409X>)

Page 18: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...

A simple RDF example (in Turtle)

<http://…/isbn/2020386682> f:titre "Le palais des mirroirs"@fr ; f:original <http://…/isbn/000651409X> .

<http://…/isbn/2020386682> f:titre "Le palais des mirroirs"@fr ; f:original <http://…/isbn/000651409X> .

Page 19: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...

“Internal” nodes

• Consider the following statement:– “the publisher is a «thing» that has a name and an address”

• nodes were identified with a URI. But…

• …what is the URI of «thing»?

• Use the concept of blank nodes » but be carefull when merging

Page 20: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...

Need for RDF schemas

• We need “extra knowledge”, so let's:– define the terms we can use– what restrictions apply– what extra relationships are there?

• This is where RDF Schemas come in– officially: “RDF Vocabulary Description Language”; the term

“Schema” is retained for historical reasons…

Page 21: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...

Classes, resources in RDF(S)

• RDFS defines the meaning of these terms• (these are all special URI-s, we just use the namespace

abbreviation)

Page 22: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...

The rough structure of data integration

1.Map the various data onto an abstract data representation

–make the data independent of its internal representation…

2.Merge the resulting representations3.Start querying on the whole!

–queries not possible on the individual data sets

Page 23: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...

A simplified bookstore data (dataset “A”)

KEYFIELD: ID Author Title Publisher YearISBN0-00-651409-X The Glass Palace 2000id_xyz id_qpr

ID Name Home Page

ID CityHarpers Collins London

id_xyz Ghosh, Amitav http://www.amitavghosh.com

Publ. Nameid_qpr

Page 24: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...

1st: export your data as a set of relations

Page 25: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...

Another bookstore data (dataset “F”)

A B C D E

1 ID Titre Auteur Original

2

ISBN0 2020386682 A7 A8 ISBN-0-00-651409-X

345

6

7

8

TraducteurLe Palais des miroirs

NomGhosh, AmitavBesse, Christianne

Page 26: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...

2nd: export your second set of data

Page 27: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...

3rd: start merging your data

Page 28: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...

3rd: start merging your data

Page 29: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...

3rd: merge identical resources

Page 30: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...

Start making queries…

• User of data “F” can now ask queries like:– “give me the title of the original”

• This information is not in the dataset “F”…

• …but can be retrieved by merging with dataset “A”!

Page 31: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...

However, more can be achieved…

• We “feel” that a:author and f:auteur should be the same

• But an automatic merge does not know that!

• Let us add some extra information to the merged data:– a:author same as f:auteur

– both identify a “Person”– a term that a community may have already defined:

• a “Person” is uniquely identified by his/her name and, say, homepage

• it can be used as a “category” for certain type of resources

Page 32: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...

3rd revisited: use the extra knowledge

Page 33: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...

Start making richer queries!

•User of dataset “F” can now query:–“give me the home page of the original’s author”•The information is not in datasets “F” or “A”…

•…but was made available by:–merging datasets “A” and datasets “F”

–adding three simple extra statements as an extra “glue”

Page 34: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...

Merge with Wikipedia data

Page 35: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...

Merge with Wikipedia data

Page 36: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...

Merge with Wikipedia data

KEYWORD: SPARQL

Page 37: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...

SPARQL as a unifying point

Page 38: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...
Page 39: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...

Let's try it ourselves:http://10.50.219.36:8890/sparql

Page 40: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...

Robert EngelsNRK

ORIGO

ORIGO enterprise architecture groupProject leader Metadatabank / Archive

[email protected]+47-99544481

Page 41: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...
Page 42: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...
Page 43: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...
Page 44: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...
Page 45: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...
Page 46: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...
Page 47: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...
Page 48: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...
Page 49: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...

Radioarkivet API-er

Abstracted API (RA)

REST/FULL– JSON

– TTL/RDF(S)

SPARQL endepunkt

Page 50: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...

EBUCoreEBU CCDM

Page 51: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...
Page 52: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...
Page 53: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...
Page 54: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...
Page 55: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...
Page 56: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...
Page 57: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...
Page 58: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...
Page 59: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...
Page 60: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...
Page 61: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...
Page 62: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...
Page 63: Robert Engels NRK ORIGO ORIGO enterprise architecture group ...