Amsterdam Museum as EDM Linked Open Data

17
www.europeanaconnect.eu Amsterdam Museum as EDM LOD Victor de Boer -- VU University Amsterdam With input from Antoine Isaac, Jan Wielemaker, Jacco van Ossenbruggen and Guus Schreiber

description

Talk about conversion of Amsterdam Museum metadata to Europeana Data Model, linking it to other data sources and publishing it as Linked Open Data

Transcript of Amsterdam Museum as EDM Linked Open Data

Page 1: Amsterdam Museum as EDM Linked Open Data

www.europeanaconnect.eu

Amsterdam Museum as EDM LOD

Victor de Boer -- VU University Amsterdam

With input from Antoine Isaac, Jan Wielemaker, Jacco van

Ossenbruggen and Guus Schreiber

Page 2: Amsterdam Museum as EDM Linked Open Data

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

Amsterdam Museum

• Formerly Amsterdam Historic Museum

• “The rich collection of works of art, objects and archaeological finds brings to life the fortunes of Amsterdammers of days gone by and today.”

• In March 2010 published their entire

collection online

• 70.000 objects

• CC license

• We converted their data to EDM / RDF and

published it as Linked Open Data

Page 3: Amsterdam Museum as EDM Linked Open Data

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

Page 4: Amsterdam Museum as EDM Linked Open Data

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

AM metadata

• Adlib database XML API

• Object metadata

• 73.000 objects, 256MB

• Nested XML

• Concept Thesaurus

• 27.000, 9MB

• Different types (geo,motif, event)

• Person „Thesaurus‟

• 67.000 persons, 10MB

• Consolidated from object metadata fields

• Creators, annotators, reproduction creators,

institutions

<record priref="10541“ >

<acquisition.date>1997</acquisition.date>

<dimension>

<dimension.type>hoogte</dimension.type>

<dimension.unit>cm</dimension.unit>

<dimension.value>6</dimension.value>

</dimension>

</record>

<record priref="28024“ >

<term>Kalverstraat 124</term>

<broader_term>Kalverstraat</broader_term>

<term.type>GEOKEYW </term.type>

</record>

<record priref="6" >

<biography>boekverkoper en uitgever van

cartografie</biography>

<birth.date.start>1659</birth.date.start>

<death.date.start>1733</death.date.start>

<name>Aa, Pieter van der</name>

<nationality>Nederlands</nationality>

<use>Aa, Pieter van der (I)</use>

</record>

Page 5: Amsterdam Museum as EDM Linked Open Data

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

Cliopatria

Conversion and alignment process

1. pure syntactic transformation to RDF

2. map to EDM classes/properties

(mapping table -> schema file)

3. conversion rules to restructure,

generate uris and do complex stuff

(XMLRDF tool)

4. align with Europeana and external

sources

5. publish as LOD

XMLRDF

Amalgame

Page 6: Amsterdam Museum as EDM Linked Open Data

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

Direct RDF conversion

<record priref="10541“ >

<acq.date>1997</acqdate>

<dimension>

<dimension.type>hoogte</dimension.type>

<dimension.unit>cm</dimension.unit>

<dimension.value>6</dimension.value>

</dimension>

</record>

am:Record

_:bn1am:Dimension

_:bn2

“10541”

“1997”

am:priref

am:acq.date

am:dimension

am:dim.type

am:dim.value

“hoogte”

“6”

Page 7: Amsterdam Museum as EDM Linked Open Data

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

Mapping schema file

• Turtle schema files

• rdfs:subClassOf + rdfs:subPropertyOf: Keep

original (specific) data, interoperability on EDM

level

• For object metadata

• Dcterms: creator, date, description

• EDM-specific properties: event, agent

• Thesaurus concepts

• SKOS + some dcterms

• Persons

• RDA Group 2 elements

• http://metadataregistry.org/schema/show/id/1

5.html

am:creditLine a rdf:Property ;

rdfs:subPropertyOf dcterms:rights .

am:dimension a rdf:Property ;

rdfs:subPropertyOf dcterms:extent .

am:documentation a rdf:Property ;

rdfs:subPropertyOf dcterms:description.

am:objectCategory a rdf:Property ;

rdfs:subPropertyOf dcterms:description.

am:scopeNote a rdf:Property ;

rdfs:subPropertyOf skos:scopeNote.

am:priref a rdf:Property ;

rdfs:subPropertyOf dcterms:identifier.

am:Person a rdfs:Class ;

rdfs:subClassOf ens:Agent.

am:equivalentName a rdf:Property ;

rdfs:subPropertyOf rda:variantNameForThePerson.

am:name a rdf:Property ;

rdfs:subPropertyOf rda:preferredNameForThePerson.

Page 8: Amsterdam Museum as EDM Linked Open Data

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

XMLRDF Conversion

• RDF interpretation of the data. Minimal enrichment

• Refer to resources rather then to terms

• Identify the resource and replace literals by URIs

• Clean up (remove empty vals)

• Some blank node structures retained

• Mint URIs

• PURL basename: purl.org/collections/nl/am/

• Use prirefs, prefixed by “proxy-”, “aggregation-”, “p-” or “t-”

• Make EDM

• Establish Proxy-Aggregation-PhysObject triangle

• Move predicates to appropriate resource

• Images (ens:object)

dimensions @@

{ _S, am:dimension, B},

{ B, am:dimensionValue, literal(Val)},

{ B, am:dimensionUnit, literal(Unit)}?,

{ B, am:dimensionType, literal(Type)}?

concat ([Type,Val,Unit], ConcatVal),

{B, rdfs:label, literal(ConcatVal)}.

< am:proxy1, am:maker, _:bnode1>

< _:bnode1, am:creator, am:p-001>

< _:bnode1, am:creatorRole, am:t-printer>

< _:bnode1, am: creatorQual, “copy after”>

Page 9: Amsterdam Museum as EDM Linked Open Data

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

XMLRDF Conversion

• Conversion rules are simple for flat record structures but more

complex for richer data.

• APEnet

• Amsterdam Museum

• (Initial) rules can be generated from other visual ingestion

tools.

• Simple rules, but with the full expressivity of programming language

• ~ 6 Million Amsterdam Museum RDF triples

Page 10: Amsterdam Museum as EDM Linked Open Data

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

Amalgame Alignment: Thesaurus

• 143 links to

GeoNames NL

• 2498 AM concepts

linked to AATNed.

• 1322 links to be

checked

http://semanticweb.cs.vu.nl/amalgame/

Page 11: Amsterdam Museum as EDM Linked Open Data

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

Amalgame Alignment: Persons

• 1076 AM persons

matched to ULAN

(VIAF)

• 34 matched to

DBPedia

• More for human

check

Page 12: Amsterdam Museum as EDM Linked Open Data

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

Serving the Data

• PURL redirects to semantic layer

• http://purl.org/collections/nl/am/proxy-63432

• http://semanticweb.cs.vu.nl/europeana/browse/list_resource?r=http://purl.org/collections/nl/am/proxy-63432

• HTTP request HTML:

• Condensed Local view

• Full Local view

• HTTP request RDF/XML

• rdf/xml “describe”

• SPARQL endpoint

Page 13: Amsterdam Museum as EDM Linked Open Data

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

Page 14: Amsterdam Museum as EDM Linked Open Data

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

Page 15: Amsterdam Museum as EDM Linked Open Data

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

http://semanticweb.cs.vu.nl/europeana/user/query

Page 16: Amsterdam Museum as EDM Linked Open Data

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

Linked Open Data

• Registered on CKAN

• More links

• to Amsterdam Rijksmonumenten

• to Amsterdam Stadsarchief

• to DBPedia (SILK): LATC

• Used by external parties/projects

• Oneindig NH

• Apps for Amsterdam

• Europeana Hackathon this friday/saturday

Page 17: Amsterdam Museum as EDM Linked Open Data

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

URL pointers

• Amsterdam Museum in EDM LOD

• http://semanticweb.cs.vu.nl/lod/am/

• http://ckan.net/package/amsterdam-museum-as-edm-lod

• Thoughtlab

• Semantic layer

• [Browse] http://semanticweb.cs.vu.nl/europeana/

• [SPARQL] http://semanticweb.cs.vu.nl/europeana/user/query

• Tools

• [ClioPatria] http://e-culture.multimedian.nl/software/ClioPatria.shtml

• [xmlrdf] http://semanticweb.cs.vu.nl/Connect/xmlrdf.pdf

• [Amalgame] http://semanticweb.cs.vu.nl/amalgame/