Amsterdam Museum as EDM Linked Open Data

Post on 06-May-2015

1.375 views 3 download

description

Talk about conversion of Amsterdam Museum metadata to Europeana Data Model, linking it to other data sources and publishing it as Linked Open Data

Transcript of Amsterdam Museum as EDM Linked Open Data

www.europeanaconnect.eu

Amsterdam Museum as EDM LOD

Victor de Boer -- VU University Amsterdam

With input from Antoine Isaac, Jan Wielemaker, Jacco van

Ossenbruggen and Guus Schreiber

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

Amsterdam Museum

• Formerly Amsterdam Historic Museum

• “The rich collection of works of art, objects and archaeological finds brings to life the fortunes of Amsterdammers of days gone by and today.”

• In March 2010 published their entire

collection online

• 70.000 objects

• CC license

• We converted their data to EDM / RDF and

published it as Linked Open Data

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

AM metadata

• Adlib database XML API

• Object metadata

• 73.000 objects, 256MB

• Nested XML

• Concept Thesaurus

• 27.000, 9MB

• Different types (geo,motif, event)

• Person „Thesaurus‟

• 67.000 persons, 10MB

• Consolidated from object metadata fields

• Creators, annotators, reproduction creators,

institutions

<record priref="10541“ >

<acquisition.date>1997</acquisition.date>

<dimension>

<dimension.type>hoogte</dimension.type>

<dimension.unit>cm</dimension.unit>

<dimension.value>6</dimension.value>

</dimension>

</record>

<record priref="28024“ >

<term>Kalverstraat 124</term>

<broader_term>Kalverstraat</broader_term>

<term.type>GEOKEYW </term.type>

</record>

<record priref="6" >

<biography>boekverkoper en uitgever van

cartografie</biography>

<birth.date.start>1659</birth.date.start>

<death.date.start>1733</death.date.start>

<name>Aa, Pieter van der</name>

<nationality>Nederlands</nationality>

<use>Aa, Pieter van der (I)</use>

</record>

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

Cliopatria

Conversion and alignment process

1. pure syntactic transformation to RDF

2. map to EDM classes/properties

(mapping table -> schema file)

3. conversion rules to restructure,

generate uris and do complex stuff

(XMLRDF tool)

4. align with Europeana and external

sources

5. publish as LOD

XMLRDF

Amalgame

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

Direct RDF conversion

<record priref="10541“ >

<acq.date>1997</acqdate>

<dimension>

<dimension.type>hoogte</dimension.type>

<dimension.unit>cm</dimension.unit>

<dimension.value>6</dimension.value>

</dimension>

</record>

am:Record

_:bn1am:Dimension

_:bn2

“10541”

“1997”

am:priref

am:acq.date

am:dimension

am:dim.type

am:dim.value

“hoogte”

“6”

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

Mapping schema file

• Turtle schema files

• rdfs:subClassOf + rdfs:subPropertyOf: Keep

original (specific) data, interoperability on EDM

level

• For object metadata

• Dcterms: creator, date, description

• EDM-specific properties: event, agent

• Thesaurus concepts

• SKOS + some dcterms

• Persons

• RDA Group 2 elements

• http://metadataregistry.org/schema/show/id/1

5.html

am:creditLine a rdf:Property ;

rdfs:subPropertyOf dcterms:rights .

am:dimension a rdf:Property ;

rdfs:subPropertyOf dcterms:extent .

am:documentation a rdf:Property ;

rdfs:subPropertyOf dcterms:description.

am:objectCategory a rdf:Property ;

rdfs:subPropertyOf dcterms:description.

am:scopeNote a rdf:Property ;

rdfs:subPropertyOf skos:scopeNote.

am:priref a rdf:Property ;

rdfs:subPropertyOf dcterms:identifier.

am:Person a rdfs:Class ;

rdfs:subClassOf ens:Agent.

am:equivalentName a rdf:Property ;

rdfs:subPropertyOf rda:variantNameForThePerson.

am:name a rdf:Property ;

rdfs:subPropertyOf rda:preferredNameForThePerson.

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

XMLRDF Conversion

• RDF interpretation of the data. Minimal enrichment

• Refer to resources rather then to terms

• Identify the resource and replace literals by URIs

• Clean up (remove empty vals)

• Some blank node structures retained

• Mint URIs

• PURL basename: purl.org/collections/nl/am/

• Use prirefs, prefixed by “proxy-”, “aggregation-”, “p-” or “t-”

• Make EDM

• Establish Proxy-Aggregation-PhysObject triangle

• Move predicates to appropriate resource

• Images (ens:object)

dimensions @@

{ _S, am:dimension, B},

{ B, am:dimensionValue, literal(Val)},

{ B, am:dimensionUnit, literal(Unit)}?,

{ B, am:dimensionType, literal(Type)}?

concat ([Type,Val,Unit], ConcatVal),

{B, rdfs:label, literal(ConcatVal)}.

< am:proxy1, am:maker, _:bnode1>

< _:bnode1, am:creator, am:p-001>

< _:bnode1, am:creatorRole, am:t-printer>

< _:bnode1, am: creatorQual, “copy after”>

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

XMLRDF Conversion

• Conversion rules are simple for flat record structures but more

complex for richer data.

• APEnet

• Amsterdam Museum

• (Initial) rules can be generated from other visual ingestion

tools.

• Simple rules, but with the full expressivity of programming language

• ~ 6 Million Amsterdam Museum RDF triples

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

Amalgame Alignment: Thesaurus

• 143 links to

GeoNames NL

• 2498 AM concepts

linked to AATNed.

• 1322 links to be

checked

http://semanticweb.cs.vu.nl/amalgame/

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

Amalgame Alignment: Persons

• 1076 AM persons

matched to ULAN

(VIAF)

• 34 matched to

DBPedia

• More for human

check

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

Serving the Data

• PURL redirects to semantic layer

• http://purl.org/collections/nl/am/proxy-63432

• http://semanticweb.cs.vu.nl/europeana/browse/list_resource?r=http://purl.org/collections/nl/am/proxy-63432

• HTTP request HTML:

• Condensed Local view

• Full Local view

• HTTP request RDF/XML

• rdf/xml “describe”

• SPARQL endpoint

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

http://semanticweb.cs.vu.nl/europeana/user/query

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

Linked Open Data

• Registered on CKAN

• More links

• to Amsterdam Rijksmonumenten

• to Amsterdam Stadsarchief

• to DBPedia (SILK): LATC

• Used by external parties/projects

• Oneindig NH

• Apps for Amsterdam

• Europeana Hackathon this friday/saturday

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

URL pointers

• Amsterdam Museum in EDM LOD

• http://semanticweb.cs.vu.nl/lod/am/

• http://ckan.net/package/amsterdam-museum-as-edm-lod

• Thoughtlab

• Semantic layer

• [Browse] http://semanticweb.cs.vu.nl/europeana/

• [SPARQL] http://semanticweb.cs.vu.nl/europeana/user/query

• Tools

• [ClioPatria] http://e-culture.multimedian.nl/software/ClioPatria.shtml

• [xmlrdf] http://semanticweb.cs.vu.nl/Connect/xmlrdf.pdf

• [Amalgame] http://semanticweb.cs.vu.nl/amalgame/