Holistic Benchmarking of Big Linked DataHOBBIT

Irini FundulakiInstitute of Computer Science - FORTH

Greece

4th Graph-TABarcelona, Spain, March 3, 2016

Irini Fundulaki (FORTH) HOBBIT March 3, 2016 1 / 9

Voluminous Datasets

1

1http://www.ibmbigdatahub.com/infographic/four-vs-big-dataIrini Fundulaki (FORTH) HOBBIT March 3, 2016 2 / 9

Large number of Linked Data Technologies

2

2https://cdn.datafloq.com/cms/os_big_data_open_source_tools-v2.pngIrini Fundulaki (FORTH) HOBBIT March 3, 2016 3 / 9

Issues to address for Linked Data Technologies

√Which are the critical steps of the LinkedData lifecycle?

√Which are the current bottlenecks?

√Which are the available market solutions?

√Which are the relevant key performanceindicators?

√What is the performance of existing toolsw.r.t. relevant performance indicators?

Irini Fundulaki (FORTH) HOBBIT March 3, 2016 4 / 9

Holistic Benchmarking of Big Linked Data(HOBBIT)

HOBBIT focuses on Big Linked Data and intends to cover thebusiness-critical steps of the Linked Data lifecycle

√Objectives

. Gather real Performance indicators and Performance thresholds fromindustry

. Develop benchmarks based on real data

. Provide universal benchmarking platform on standardized hardware toprovide comparable results

. Provide periodic benchmarking challenges and reporting

. Found independent Hobbit association

Irini Fundulaki (FORTH) HOBBIT March 3, 2016 5 / 9

HOBBIT Benchmarks

√Generation and Acquisition: will test the performance of the systems thatimplement approaches for extracting RDF data from

. semi-structured data streams such as sensor data (smart metering) and

. unstructured data streams (Twitter, RSS feeds, etc.)

√Analysis and Processing

. linking benchmark will test the performance of instance matchingmethods for Linked Data

. analytics benchmark will test the performance of supervised andunsupervised machine learning methods

Irini Fundulaki (FORTH) HOBBIT March 3, 2016 6 / 9

HOBBIT Benchmarks

√Storage and Curation

. storage benchmark will test the performance storage components andsmall storage subsystems

. versioning benchmark will examine how versioning systems performw.r.t. size of the multi-version repository and the efficiency ofcross-snapshot query answering

√Visualization and Services: will test the performance of systems regarding

. question answering and

. faceted browsing.

Irini Fundulaki (FORTH) HOBBIT March 3, 2016 7 / 9

HOBBIT Overview

Irini Fundulaki (FORTH) HOBBIT March 3, 2016 8 / 9

HOBBIT Logistics√

Horizon 2020, 3 years duration (01/12/2016–30/11/2018)√

Coordinator: Dr. Axel-Cyrille Ngonga-Ngomo, Institute of AppliedInformatics, Germany

√Partners:

. Institute for applied informatics (InfAI), Germany

. Fraunhofer IAIS, Germany

. Foundation for Research and Technology (FORTH), Greece

. National Center for Scientific Research "Demokritos" (NCSR), Greece

. iMinds, Belgium

. USU Software AG, Germany

. ONTOS AG, Switzerland

. OpenLink, UK

. AGT Group R&D GMBH, Germany

. TomTom, PolandIrini Fundulaki (FORTH) HOBBIT March 3, 2016 9 / 9