13/04/2023 CUbRIK Presentation 1

The CUbRIK Project

P.Fraternali, M.Tagliasacchi, D.Martinenghi, A.Bozzon, I.Catallo,

E.Ciceri, F.Nucci, V.Croce, I.S.Altingovde, W.Siberski

The CUbRIK project

36 month large-scale integrating project

partially funded by the European Commission’s 7th Framework ICT Programme for Research and Technological Development

www.cubrikproject.eu

13/04/2023 CUbRIK Presentation 2

Objectives

The technical goal of CUbRIK is to build an open search platform grounded on four objectives: Advance the architecture of multimedia search Place humans in the loop Open the search box Start up a search business ecosystem

13/04/2023 CUbRIK Presentation 3

Objective: Advance the architecture of multimedia search

Multimedia search: coordinated result of three main processes: Content processing: acquisition, analysis,

indexing and knowledge extraction from multimedia content

Query processing: derivation of an information need from a user and production of a sensible response

Feedback processing: quality feedback on the appropriateness of search results

13/04/2023 CUbRIK Presentation 4

Objective: Advance the architecture of multimedia search

Objective: Content processing, query processing and

feedback processing phases will be implemented by means of independent components

Components are organized in pipelines Each application defines ad-hoc pipelines that

provide unique multimedia search capabilities in that scenario

13/04/2023 CUbRIK Presentation 5

Objective: Humans in the loop

Problem: the uncertainty of analysis algorithms leads to low confidence results and conflicting opinions on automatically extracted features

Solution: humans have superior capacity for understanding the content of audiovisual material

State of the art: humans replace automatic feature extraction processes (human annotations)

Our contribution: integration of human judgment and algorithms

Goal: improve the performance of multimedia content processing

6

CUbRIK architecture

13/04/2023 CUbRIK Presentation 7

Human-powered trademark logo detection demo

Goal: integrate human and automatic computation to increase precision and recall w.r.t. fully automatic solutions

13/04/2023 CUbRIK Presentation 8

Thanks for your attentionwww.cubrikproject.eu

13/04/2023 CUbRIK Presentation 9