Networked Media - â€؛ ISR-HUN â€؛ Magyar_Gabor.pdfآ  Networked, electronic media Media...

download Networked Media - â€؛ ISR-HUN â€؛ Magyar_Gabor.pdfآ  Networked, electronic media Media technology Content

If you can't read please download the document

  • date post

    10-Jun-2020
  • Category

    Documents

  • view

    0
  • download

    0

Embed Size (px)

Transcript of Networked Media - â€؛ ISR-HUN â€؛ Magyar_Gabor.pdfآ  Networked, electronic media Media...

  • Budapest University of Technology and Economics, BME

    Networked Media

    in the Future nternet

  • Israeli Hungarian Workshop on Future Internet Research

    Motivation

    • Future Internet --- Internet of media

    • content delivery should rely on service-

    centric networks

    • New requirements in knowledge

    representation and analysis

    2

  • Israeli Hungarian Workshop on Future Internet Research

    Media Informatics Outline

    Networked electronic media

    Information and knowledge management

    Human-computer interaction

    Media technology Content delivery

    Content production web 2.0 technologies

    Databases Knowledge representation

    Data- and text mining IR & CBIR

    Personalized access to media

    Natural language interfaces (Voice & visual ) Dialog systems

    Cognitive interfaces Context identification

    3

  • Israeli Hungarian Workshop on Future Internet Research

    Networked, electronic media

    Media technology Content delivery

    Content production web 2.0 technologies

    Digital audiovisual archiving

    Content Management Systems

    IPTV apps.

    Mobile TV apps.

    3Play apps.

    Streaming media analysis and mining Video based tracking Video based traffic count Audio and video based in-home health care solutions

    4

  • Israeli Hungarian Workshop on Future Internet Research

    Information and knowledge management

    Databases Knowledge representation

    Data- and text mining IR & CBIR

    Personalized access to media Text processing

    Intelligent text retrieval

    Domain specific search engines

    Text categorization

    Collaborative filtering

    - in information filtering

    - in recommender systems

    - localization based services

    - advertisement and content targeting

    Indexing Knowledge retrieval by fuzzy

    pseudo thesaurus Multi Criteria Decision Analysis

    5

  • Israeli Hungarian Workshop on Future Internet Research

    Human-computer interaction Natural language interfaces

    (Voice & visual ) Dialog systems Cognitive interfaces

    Context identification Context identification in language processing

    Question to SQL Query translation Deep Web Search Engine Anaphora resolution Genitive phrase meaning discovery Text to ontology building

    Inferring from natural language corpus Personal rating (‘vox populi’) Context targeting and content recommendations Term extraction Textual corpus based decision support systems

    Pattern recognition in images - recognition of pedestrians, signals - identification and classification in time series - photo based recognition - signature, face, handwriting identification - impression identification of images Voice, tone and feeling identification in audio

    6

  • Israeli Hungarian Workshop on Future Internet Research

    Context recognition

    7

    Partneroldali vékonykliens

    Szavak hálójában

    Magas szintű modell

    Nyelvi

    elemző Kontextus-

    felismerő

    Mély háló

    motor

    Mediátor

    réteg Mély háló

    adatbázis

    Válasz-

    elemzés

    Kérdés

    Formális mondat

    CL kifejezés

    Általános SQL

    Eredmények

    Rangsor

    SQL

    Abstract model

    Context

    recognizer

    Morpho

    analyzer

    Deep web

    engine

    Answer

    analyzer

    Mediator

    layer Deep web

    DB

  • Israeli Hungarian Workshop on Future Internet Research

    Context recognizer

    • Determines the context(s) of queries

    • Identifies the focus and the schema of the query

    • Determines the role of each information granule of the query and assigns them to appropriate attributes of the identified schema

    • Creates so-called CL (Context Language) expressions that is the basis of SQL queries

    8

  • Israeli Hungarian Workshop on Future Internet Research

    Multi Criteria Decision Analysis in engineering areas

    • Info-communication networks

    • Fault spreading problem

    • Routing tasks

    Mathematical modelling tools Analytic Hierarchy Process (AHP)

    Analytic Network Process (ANP)

    Bayesian Network

    Method combining expert knowledge

    and probabilistic theory to analyse fault

    spreading problem

    9

  • Israeli Hungarian Workshop on Future Internet Research

    • Task: extraction of feature vectors

    characteristic to objects

    • Referential comparison of different

    categorization methods

  • Israeli Hungarian Workshop on Future Internet Research

    Method

    • Originally used for text documents

    • Hierarchical taxonomy tree

    • Each node has a processing unit

    • Each processing unit outputs a sigmoid

    function of the linear combination of its

    inputs

  • Israeli Hungarian Workshop on Future Internet Research

  • Israeli Hungarian Workshop on Future Internet Research

    Data Mining Competitions

    • ACM KDD Cup (classification of internet search query; automatic identification of pulmonary embolisms (PE) from 3D computed tomography data)

    – First place in patient classification

    – Runner-up in query categorization precision

    – Runner-up in PE identification

    – Runner-up in creativity

    • ACM SIGKDD Challenge on Time Series Classification (general purpose time series classification task)

    – 3rd place

    • IEEE Conference on Data Mining – 5th in precision on high precision in-door localization

    • Netflix Prize Competition – 2nd place

    13

    KDD Cup is the annual Data Mining and Knowledge Discovery competition organized by ACM, USA

  • Israeli Hungarian Workshop on Future Internet Research

     integrated 3D mouse

     Integrated touch-based actuator

     haptic vibration feedback

    Audio (speach recognition and synthesis 3D input devices

    Cognitive interfaces

    14

  • Israeli Hungarian Workshop on Future Internet Research

    - RT middleware

    - ICE based TRT

    middle ware

    -Platform independent

    - 3D Internet

    -Collaboration Arena

    VirCA operation system - network

    15

  • Israeli Hungarian Workshop on Future Internet Research

    Co-operation networks

    • Emerging Information Technology in

    Manufacturing (ITM) www.itm-lab.eu – Norwegian University of Science and Technology,

    Narvik University College, BME, MTA-SZTAKI,

    Budapest Tech (BMF), Széchenyi István University

    • Intelligent Integrated Systems

    Japanese-Hungarian Joint Laboratory

    www.iisl-lab.org – University of Tokyo, BME

    16

    http://www.itm-lab.eu/ http://www.itm-lab.eu/ http://www.itm-lab.eu/ http://www.iisl-lab.org/ http://www.iisl-lab.org/ http://www.iisl-lab.org/

  • Israeli Hungarian Workshop on Future Internet Research

    7% - verbal communication; 38% - paraverbal communication; 55% - non-verbal signals, such

    as gesticulation, posture

    3D Motion capture

    systems Speech recognition

    17

  • Israeli Hungarian Workshop on Future Internet Research

    CAD

    matching

    Norway Hungary

    18

  • Israeli Hungarian Workshop on Future Internet Research

    Two approaches:

     Cell phone actuator in CAVE

     CAVE-enhanced cell phone

    Cell phone equipped with:

    Motion sensors (integrated 3D mouse)

    Touch sensors (integrated touch-based actuator)

    Vibrating components (haptic feedback)

    Data glove for position

    capture and haptic

    feedback

    Wireless input device

    Mobile 3D Internet

    19

  • Israeli Hungarian Workshop on Future Internet Research

    Foundation of

    Intelligent Space Network

    • Dept. of Electrical and Computer Engineering North Carolina State

    University

    • Computer and Automation Research Institute of Hungarian Academy of

    Sciences

    • Eötvös University

    • Budapest University of Technology and Economics

    • National Institute of Advanced Industrial Science and Technology

    • Hashimoto Laboratory, Institute of Industrial Science University of Tokyo

    • Department of Electrical and Electronic Engineering Chuo University

    • College of Information Science and Engineering Ritsumeikan University

    • Department of Electrical Engineering Meiji University

    • Department of Industrial Engineering, Narvik University College

    • Department of Production and Quality Engineering Norwegian University

    of Science and Technology

    20

  • Israeli Hungarian Workshop on Future Internet Research

    Speech activities

    • Multi-lingual artificial speech generation

    • Speech recognition

    • Speech databases

    21

  • Israeli Hungarian Workshop on Future Internet Research

    • Multi-lingual artificial speech generation – limited vocabulary (e.g., numb