Tangible Mashups: Exploiting Links between the Physical and Virtual World

59
Tangible Mashups Exploiting Links between the Physical and Virtual World Expertise Centre for Digital Media Affiliated with the Institute for BroadBand Technology Hasselt University - transnationale Universiteit Limburg Belgium Jo Vermeulen, Kris Luyten and Karin Coninx {jo.vermeulen, kris.luyten, karin.coninx}@uhasselt.be
  • date post

    18-Oct-2014
  • Category

    Technology

  • view

    1.928
  • download

    2

description

The link between corresponding physical and virtual worlds has been the subject of research for many years now. The instantiation of this link was often a complex task that involved special purpose techniques to identify and search for the virtual information that belongs to a selected physical object. It is since the conception of physical tagging technologies such as RFID that physical objects can carry their own virtual information. In this paper we show a simple yet effective approach to extract the virtual information of physical objects and aggregate it in a sensible way for the user. We rely on Web 2.0 techniques to accomplish this. A useful side-effect of our approach is the fact that a set or mashup of physical objects leads to a mashup of their related information in the virtual world. Presented at the first International Workshop on System Support for the Internet of Things (WoSSIoT '07), Lisbon, Portugal, March 20, 2007.

Transcript of Tangible Mashups: Exploiting Links between the Physical and Virtual World

Page 1: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Tangible Mashups

Exploiting Links between the Physical and Virtual World

Expertise Centre for Digital MediaAffiliated with the Institute for BroadBand Technology

Hasselt University - transnationale Universiteit LimburgBelgium

Jo Vermeulen, Kris Luyten and Karin Coninx{jo.vermeulen, kris.luyten, karin.coninx}@uhasselt.be

Page 2: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Tangible Mashups

Exploiting Links between the Physical and Virtual World

Expertise Centre for Digital MediaAffiliated with the Institute for BroadBand Technology

Hasselt University - transnationale Universiteit LimburgBelgium

Jo Vermeulen, Kris Luyten and Karin Coninx{jo.vermeulen, kris.luyten, karin.coninx}@uhasselt.be

Page 3: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Extract and visualize information from physical objects

Page 4: Tangible Mashups: Exploiting Links between the Physical and Virtual World

N. Gershenfeld, R. Krikorian, and D. Cohen. The Internet of Things. Scientific American, 291:76–81, Oct. 2004.

Internet of Things

Page 5: Tangible Mashups: Exploiting Links between the Physical and Virtual World

An extension of the current Internet, in which everyday devices and physical objects are given the ability to connect to a data network

N. Gershenfeld, R. Krikorian, and D. Cohen. The Internet of Things. Scientific American, 291:76–81, Oct. 2004.

Internet of Things

Page 6: Tangible Mashups: Exploiting Links between the Physical and Virtual World

An extension of the current Internet, in which everyday devices and physical objects are given the ability to connect to a data network

N. Gershenfeld, R. Krikorian, and D. Cohen. The Internet of Things. Scientific American, 291:76–81, Oct. 2004.

Internet of Things

Page 7: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Internet of Things

Page 8: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Internet of Things1. Use IP

Page 9: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Internet of Things1. Use IP2. No network layers

Page 10: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Internet of Things1. Use IP2. No network layers3. Operate independently

Page 11: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Internet of Things1. Use IP2. No network layers3. Operate independently4. Responsible for own identity

Page 12: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Internet of Things1. Use IP2. No network layers3. Operate independently4. Responsible for own identity5. Big bits

Page 13: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Internet of Things1. Use IP2. No network layers3. Operate independently4. Responsible for own identity5. Big bits6. Consistent physical representation

Page 14: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Internet of Things1. Use IP2. No network layers3. Operate independently4. Responsible for own identity5. Big bits6. Consistent physical representation7. Open standards

Page 15: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Internet of Things1. Use IP2. No network layers3. Operate independently4. Responsible for own identity5. Big bits6. Consistent physical representation7. Open standards

Page 16: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Radio-Frequency Identification tags

Page 17: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Radio-Frequency Identification tags

can be read by a wireless readercontain a unique code

Page 18: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Radio-Frequency Identification tags

can be read by a wireless readeralready in use today

contain a unique code

Page 19: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Radio-Frequency Identification tags

can be read by a wireless readeralready in use today

contain a unique code

link an RFID tag to any kind of information

Page 20: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Radio-Frequency Identification tags

can be read by a wireless readeralready in use today

contain a unique code

link an RFID tag to any kind of information

object annotation

Page 21: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Accessibility of the digital annotations embedded in

our environment

Page 22: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Accessibility of the digital annotations embedded in

our environmentHow can we present it to the user?

Page 23: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Web mashups

Page 24: Tangible Mashups: Exploiting Links between the Physical and Virtual World

http://www.brusselstripstad.be/Brussel Stripstad

Page 25: Tangible Mashups: Exploiting Links between the Physical and Virtual World

http://www.nastypixel.com/FlickrFling

Page 27: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Mashup data from a set of physical objects

Page 28: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Mashup data from a set of physical objects

identified by their RFID tags

Page 29: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Mashup data from a set of physical objects

annotated with snippets of informationidentified by their RFID tags

Page 30: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Mashup data from a set of physical objects

annotated with snippets of informationidentified by their RFID tags

virtual representation

Page 31: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Intuitive mapping

Page 32: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Intuitive mappingReal-world mashup

Page 33: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Intuitive mappingReal-world mashup

Virtual mashup

Page 34: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Object annotation

Page 35: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Object annotation

persistent URL

Page 36: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Object annotation

persistent URLmetadata

Page 37: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Object annotation

persistent URLmetadatadata schemas

Page 38: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Two types of physical objects

Page 39: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Two types of physical objects

tool objects

Page 40: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Two types of physical objects

tool objects data objects

Page 41: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Two types of physical objects

tool objects data objects

Page 42: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Two types of physical objects

tool objects data objects

Page 43: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Usage scenario Physical mashup

Page 44: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Usage scenario Virtual mashup

Page 45: Tangible Mashups: Exploiting Links between the Physical and Virtual World

System architecture

User

RFID reader

Page 46: Tangible Mashups: Exploiting Links between the Physical and Virtual World

System architecture

schema

User

RFID reader

Front-end

Portal

Page 47: Tangible Mashups: Exploiting Links between the Physical and Virtual World

System architecture

schema

schema

User

RFID reader

Front-end

Portal

Back-end

Portal web service

Page 48: Tangible Mashups: Exploiting Links between the Physical and Virtual World

System architecture

schema

schema

User

RFID reader

Front-end

Portal

Back-end

Portal web service

schema

RFID tagspurl

Page 49: Tangible Mashups: Exploiting Links between the Physical and Virtual World

System architecture

schema

schema

input

Web services

User

RFID reader

Front-end

Portal

Back-end

Portal web service

schema

RFID tagspurl

Page 50: Tangible Mashups: Exploiting Links between the Physical and Virtual World

System architecture

schema

schema

input

results

Web services

User

RFID reader

Front-end

Portal

Back-end

Portal web service

schema

RFID tagspurl

Automatic invocation and schema matching

Page 51: Tangible Mashups: Exploiting Links between the Physical and Virtual World

System architecture

schema

schemaresults

input

results

Web services

User

RFID reader

Front-end

Portal

Back-end

Portal web service

schema

RFID tagspurl

Automatic invocation and schema matching

Page 52: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Automatic invocation and schema matching

Current status

Front-end

Back-end

schema

schemaresults

input

results

Web services

User

RFID reader

Portal

Portal web service

schema

RFID tagspurl

Page 53: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Automatic invocation and schema matching

Current status

Front-end

Back-end

schema

schemaresults

input

results

Web services

User

RFID reader

Portal

Portal web service

schema

RFID tagspurl

1 predefined

Page 54: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Automatic invocation and schema matching

Current status

Front-end

Back-end

schema

schemaresults

input

results

Web services

User

RFID reader

Portal

Portal web service

schema

RFID tagspurl

1

2

predefined

not yet working

Page 55: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Automatic invocation and schema matching

Current status

Front-end

Back-end

schema

schemaresults

input

results

Web services

User

RFID reader

Portal

Portal web service

schema

RFID tagspurl

1

2

3

predefined

not yet working

no anti-collision support

Page 56: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Conclusions

Page 57: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Conclusions

early approach to visualize information from physical objects

Page 58: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Conclusions

early approach to visualize information from physical objects

• tool objects• data objects

Page 59: Tangible Mashups: Exploiting Links between the Physical and Virtual World

Conclusions

early approach to visualize information from physical objects

• tool objects• data objects

Web services

User

Front-end

Portal

Back-end

Portal web service

Automatic invocation and schema matching