Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course,...

44
Exploiting the Semantic Technology for Developing Smart Space Application Software Engineering Competence Center

Transcript of Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course,...

Page 1: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

Exploiting the Semantic Technology for Developing Smart Space Application

Software Engineering Competence Center

Page 2: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

© Copyright Software Engineering Competence Center 2013

Outline

Semantic Smart Spaces Overview

• Smart Environment

• Smart Environment Requirements

• Smart Environment Challenges

• Smart Environment Key Concept

• Semantic Web

• Semantic Smart Environment

Energy Aware Smart Building Scenario

• Overview

• Objectives

• System Actors

• Usage Scenarios

• Devices

• Technologies

• Hardware / Software Architecture

• Events and Data Flow

• Test Environment

2

Page 3: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

SEMANTIC SMART SPACES OVERVIEW

Page 4: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

© Copyright Software Engineering Competence Center 2013

A smart environment is a context aware environment that is able to interact with its inhabitants through autonomous devices embedded all around this physical world

Smart Environment

4

Page 5: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

© Copyright Software Engineering Competence Center 2013

Smart Environment Requirements (1/2)

Who I am?

Who I am with?

What do I like?

What I am doing?

How do I feel?

Context Awareness

Where I am?

5

Page 6: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

© Copyright Software Engineering Competence Center 2013

Smart Environment Requirements (2/2)

Network

Traffic

Navigation

Store info.

Home Automation

Health care

Agriculture

Industry Sightseeing

Interoperability Evolvalbility

6

Page 7: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

© Copyright Software Engineering Competence Center 2013

Smart Environment Challenges

Multi-vendor devices

Lack of a shared data storage

Lack of common information exchange methods and standards

7

Page 8: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

© Copyright Software Engineering Competence Center 2013

If information about the surrounding environment is machine understandable, then the variety of applications that can benefit is tremendous

Smart Environment Key Concept

Here Comes the Role of

8

Page 9: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

© Copyright Software Engineering Competence Center 2013

Extension of the current web

Web of data

Semantic Web

9

Page 10: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

© Copyright Software Engineering Competence Center 2013

What Semantic Web is all About? (1/2)

WORLD WIDE DATABASE

Build the Internet of things

MAKE THE WEB

10

Page 11: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

© Copyright Software Engineering Competence Center 2013

What Semantic Web is all About? (2/2)

Makes

information

MACHINE UNDERSTANDABLE

Using

RESOURCE DESCRIPTION FRAMEWORK

To link data

LINKED DATA

So that we

can find

information

in

QUERY LANGUAGE

FEDERATED DATA SETS

Using

WORLD WIDE DATABASE

And so the

web

becomes

11

Page 12: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

© Copyright Software Engineering Competence Center 2013

Semantic Smart Environment

A smart environment that uses semantic web technologies for data representation

Semantic Middleware

Ontology

Services

12

Page 13: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

ENERGY AWARE SMART BUILDING SCENARIO

Page 14: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

© Copyright Software Engineering Competence Center 2013

Overview

Training Development WP3

Develop training tracks; SOA, Semantic Web, MDD, Ubiquitous Computing

Joint Experiments WP4

Joint experiments with TECNALIA, VTT and UNIBO

Staff Exchange WP5

3 months collaboration missions with TECNALIA

Technology Road Mapping WP2

TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation

Dissemination and Exploitation WP6

Training rounds Exploitation cluster projects

14

Page 15: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

© Copyright Software Engineering Competence Center 2013

Participants

Software Engineering Competence Center

University of Bologna - Italy

TECNALIA - Spain

15

ANSR Lab Cairo University

Page 16: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

© Copyright Software Engineering Competence Center 2013

Objectives

16

Low Cost Devices

and Sensors

Extendible and Configurable

System

Power Harvesting

Policies

Varity of End User Apps

(Mobile – Web)

Page 17: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

© Copyright Software Engineering Competence Center 2013

Key Features

User Identification and profiling

Detect user presence, localize user, and apply preferences

Apply energy saving policies

Device self identification

Remote monitoring and control

Fault detection and notification

17

Page 18: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

© Copyright Software Engineering Competence Center 2013

System Actors

• Register user preferences

• Remote monitoring and control via web interface

• Receive fault notification and alarms via mobile

Home User

• Register profile via web interface

• Contact info

• Rates and working hours

• Devices to fix

Maintenance Company

• Configure smart home

• Create smart home ID

• Plugs devices to enter the smart space

Admin

18

Page 19: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

© Copyright Software Engineering Competence Center 2013

Usage Scenarios (1/4)

Smartification

Smart Space Send

Identification

Packets

Admin Configure

and Localize

Devices

1

19

Page 20: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

© Copyright Software Engineering Competence Center 2013

Usage Scenarios (2/4)

User and Company Registration

Smart Space Send Data

2

20

Page 21: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

© Copyright Software Engineering Competence Center 2013

•Detect user Presence •Localize User •Apply user preferences •Apply Energy Saving Policy in case of no presence

Usage Scenarios (3/4)

Actuation

Smart Space Send Data

3

21

Page 22: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

© Copyright Software Engineering Competence Center 2013

Usage Scenarios (4/4)

Monitoring, Control, Fault Detection

Send Periodic

Data

4

Smart Space

22

Page 23: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

© Copyright Software Engineering Competence Center 2013

Devices

23

Page 24: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

© Copyright Software Engineering Competence Center 2013

JN5148-EK010 ZigBee PRO Evaluation Kit

Jennic JN5148 wireless microcontroller

1 Controller board with LCD

4 Sensor boards

Temperature, humidity, and light on board sensors

Physical Layer

Zigbee-based Wireless Sensor Network

Technologies (1/4)

24

Page 25: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

© Copyright Software Engineering Competence Center 2013

Technologies (2/4)

Smart-M3 Open Source Platform

Multidomain, Multidevice, Multivendor

Semantic Information Broker (SIB) is a triple store that represents the smart space and stores information in the form of RDF graphs based on ontologies

Knowledge Processor (KP) are software agents

KPIs exist in different languages (Java, Python, ..)

Simple communication protocol called Smart Space Access Protocol (SSAP) that provides KPs with primitive to access SIB data (insert/add/remove/query/etc.)

Semantic Middleware

Smart-M3 an Open

25

Page 26: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

© Copyright Software Engineering Competence Center 2013

Technologies (3/4)

SOA and Open Source Mule ESB

Service-oriented architecture (SOA) is a set of principles and methodologies for designing and developing software in the form of interoperable services

An Enterprise Service Bus (ESB) is a set of rules and principles for integrating numerous applications together over a bus-like infrastructure

Service Layer

SOA and ESB

26

Page 27: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

© Copyright Software Engineering Competence Center 2013

Technologies (4/4)

Android Application using GCM

Google cloud messaging service that provides some APIs to communicate with the GCM server in both communication directions, sending and receiving

Application Layer

Google Cloud Messaging

27

Page 28: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

© Copyright Software Engineering Competence Center 2013

System Layers

Applications (Web, Mobile)

Sensors

KPI

Data acquisition

Device Family 1 KP

SIB

KPI

Data acquisition

Device Family N KP

ESB

Consumer/Aggregator KP(Actuation /web service adapter)

Semantic Middleware

Applications

Producer / Aggregator KP’s

SSAP over TCP/IP

SSAP over TCP/IP

Ontology

Service Layer

28

Page 29: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

© Copyright Software Engineering Competence Center 2013

PIR Light AC

Software Components

coordinator

KP (Drivers, Adapters)

MMP Fridge RFID

SIB

Fault Detector

Brain

Fault Dispatcher

Service Layer Adapter

ESB

Registration Visualization and

Control

TCP/IP

Web App (user/maintenance) Mobile App Application Layer

Information Layer

Physical Layer

29

Page 30: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

© Copyright Software Engineering Competence Center 2013

SIB Adapter KP

Inserts data to SIB

AC/Ref Multimedia

Environment Light

Send identification packets to coordinator

Ontology

Data and Events Flow - Smartification

30

Page 31: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

© Copyright Software Engineering Competence Center 2013

SIB Driver KP

Send commands to devices

AC/Ref Multimedia

Environment Light

Actuate devices

User Identification

Brain KP

Send user

ID

Consumes data from SIB and insert commands based on user presence or identification

Data and Events Flow - Actuation

31

Page 32: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

© Copyright Software Engineering Competence Center 2013

Adapter/ Driver KPs

AC/Ref Multimedia

Environment Light

Send periodic data packets to coordinator

Brain KP

Service Adaptation Layer

Consumes data from SIB and insert commands based on user presence or identification

SIB

Data and Events Flow – Monitoring

Consumes data to display on web application and add new home, user, company, or command

32

Page 33: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

© Copyright Software Engineering Competence Center 2013

Adapter/ Driver KPs

AC/Ref Multimedia

Environment Light

Send periodic data

packets to coordinator

Fault Detector KP

Fault Dispatcher KP

Service Adaptation Layer

Consumes data from SIB and insert faults if any is detected

Consumes data from SIB and send faults and alarms to mobile device via Google cloud messaging

Consumes data to display on web application and add new home, user, company, or command

SIB

Data and Events Flow – Fault Detection

33

Page 34: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

© Copyright Software Engineering Competence Center 2013

Test Environment

34

Page 35: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

© Copyright Software Engineering Competence Center 2013

Test Environment – Rooms

35

Page 36: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

© Copyright Software Engineering Competence Center 2013

Test Environment – Nodes (1/3)

Multimedia node

Light node

RFID module 36

Page 37: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

© Copyright Software Engineering Competence Center 2013

Test Environment – Nodes (2/3)

Refrigerator and AC nodes

Environmental node

37

Page 38: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

© Copyright Software Engineering Competence Center 2013

Test Environment – Nodes (3/3)

Coordinator node

38

Page 39: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

© Copyright Software Engineering Competence Center 2013

ECWebSec is the website for:

Admin: to add new smart homes

User: to monitor and control smart home remotely

Maintenance company: to register info and contact data

Web Application (1/5)

39

Page 40: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

© Copyright Software Engineering Competence Center 2013

User can configure perefernces

Web Application (2/5)

40

Page 41: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

© Copyright Software Engineering Competence Center 2013

User can monitor and control appliances from the website

Web Application (3/5)

41

Page 42: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

© Copyright Software Engineering Competence Center 2013

User can browse list of available companies that can fix a certain fault

Web Application (4/5)

42

Page 43: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

© Copyright Software Engineering Competence Center 2013

Maintenance company can register to fix certain faults

Web Application (5/5)

43

Page 44: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6

© Copyright Software Engineering Competence Center 2013

Thank You

Software Engineering Competence Center

Research and Development Unit (R&D)

Smart Village - Building 121

Cairo \ Alexandria Desert Road

Giza, Egypt, 12577

(+202) 16248

[email protected]

www.secc.org.eg

44