Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course,...
Transcript of Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course,...
![Page 1: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/1.jpg)
Exploiting the Semantic Technology for Developing Smart Space Application
Software Engineering Competence Center
![Page 2: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/2.jpg)
© Copyright Software Engineering Competence Center 2013
Outline
Semantic Smart Spaces Overview
• Smart Environment
• Smart Environment Requirements
• Smart Environment Challenges
• Smart Environment Key Concept
• Semantic Web
• Semantic Smart Environment
Energy Aware Smart Building Scenario
• Overview
• Objectives
• System Actors
• Usage Scenarios
• Devices
• Technologies
• Hardware / Software Architecture
• Events and Data Flow
• Test Environment
2
![Page 3: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/3.jpg)
SEMANTIC SMART SPACES OVERVIEW
![Page 4: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/4.jpg)
© Copyright Software Engineering Competence Center 2013
A smart environment is a context aware environment that is able to interact with its inhabitants through autonomous devices embedded all around this physical world
Smart Environment
4
![Page 5: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/5.jpg)
© Copyright Software Engineering Competence Center 2013
Smart Environment Requirements (1/2)
Who I am?
Who I am with?
What do I like?
What I am doing?
How do I feel?
Context Awareness
Where I am?
5
![Page 6: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/6.jpg)
© Copyright Software Engineering Competence Center 2013
Smart Environment Requirements (2/2)
Network
Traffic
Navigation
Store info.
Home Automation
Health care
Agriculture
Industry Sightseeing
Interoperability Evolvalbility
6
![Page 7: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/7.jpg)
© Copyright Software Engineering Competence Center 2013
Smart Environment Challenges
Multi-vendor devices
Lack of a shared data storage
Lack of common information exchange methods and standards
7
![Page 8: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/8.jpg)
© Copyright Software Engineering Competence Center 2013
If information about the surrounding environment is machine understandable, then the variety of applications that can benefit is tremendous
Smart Environment Key Concept
Here Comes the Role of
8
![Page 9: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/9.jpg)
© Copyright Software Engineering Competence Center 2013
Extension of the current web
Web of data
Semantic Web
9
![Page 10: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/10.jpg)
© Copyright Software Engineering Competence Center 2013
What Semantic Web is all About? (1/2)
WORLD WIDE DATABASE
Build the Internet of things
MAKE THE WEB
10
![Page 11: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/11.jpg)
© Copyright Software Engineering Competence Center 2013
What Semantic Web is all About? (2/2)
Makes
information
MACHINE UNDERSTANDABLE
Using
RESOURCE DESCRIPTION FRAMEWORK
To link data
LINKED DATA
So that we
can find
information
in
QUERY LANGUAGE
FEDERATED DATA SETS
Using
WORLD WIDE DATABASE
And so the
web
becomes
11
![Page 12: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/12.jpg)
© Copyright Software Engineering Competence Center 2013
Semantic Smart Environment
A smart environment that uses semantic web technologies for data representation
Semantic Middleware
Ontology
Services
12
![Page 13: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/13.jpg)
ENERGY AWARE SMART BUILDING SCENARIO
![Page 14: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/14.jpg)
© Copyright Software Engineering Competence Center 2013
Overview
Training Development WP3
Develop training tracks; SOA, Semantic Web, MDD, Ubiquitous Computing
Joint Experiments WP4
Joint experiments with TECNALIA, VTT and UNIBO
Staff Exchange WP5
3 months collaboration missions with TECNALIA
Technology Road Mapping WP2
TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation
Dissemination and Exploitation WP6
Training rounds Exploitation cluster projects
14
![Page 15: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/15.jpg)
© Copyright Software Engineering Competence Center 2013
Participants
Software Engineering Competence Center
University of Bologna - Italy
TECNALIA - Spain
15
ANSR Lab Cairo University
![Page 16: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/16.jpg)
© Copyright Software Engineering Competence Center 2013
Objectives
16
Low Cost Devices
and Sensors
Extendible and Configurable
System
Power Harvesting
Policies
Varity of End User Apps
(Mobile – Web)
![Page 17: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/17.jpg)
© Copyright Software Engineering Competence Center 2013
Key Features
User Identification and profiling
Detect user presence, localize user, and apply preferences
Apply energy saving policies
Device self identification
Remote monitoring and control
Fault detection and notification
17
![Page 18: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/18.jpg)
© Copyright Software Engineering Competence Center 2013
System Actors
• Register user preferences
• Remote monitoring and control via web interface
• Receive fault notification and alarms via mobile
Home User
• Register profile via web interface
• Contact info
• Rates and working hours
• Devices to fix
Maintenance Company
• Configure smart home
• Create smart home ID
• Plugs devices to enter the smart space
Admin
18
![Page 19: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/19.jpg)
© Copyright Software Engineering Competence Center 2013
Usage Scenarios (1/4)
Smartification
Smart Space Send
Identification
Packets
Admin Configure
and Localize
Devices
1
19
![Page 20: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/20.jpg)
© Copyright Software Engineering Competence Center 2013
Usage Scenarios (2/4)
User and Company Registration
Smart Space Send Data
2
20
![Page 21: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/21.jpg)
© Copyright Software Engineering Competence Center 2013
•Detect user Presence •Localize User •Apply user preferences •Apply Energy Saving Policy in case of no presence
Usage Scenarios (3/4)
Actuation
Smart Space Send Data
3
21
![Page 22: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/22.jpg)
© Copyright Software Engineering Competence Center 2013
Usage Scenarios (4/4)
Monitoring, Control, Fault Detection
Send Periodic
Data
4
Smart Space
22
![Page 23: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/23.jpg)
© Copyright Software Engineering Competence Center 2013
Devices
23
![Page 24: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/24.jpg)
© Copyright Software Engineering Competence Center 2013
JN5148-EK010 ZigBee PRO Evaluation Kit
Jennic JN5148 wireless microcontroller
1 Controller board with LCD
4 Sensor boards
Temperature, humidity, and light on board sensors
Physical Layer
Zigbee-based Wireless Sensor Network
Technologies (1/4)
24
![Page 25: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/25.jpg)
© Copyright Software Engineering Competence Center 2013
Technologies (2/4)
Smart-M3 Open Source Platform
Multidomain, Multidevice, Multivendor
Semantic Information Broker (SIB) is a triple store that represents the smart space and stores information in the form of RDF graphs based on ontologies
Knowledge Processor (KP) are software agents
KPIs exist in different languages (Java, Python, ..)
Simple communication protocol called Smart Space Access Protocol (SSAP) that provides KPs with primitive to access SIB data (insert/add/remove/query/etc.)
Semantic Middleware
Smart-M3 an Open
25
![Page 26: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/26.jpg)
© Copyright Software Engineering Competence Center 2013
Technologies (3/4)
SOA and Open Source Mule ESB
Service-oriented architecture (SOA) is a set of principles and methodologies for designing and developing software in the form of interoperable services
An Enterprise Service Bus (ESB) is a set of rules and principles for integrating numerous applications together over a bus-like infrastructure
Service Layer
SOA and ESB
26
![Page 27: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/27.jpg)
© Copyright Software Engineering Competence Center 2013
Technologies (4/4)
Android Application using GCM
Google cloud messaging service that provides some APIs to communicate with the GCM server in both communication directions, sending and receiving
Application Layer
Google Cloud Messaging
27
![Page 28: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/28.jpg)
© Copyright Software Engineering Competence Center 2013
System Layers
Applications (Web, Mobile)
Sensors
KPI
Data acquisition
Device Family 1 KP
SIB
KPI
Data acquisition
Device Family N KP
ESB
Consumer/Aggregator KP(Actuation /web service adapter)
Semantic Middleware
Applications
Producer / Aggregator KP’s
SSAP over TCP/IP
SSAP over TCP/IP
Ontology
Service Layer
28
![Page 29: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/29.jpg)
© Copyright Software Engineering Competence Center 2013
PIR Light AC
Software Components
coordinator
KP (Drivers, Adapters)
MMP Fridge RFID
SIB
Fault Detector
Brain
Fault Dispatcher
Service Layer Adapter
ESB
Registration Visualization and
Control
TCP/IP
Web App (user/maintenance) Mobile App Application Layer
Information Layer
Physical Layer
29
![Page 30: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/30.jpg)
© Copyright Software Engineering Competence Center 2013
SIB Adapter KP
Inserts data to SIB
AC/Ref Multimedia
Environment Light
Send identification packets to coordinator
Ontology
Data and Events Flow - Smartification
30
![Page 31: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/31.jpg)
© Copyright Software Engineering Competence Center 2013
SIB Driver KP
Send commands to devices
AC/Ref Multimedia
Environment Light
Actuate devices
User Identification
Brain KP
Send user
ID
Consumes data from SIB and insert commands based on user presence or identification
Data and Events Flow - Actuation
31
![Page 32: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/32.jpg)
© Copyright Software Engineering Competence Center 2013
Adapter/ Driver KPs
AC/Ref Multimedia
Environment Light
Send periodic data packets to coordinator
Brain KP
Service Adaptation Layer
Consumes data from SIB and insert commands based on user presence or identification
SIB
Data and Events Flow – Monitoring
Consumes data to display on web application and add new home, user, company, or command
32
![Page 33: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/33.jpg)
© Copyright Software Engineering Competence Center 2013
Adapter/ Driver KPs
AC/Ref Multimedia
Environment Light
Send periodic data
packets to coordinator
Fault Detector KP
Fault Dispatcher KP
Service Adaptation Layer
Consumes data from SIB and insert faults if any is detected
Consumes data from SIB and send faults and alarms to mobile device via Google cloud messaging
Consumes data to display on web application and add new home, user, company, or command
SIB
Data and Events Flow – Fault Detection
33
![Page 34: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/34.jpg)
© Copyright Software Engineering Competence Center 2013
Test Environment
34
![Page 35: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/35.jpg)
© Copyright Software Engineering Competence Center 2013
Test Environment – Rooms
35
![Page 36: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/36.jpg)
© Copyright Software Engineering Competence Center 2013
Test Environment – Nodes (1/3)
Multimedia node
Light node
RFID module 36
![Page 37: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/37.jpg)
© Copyright Software Engineering Competence Center 2013
Test Environment – Nodes (2/3)
Refrigerator and AC nodes
Environmental node
37
![Page 38: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/38.jpg)
© Copyright Software Engineering Competence Center 2013
Test Environment – Nodes (3/3)
Coordinator node
38
![Page 39: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/39.jpg)
© Copyright Software Engineering Competence Center 2013
ECWebSec is the website for:
Admin: to add new smart homes
User: to monitor and control smart home remotely
Maintenance company: to register info and contact data
Web Application (1/5)
39
![Page 40: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/40.jpg)
© Copyright Software Engineering Competence Center 2013
User can configure perefernces
Web Application (2/5)
40
![Page 41: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/41.jpg)
© Copyright Software Engineering Competence Center 2013
User can monitor and control appliances from the website
Web Application (3/5)
41
![Page 42: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/42.jpg)
© Copyright Software Engineering Competence Center 2013
User can browse list of available companies that can fix a certain fault
Web Application (4/5)
42
![Page 43: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/43.jpg)
© Copyright Software Engineering Competence Center 2013
Maintenance company can register to fix certain faults
Web Application (5/5)
43
![Page 44: Exploiting the Semantic Technology for Developing Smart Space … · 2013-10-10 · TRM Course, Market Analysis Seminar, Input Gathering, Consolidation, and Final Presentation WP6](https://reader031.fdocuments.in/reader031/viewer/2022020416/5caff3c988c993ca528b8230/html5/thumbnails/44.jpg)
© Copyright Software Engineering Competence Center 2013
Thank You
Software Engineering Competence Center
Research and Development Unit (R&D)
Smart Village - Building 121
Cairo \ Alexandria Desert Road
Giza, Egypt, 12577
(+202) 16248
www.secc.org.eg
44