Integration of Things (Sam Vanhoutte @Iglooconf 2017)
Transcript of Integration of Things (Sam Vanhoutte @Iglooconf 2017)
INTEGRATION OF THINGS: INDUSTRIAL IOT SOLUTIONS ON
AZURE
@SamVanhoutte, CTO Codit
Hello world
[email protected]+32 474 849 [email protected]/in/samvanhoutte
4th year Azure MVP
2000 Belgium2004 France2013 Portugal2016 Netherlands2016 Swiss2016 UK
Microsoft Integration
IoT Integrati
onAPI
MgmtAzure
@CoditCompany 120 employees
3
IoT Scenarios
4
IoT Scenarios
Industrial IoT
5
Industrial IoT
It’s not about Arduino’s or Raspberry Pi’s
Very diverse landscape of machinery
Multi-tenancy on data (customer vs manufacturer)
6
Industrial IoT
Very often legacy systems, not build with connectivity in mind
Remote monitoring & predictive maintenance
Standardization efforts: OPC-UA
IoT Value chain
7
The IoT
value
chain
Nebulus Cloud
Gateway
Bridge local protocols to cloud
Cross-plat, Azure connected
Device & gateway management
Cloud gateway connectivity
Gateway portal
Manage & provision configure & secure
gateways
NebulusField
Gateway
Adding value to
Azure
Project effort per phase
Connectivity
10
Direct connectivity➔ Easiest to install and configure➔ Mixing machine logic with IoT
logic➔ Complexity of IoT (retries,
command handling…) on every machine
➔ Not possible for legacy systems➔ “Feels” less secure
Connect machines directly with the internet
Azure IoT Hub
Cloud gateways➔ Devices come with embedded
connectivity (LoRa, SigFox…) to a propriatary cloud
➔ Cloud to Cloud integration needed➔ Forwarding capabilities from platforms
available to ➔ Azure IoT, Amazon, custom HTTP endpoints
➔ Easy to start in the cloud
Out of the box cloud connectivity with cloud gateway forwarding
Azure IoT Hub Protocol Gateway SDK
Field gateways➔ Requires extra hardware
➔ industrial PC, physical gateway➔ Machine logic seperated from
IoT logic➔ Complexity of IoT in one single
place➔ Retries, command handling…
➔ Way to Internet-enable legacy systems
➔ “Feels” more secure
Connect (multiple) machines through a gateway with the internet
Azure IoTGateway SDK
Nebulus IoT Gateway designNebulus IoT Field Gateway
Microsoft Azure IoT Gateway SDK (module)
Channel
ModBusModule
FilteringModule
CompressionModule
IoTHubModule
Channel
DeviceModel Module
Identity Module
IoTHubModule
Nebulus channels can contain custom modules and standard modules and will be mapped to runtime SDK modules.
pub/sub
Dyna
mic
Com
man
d Di
spat
cher
Com
man
d lis
tene
r tha
t disp
atch
es C
2D c
omm
ands
to d
iffer
ent m
odul
es
Activation Logic Secure bootstrapper for initial activation & identity logic
Module Repository Manager Downloads and updates modules from the cloud, on new versions
Configuration Manager Listens for configuration updates to the cloud and dispatches to the runtime
Gateway Information Manager Returns information about the health of the device on which the Gateway runs
Port forwarder (remote access) Allows remote connections on the local network for remote desktop & other tools
Device Discovery agent Listens for requests to scan network for devices and reports back to backendBuilt and provided by Codit
Provided by Microsoft SDK
Nebulus IoT Gateway is a supported, full product, using the Microsoft Azure IoT Gateway SDK (which is a framework), provided by Microsoft.
Nebulus IoT Gateway is backed by a Cloud API that allows customers to interact with their gateways.
Data
15
Data structures➔ Canonical data structures needed
➔ Device representation (structure)➔ Field parameters
➔ Two directions of telemetry➔ Persist native stream➔ Normalize towards ‘canonical data structure’
Data storage options
Source: https://biz-excellence.com/2016/08/30/big-data-dt/
Integrate & Act
18
Business Rules➔ Seperate rules evaluation
from action processing➔ Require flexibility & dynamic
creationAzure Stream Analytics
Azure Service Fabric
Integration➔ An IoT solution should not be isolated➔ Integration with other systems
➔ Ticketing systems➔ Maintenance➔ Command and control
Azure Logic Apps
Azure Service Bus& Routes !
Device Management
21
Device lifecycle PlanGroup devices and control access according to your
organization's needs
ProvisionSecurely authenticate devices, on-board for management and
provision for service
ConfigureProvide updates, configuration
& applications to assign the purpose of each device
MonitorMonitor device inventory, health & security while
providing proactive remediation of issues
RetireReplace or decommission
devices after failure or service lifetime
Device management, challenges
23
➔ Scale & Automation➔ Less complex tools which enable management of millions of devices with a
small staff ➔ Open & Compatible
➔ Tools provide tailored management for many different hardware, software, and protocol platforms
➔ Context aware➔ Management operations adjust to dynamic conditions: downtime windows,
network/power conditions, usage patterns, and device geolocation ➔ Serve many roles
➔ Including traditional IT, support for the workflows and processes of admin and operations roles are crucial (IT + OT)
Azure IoT
24
Platform Services
Infrastructure ServicesOS/Server Compute Storage
Datacenter Infrastructure (24 Regions, 22 Online)
Web and Mobile
Web Apps
MobileApps
APIManagement
API Apps
Logic Apps
Notification Hubs
Media & CDNContent DeliveryNetwork (CDN)
Media Services
Integration
HybridConnections
Service Bus
StorageQueues
HybridOperations
Backup
StorSimple
Azure SiteRecovery
Import/Export
Networking
Data
SQL Database
DocumentDB
RedisCache Azure
SearchStorageTables
DataWarehouse Azure AD
Health Monitoring
Virtual Network
ExpressRouteBLOB
StorageAzureFiles
PremiumStorage
Virtual Machines
AD PrivilegedIdentity Management
Traffic Manager
AppGateway
OperationalAnalytics
Services ComputeCloud Services
Batch RemoteApp
ServiceFabric
Developer Services
Visual Studio
AppInsights
Azure SDK
VS Online
ContainerService
DNS VPN Gateway
Load Balancer
Domain Services
Analytics & IoT
HDInsight MachineLearning
StreamAnalytics
Data Factory
EventHubs
MobileEngagement
Data Lake
IoT Hub
Data Catalog
Security & Manageme
nt
Azure ActiveDirectory
Multi-FactorAuthentication
Automation
Portal
Key Vault
Store/Marketplace
VM Image Gallery& VM Depot
Azure ADB2C
Scheduler
Logic Apps
Platform Services
Infrastructure ServicesOS/Server Compute Storage
Datacenter Infrastructure (24 Regions, 22 Online)
Web and Mobile
Web Apps
MobileApps
APIManagement
API Apps
Logic Apps
Notification Hubs
Media & CDNContent DeliveryNetwork (CDN)
Media Services
Integration
HybridConnections
Service Bus
StorageQueues
HybridOperations
Backup
StorSimple
Azure SiteRecovery
Import/Export
Networking
Data
SQL Database
DocumentDB
RedisCache Azure
SearchStorageTables
DataWarehouse Azure AD
Health Monitoring
Virtual Network
ExpressRouteBLOB
StorageAzureFiles
PremiumStorage
Virtual Machines
AD PrivilegedIdentity Management
Traffic Manager
AppGateway
OperationalAnalytics
Services ComputeCloud Services
Batch RemoteApp
ServiceFabric
Developer Services
Visual Studio
AppInsights
Azure SDK
VS Online
ContainerService
DNS VPN Gateway
Load Balancer
Domain Services
Analytics & IoT
HDInsight MachineLearning
StreamAnalytics
Data Factory
EventHubs
MobileEngagement
Data Lake
IoT Hub
Data Catalog
Security & Manageme
nt
Azure ActiveDirectory
Multi-FactorAuthentication
Automation
Portal
Key Vault
Store/Marketplace
VM Image Gallery& VM Depot
Azure ADB2C
Scheduler
Logic Apps
Azure IoT HubIoT Hub
Twin 0
Tags
Properties
Desired
Reported
Methods
Device 0 (or GW)
edge cloud back-end
Edge-visible metadata/config
Edge reported state/condition
…
Telemetry
Edge-opaque metadata
Cloud initiated device actions
Device metadata & organisation
28
IoT Hub
Twin 0
Tags
Properties
Desired
Reported
Methods…
Telemetry
Jobs
Queries
Set tags on twins to simplify the task of finding and targeting devices
Device management & configuration
29
IoT Hub
Twin 0
Tags
Properties
Desired
Reported
Methods…
Telemetry
Jobs
Queries
Set desired properties on twins to set common policy across a large group of devices
Device querying & compliance
30
IoT Hub
Twin 0
Tags
Properties
Desired
Reported
Methods…
Telemetry
Jobs
Query desired and reported properties to attest device compliance and surface problems Queries
Device troubleshooting & updating
31
IoT Hub
Twin 0
Tags
Properties
Desired
Reported
Methods…
Telemetry
Jobs
Queries
Initiate an action directly on a device or schedule an action with a job
demo
32
• Telemetry & routes• File upload•Device twins•Device queries•Direct methods•Device jobs
demo
33
Cognitive services (ADLA)
link
THANK YOU!