Steef-Jan Wiggers - Microsoftbiztalk360.blob.core.windows.net/integrate2018/Integrate... ·...
Transcript of Steef-Jan Wiggers - Microsoftbiztalk360.blob.core.windows.net/integrate2018/Integrate... ·...
![Page 1: Steef-Jan Wiggers - Microsoftbiztalk360.blob.core.windows.net/integrate2018/Integrate... · 2018-06-14 · Steef-Jan Wiggers Azure & IoT Domain Lead Serverless Messaging with Microsoft](https://reader035.fdocuments.in/reader035/viewer/2022062602/5ec59fe195c9d3660c429e8d/html5/thumbnails/1.jpg)
Steef-Jan WiggersAzure & IoT Domain Lead
Serverless Messaging with Microsoft Azure
![Page 3: Steef-Jan Wiggers - Microsoftbiztalk360.blob.core.windows.net/integrate2018/Integrate... · 2018-06-14 · Steef-Jan Wiggers Azure & IoT Domain Lead Serverless Messaging with Microsoft](https://reader035.fdocuments.in/reader035/viewer/2022062602/5ec59fe195c9d3660c429e8d/html5/thumbnails/3.jpg)
What can you expected in this session
• Serverless messaging
• Messaging In Azure
• Messaging scenarios
• Demo’s
![Page 4: Steef-Jan Wiggers - Microsoftbiztalk360.blob.core.windows.net/integrate2018/Integrate... · 2018-06-14 · Steef-Jan Wiggers Azure & IoT Domain Lead Serverless Messaging with Microsoft](https://reader035.fdocuments.in/reader035/viewer/2022062602/5ec59fe195c9d3660c429e8d/html5/thumbnails/4.jpg)
Serverless
4
![Page 5: Steef-Jan Wiggers - Microsoftbiztalk360.blob.core.windows.net/integrate2018/Integrate... · 2018-06-14 · Steef-Jan Wiggers Azure & IoT Domain Lead Serverless Messaging with Microsoft](https://reader035.fdocuments.in/reader035/viewer/2022062602/5ec59fe195c9d3660c429e8d/html5/thumbnails/5.jpg)
Evolution to Serverless
• You can choose:• VM →
• Containers →
• Orchestrators →
• PaaS →
• Serverless
On-premise IaaS PaaS Serverless
![Page 6: Steef-Jan Wiggers - Microsoftbiztalk360.blob.core.windows.net/integrate2018/Integrate... · 2018-06-14 · Steef-Jan Wiggers Azure & IoT Domain Lead Serverless Messaging with Microsoft](https://reader035.fdocuments.in/reader035/viewer/2022062602/5ec59fe195c9d3660c429e8d/html5/thumbnails/6.jpg)
“Serverless computing is a cloud-computing execution model in
which the cloud provider dynamically manages the allocation of
machine resources. Pricing is based on the actual amount of
resources consumed by an application, rather than on pre-
purchased units of capacity. It is a form of utility computing.”
Source (Wikipedia Serverless Computing):
https://en.wikipedia.org/wiki/Serverless_computing
Defining Serverless
![Page 7: Steef-Jan Wiggers - Microsoftbiztalk360.blob.core.windows.net/integrate2018/Integrate... · 2018-06-14 · Steef-Jan Wiggers Azure & IoT Domain Lead Serverless Messaging with Microsoft](https://reader035.fdocuments.in/reader035/viewer/2022062602/5ec59fe195c9d3660c429e8d/html5/thumbnails/7.jpg)
Thoughts on Serverless
- Infinite scale requires atomic workloads and
infinite resources.
- Reality is resources are always finite and many
workloads not atomic.
- Messaging is for decoupling and transferring
state or data secure and reliably.
![Page 8: Steef-Jan Wiggers - Microsoftbiztalk360.blob.core.windows.net/integrate2018/Integrate... · 2018-06-14 · Steef-Jan Wiggers Azure & IoT Domain Lead Serverless Messaging with Microsoft](https://reader035.fdocuments.in/reader035/viewer/2022062602/5ec59fe195c9d3660c429e8d/html5/thumbnails/8.jpg)
Serverless in Azure
- Serverless Compute → Azure Functions
- Serverless Database → Azure Cosmos DB
- Serverless Events → Azure Event Grid
- Serverless Realtime → Azure Signal R Service
- Serverless Workflow → Logic Apps &
Durable Functions
- Serverless IoT → IoT Hubs
- Serverless Analytics → Application Insights
![Page 9: Steef-Jan Wiggers - Microsoftbiztalk360.blob.core.windows.net/integrate2018/Integrate... · 2018-06-14 · Steef-Jan Wiggers Azure & IoT Domain Lead Serverless Messaging with Microsoft](https://reader035.fdocuments.in/reader035/viewer/2022062602/5ec59fe195c9d3660c429e8d/html5/thumbnails/9.jpg)
Serverless Messaging
Message: >Down
Message: >Stay
Message: >Come
Is this serverless messaging?
![Page 10: Steef-Jan Wiggers - Microsoftbiztalk360.blob.core.windows.net/integrate2018/Integrate... · 2018-06-14 · Steef-Jan Wiggers Azure & IoT Domain Lead Serverless Messaging with Microsoft](https://reader035.fdocuments.in/reader035/viewer/2022062602/5ec59fe195c9d3660c429e8d/html5/thumbnails/10.jpg)
What I mean is: You have options!
We have various messaging capabilities in Azure!
Event Hubs
Telemetry
stream
ingestion
Service Bus &
Azure Queues
Cloud
messaging
Event Grid
Event
distribution
Logic Apps
Workflow
and LOB
Integration
IoT Hub
IoT messaging
and manage-
ment
Notification
Hubs
Mobile push
notifications
Relay
Discovery,
Firewall/NAT
Traversal
![Page 11: Steef-Jan Wiggers - Microsoftbiztalk360.blob.core.windows.net/integrate2018/Integrate... · 2018-06-14 · Steef-Jan Wiggers Azure & IoT Domain Lead Serverless Messaging with Microsoft](https://reader035.fdocuments.in/reader035/viewer/2022062602/5ec59fe195c9d3660c429e8d/html5/thumbnails/11.jpg)
Azure Messaging Services
![Page 12: Steef-Jan Wiggers - Microsoftbiztalk360.blob.core.windows.net/integrate2018/Integrate... · 2018-06-14 · Steef-Jan Wiggers Azure & IoT Domain Lead Serverless Messaging with Microsoft](https://reader035.fdocuments.in/reader035/viewer/2022062602/5ec59fe195c9d3660c429e8d/html5/thumbnails/12.jpg)
What do people do with messaging?
- Order processing
- Logging / telemetry
- Connected devices
- Notification / event driven systems
![Page 13: Steef-Jan Wiggers - Microsoftbiztalk360.blob.core.windows.net/integrate2018/Integrate... · 2018-06-14 · Steef-Jan Wiggers Azure & IoT Domain Lead Serverless Messaging with Microsoft](https://reader035.fdocuments.in/reader035/viewer/2022062602/5ec59fe195c9d3660c429e8d/html5/thumbnails/13.jpg)
Messaging Services in Azure
•Azure Service Bus
•Event Hubs
•Event Grid
•Storage Queue
![Page 14: Steef-Jan Wiggers - Microsoftbiztalk360.blob.core.windows.net/integrate2018/Integrate... · 2018-06-14 · Steef-Jan Wiggers Azure & IoT Domain Lead Serverless Messaging with Microsoft](https://reader035.fdocuments.in/reader035/viewer/2022062602/5ec59fe195c9d3660c429e8d/html5/thumbnails/14.jpg)
Service Bus Event Hubs Storage Queues
Big data streamingEnterprise messaging Simple task queues
Event Grid
Cross cloud reactive eventing
Building Blocks
![Page 15: Steef-Jan Wiggers - Microsoftbiztalk360.blob.core.windows.net/integrate2018/Integrate... · 2018-06-14 · Steef-Jan Wiggers Azure & IoT Domain Lead Serverless Messaging with Microsoft](https://reader035.fdocuments.in/reader035/viewer/2022062602/5ec59fe195c9d3660c429e8d/html5/thumbnails/15.jpg)
Enterprise MessagingBusiness state transition
• Transfer of money and material
• Central arbiter of state / truth of transition or ownership
• Rich control of communication features
• You know a lot ahead of time
• You know the nouns:• Who• What• Where
• Competitive offering from Amazon: SQS, Amazon MQ, Google Pub/Sub
![Page 16: Steef-Jan Wiggers - Microsoftbiztalk360.blob.core.windows.net/integrate2018/Integrate... · 2018-06-14 · Steef-Jan Wiggers Azure & IoT Domain Lead Serverless Messaging with Microsoft](https://reader035.fdocuments.in/reader035/viewer/2022062602/5ec59fe195c9d3660c429e8d/html5/thumbnails/16.jpg)
Reacting dynamically to the world around you
• Cross App / Service / Cloud / Organization
• Light weight
• Low cost
• Few features, but important ones
• You probably don’t know the nouns and may not care
Eventing
![Page 17: Steef-Jan Wiggers - Microsoftbiztalk360.blob.core.windows.net/integrate2018/Integrate... · 2018-06-14 · Steef-Jan Wiggers Azure & IoT Domain Lead Serverless Messaging with Microsoft](https://reader035.fdocuments.in/reader035/viewer/2022062602/5ec59fe195c9d3660c429e8d/html5/thumbnails/17.jpg)
Service BusEnterprise Messaging
Azure Event GridReactive Programming
• Queue Semantics• Rich filters• Instantaneous consistency• Strict ordering• JMS• Geo-replication & Availability• Rich broker features
• Event raised by sources• Independent individual
messages• Push mechanism• Filtering and routing• Pay as you go• Fan out
Push-Pull - Push-Push
Cloud Pub/Sub Models
![Page 18: Steef-Jan Wiggers - Microsoftbiztalk360.blob.core.windows.net/integrate2018/Integrate... · 2018-06-14 · Steef-Jan Wiggers Azure & IoT Domain Lead Serverless Messaging with Microsoft](https://reader035.fdocuments.in/reader035/viewer/2022062602/5ec59fe195c9d3660c429e8d/html5/thumbnails/18.jpg)
Task Queue
Coordinate simple tasks across compute (workers)
• Low cost
• Pay as you Go
• Few features
• Easy to use
• Have as many queues as you like
![Page 19: Steef-Jan Wiggers - Microsoftbiztalk360.blob.core.windows.net/integrate2018/Integrate... · 2018-06-14 · Steef-Jan Wiggers Azure & IoT Domain Lead Serverless Messaging with Microsoft](https://reader035.fdocuments.in/reader035/viewer/2022062602/5ec59fe195c9d3660c429e8d/html5/thumbnails/19.jpg)
Cloud QueuesService Bus Queues - Storage Queues
Service BusQueues
StorageQueues
• Queue Semantics• Rich filters• Instantaneous consistency• Strict ordering• JMS• Geo-replication & Availability• Rich broker features
• Part of Storage infrastructure• Simple REST-based interface• Pull mechanism• Reliable• Persistence messaging• Only queues
![Page 20: Steef-Jan Wiggers - Microsoftbiztalk360.blob.core.windows.net/integrate2018/Integrate... · 2018-06-14 · Steef-Jan Wiggers Azure & IoT Domain Lead Serverless Messaging with Microsoft](https://reader035.fdocuments.in/reader035/viewer/2022062602/5ec59fe195c9d3660c429e8d/html5/thumbnails/20.jpg)
Big Data StreamsFlow data and telemetry in real-time
• Durable re-playable buffer
• Designed as a stream
• Events to an event hub via AMQP or HTTP
• Real-time and batch processing
• Feeding Big Data and Analytics
• Pre-purchase capacity in terms of throughput units
• Offers an Kafka Endpoint
• Competitive offering from Amazon Kinesis, Apache Kafka, and Google Pub/Sub
![Page 21: Steef-Jan Wiggers - Microsoftbiztalk360.blob.core.windows.net/integrate2018/Integrate... · 2018-06-14 · Steef-Jan Wiggers Azure & IoT Domain Lead Serverless Messaging with Microsoft](https://reader035.fdocuments.in/reader035/viewer/2022062602/5ec59fe195c9d3660c429e8d/html5/thumbnails/21.jpg)
Brought to you by Wagner Silveira - https://goo.gl/LcjMQB
Kafka Endpoint - Demo
![Page 22: Steef-Jan Wiggers - Microsoftbiztalk360.blob.core.windows.net/integrate2018/Integrate... · 2018-06-14 · Steef-Jan Wiggers Azure & IoT Domain Lead Serverless Messaging with Microsoft](https://reader035.fdocuments.in/reader035/viewer/2022062602/5ec59fe195c9d3660c429e8d/html5/thumbnails/22.jpg)
Produce - Consume
![Page 23: Steef-Jan Wiggers - Microsoftbiztalk360.blob.core.windows.net/integrate2018/Integrate... · 2018-06-14 · Steef-Jan Wiggers Azure & IoT Domain Lead Serverless Messaging with Microsoft](https://reader035.fdocuments.in/reader035/viewer/2022062602/5ec59fe195c9d3660c429e8d/html5/thumbnails/23.jpg)
.NET Code
![Page 24: Steef-Jan Wiggers - Microsoftbiztalk360.blob.core.windows.net/integrate2018/Integrate... · 2018-06-14 · Steef-Jan Wiggers Azure & IoT Domain Lead Serverless Messaging with Microsoft](https://reader035.fdocuments.in/reader035/viewer/2022062602/5ec59fe195c9d3660c429e8d/html5/thumbnails/24.jpg)
Messaging considerations
Protocol
Format
Size
Security
Frequency
Reliability
Monitoring
Networking
![Page 25: Steef-Jan Wiggers - Microsoftbiztalk360.blob.core.windows.net/integrate2018/Integrate... · 2018-06-14 · Steef-Jan Wiggers Azure & IoT Domain Lead Serverless Messaging with Microsoft](https://reader035.fdocuments.in/reader035/viewer/2022062602/5ec59fe195c9d3660c429e8d/html5/thumbnails/25.jpg)
VMSS
Cloud Services
VMs
Logic Apps
SQL DB
Express Route
ASA
SQL DW
Power BI
Data Lake
Cosmos DB
Functions
AKS
ACS
![Page 26: Steef-Jan Wiggers - Microsoftbiztalk360.blob.core.windows.net/integrate2018/Integrate... · 2018-06-14 · Steef-Jan Wiggers Azure & IoT Domain Lead Serverless Messaging with Microsoft](https://reader035.fdocuments.in/reader035/viewer/2022062602/5ec59fe195c9d3660c429e8d/html5/thumbnails/26.jpg)
Messaging scenario’s
![Page 27: Steef-Jan Wiggers - Microsoftbiztalk360.blob.core.windows.net/integrate2018/Integrate... · 2018-06-14 · Steef-Jan Wiggers Azure & IoT Domain Lead Serverless Messaging with Microsoft](https://reader035.fdocuments.in/reader035/viewer/2022062602/5ec59fe195c9d3660c429e8d/html5/thumbnails/27.jpg)
Tollbooth License Plate Recognition
![Page 28: Steef-Jan Wiggers - Microsoftbiztalk360.blob.core.windows.net/integrate2018/Integrate... · 2018-06-14 · Steef-Jan Wiggers Azure & IoT Domain Lead Serverless Messaging with Microsoft](https://reader035.fdocuments.in/reader035/viewer/2022062602/5ec59fe195c9d3660c429e8d/html5/thumbnails/28.jpg)
License plate OCR
• Use the Recognition Services Computer Vision API and its built-
in OCR capabilities
• The image processing function can make a REST call to send the
photo and read the JSON data in return
Smart solution
![Page 29: Steef-Jan Wiggers - Microsoftbiztalk360.blob.core.windows.net/integrate2018/Integrate... · 2018-06-14 · Steef-Jan Wiggers Azure & IoT Domain Lead Serverless Messaging with Microsoft](https://reader035.fdocuments.in/reader035/viewer/2022062602/5ec59fe195c9d3660c429e8d/html5/thumbnails/29.jpg)
Smart Services - Demo
![Page 30: Steef-Jan Wiggers - Microsoftbiztalk360.blob.core.windows.net/integrate2018/Integrate... · 2018-06-14 · Steef-Jan Wiggers Azure & IoT Domain Lead Serverless Messaging with Microsoft](https://reader035.fdocuments.in/reader035/viewer/2022062602/5ec59fe195c9d3660c429e8d/html5/thumbnails/30.jpg)
Change feed
![Page 31: Steef-Jan Wiggers - Microsoftbiztalk360.blob.core.windows.net/integrate2018/Integrate... · 2018-06-14 · Steef-Jan Wiggers Azure & IoT Domain Lead Serverless Messaging with Microsoft](https://reader035.fdocuments.in/reader035/viewer/2022062602/5ec59fe195c9d3660c429e8d/html5/thumbnails/31.jpg)
Serverless Home Automation - Demo
![Page 32: Steef-Jan Wiggers - Microsoftbiztalk360.blob.core.windows.net/integrate2018/Integrate... · 2018-06-14 · Steef-Jan Wiggers Azure & IoT Domain Lead Serverless Messaging with Microsoft](https://reader035.fdocuments.in/reader035/viewer/2022062602/5ec59fe195c9d3660c429e8d/html5/thumbnails/32.jpg)
The processing required by an application can easily be broken
down into a set of independent steps.
Pipes and filters
![Page 33: Steef-Jan Wiggers - Microsoftbiztalk360.blob.core.windows.net/integrate2018/Integrate... · 2018-06-14 · Steef-Jan Wiggers Azure & IoT Domain Lead Serverless Messaging with Microsoft](https://reader035.fdocuments.in/reader035/viewer/2022062602/5ec59fe195c9d3660c429e8d/html5/thumbnails/33.jpg)
Microservices containers
![Page 34: Steef-Jan Wiggers - Microsoftbiztalk360.blob.core.windows.net/integrate2018/Integrate... · 2018-06-14 · Steef-Jan Wiggers Azure & IoT Domain Lead Serverless Messaging with Microsoft](https://reader035.fdocuments.in/reader035/viewer/2022062602/5ec59fe195c9d3660c429e8d/html5/thumbnails/34.jpg)
Microservice processing - Demo
![Page 35: Steef-Jan Wiggers - Microsoftbiztalk360.blob.core.windows.net/integrate2018/Integrate... · 2018-06-14 · Steef-Jan Wiggers Azure & IoT Domain Lead Serverless Messaging with Microsoft](https://reader035.fdocuments.in/reader035/viewer/2022062602/5ec59fe195c9d3660c429e8d/html5/thumbnails/35.jpg)
K8S – Microservice Log
![Page 36: Steef-Jan Wiggers - Microsoftbiztalk360.blob.core.windows.net/integrate2018/Integrate... · 2018-06-14 · Steef-Jan Wiggers Azure & IoT Domain Lead Serverless Messaging with Microsoft](https://reader035.fdocuments.in/reader035/viewer/2022062602/5ec59fe195c9d3660c429e8d/html5/thumbnails/36.jpg)
Use Azure Messaging Services together
![Page 37: Steef-Jan Wiggers - Microsoftbiztalk360.blob.core.windows.net/integrate2018/Integrate... · 2018-06-14 · Steef-Jan Wiggers Azure & IoT Domain Lead Serverless Messaging with Microsoft](https://reader035.fdocuments.in/reader035/viewer/2022062602/5ec59fe195c9d3660c429e8d/html5/thumbnails/37.jpg)
Data and event pipeline - Demo
![Page 38: Steef-Jan Wiggers - Microsoftbiztalk360.blob.core.windows.net/integrate2018/Integrate... · 2018-06-14 · Steef-Jan Wiggers Azure & IoT Domain Lead Serverless Messaging with Microsoft](https://reader035.fdocuments.in/reader035/viewer/2022062602/5ec59fe195c9d3660c429e8d/html5/thumbnails/38.jpg)
Summary
Choose the right messaging service(s)
Workloads
Cross-platform
Costs
DevOps and Management
Security and compliance
![Page 39: Steef-Jan Wiggers - Microsoftbiztalk360.blob.core.windows.net/integrate2018/Integrate... · 2018-06-14 · Steef-Jan Wiggers Azure & IoT Domain Lead Serverless Messaging with Microsoft](https://reader035.fdocuments.in/reader035/viewer/2022062602/5ec59fe195c9d3660c429e8d/html5/thumbnails/39.jpg)
Happy Messaging!
![Page 40: Steef-Jan Wiggers - Microsoftbiztalk360.blob.core.windows.net/integrate2018/Integrate... · 2018-06-14 · Steef-Jan Wiggers Azure & IoT Domain Lead Serverless Messaging with Microsoft](https://reader035.fdocuments.in/reader035/viewer/2022062602/5ec59fe195c9d3660c429e8d/html5/thumbnails/40.jpg)
Thank you!Keep in touch. Call or mail us. Ask us. Happy to help.