MQ Telemetry Transport (MQTT) Programming - Capitalware's MQ
Understanding mq deployment choices and use cases
-
Upload
leif-davidsen -
Category
Software
-
view
490 -
download
1
Transcript of Understanding mq deployment choices and use cases
© 2015 IBM Corporation
AME 4169 -Understanding MQ Deployment choices and use casesLeif Davidsen Senior Product ManagerIBM Messaging@LeifDavidsen
The need for connectivity is growing
Connectivity in business infrastructure is increasing • More information, more
systems, more services, deployed anywhere
Connect systems together• Deliver timely updates of
targeted data
• Gain business insight
• Applications and data become
valuable assets, not growing
costs
New sources of data are
changing the world• However data without
connectivity becomes a
burden not an asset
1 AME 4169 - @LeifDavidsen
Moving data – where does it need to go?
Systems are dynamic – new
applications, new sources of data, new
consumers of data
• The challenge of delivering data to
meet changing demands needs a
flexible infrastructure
– Roll-your-own code in the applications
– Storing the data in a database or file
A messaging infrastructure can meet both needs• Keeps the application simple and able to adapt to change
• Deliver filtered information to consuming applications
• Deliver to a permanent information store
2 AME 4169 - @LeifDavidsen
Messaging continues to be essential…
• Failures still happen - application and network – cloud and mobile especially
• Don’t try to handle these failures in your business application logic
• Moves any type of data and any type of system, device or environment, with a common shared API
• Configurable: Persistence, Performance, Management, Security, etc.
Here is why messaging is important…
“business transactions must happen only
once”
“adding new services or applications is unpredictable”
“change is relentless”
“need to adopt new industry standards”
“business insight is key in today’s market”
“consumer interaction is forcing us to respond faster”
“we need to become more event driven”
“we need to recover from IT failures
better”
“our applications are getting too complex”
“must become more agile”
“losing data costs time money and reputation”
3 AME 4169 - @LeifDavidsen
IBM Messaging – Market segments
Deliver Messaging Backbone for Enterprise
Focus on traditional MQ values, rock-solid enterprise-class service, ease-of-operation, breadth of platform coverage, availability, z/OS exploitation
Enable developers to build more scalable, responsive applications
Focus on app use cases, breadth of languages, ease-of-deployment, lightweight services, integration with developer frameworks
4 AME 4169 - @LeifDavidsen
Growth in MQ Deployment Choices 2011-2015
2011 2012 2013 2014 2015
Individual
Software
Deployment
MQ V7.1 MQ V7.5 MQ 7.5 MQ V8 MQ V8
Integrated
Software
Deployment
MQ V7.5
Advanced
MQ V7.5
Advanced
MQ V8
Advanced
MQ V8 Advanced
Cloud/aaS
deployment
MQ V7.0.1
HVE
MQ V7.5
HVE
MQ V7.5 HVE MQ V75 HVE
Bluemix MQ
Light Service
MQ & MQ Light
on Docker
Bluemix MQ Light
Service
Developer
focused
deployment
MQ Advanced
for Developers
MQ Light
MQ Advanced
for Developers
MQ Light
MQ Advanced for
Developers
Appliance
Deployment
MQ Appliance V8
5 AME 4169 - @LeifDavidsen
So what is IBM MQ?
• Simplifies applications, no need for complex connectivity logic or error handling
• Scales from single application deployments to billions of messages per day
• Connects from the mainframe to the mobile and the Internet of Things, moving data from applications, files and services
• Most widely deployed enterprise messaging solution with the largest ecosystem and set of skilled practitioners
• A secure messaging environment,
with your customer and business
data encrypted end to end
• Built-in High Availability with
automated failover
• A single point of visibility and
control for the data flowing
through your business
• Reliable, robust movement of data
with transactional integrity
Messaging you need Messaging as you
need it
7 AME 4169 - @LeifDavidsen
What does IBM MQ do?
Provides messaging services to applications
and Web services that need to exchange data
and events with:
Universally supported by multiple platforms & 20 years leading
in transactional message delivery
• Inherent reliable delivery and transaction control
• Native, high-speed handling of any type of message or file
• Native lightweight capabilities for supporting remote devices & sensors
• End-to-end advanced security
• Single point of control, visibility, and management for all data movement
• Applications become more flexible and data movement
becomes more reliable
• Capabilities like the Coupling Facility in System z
provide unique strengths
• Extensive support through years of development, skills
and partner ecosystem extensions
• Comprehensive single solution reduces complexity of
deployment and operation
Message
Q Manager
Q Manager
Application ZApplication A
Channels
Pervasive
DeviceSensor
e.g. RFID
Regional
Office
Mobile
Phone
Petrol
Forecourt
Refinery
Branch
Office
Retail
Store
zEnterprise
Financial
Services
& Banking Manufacturing
GovernmentRetail
8 AME 4169 - @LeifDavidsen
Why choose to deploy IBM MQ
• The most widely chosen and deployed enterprise messaging solution
• Deploy on any platform
• Meets immediate need for messaging
• Works to connect with any existing, or future MQ application
• IBM MQ licenses can be deployed flexibly
• Cloud
• On-premise
• Virtual machines etc.
• Additional MQ functions can always be added later, including upgrading to MQ Advanced
9 AME 4169 - @LeifDavidsen
IBM MQ Advanced makes it easier for
clients to buy and deploy all the IBM
MQ distributed server capabilities they
need within a single purchase.
• IBM MQ Advanced for Developers is
also available specifically for
development use only
IBM MQ Advanced is a part that provides
entitlement to IBM MQ Server, Managed
File Transfer Service, Advanced
Message Security, and Telemetry:
• Buy a single part at a single price (per
PVU) for all the distributed server
capabilities.
What makes IBM MQ Advanced different?
MQ MFT Service AMS Telemetry
IBM MQ Advanced
11 AME 4169 - @LeifDavidsen
Use IBM MQ Advanced
Message Security (AMS) to
guarantee the privacy of
message contents
End-to-end data encryption
• Protects business and customer
data from exposure if systems
breached
• Demonstrates awareness of
security risks and takes action to
avoid impact
Where does Advanced Message Security fit in?
Application BApplication A
Channels
IBM MQ system
Queue Manager
Queue Manager
IBM MQ has many built in security features:
12 AME 4169 - @LeifDavidsen
Where does Telemetry fit in?
Real-time access for enterprise
applications to connect to a range of
mobile devices, remote sensors,
actuators etc.
IBM MQ Telemetry includes the
following key components:
• The Telemetry service that runs on
the IBM MQ server
• MQ Telemetry clients that are
distributed to remote devices and
applications
MQ Telemetry uses the open standard
MQTT protocol.
Ideal to connect devices within the
enterprise
Sensor
(e.g. RFID)
Telemetry client
Enterprise
Telemetry Service
Topic
Application BApplication A
Queue Manager
Oil Rig
Smart
Phone
Medical
DeviceVehicle
13 AME 4169 - @LeifDavidsen
Where does Managed File Transfer fit in?
Bringing Managed File Transfer to IBM MQ – file data is moved as MQ messages.
Available as 2 chargeable components: MFT Agent and MFT Service. Available
separately, and MFT Service is included in MQ Advanced
An MFT Agent performs the fundamental file
transfer function of sending and receiving files from
the local system.
MFT Service installs a file transfer agent on a MQ
server with additional capabilities
MQ MFT supports file-to-file movement, but also
file-to-message, and message-to-file
An MQ Explorer integrated GUI or command-line is
used to configure and administer MFT.
IBM Sterling Control Center is included to provide
additional monitoring of file transfers
Channels
MQ network
Logging
component
MFT Agent
Application BApplication A
MFT Agent
14 AME 4169 - @LeifDavidsen
Why license and deploy MQ Advanced
• Gain access and entitlement to use all MQ capabilities in one package
• Can trade up from existing MQ licenses
• Leverages all the function delivered as part of the MQ package
• Single infrastructure to deploy and configure
• Maximises the benefit of building and deploying a MQ network
• A single MQ messaging environment that can support multiple use-cases, including strong end-to-end security
• Simplified infrastructure by reducing the need for additional alternative solutions to provision and maintain
• Aligns with the functions likely to be delivered by projects using IBM MQ Advanced for Developers
15 AME 4169 - @LeifDavidsen
IBM MQ Advanced for Developers
• What’s this for?
• A part in the IBM MQ offering that is intended for use by developers only
• Enables developers to install and use the entire IBM MQ Advanced stack on
their personal development machines without needing to pay a PVU based
license
– Priced by Authorised User Single Install with IBM Support
– Doesn’t replace existing Test and Production usage
– Also available without IBM Support – and free to download
Development environment
Integration
Test
System and
Performance
Test
Production
EnvironmentHigh
Availability
Full MQ Advanced License RequiredMQ Advanced for Developers
License
Idle Standby
License Required
17
Designed for Application developers
• LoB developers who use OSS and do not engage IT
• Teams that do not see messaging as relevant to them
• Applications adopting a micro-service architecture
www.ibmdw.net/messaging/mq-light/
MQ Light Service(On BlueMix)
IBM MQ[Statement of Direction]
[Now in beta]
“MQ Light”
Develop Application
node, ruby, python, etc
Develop using
MQ Light
Trivial to download
and get started
Simple API using open
protocols in a growing
range of languages
Development
focused tooling
MQ LightMessaging for app teams who do not want infrastructure
18 AME 4169 - @LeifDavidsen
Why give messaging to application developers
• Messaging important to simplify the needs of application developers
• Increased use of MQ messaging reduces workload on infrastructure team by reducing different technologies
• Single environment for management and monitoring
• Developer access to messaging will build skills
• Faster development using messaging
• Increase messaging skills – delivering additional function
• Reduce errors
• Increased numbers of applications can make use of robust, reliable, simple, secure messaging
• Enterprise applications
• New apps to support mobile, cloud
• Transient, scripted apps
19 AME 4169 - @LeifDavidsen
IBM’s fully managed cloud messaging service
The same MQ Light experience aimed at developers
available as a fully managed cloud service in BlueMix
Integrated into the
BlueMix experience
Push application into BlueMix and
use MQ Light Service
Develop cloud application
using node, java, etc
Develop offline
using MQ Light
MQ Light
MQ Light Service
Simple API using open
protocols in a growing
range of languages
Development
focused tooling
21 AME 4169 - @LeifDavidsen
Deploying MQ in the clouds/virtual machines
• MQ licenses can be used to deploy MQ in various public clouds using a BYOSL model – uses existing PVU licenses mapped to hosted VM size
• Deploy on IBM SoftLayer
• Deploy on Microsoft Azure
• Deploy on Amazon EC2
• MQ in a ‘hybrid cloud’ deployed on premise on Virtual Machines
• Very common deployment model
– Uses existing PVU licensing matched to VM size
• Deployed as repeatable patterns for Development, Test and Production
• Docker images now available for MQ and MQ Light
– Images available on DockerHub February 2015
• MQ Advanced for Developers on Docker currently only a Tech Preview – we want your feedback
22 AME 4169 - @LeifDavidsen
Why deploy ‘patterns’ in Clouds/VMs?
• Provides messaging as repeatable infrastructure
independent of the specific deployment choice
• Massive growth in Virtual Machine configurations and
deployments
• Now move to Containers/Docker
• Existing licensing model paired with BYOSL deployments
makes it easy for today’s on premise models to shift
• Messaging available as a Service on Bluemix with MQ Light
• The deployment of MQ remains flexible and configurable
• Building and deploying images or patterns reduces
variability and associated errors
2323 AME 4169 - @LeifDavidsen
IBM MQ Appliance M2000
• The scalability and security of IBM MQ V8 in a physical appliance form factor
• Rapid, reliable, simple, secure exchange of data across applications, systems and services
• Convenience, fast time-to-value, and low total cost of ownership of an appliance
• Use as a messaging hub to extend connectivity within your enterprise, in branch offices,
factories or stores
Rapid to deploy, easy to configure and run for enterprise and remote deployments
What’s new in IBM MQ Appliance M2000
Integrates seamlessly into MQ networks and clusters
Simple out of the box High-Availability with paired connectivity to another appliance
New MQ Console to provide a browser-based user interface offering personalized
monitoring and configuration
Simpler maintenance with fixpacks delivered as certified firmware updates onto a locked
down appliance
Appliance delivered pre-optimized for maximum performance out-of-the-box
25 AME 4169 - @LeifDavidsen
Consolidate my MQ
infrastructure into an “MQ
Hub” for lower TCO
Reduce total cost of ownership
Reduce deployment footprint
Move queue managers to a hub
Objectives:
Mixture of platforms and versions
Complex dependencies
Application downtime impacts other applications
Challenges:
Migrations difficult – lack of standardization
Standardize deployments
Benefits: Easy to deploy, familiar MQ admin interfaces, supports existing MQ definitions and security, single firmware level and maintenance, downtime reduced by separating
applications from MQ, adding appliances for HA avoids external dependencies26 AME 4169 - @LeifDavidsen
Deploy to remote premises,
e.g. Branch, Factory,
Warehouse
Resilient connectivity in
remote location
HA failover Support
Objectives:
Outside assistance
needed, due to
geographic remoteness
Challenges:
Difficult to support
failover
Benefits:
Pre-configured appliances, remote configuring and managing of appliances,
High Availability with no external dependencies
Resilient connectivity to
remote location that
has limited
infrastructure and local
MQ knowledge
27 AME 4169 - @LeifDavidsen
Deploy to business partner,
e.g. Dealer, Broker
Extend connectivity to
external business
partner
Deploy an MQ
gateway to which
your partner
connects
Objectives:
No time to build the
partner a server
Partner might not have
IBM MQ or MQ skills
Application downtime
impacts other
applications
Challenges:
Control what your
partner can connect to
Benefits:
Standardization, easy to deploy, ability to pre-configure, in-built High
Availability without dependencies
Onboard partner quickly
Partner’s configuration
should meet standards
28 AME 4169 - @LeifDavidsen
High-end solution for enterprise consolidation use case
Capable of handling large MQ workloads for persistent and non-persistent messaging
Host multiple Queue Managers to act as a messaging hub
A possible replacement for deploying multiple separate MQ servers
Built-in High Availability when paired to a 2nd appliance
Supports MQ AMS, and can be used to move MQ MFT files between MFT endpoints
Lower-end solution for branch office or factory deployment
Same software and hardware as the Enterprise appliance, but processor usage limited
Designed to meet lower messaging throughput requirements
Supports all other features of M2000A, including High Availability and MQ AMS
Trade-up part available from M2000B capacity to M2000A capacity
IBM MQ Appliance M2000A (for Enterprise) IBM MQ Appliance M2000B (Branch etc.)
Which MQ Appliance is right for you?
Easily deploy MQ messaging in less than 30 minutes!
29 AME 4169 - @LeifDavidsen
Why deploy MQ as an appliance?
• Announcement Feb 17th
• Availability Mar 13th
• Single form factor, 2 price points
Fixed hardware specification allows IBM to simplify and tune the firmware
Easier to deploy and manage
Delivered pre-optimized
Standardisation accelerates deployment
Repeatable and fast
Post-deployment resource definition or lock down before deployment
“Hub” pattern separates messaging from applications/middleware
Organisational independence from application teams
Improved availability, due to reduction of downtime
Predictable performance, simpler capacity planning
Simplified ownership
Self-contained: avoids dependencies on other resources/teams especially for HA
Licensing: Simpler than calculating licensing costs
Security: Easier to assess for complying with security audit
30 AME 4169 - @LeifDavidsen
1990s 2000s 2010s
V2 V5 V5.1 V5.3V5.2 V6 V7 V7.0.1V1.1
Multi-platform Managed File Transfer
V7.1 V7.5
System PatternApplication Pattern
MQIAssured delivery
Integrated Messaging
Hypervisors
JMS 1.1RCMS
Common criteriaEclipse
HTTPAJAXREST
Web 2.0
.NET
SSLSOAP
JMS
XML
Mobile
V2.1
Pub/sub
Multiple clusterXMIT queue
Multi-instanceQMGR
20th Anniversary of MQ at IMPACT
Timeline for MQ and Messaging product releases
V8
IBM MQ
Advanced for
Developers
IBM MQ
Advanced
IBM
MessageSight
IBM MQ
Advanced
Message
Security
IBM MQ
Managed File
Transfer
IBM MQ Low
Latency
IBM
MQSeries IBM MQTTIBM MQ
Everyplace IBM MQ
Appliance
31 AME 4169 - @LeifDavidsen
Notices and Disclaimers
Copyright © 2015 by International Business Machines Corporation (IBM). No part of this document may be reproduced or
transmitted in any form without written permission from IBM.
U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with
IBM.
Information in these presentations (including information relating to products that have not yet been announced by IBM) has been
reviewed for accuracy as of the date of initial publication and could include unintentional technical or typographical errors. IBM
shall have no responsibility to update this information. THIS DOCUMENT IS DISTRIBUTED "AS IS" WITHOUT ANY WARRANTY,
EITHER EXPRESS OR IMPLIED. IN NO EVENT SHALL IBM BE LIABLE FOR ANY DAMAGE ARISING FROM THE USE OF
THIS INFORMATION, INCLUDING BUT NOT LIMITED TO, LOSS OF DATA, BUSINESS INTERRUPTION, LOSS OF PROFIT
OR LOSS OF OPPORTUNITY. IBM products and services are warranted according to the terms and conditions of the
agreements under which they are provided.
Any statements regarding IBM's future direction, intent or product plans are subject to change or withdrawal without
notice.
Performance data contained herein was generally obtained in a controlled, isolated environments. Customer examples are
presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual
performance, cost, savings or other results in other operating environments may vary.
References in this document to IBM products, programs, or services does not imply that IBM intends to make such products,
programs or services available in all countries in which IBM operates or does business.
Workshops, sessions and associated materials may have been prepared by independent session speakers, and do not
necessarily reflect the views of IBM. All materials and discussions are provided for informational purposes only, and are neither
intended to, nor shall constitute legal or other guidance or advice to any individual participant or their specific situation.
It is the customer’s responsibility to insure its own compliance with legal requirements and to obtain advice of competent legal
counsel as to the identification and interpretation of any relevant laws and regulatory requirements that may affect the customer’s
business and any actions the customer may need to take to comply with such laws. IBM does not provide legal advice or
represent or warrant that its services or products will ensure that the customer is in compliance with any law.
Notices and Disclaimers (con’t)
Information concerning non-IBM products was obtained from the suppliers of those products, their published
announcements or other publicly available sources. IBM has not tested those products in connection with this
publication and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM
products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products.
IBM does not warrant the quality of any third-party products, or the ability of any such third-party products to
interoperate with IBM’s products. IBM EXPRESSLY DISCLAIMS ALL WARRANTIES, EXPRESSED OR IMPLIED,
INCLUDING BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A
PARTICULAR PURPOSE.
The provision of the information contained herein is not intended to, and does not, grant any right or license under any
IBM patents, copyrights, trademarks or other intellectual property right.
• IBM, the IBM logo, ibm.com, Bluemix, Blueworks Live, CICS, Clearcase, DOORS®, Enterprise Document
Management System™, Global Business Services ®, Global Technology Services ®, Information on Demand,
ILOG, Maximo®, MQIntegrator®, MQSeries®, Netcool®, OMEGAMON, OpenPower, PureAnalytics™,
PureApplication®, pureCluster™, PureCoverage®, PureData®, PureExperience®, PureFlex®, pureQuery®,
pureScale®, PureSystems®, QRadar®, Rational®, Rhapsody®, SoDA, SPSS, StoredIQ, Tivoli®, Trusteer®,
urban{code}®, Watson, WebSphere®, Worklight®, X-Force® and System z® Z/OS, are trademarks of
International Business Machines Corporation, registered in many jurisdictions worldwide. Other product and
service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on
the Web at "Copyright and trademark information" at: www.ibm.com/legal/copytrade.shtml.