Ultra-scale e-Commerce Transaction Services with Lean Middleware
-
date post
19-Oct-2014 -
Category
Technology
-
view
2.076 -
download
0
description
Transcript of Ultra-scale e-Commerce Transaction Services with Lean Middleware
UltraUltra--scale escale e--Commerce Transaction Commerce Transaction
Services with Lean MiddlewareServices with Lean Middleware
Paul FremantlePaul Fremantle
CTO and CoCTO and Co--FounderFounder
[email protected]@wso2.com
##pzfreopzfreo
http://pzf.fremantle.orghttp://pzf.fremantle.org
Contents
• Challenges at extreme scale deployment
• A case study – online retailer
• What is lean software?
• What are the challenges in Cloud?
• Why is Platform-as-a-Service important
http://www.flickr.com/photos/theplanetdotcom/
Case Study: Problem Definition
• Millions of power sellers connecting directly to APIs
• Accessing APIs via slow and fast connections
• Load balancing to an ultra-scale backend cluster
• ~1bn large message transactions/day
Enterprises with these challenges
The challenges of ultra-scale integration
• Absolute rigor for service/API definitions
• Peaks and troughs in load
– In this case “Cyber Monday”
• Slow clients, large messages
• Patch and system management
• Monitoring
– Monitor latency, memory, CPU, message size (by “bucket”
• All at 5 mins, 15 mins, 1 hr, 24 hrs
– Alerting when the “queue” depth increases
Deployment Architecture
Outcomes of this architecture
• Initial test production Q4/2009, ramp up during 2010
• Ramped up incrementally to 600m transactions/day
• On 36 JVM instances
• Expected to grow to 1bn/day during 1H2011
• Significantly more robust
• Handling around Other groups now using the ESB
• 80+ instances throughout the organization
• Looking add Governance Registry during 2011
• Better reliability, better scalability, lower TCO
Lean
http://www.flickr.com/photos/akalat/
Lean and Open Source• Lean
– Triumph of the Lean Production System, John Krafcik, 1988, Sloan Management Review
• What is “Lean Software”
– Designed to do just enough
• No muda
• Only focus on real requirements – not feature checklists
– Agile Development and Minimum Viable Product
• Decide as late as possible, Code as fast as possible
– Modular so that unnecessary code isn’t even loaded
– No duplicate code (unfortunately a typical result of M&A)
• Open Development model complements Lean strongly:
– Shared requirements, testing and architecture decisions
– Iterative Agile development model based on milestones and continuous build
Why Lean and Open Source for our e-tailer?
• Lean– Simpler cleaner configuration:
• Easier to configure, easier to fix
• Highly effective solution
– Lower hardware costs for the same workload
– Less money spent on consultants:• 80 instances in production in a year with
approximately 1/3 person year onsite support
• Open Source– Not the only factor in purchasing:
• Test production “shoot-out” between Open Source and Proprietary
– Better insight, better partnership, community
Enterprise Architecture
Modularity enables Lean
Taking Lean Open Source into the Clouds
• Security
• Resource sharing inside an organization
– Central Limit Theorem and Private Cloud
• Agility
• Shared Nothing for Data, Cache and
Processing
– Designing systems so they scale effortlessly
• More than just Infrastructure-as-a-Service
– Getting the right shared services
Cloud Challenges
Moore’s Law for Data
• Online data went from
– 5 exabytes in 2002 to
– 281 exabytes in 2009
That is doubling every 15 months
• The only way to deal with this expansion is to create new applications
– Its not just the volume, but new types of data
– Need the “Industrial Revolution” for Software Development
Platform-as-a-Service (PaaS)
• PaaS is about making it
simpler, faster and more repeatable
to develop, deploy and manage applications
– Shared Multi-tenant Services
– Such as Identity, Application Server, Queues, Logs,
Metering, Configuration Repository and Registry
– Allows developers to focus on the logic and design
– Commonality at a higher level creates efficiencies
(shared memory, better load distribution)
Enterprise IT in 2015+
• Lean
– All the same benefits are magnified in a cloud
– Efficiency that is valuable in fixed deployments is invaluable in large dynamic deployments!
• Available on private, public, on-premise
– Getting locked into a specific public PaaS will have long term repercussions
– Open Source is a huge protection against this
• The correct set of core “services”
– Not just App Server, but Identity, Registry, Data, Cache, ESB, BPMS, Billing, Logging, etc
• Open Standard interfaces to common services
– Enables modular usage
• Self-service, multi-tenancy, elasticity, metering, incremental deployment and testing
What to look for in a PaaS
Stratos – Carbon as a PaaS• A full middleware platform available as-a-service
• Based on OSGi
• Self-service, Multi-tenant, Elastic, Metered and Billed
• Completely Open Source under the Apache License
– Available in the cloud, on-premise and private cloud
• Isolates applications from the Infrastructure
– Currently supports vSphere, Eucalyptus, Ubuntu, Amazon
• Provides
– Application Server, ESB, Governance Registry, Business Process Management Server, Business Activity Monitoring, Rules, Data Services
http://wso2.org/downloads/stratos
Carbon/Stratos and Enterprise Architecture
What can a PaaS do for you?
• Integrate multiple internal and cloud data sources and present via JSON to a Mobile Client
• Provide all the building blocks to build SaaS applications
• Give developers in your organization the perfect balance of control and freedom to innovate
• Automate governance
A good PaaS is a platform for innovation
About WSO2WSO2 is a fast-growing software company operating globally offering:
• A comprehensive on-premises platform - WSO2 Carbon
• A unique cloud platform - WSO2 Stratos
WSO2 has next generation vision and technology
• Called out as a visionary in the SOA market
• WSO2 Cloud and On-Premise platforms have a completely unified architecture allowing WSO2 to scale up both aspects of the business in parallel
In 5 years WSO2 has grown:
• More than 115 employees and more than 75 customers
• Doubled revenue and bookings every year
• The Open Source business model WSO2 implements creates strong customer pull, high customer satisfaction, and a total of more than 1 million product downloads
Company website: http://wso2.com
Developer Site and Open Source Forge: http://wso2.org
Thank You
Thank you very much for your time
If you wish to find out more, please come talk to
us at Booth #102!