Rl Partner Webinar To Share

Provide On-Demand, Real World Load Testing to Your Customers

Robb Corduck, Channel & Alliances Manager

Marina Gil-Santamaria, Product Marketing Manager

Agenda

Who is Gomez

Reality Load Overview – Load testing from the end user perspective

The Services Opportunity for Partners

Partnering with Gomez

QA

Gomez

We help organizations deliver quality experiences to their Web and mobile users

Optimal performance and availabilityQuality operation across all users, browsers, devices, and geographies Rapid issue notification with actionable diagnosticsInsight into how these issues affect your business (revenue, brand, cost)

SaaS Platform

• No installation• Rapid startup &

payback• World’s most

comprehensive testing network (100K+ testing locations)

2,500+ Customers Worldwide

• 1,250+ enterprise customers

• 1,250+ SMB customers

• 12 of top 20 US sites

Solid Business Performance

• Five consecutive years double digit revenue growth

• 44% revenue growth 2008

• Offices worldwide

Recognized as Industry Leader

• Forrester: “The leader in Web Experience Management”

• Gartner: “A cool vendor”

Gomez Customers

Media EntertainmentFinancial Services High Tech Retail Travel Other

1,250 Enterprise customers

5,000 Entry/viralcustomers

1,250 SMB

customers

12 of the top 20

visited US sites

Gomez Network: The World’s Most Comprehensive Performance and Testing Network

Web Performance Management and Load Testing

100+ locations

Backbone

Cross-Browser Testing 500+ browser/OS combo’s5,000+ supported devices

Virtual Test Bed

Web Performance Management and Load Testing

100,000+ locations

Gomez Last Mile

Agenda

Who is Gomez




QA

Internet

Content DeliveryNetworks

MajorISP

Local ISP

Mobile Carrier

3rd Party/Cloud Services

Browsers and devices Users

The Challenge of Delivering Quality Web Experiences

Storage

Load Balancing

Web Servers

App Servers

DB Servers

Mobile Components

Storage

Load Balancing

Web Servers

App Servers

DB Servers

Mobile Components

Users

The Web Application Delivery Chain

Traditional zone of control

Traditional testing: “OK” …user is

NOT happy

Internet


MajorISP

Local ISP

Mobile Carrier

Storage

Load Balancing

Web Servers

App Servers

DB Servers

Mobile Components

Users3rd Party/

Cloud ServicesBrowsers

and Devices

The Web Application Delivery Chain

• Network peering problems

• Outages

• Inconsistent geo performance• Bad performance under load• Blocking content delivery• Incorrect geo-targeted content

• Configuration issues• Oversubscribed POP• Poor routing optimization• Low cache hit rate

• Network peering problems

• Bandwidth throttling• Inconsistent

connectivity• Configuration

errors• Application

design issues• Code defects• Insufficient

infrastructure

• Poorly performing JavaScript

• Browser/device incompatibility

• Page size too big

• Too many objects

• Low cache hit rate

• Network resource shortage

• Faulty content transcoding

• SMS routing / latency issues

The Challenge of Ensuring Quality Web Experiences

Zone of customer expectationZone of customer expectationTraditional zone of control

Traditional testing: “OK” …user is

NOT happy

-18%

-16%

-14%

-12%

-10%

-8%

-6%

-4%

-2%

0%

-11%

-7%

-16%

Web Performance Matters

Average impact of 1 second delay in response time for Web users

*Online business doing $100K/day = $2.5M/year in lost revenue

• Lost revenues*• Brand damage• More support calls• Increase costs• LOB dissatisfaction with IT

Page Views ConversionsCustomer

Satisfaction

What Features Should a Realistic Web Performance Testing Platform Have? It Should:

Test from the end user’s point of view Different locations Different browsers Different loads Different tasks

Be easy for developers, testers and business people to use.

Identify and resolve problems along the entire web application delivery chain.

*Source: Achieving Peak User Experiences — Performance Testing in an Agile Web 2.0 World : Forrester’s Senior Analyst, Mike Gualtieri, and Gomez’s CTO, Imad Mouline

Internet


MajorISP

Local ISP

Mobile Carrier

Storage

Load Balancing

Web Servers

App Servers

DB Servers

Mobile Components

Users3rd Party/

Cloud ServicesBrowsers

and Devices

BackboneHigh volume load (HTTP, Browser)

Find infrastructure breaking pointsDefine capacity headroom

100,000+ consumer- grade desktops

168+ countries

2,500+ ISPs

Major mobile carriers around the globe

Gomez Reality Load XF: On-Demand Realistic Load Testing from Browser to Data Center

Last Mile Real-world load

Find user experience breaking pointsAccurately measure response time

100+ commercial-grade nodes & data centers

Reality Load Geographic Perspective Finds Critical Problems Undetectable with other Solutions

Page response time stayed under 4 seconds, outside of one brief blip

Only 11 error total out of 60,000+ transactions

A major hotel chain was planning a major marketing campaign in 3 key regions: Las Vegas, New York & Los Angeles, and they wanted to load test prior to launch. By traditional load testing standards, the test passed.Reality Load Geographic Perspective showed another story thought

Problem identified: A large number of measurements were greater than 4 seconds for key geographies (NY). These findings spurred a code tune and content deployment to a CDN to reduce response time variations across geographies. Overall response times was improved by 2+ seconds

Reality Load Geographic Perspective Finds Critical Problems Undetectable with other Solutions cont.

Test 1: Old Firewall (Benchmark)• Users ramp up, and the

firewall supported over 2,500 transactions per second.

Test 2: New Firewall• Users ramp up, but the

transaction rate bottlenecks at 1,000 per second.

• Response times for users climb Validation for new firewall failed, bottleneck detected

Reality Load Identifies Infrastructure-related Issues

A financial services organization had deployed new hardware, and they wanted to ensure that they would deliver quality Web experiences under load. Problem identified The new firewall was only licensed for 1,000 transactions per second

The load increases throughout the test

The transaction rate increases and then falls off as response times climb

Errors are seen, all on a 3rd party object

Reality Load Detects External Errors or 3rd-party SLAs Violations

An e-retailer had just selected a new third-party provider, and they wanted to verify overall application performance under load. Problem identified 3rd party hardware was insufficient for overall demands on the application, and based on SLA agreement, 3rd-party provider had to increase hardware and improve performance to get paid.

Reality Load Detects External Errors or 3rd-party SLAs Violations (continued)

Problem identified Error with an external redirect (configuration error that was handling a simple redirect as 6 steps)

What Makes Gomez Reality Load XF Unique

On-demand Agile, responsive and timely testing No need for large testing infrastructure investments Flexible scheduling and usage

Real world Last Mile testing from where your customers are Combines high volume and real browser load Self-service and managed-service options

Browser to data center Find and resolve problems across the entire Web application

delivery chain See impact of 3rd parties World’s largest load testing network reach

Los AngelesNew York

LondonGermanyBeijing

Los AngelesNew York

LondonGermanyBeijing

Agenda

Who is Gomez




QA

What Projects Can Gomez Help With?

Project Concern addressed by Gomez

Web Site Launch/ Upgrade Will it work properly on all browsers and scale under real world load?

Rich Internet Applications Will Flex, AJAX, Flash, streaming video, etc. perform well?

Mobile Initiative Will it work on a variety of devices and perform optimally?

Virtualization Will our Web applications perform as well or better after virtualization?

Cloud Computing Are our providers delivering as promised?

Infrastructure Changes Will our Web applications perform as well or better after the changes?

Data Center Consolidation Will our Web applications perform as well or better after consolidation?

CDN Selection/ Optimization

Are we selecting the right vendor? Is the service optimized for our users? Are we getting what we’re paying for?

SLA Management

How can we ensure our 3rd-party providers are delivering as promised? How can IT validate it’s meeting the needs of the business?

• Gomez Outside-in Testing

• Identify key geographies & regions

• Define external components to test

• Gomez ‘Script Once, Test Many’

• Gomez Geographic Perspective

• Extend existing load test projects to include outside the firewall Gomez test data

Load Test Methodology, Test Goals &

Plans

Script Creation

Load Test Execution &

Analysis

Load Test Results & Reports

Reality Load Complements Existing Load Test Tools

Traditional Load Testing Tools

External Load Test Service Opportunities

Organizations lack the time, skill and expertise to:

Create a solid load testing methodology

Script web applications including complex Web 2.0 apps

Execute load tests within aggressive QA / and launch schedules

Expertly interpret and analyze test result data

Conduct root cause analyses based on test results

Implement proper changes to ensure a quality performance

Challenge: Customer purchased Super Bowl ad and has less than 2 weeks to make switch to new hosting

infrastructure and validate that the site can handle the anticipated end-user traffic to be generated by the high-profile ad.

Opportunity: Customer lacked time and expertise to set-up, run and analyze a load test in a self-service

manner. Also, with time so short, they needed a solution that could dial up load testing in near real-time

Partner Managed Test Plan: Develop a test plan to simulate expected volume of site traffic Create a series of load tests to provide run-up tests and longer duration load tests Script user interactions with the C4G.com website Execute a series of tests, tweak performance and re-execute over 2 days

Results: Partner ran a series of short and medium duration load tests Identified a load-balancer configuration issue with the hosting vendor prior to site launch After correcting the issue, confirmed that C4G could handle the expected user traffic The site performed well and delivered a quality user experience during and after the Super Bowl Partner billed for 5 days of pro services

Partnering Success Story -

Agenda

Who is Gomez




QA

Benefits of Partnering with Gomez

Best-in-Class Solutions Gomez is a leader in outside the firewall load testing & user experience

monitoring SaaS Suite of testing tools

- Eliminates need for expensive hardware- No software to be installed- Create and launch load tests in under 15 minutes

Training & Methodology Resources Gomez Partner Portal On-Line Training & Gomez University Partner Certification Training Professional Services Methodologies & Best Practices Utilize Gomez load test data to identify additional web application

optimization projects

Revenue Opportunities Resell Margins or Referral Commissions Professional Services

Gomez Solution in Review

Backbone Virtual Last Mile Real UserPrivateCovers the entire Web application delivery chain – from browser to data center

Over 100K+ global testing locations, including the Gomez Last MileTM

Find and fix the broadest set of issues Web 2.0 technologies Understand 3rd party impact on performance

A single, integrated platform Extend your load testing capabilities Understand real-user experience Low total cost of ownership

The most self-service control and flexibility

Rapid on-boarding and professional guidance On-demand test creation, provisioning, usage Consumption-based pricing Adapts to your changing business needs Reduce Cap Ex through SaaS

EASY

Agenda

Who is Gomez




QA

Putting the Pieces Together

Questions & Answers

To find out more about becoming a Gomez Partner:

(781) 698-2317

[email protected]

http://www.gomez.com/partners/application/

mailto:[email protected]

Rl Partner Webinar To Share

Technology

Transcript of Rl Partner Webinar To Share