Professional Services Performance Testing Center of Excellence Application Performance Management...
-
Upload
rayna-cattell -
Category
Documents
-
view
222 -
download
0
Transcript of Professional Services Performance Testing Center of Excellence Application Performance Management...
Professional Services
Performance Testing Center of Excellence
Application Performance Management Solution
Information Technology Services Click to Advance Presentation
Mute sound if necessary (sound icon)
Today’s Challenges
Business lines rarely share information on tool research, usage, testing practices, and cost containment.
Software Development Life Cycle models frequently compromise testing initiatives to meet deliverable deadlines.
Performance Testing Practices vary in most projects.
Knowledge Transfer – performance testing information leaves with consultants.
Performance Tools are expensive, and very complex to integrate.
No global approach to Performance Testing tools, techniques, or costs.
Expensive consultants are frequently hired for Performance Testing
Many projects cannot afford to make long term commitments to Performance testing.
Decentralized approach to building and testing software.
2
Industry Trends
Application owners often ask the following:
Does my application scale to meet business goals?
75% of ERP systems fail to do so (Gartner)
Does my application scale to meet business goals?
70% of performance problems can be resolved by configuration changes (survey of 3,000 HP/Mercury engagements)
Can I resolve application bottlenecks?
40% of app bottlenecks are first noticed by a customer or executive (Mercury Survey)
$2B + spent in app server overcapacity from 2001 to 2003 (Gartner)
Have I overspent on infrastructure?
3
One Platform Solution
T3 works to empower Business, Quality Assurance, and Development teams to deliver better software by centralizing all aspects of testing and performance management.
Become Performance center of excellence
Centralize performance testing and monitoring tools
Global Performance testing execution capability
Focus on quick “cost savings” wins!
Reduce dependency on expensive consultancy
QUICK START- Bring automation in quickly that addresses an immediate need.
Reduce infrastructure support for testing
Take a ‘value’ approach and network it
Forge alliances & partnerships
Leverage vendor Purchasing Power
“Bringing the pieces together”
4
Performance Approach
Phase-driven approach to Performance Optimization
Phase 1:Plan
Fully Plan the projectOrganize the Team
Determine the business goalsDefine the business processInventory HW, SW and networkIdentify key participantsMobilize test teamCreate test planAgree execution schedule
Phase 2:Baseline
Quantify the SystemPerformance
Create test casesDeploy monitoring agentsRun initial test planDocument the baseline profileCompare baseline with target
Phase 3:Optimize
Iteratively Isolate andReduce Bottlenecks
Emulate production loadMonitor system performanceIdentify problem areasAnalyze root causeDetermine resolutionApply modification
Assess the PerformanceImprovements and Report
Phase 4:Report
Document improved throughput Increased capacity reduced error rate greater stability better user response time
Compare with baseline and targetProduce findings/recommendationsRetain data for future comparison
5
Why HP/Mercury
1.1. Proven LeadershipProven Leadership
2.2. Market VisionariesMarket Visionaries
3.3. Strategic AllianceStrategic Alliance
Worldwide Performance Testing Market Share Source Newport Group, Inc © 2004
Empirix4%
Compuware4%
Other9%
Segue2%
Rational9%
RadView1%
HP/Mercury71%
6
Automated Performance Testing
Web Server App. Server DatabaseInternet/WAN
Controller User Simulation
PERFORMANCE MONITORS
Replaces real users with thousands of virtual users
Generates consistent, measurable, and repeatable load, managed from a single point of control
Efficiently isolates performance bottlenecks across all tiers/layers with automated reporting and analyses
7
Types of Performance Testing
1.1. Stress TestingStress Testing
2.2. Capacity PlanningCapacity Planning
3.3. Throughput ImprovementThroughput Improvement
4.4. Server ConsolidationServer Consolidation
5.5. Baseline AssessmentBaseline Assessment
6.6. New Version Impact AnalysisNew Version Impact Analysis
7.7. Ensure Business PerformanceEnsure Business Performance
8
Application Monitoring
ApplicationServer
WebServers
DatabaseServer
Router Router
LoadBalancerFirewall
ISPISPISP
98% of sites experience critical performance problems– Typical applications encounter problems at 15% of design
capacity
Problems occur both inside & outside firewall– 25% - network and bandwidth related– 23% - application server related– 20% - load balancers, web server or proxy server issues
Source: Mercury Interactive hosted services
Application Management monitors the entire infrastructure from the users perspective!
9
A Day In the Life… Daily Challenges
07:17AM Ticket opened
07:05AM Problem detected - data center serving e-Bank customers is down
07:31AM Bridge-line opened - 8 people
11:48AM 4 more people paged, DBA joins line
04:05PM Root cause identified: mis-configured connection pooling caused DB crash at peak traffic. At least 800 customers affected, business impact unknown
04:20PM IT representative sent to client impact assessment meeting
08:03AM Check UNIX issue, escalate to hardware vendor
08:06AM Business urgency discussed, not well understood
10:51AM Hardware is ok, Informix DB appears down
10:20AM Security clearance delays hardware vendor from entering data center
10
Diagnose Root Cause
Define SLAsBusinessConsole
CustomerImpact SLM Event
ViewerTier 2Top View
BUSINESS AVAILABILITY CENTER
Tier 1 Tier 3
RESOLUTION CENTER
11
Application Management Dashboard
Define SLAsBusinessConsole
CustomerImpact SLM Event
ViewerTier 1 Tier 2 Tier 3Top View
BUSINESS AVAILABILITY CENTER RESOLUTION CENTER
12
Appendix
Supplemental Information
13
Introducing LoadRunner
Our Center of Excellence approach uses Mercury Interactive LoadRunner product to deliver an integrated solution
for business technology optimization.
Network bandwidth
Routers
Switches
Hosting equipment
Load balancers
Application servers
Databases
Middleware
Back office
Firewalls
IDS systems
DDoS systems
Gateways
Web servers
Cache servers
LAN / WAN
Client Systems
Legacy system
.NET services
Sun ONE services
SecurityInfrastructureApplication
LoadRunner
System
Monitor
AutomatedScripts
DataRepository
It provides an end-to-end tool set for performance tuning a user simulation module to create business transaction load a system monitoring module to display infrastructure behavior and application
errors a set of automated scripts that identifies modifications a data repository for future comparisons
14
Powering the CoE
Application Delivery Foundation
Application MonitoringBusiness Availability Center • Resolution Center
Application Delivery Console
Virtual Users
ProtocolsMonitors
PERFORMANCE CoE
Global ManagementMulti-project ManagementResource Management
DiagnosticsTuningLoadRunner CapacityPlanning
15
LoadRunner Coverage
Recommendation ResolutionProblem Identification
MonitoringUser Simulation
Infrastructure(e.g. Linux, Solaris, Windows)
Vendor Product(e.g. Oracle, Websphere)
Performance Tuning Steps
Tu
na
ble
Co
mp
on
en
ts
LoadRunner Capabilities in Optimization Exercise
In-house Apps• method level for J2EE apps
• program level for other types
* J2EE source code line-level identification available using OptiBench add-on.
16
LoadRunner Overview
Web Server App. Server DatabaseInternet/ Intranet
USER SIMULATION PROTOCOLS
Clients
PERFORMANCE MONITORS
•SAP•Oracle•Siebel•PeopleSoft
ERP/CRM
• HTTP(S)• XML• Citrix ICA• SOAP• WAP
Web
• EJBs• CORBA• COM• RMI• MQSeries
• 3270• 5250• VT100
• Oracle• MS
SQLServer• DB2• ODBC
Middleware LegacyDatabases
Operating Systems Network Web
ServersApp Servers Java Databases
• Windows• Unix• Linux
• SNMP• WAN
Emulation
• MS IIS• iPlanet• Apache
• EJB• JDBC• JSP• Sitraka
JMonitor
• Oracle• MSSQL
Server• DB2
• BEA WebLogic• IBM WebSphere• ATG Dynamo• iPlanet App Server
17
LoadRunner Deployment
Application Tier
Applications
ApplicationServers
Infrastructure Tier
Firewall
Web Servers
Load Balancer
Firewall
Database Tier
DatabaseServers
Storage
Distributed System
App & SystemMonitoring
Measure Performance → Identify Constraints → Apply Modification
~~~~~~
Stress Simulation
Telecomm Fabric
Infrastructure
Consumption
CPU 28 CPUs
Memory
2,560MB
Disk I/O 70%
Network
80%
System
Capacity
User count 100
Tranx rate 100/min
User
Experience
Response time
10 sec
Error rate 10 %
Automated & Manual Tuning
Apply Tuning Process
Gather Metrics
Step 1
1. Define business process
2. Capture user behavior
3. Create simulation profile
4. Apply controlled load
Step 2
Step 4
Sample Recommendations
WebLogic - misconfigured Java VM heap size
Database - missing indexes, full table scan
...
Step 3
EnvironmentunderUser Load
Typical Statistics
18
Metrics
DatabasesOracle
• Total file opens • Enqueue deadlocks• Enqueue waits• Opened cursors current• SQL*Net roundtrips to/from client • Plus 164 other counters
Sybase• Disk Reads • Memory • Disk Writes• Disk Waits• Locks count • % Hits • % Processor Time (process) %• Plus 49 other counters
Microsoft SQL Server• SQL Re-Compilations/Sec • I/O - Outstanding Reads • Lock Wait Time (ms) • Total Latch Wait Time (ms)• SQL Re-Compilations/Sec • Plus 38 other counters
DB2• Local_con_exec• Total_sorts• Plus 174 other counters
App. ServersIBM WebSphere
• ThreadCreates • ActiveThreads • ConnectionPoolSize • SessionsActive• Plus 82 other counters
BEA WebLogic• HeapSizeCurrent • ActiveConnectionsCurrentCount • WaitingForConnectionCurrentCount • Plus 118 other counters
Iplanet Application Server• nasKesEngAutoStart • nasEngSYBPreparedQueryTotal • nasEngThreadWait • Plus 118 other counters
Microsoft Active Server Pages• Requests Executing • Requests Queued • Request Bytes Out Total• Requests/Sec • Transactions Aborted • Transactions Pending
Oracle 9iAS HTTP ServerAllaire ColdFusionSilverStreamAribaATG DynamoMicrosoft COM+ MonitorBroadVision
Web ServersApache
• #Busy Servers • #Idle Servers • CPU Usage• Hits/Sec • KBytes Sent/Sec
MS IIS• Connection
Attempts/Sec • Files Received/Sec • Logon Attempts/Sec • Total Files Transferred • Plus 50 other counters
Iplanet (Netscape)• Bad requests/Sec • Bytes Sent/Sec• Hits/Sec • Plus 11 other counters
Other Softwareand Hardware
Streaming Media MonitorsCheckpoint Firewall Server ERP Performance MonitorsMiddleware MonitorsJava Performance MonitorsCitrix MetaFrame MonitorsNetwork Delay
Cu
stom
ized
Co
un
ters C
ap
ab
ility
Cu
stom
ized
Co
un
ters C
ap
ab
ility
19
The Tuning Process
Apache Web Server 1.x/2.x
BEA Weblogic 6.x/7.x
IBM HTTP Server
IBM Websphere Advanced 4.x
IBM Websphere Single Server 4.x
iPlanet Enterprise Server 6 & higher
Microsoft IIS 4/5
Microsoft Active Server Pages 2/3
Oracle Database
Oracle 9iAS
PeopleSoft 8.x
SAP Enterprise Portals 5
Siebel 7.x
SQL Server 7.5/2000
Windows: NT, 2000 and XP
UNIX: Solaris, HP, AIX and Linux
LoadRunner’s tuning agent can be deployed to automatically recommend optimum settings for a wide range of industry-standard applications.
IT specialists will manually optimize additional hardware and software based on LoadRunner performance metrics.
20
Benefits of Tuning
• Optimizes application and infrastructure performance
• Isolates and resolves performance bottlenecks
• Establishes optimized configuration settings for production
21
Benefits of LoadRunner Diagnostics
• Pinpoints application bottlenecks, e.g., J2EE to method/SQL level
• Reduces time to resolution for application issues
• Integrated with Mercury LoadRunner— combines end user response time with diagnostics
22
23
Visit Us Online
Global VirtualTesting Capabilities
For additional information contact:[email protected]
Click Here or copy/pastewww.t3consortium.com