Oracle 0174

15
Navigating to Customer Success This case study explains how TomTom, a leading manufacturer of navigation software and personal navigation devices, got on track with their end-to- end e-commerce processes and gained maximum insight in customer experience. Test for Success Learn how two customers profited from using the Oracle Application Testing Suite. Featured Resources Ensuring Web Service Quality for Service-Oriented Architectures Deploy Changes 80% Faster: Oracle Real Application Testing—Business Agility Through Superior Testing Achieving a Superior Ownership Experience in Manageability and Quality for Oracle E-Business Suite Other Resources Application Testing Suite Real Application Testing Data Masking Real User Experience Insight Application Management ENTERPRISE MANAGEMENT FLYOVER A high-level view on mission-critical IT management The typical IT environment today is overwrought with complexity that impedes service quality, stifles dynamism, and is expensive to maintain. Far too much IT time and money is spent just keeping the engines running. What’s needed is a bold new approach to managing business applications, an approach that includes the applications themselves. The path to this approach is paved with comprehensive, integrated, top-down management solutions from the application provider, not with the disparate and unlinked third-party management solutions found so often today. Oracle’s Enterprise Manager is one such solution designed to integrate with the application for its manageability and move businesses decisively away from component-centric solutions. Whether packaged applications or composite applications, their usage and business dependencies are ever increasing. These environments are highly complex because of the thousands of IT components and assets that need to be monitored, tracked and managed. It’s only at the end-user level that application performance truly matters. Carefully considered enterprise management strategies show the way through the thicket of IT complexity. The depth of management of Oracle Enterprise Manager translates into optimal application performance, lower costs, optimal service levels and happy end users. This IDG eBook, with specially selected articles and numerous clickable resources, is designed to showcase practical ways that, even in this tough economy, allow you to take big steps to reduce IT complexity and drive your organization forward. Whether it is battle-testing applications before deployment, automating service lifecycle management, accelerating problem resolution, or devising a user-centric approach to application performance management, enterprise management tactics and strategies are the IT manager’s best friend. Read on to see how real-world users are harnessing readily available enterprise management solutions while keeping costs low. interactive eBook An Sponsored by COMPUTERWORLD Navigating to Customer Success Test for Success Featured Resources Application Testing Suite Resources Real Application Testing Resources Data Masking Resources Real User Insight COMPUTERWORLD custom publishing group Application Management Resources

Transcript of Oracle 0174

Page 1: Oracle 0174

Navigating to Customer SuccessThis case study explains how TomTom, a leading manufacturer of navigation software and personal navigation devices, got on track with their end-to-end e-commerce processes and gained maximum insight in customer experience. Test for SuccessLearn how two customers profited from using the Oracle Application Testing Suite. Featured Resources Ensuring Web Service Quality for

Service-Oriented Architectures Deploy Changes 80% Faster: Oracle

Real Application Testing—Business Agility Through Superior Testing

Achieving a Superior Ownership Experience in Manageability and Quality for Oracle E-Business Suite Other Resources Application Testing Suite Real Application Testing Data Masking Real User Experience Insight Application Management

EntErprisE ManagEMEnt FlyovErA high-level view on mission-critical IT managementThe typical IT environment today is overwrought with complexity that impedes service quality, stifles dynamism, and is expensive to maintain. Far too much IT time and money is spent just keeping the engines running.

What’s needed is a bold new approach to managing business applications, an approach that includes the applications themselves. The path to this approach is paved with comprehensive, integrated, top-down management solutions from the application provider, not with the disparate and unlinked third-party management solutions found so often today. Oracle’s Enterprise Manager is one such solution designed to integrate with the application for its manageability and move businesses decisively away from component-centric solutions.

Whether packaged applications or composite applications, their usage and business dependencies are ever increasing. These environments are highly complex because of the thousands of IT components and assets that need to be monitored, tracked and managed. It’s only at the end-user level that application performance truly matters. Carefully considered enterprise management strategies show the way through the thicket of IT complexity.

The depth of management of Oracle Enterprise Manager translates into optimal application performance, lower costs, optimal service levels and happy end users.

This IDG eBook, with specially selected articles and numerous clickable resources, is designed to showcase practical ways that, even in this tough economy, allow you to take big steps to reduce IT complexity and drive your organization forward.

Whether it is battle-testing applications before deployment, automating service lifecycle management, accelerating problem resolution, or devising a user-centric approach to application performance management, enterprise management tactics and strategies are the IT manager’s best friend. Read on to see how real-world users are harnessing readily available enterprise management solutions while keeping costs low.

interactive eBookan

sponsored by

COMPUTERWORLD Navigating to Customer Success

Test for Success

Featured Resources

Application Testing Suite Resources

Real Application Testing Resources

Data Masking Resources

Real User Insight

COMPUTERWORLDcustom publishing group

Application Management Resources

Page 2: Oracle 0174

sponsored by

COMPUTERWORLD � of 15

EntErprisE ManagEMEnt FlyovEr an interactive eBook

Navigating to Customer Success

Test for Success

Featured Resources

Application Testing Suite Resources

Real Application Testing Resources

Data Masking Resources

Real User Insight

Application Management Resources

navigating to customer successInsight into the end-to-end customer experience allows TomTom to navigate to the right business destination By David a. Kelly

SometimeS, all the expertise in the world can’t help you if you don’t know where you are or what’s going wrong in your organization. Take the case of TomTom, a 1.7 bil-lion Euro (approximately US$2.5 billion) Dutch-based leading man-ufacturer of navigation software and personal navigation devices (PNDs), or GPS units. Problems with inconsistent performance and a lack of insight into its end-to-end e-commerce processes made it dif-ficult for TomTom to satisfy its cus-tomers and capture maximum po-tential revenue growth. “There was a point in time when we were more or less driving in the dark,” admits

Oscar Diele, global vice president of e-commerce at TomTom.

As good as the company’s naviga-tion devices are, they couldn’t pro-vide TomTom’s management with visibility into its e-commerce sys-tems or the issues that its custom-ers were experiencing when trying to download manuals, update their equipment, or purchase additional maps or services. At risk was a po-tential huge growth in revenue that TomTom hoped to capture.

That’s where Oracle Real User Experience Insight comes in. Part of Oracle Enterprise Manager, Oracle Real User Experience Insight helps organizations by allowing them to

monitor and proactively manage their customers’ or users’ applica-tion experiences.

It also helps to align IT and busi-ness objectives.

“We had a couple of outages where we were unable to process customer transactions on the Web, causing us to actually lose sales. We didn’t even know which part of our in-frastructure was causing it. We were just lacking the right management information to understand what was going on,” says Diele. “That’s when we contacted Oracle and deployed Oracle Real User Experience Insight. In order to serve our customers and grow our business, we needed to un-

derstand the end user experience of our Web site visits.”

It’s a problem that’s not confined to TomTom. With more and more companies focused on saving mon-ey and optimizing customer relation-ships, it’s more important than ever for companies to have targeted in-sight into how effectively their cus-tomers are interacting with a compa-ny’s online presence.

“Oracle Real User Experience In-sight gives organizations visibility into their end users’ experience,” says Leng Leng Tan, vice president of ap-plications and systems management at Oracle. “It really fills a gap in tra-ditional IT management tools by en-

abling organizations to gain visibility into what their users are experienc-ing. At the same time, Oracle Real User Experience Insight collects a lot of information and performance data so that application administrators can drill down and isolate the com-ponents, tiers, or services that are causing problems and then use this information to identify solutions.

It’s a top-down management sol- ution from an end-user perspective.”

TomTom’s experience with its e-commerce site and the subsequent solution built around Oracle Real User Experience Insight is a good example of how traditional IT man-agement is in transition; instead of

CaseStudy

Page 3: Oracle 0174

sponsored by

COMPUTERWORLD � of 15

EntErprisE ManagEMEnt FlyovEr an interactive eBook

Navigating to Customer Success

Test for Success

Featured Resources

Application Testing Suite Resources

Real Application Testing Resources

Data Masking Resources

Real User Insight

Application Management Resources

CaseStudysimply focusing on individual devices, CPU performance, or storage limits, many organizations are now looking for management solutions that can help them manage IT as a business. It’s also a good example of the poten-tial upside of managing IT this way.

“It takes more than just manag-ing individual servers or databases to succeed today,” says Jean-Pierre Garbani, vice president, Forrester Re-search. “We have seen in the past that servers or databases can be up and available and yet deliver a poor service to the business. Oracle, by concentrating on user experience, application management, and root cause analysis, is answering the need for business-oriented IT services.”

Critical need for Business insightSince its founding in 1991, TomTom

has experienced incredible success. In 2008, the company expects to ship 14 million to 15 million PNDs worldwide. In fact, its device ship-ments have been growing at a tre-mendous rate—60 percent in the first half of 2008, 105 percent last year, and 180 percent the year be-fore. This astounding market pene-tration is providing an ever-expand-ing platform for TomTom on which to sell add-on services and content, including map updates, additional maps, and more.

However, capturing these “add-on” sales requires a robust e-com-merce system and a solid under-standing of its effectiveness—and when Diele was hired as vice presi-dent of e-commerce in 2007, he found that TomTom’s e-commerce infrastructure was not in optimal shape. Inadequate planning and

lack of management systems had led to problematic user experiences for some of the approximately 6 mil-lion unique TomTom customers vis-iting the company’s Web site each month—from enduring slow load times of Web pages to not being able to complete orders.

Like many companies’ e-com-merce environments, TomTom’s was complex, relying on several systems. As a result, it was possible that no one would notice when individual fail-ures occurred—especially if the Web site was still up and running. When it came down to it, there was no way to tell if the individual end-to-end user processes were working correctly.

“It is surprising that we didn’t have good insight into our e-com-merce experience, but it makes sense given that in the past the fo-cus of TomTom was on making great

portable navigation devices and working with our retail partners to sell them,” says Diele. “But we’re in a transition phase, expanding from an electronics manufacturer to a content-and-services provider. Now we know that monetizing content and services is a very good growth opportunity for the future.”

gaining insight into the Customer ExperienceBut putting the company in a posi-tion to capture that revenue would require a different approach to e-commerce management. That’s when TomTom contacted Oracle and decided to try out Oracle Real User Experience Insight.

“Oracle believed so much in the product that they said, ‘Try it. We know this is what you need, and if it’s not the case, we’ll pick every-

thing up and take it all back,’” says Diele. “It was very, very open, and they showed a lot of confidence in the solution they provided.”

Given the low risk and the po-tential upside, TomTom proceeded. “The product did what Oracle prom-ised,” says Diele. “It gave us valu-able insights into the end user expe-rience and provided guidance to us on where to optimize the process. That’s when we decided to actually purchase the product.”

Oracle Real User Experience In-sight allowed TomTom to identify the weakest links in the end-to-end cus-tomer process and which e-com-merce or back-office systems weren’t working correctly. “It helped us to get our IT teams focused on the busi-ness objective of improving our end-to-end user experience,” says Diele.

Like many companies’ e-commerce

Page 4: Oracle 0174

sponsored by

COMPUTERWORLD � of 15

EntErprisE ManagEMEnt FlyovEr an interactive eBook

Navigating to Customer Success

Test for Success

Featured Resources

Application Testing Suite Resources

Real Application Testing Resources

Data Masking Resources

Real User Insight

Application Management Resources

CaseStudyinfrastructures, TomTom’s was built from many different applications and systems that were not necessarily in-tended to work together but nonethe-less provide customers with a com-plete e-commerce experience.

“After deploying Oracle Real User Experience Insight, we really got a better understanding of how our e-commerce interactions worked and where the points of failure were,” says Diele. “We also learned how we could optimize the system to obtain the best ROI [return on investment]. I’m convinced that for us, this prod-uct will pay back within the first six months, easily.”

Business-Focused DecisionFor TomTom, the decision to invest in Oracle Real User Experience In-sight was driven by business needs, not IT requirements. “Our e-com-

merce sales and Web site are ex-tremely important for the future growth of our business, both in terms of their financial implications as well as their impact on our cus-tomer relationships,” says Diele. “So it wasn’t a hard decision to make this investment.”

In some companies, this type of tool might be the responsibility of the IT department. But in a fast-grow-ing company such as TomTom, the driver for business-focused IT end-user experience management came down to a business imperative.

“It all starts with our business objectives. We’re doing this because there’s a lot of value in our content and services,” says Diele. “Every hour that the Web site is not per-forming to its max, it costs us money and more importantly doesn’t meet the high quality standards we have

for our customers. My objective is to increase the business and bene-fits that we can drive with our end users.”

That’s why Diele’s e-commerce group, and not the IT department, was the key driver for the system. “My business unit was the main sponsor of this investment, but we did make sure to get buy-in from our experts in the technical department, who’d be working with the product on a day-to-day basis,” he notes.

Diele also had to make an invest-ment proposal to the board of direc-tors, who approved the purchase.

“The board recognized the tre-mendous upside potential in time and availability of our end-user in-terface, and they saw this as a criti-cal tool in catching those opportu-nities,” says Diele. “That’s why they approved the investment.”

proactive Customer Experience ManagementIf customers complain about some-thing, a company has a chance of fixing the problem. But that doesn’t always happen. Not all customers who experience problems follow up by complaining—instead, some leave and never come back. Also, some problems can be transient, occur-ring sporadically for a few hours and then correcting themselves.

But at TomTom that no longer happens. “With insights from Or-acle Real User Experience Insight, we now get notified within a couple of minutes when something goes wrong—if no new orders are com-ing in or if the end-to-end processes aren’t working normally,” say Diele. “It also helps us in outage situa-tions, because we can pinpoint the IT problems and react more quickly—

getting a fix up sooner, which helps our customers first and foremost. That helps us both lose less money as well as make more money.”

And it’s this type of impact that transformative IT departments are having on businesses of all types. “When IT leaves the back office to be-come part of the business, the qual-ity of IT services must be in line with business expectations,” says Forrest-er’s Garbani. “For example, the qual-ity of the user experience is what makes the business experience pleas-ant or not. It is also part of user satis-faction and client retention, which is extremely important to the business.”

Oracle Real User Experience In-sight also helps TomTom’s IT group identify the weak spots—for instance, Web pages that might have long load times and are causing customer frustration and customer drop-offs.

Page 5: Oracle 0174

sponsored by

COMPUTERWORLD 5 of 15

EntErprisE ManagEMEnt FlyovEr an interactive eBook

Navigating to Customer Success

Test for Success

Featured Resources

Application Testing Suite Resources

Real Application Testing Resources

Data Masking Resources

Real User Insight

Application Management Resources

CaseStudy“If you know which Web pages are

causing the problems, you can fix them,” notes Diele. “You can improve the overall user experience, and as a result, conversion rates will go up and your customers will be happier. That all translates into money.”

Oracle Real User Experience In-sight monitors not just TomTom’s Web site but also the core shop-ping engine, payment flow, pay-ment service providers, Web servers, and overall performance. In short, it monitors everything that occurs on TomTom’s e-commerce site. The product does real-time monitoring of all the elements and notifies the appropriate people when there are metrics that are above or below cer-tain thresholds.

It also generates daily and week-ly reports on the service levels and performance of the entire end-to-

end user experience.“The monitoring, notification, and

reporting are what really make this product very valuable to our busi-ness,” says Diele. “Using Oracle Real User Experience Insight, we have good insights into the average re-sponse times. Often our reports show exactly how many people drop off when load times become too long. That helps us to identify where in our infrastructure and where in the soft-ware we need to put more focus, and which people need to be responsible for optimizing those parts.”

Another important aspect of the system is that it now lets TomTom business leaders such as Diele ac-tually set service levels that can be measured, monitored, and reported on, providing another way for Tom-Tom to align business and IT.

“Before, we never measured any-

thing on the Web in much detail. Now we can set service levels, and we can set targets to improve,” says Diele. “And because we’re no-tified every time something goes wrong, we can fix it and make sure it doesn’t go wrong in the future. As a result of using Oracle Real User Ex-perience Insight, the overall service levels and overall customer experi-ence have improved dramatically.”

providing a Framework for MotivationIT shouldn’t happen in a vacuum. In-stead, a well-run IT group is integral-ly linked with the business and its changing objectives. Yet sometimes it can be hard for organizations to build those linkages.

“When I joined the company, there were not a lot of people out-side of the e-commerce business

unit who were really worried or con-cerned with the Web site or systems on a daily basis. They simply weren’t aware of the relative poor perfor-mance of the systems,” says Diele. “There was a huge potential upside for improving system stability and in-frastructure. Investing in Oracle prod-ucts has helped the business side convince the IT department of the added value of investing resources in improving the processes and in-frastructure. We were able to use Or-acle Real User Experience Insight as an eye-opener to get the organization moving in the right direction.”

Oracle Real User Experience In-sight is also helping the company establish better alignment between its business and IT organizations. “I think one very important value for us that’s hard to quantify is that this system provides us with reporting,

and reporting is always very essential in making something come alive,” says Diele. “If you don’t have statis-tics, if you don’t have information, it’s hard to communicate something.

“Now we have the information, the reports, the data, and statistics. We can actually show people what’s hap-pening, and as a result, it becomes alive and people are much more mo-tivated to act on the information.”

With better visibility and metrics into its e-commerce experience, ev-eryone at TomTom shares a similar goal for business growth. “Now, all of a sudden, people realize how fast e-commerce is growing and how im-portant it is for our business,” says Diele. “It’s very satisfying.” <<

David A. Kelly is a freelance business/technology writer based in Massachusetts.

Page 6: Oracle 0174

sponsored by

COMPUTERWORLD � of 15

EntErprisE ManagEMEnt FlyovEr an interactive eBook

Navigating to Customer Success

Test for Success

Featured Resources

Application Testing Suite Resources

Real Application Testing Resources

Data Masking Resources

Real User Insight

Application Management Resources

According to Leng Leng Tan, vice pres-ident of applications and systems management at Oracle, there are four major trends that are affecting how organizations are managing their IT infrastructure:

• Driving down costs. Many organiza-tions are under pressure to reduce costs, particularly with changing economic times.

• Increasing quality of service. At the same time, organizations are being pressured to increase the quality of service—often having to provide more services (or better service) with reduced resources.

• Increasing agility. With business requirements changing faster than ever before, IT needs to make more changes than ever before. From security requirements to com-pliance requirements to new busi-ness processes, IT has to keep up with business.

• Lowering risks. While organiza-tions need to increase agility, making any change introduces risk. That’s why IT organizations are always on the lookout for ways to reduce risks while keep-ing up with change.

“It’s not just about managing the individual components, such as servers, databases, or middleware components, anymore,” says Tan. “It’s about managing the whole end-user and business-user experience. Being able to drill down on the per-

formance and availability of end-to-end business processes allows or-ganizations to identify exactly where processes are having problems and what needs to be fixed. It’s one of the key aspects of a solution that helps organizations align business goals with IT performance.”

According to Jean-Pierre Garbani, vice president, Forrester Research, more and more enterprises are us-ing business-oriented management solutions: “We are at a new stage of cooperation between IT and the busi-ness, where using effective data from IT can help the business better under-stand customer behavior and improve business processes, and consequent-ly IT practices,” says Garbani. “More effective alignment of business and IT can also help suggest better applica-tions or new technologies that will im-prove the business processes.”

In general, Tan sees an increased focus among enterprises on business key performance indicators (KPIs) and solutions that are KPI-centric or business service–centric. Instead of monitoring low-level metrics such as CPU or disk usage, a business-fo-cused management solution enables organizations to manage IT resources according to business needs. For ex-ample, during quarter-end, a key busi-ness activity is entering orders; the IT department should be focused on en-suring the performance and availabil-ity of the systems that are most relat-ed to quarter-end processing to make sure everything goes smoothly, rather than giving priority to something like expense report servers.

“We see customers asking more and more for management solu-tions that are high-level and fo-cused on business processes,”

says Tan. “Oracle is in a unique po-sition because we offer a wide va-riety of applications, from Oracle E-Business Suite to Siebel and Peo-pleSoft and more. We’re able to leverage our knowledge of those applications and the business pro-cesses in them to provide the right solutions for our customers.”

“Business-oriented management solutions like Oracle’s are not only satisfying the need for managing the technology pieces of an orga-nization’s infrastructure, but also managing those pieces from the end-user standpoint,” says Garbani. “That tells IT not only which individ-ual services are unsatisfactory but why they’re unsatisfactory.

“In addition, business-oriented management solutions can constant-ly monitor the end-user experience to make sure it’s good.”

Key trends driving it management

CaseStudy

Page 7: Oracle 0174

sponsored by

COMPUTERWORLD � of 15

EntErprisE ManagEMEnt FlyovEr an interactive eBook

Navigating to Customer Success

Test for Success

Featured Resources

Application Testing Suite Resources

Real Application Testing Resources

Data Masking Resources

Real User Insight

Application Management Resources

When it profeSSionalS absolutely, positively have to get it right—whether they’re helping an educational soft-ware company improve its application lifecycle or they’re running the Web site of a charitable organization that raises funds online—they test. Making sure that all applications run smooth-ly in all kinds of conditions is mission critical, and the way to ensure that ap-plications perform as needed is to test them—rigorously and repeatedly—un-der real-world conditions.

Application testing is becoming in-creasingly important as customers

seek to deploy applications faster, at lower cost, and with higher quality of service. Quality assurance (QA) pro-fessionals want application testing solutions that prevent costly applica-tion performance problems, avoid un- planned outages of business-critical applications, and automate manual steps involved in application testing.

These QA goals were key for Merid-ian Knowledge Solutions, which want-ed to establish processes that would make its entire application testing life-cycle more efficient. The company, a subsidiary of Visionary Integration Pro-

fessionals, provides learning manage-ment system (LMS) and learning con-tent management system software. Meridian serves 4.5 million users at more than 200 public and private sector employers. For this educational software company, testing isn’t some-thing that their end users do after they’ve mastered the material. Testing starts at home.

“We didn’t want to simply develop our testing processes around an ap-plication,” says James Downs, product QA manager at Meridian. “We wanted to define processes that would make us more efficient so we could better manage our application testing lifecy-cle from beginning to end.”

As part of defining their process-es—as well as managing application testing lifecycles—QA professionals at Meridian asked themselves a simple question: how can we become more

efficient in the QA department while driving our testing processes forward?

To better serve its customers and keep the LMS performing optimally, Downs and his team follow proven methods for control processes, test-ing, documentation, and review pro-cedures, as well as creating templates and guidelines for QA deliverables.

Oracle Test Manager for Web Applica-tions, one component of Oracle Ap-plication Testing Suite, helps them bring all these pieces together while enabling collaborative communication through a common portal.

The biggest advantage of the Oracle software, according to Downs, is its simplicity: all fundamental areas

test for success Prevent errors, reduce downtime, and save money with Oracle Application Testing Suite By David Baum

snapshots

CaseStudy

Meridian Knowledge solutions (a subsidiary of Visionary Integration Professionals)

location: Chantilly, Virginiaindustry: Software and servicesrevenue: US$13 millionemployees: 80oracle products: Oracle Applica-tion Testing Suite, Oracle Database

Comic relief

location: London, Englandindustry: Charityrevenue: US$136 millionemployees: 120oracle products: Oracle Load Testing for Web Applications, Oracle Database, Oracle Applica-tion Server, Oracle Data Guard, Oracle Real Application Clusters

Page 8: Oracle 0174

sponsored by

COMPUTERWORLD 8 of 15

EntErprisE ManagEMEnt FlyovEr an interactive eBook

Navigating to Customer Success

Test for Success

Featured Resources

Application Testing Suite Resources

Real Application Testing Resources

Data Masking Resources

Real User Insight

Application Management Resources

of the software lifecycle are available in a simple and intuitive interface.

“Oracle offers three important test-ing modules integrated into one in-terface,” says Downs. “Requirements, test management, and defect tracking are all bundled together, which is fan-tastic for traceability purposes. When you’re trying to itemize things, it is easier to have them all in one place.”

One of the most time-consuming QA tasks for Meridian involves creat-ing traceability between requirements, tests, and defects. “By allowing us-ers to associate requirements to tests, tests to issues, and issues to require-ments, Oracle Test Manager for Web Applications provides traceability and mapping that aids in our CCB [change control board] process, issue resolu-tion, and testing preparation and exe-cution,” Downs says. That functionality has big payoffs for Meridian.

“Oracle’s traceability capabilities alone save our team days, if not weeks, on every release,” says Downs. “These capabilities systematically cov-er our functionality and prevent a lot of upkeep and overhead.”

Meridian’s application testing procedures are built both for today’s requirements and with an eye to the future.

“We focus on making sound deci-sions for all areas that we want to fix, from requirements management to development to QA to the change pro-cess,” explains Downs. “It’s all about repeatability. You want to devise pro-cedures that are cyclical, consistent, and predictable.”

no laughing MatterConsistent and predictable applica-tion performance under extreme con-ditions is paramount for Comic Relief,

a U.K.-based charity whose vision is “a just world free from poverty” and whose mission is “positive change through the power of entertainment.” Established in 1985 by comedians with a passion for helping others, each year Comic Relief runs a ma-jor fundraising campaign—either Red Nose Day or Sport Relief, which are held in alternate years.

During these campaigns, Web site performance is critical. Comic Relief uses Oracle Load Testing for Web Ap-plications, one of the three primary Oracle Application Testing Suite mod-ules, to define and manage a compre-hensive testing process that includes validating the functionality of its Web applications and ensuring that those applications can perform well even when the organization experiences huge spikes in traffic.

Comic Relief’s Web application test-

ing processes ensure that people visit-ing the organization’s fundraising sites can get information and make dona-tions quickly. “Oracle Load Testing for Web Applications includes infrastruc-ture performance monitors that record metrics on Web servers, application servers, databases, and other infra-structure components,” says Charlotte Melén, Web technology manager at Comic Relief. “That’s been really useful.”

Comic Relief’s test campaigns fol-low a set process that begins with per-formance testing and tuning and then moves on to load and stress testing. Oracle Application Testing Suite helps the QA team define and manage these testing processes, validate ap-plication functionality, and ensure that Comic Relief’s Web properties per-form under the anticipated demand. Comic Relief’s testing procedures in-clude simulating 30,000 simultane-

ous users and measuring the effect of the load on application performance.

During extensive load testing lead-ing up to Red Nose Day 2007, Oracle Load Testing for Web Applications was instrumental in ensuring that the on-line donation application would be able to handle traffic processed by 9,800 call center agents. “Thanks to our systematic testing efforts, we were confident that our infrastructure would be able to handle the tremendous de-mands it would experience during the event,” Melén says.

The site performed as planned. Comic Relief processed more than 450,000 transactions during a seven-hour period. During peak loads, the site processed an average of 54 trans-actions per second. Comic Relief is planning for three times that amount of traffic for the 2009 Red Nose Day campaign. “We’ll be testing for peaks

CaseStudy

Page 9: Oracle 0174

sponsored by

COMPUTERWORLD � of 15

EntErprisE ManagEMEnt FlyovEr an interactive eBook

Navigating to Customer Success

Test for Success

Featured Resources

Application Testing Suite Resources

Real Application Testing Resources

Data Masking Resources

Real User Insight

Application Management Resources

of 150 transactions per second to ensure we can handle an expected 750,000 transactions in six hours,” Melén says. “This will allow us to walk into Red Nose Day 2009 with confi-

dence that the Web site will perform under pressure.”

Melén believes that testing thor-oughly is the key to application suc-cess. “I would advise anyone putting

in place a business-critical Web ap-plication to test thoroughly,” she says. “It’s a key quality assurance measure to show whether or not an application will perform under traffic. We certainly

could not run our campaigns without such rigorous testing.”

James Downs from Meridian Knowl-edge Solutions acknowledges the im-portance of application testing and

the value of the Oracle testing tools to his team: “Oracle has provided a rela-tively low-cost solution that supports almost all aspects of our product de-velopment lifecycle.”

the oracle application teSting Suite, part of Oracle Enterprise Manager’s suite of applica-tion quality management products, provides an integrated solution for load testing, functional testing, and test management. It enables custom-ers to test packaged, Web, and service-oriented architecture-based applications and their under-lying infrastructure, and it helps ensure optimum quality, scalability, and availability. Oracle Appli-cation Testing Suite includes three components.

Load testing for Web applications simulates thousands of virtual users accessing the applica-tion simultaneously and measures the effect of

the load on application performance, thus vali-dating the performance and scalability of applica-tions and Web services.

Functional testing for Web applications pro-vides for comprehensive functional testing of ap-plications and Web services by simplifying au-tomated test script generation and enabling the automation of complex Web applications and as-sociated technologies out of the box.

Test manager for Web applications helps man-age Web application testing by allowing users to define testing requirements, specify and execute manual or automated tests to validate require-ments, and manage defects that they uncover.

Oracle Application Testing Suite also provides a common scripting environment between func-tional testing and load testing to simplify test pro-

cesses and accelerate test completion by up to 50 percent.

Melinda-Carol Ballou, program director of IDC’s Application Life Cycle Management Service and a principal analyst at the independent research firm, says, “Oracle’s acquisition of the Oracle Ap-plication Testing Suite functionality [acquired with Emperix’ e-TEST suite] is an important first step toward developing an overall lifecycle strategy for Oracle Applications.”

Indeed, Oracle is in the process of integrating and enhancing Oracle Application Testing Suite functionality in several of its applications lines, in-cluding Oracle E-Business Suite and Siebel Cus-tomer Relationship Management (CRM). “We are leveraging Oracle’s extensive knowledge of these applications to generate test scripts more efficient-

ly and to provide best-of-breed solutions for test-ing Oracle Applications,” says Leng Leng Tan, vice president of applications and systems manage-ment at Oracle. For example, the Oracle Applica-tion Testing Suite accelerators for Siebel let cus-tomers jump-start their Siebel application testing by providing automated load and functional test-ing for Siebel customer relationship management applications. “Oracle Application Testing Suite in-tegrates with Siebel Test Automation Interfaces to natively recognize Siebel UI elements and corre-late application requests when creating automated test scripts, greatly simplifying the testing process,” says Tan. “The framework allows customers to fo-cus on testing their Siebel applications rather than creating test scripts and greatly reduces the overall cost of testing.”

putting it all together

CaseStudy

Page 10: Oracle 0174

sponsored by

COMPUTERWORLD 10 of 15

EntErprisE ManagEMEnt FlyovEr an interactive eBook

Navigating to Customer Success

Test for Success

Featured Resources

Application Testing Suite Resources

Real Application Testing Resources

Data Masking Resources

Real User Insight

Application Management Resources

ResourcesEnsuring Web service Quality for service-oriented architectures

White paper

Current trends show that the vast majority of companies are moving to services-oriented architectures (SOAs) and deploying Web services within and across their IT infrastructure. However, the success of those deployments is determined by the integrations and innovations that Web services make possible and how Web services affect the quality and performance of the mission-critical applications with which they interface. As such, it is crucial to thoroughly test Web services before they are deployed in order to ensure service level compliance in production.

Download this whitepaper to see how Oracle Real Application Testing facilitates new technology adoption associated with infrastructure changes, and offers the following benefits:

• Reduce Risk—Improve system reliability and quality of service by accurately validating changes

before production deployment• Lower IT Costs—Cut infrastructure testing

costs by up to 70%• Enhance IT Efficiencies—Automate manual and complex testing tasks, which previously took

months; it can now be done with a few clicks• Greater Agility—Reduce testing effort by up to 80%

Deploy Changes 80% Faster: oracle real application testing—Business agility through superior testing

White paper

Download this white paper Download this white paper

Page 11: Oracle 0174

sponsored by

COMPUTERWORLD 11 of 15

EntErprisE ManagEMEnt FlyovEr an interactive eBook

Navigating to Customer Success

Test for Success

Featured Resources

Application Testing Suite Resources

Real Application Testing Resources

Data Masking Resources

Real User Insight

Application Management Resources

Resourcesachieving a superior ownership Experience in Manageability and Quality for oracle E-Business suite

White paper

Oracle E-Business Suite provides class-leading capabilities to improve the performance of organizations. To help you maximize the value of this mission-critical application, and to achieve a Superior Ownership Experience in application manageability and quality, Oracle provides a set of tools that facilitate top-down application management and cover the entire application lifecycle.

Download this white paper

Page 12: Oracle 0174

sponsored by

COMPUTERWORLD 1� of 15

EntErprisE ManagEMEnt FlyovEr an interactive eBook

Navigating to Customer Success

Test for Success

Featured Resources

Application Testing Suite Resources

Real Application Testing Resources

Data Masking Resources

Real User Insight

Application Management Resources

Resourcesoracle application testing suite resources

Deploy Higher-Quality applications in less time with Comprehensive and secure testing (Brochure)

Comic relief raises Us$94 Million with Help of Web application testing (Case study)

Meridian Knowledge solutions, llC streamlines application testing and reduces product Complaints (Case study)

Ensuring Web service Quality for service-oriented architectures (White paper)

rapid Bottleneck identification - a Better Way to Do load testing (White paper)

Ensuring End User performance for siebel CrM: (White paper)

oracle Functional testing for Web applications overview (Screenwatch)

oracle load testing for Web applications overview (Screenwatch)

oracle test Manager for Web applications overview (Screenwatch)

load testing for Web applications (Data sheet)

Functional testing for Web applications (Data sheet)

test Manager for Web applications (Data sheet)

application testing suite siebel testing accelerators (Data sheet)

view

view

view

view

view

view

view

view

view

view

view

view

view

Additional resources can be found at http://www.oracle.com/technology/products/oem/prod_focus/etest.html.

Page 13: Oracle 0174

sponsored by

COMPUTERWORLD 1� of 15

EntErprisE ManagEMEnt FlyovEr an interactive eBook

Navigating to Customer Success

Test for Success

Featured Resources

Application Testing Suite Resources

Real Application Testing Resources

Data Masking Resources

Real User Insight

Application Management Resources

Resourcesoracle real application testing

oracle real application testing (Data sheet)

ovum summit: oracle real application testing - Business agility through superior testing (Podcast)

ovum summit: oracle real application testing - Business agility through superior testing (White paper)

oracle Database 11g: real application testing (Overview - iSeminar)

oracle real application testing (Technical - iSeminar)

nokia streamlines Database testing with real application testing (Video)

EDs relies on oracle real application testing (Video)

starwood Mitigates risk During Business-Critical application Upgrade Using oracle real application testing (Podcast)

view

view

view

view

view

view

view

view

Page 14: Oracle 0174

sponsored by

COMPUTERWORLD 1� of 15

EntErprisE ManagEMEnt FlyovEr an interactive eBook

Navigating to Customer Success

Test for Success

Featured Resources

Application Testing Suite Resources

Real Application Testing Resources

Data Masking Resources

Real User Insight

Application Management Resources

Resourcesoracle Data Maskingoracle Enterprise Manager 10g r4 Data Masking (Webcast)

oracle Enterprise Manager 10g Data Masking pack (Data sheet)

oracle Database security - Data Masking (iSeminar)

oracle Data Masking (Screenwatch)

view

oracle real User Experience insightoracle real User Experience insight technical White paper (White paper)

Forrester: oracle real User Experience insight (Webcast)

oracle real User Experience insight (Data sheet)

oracle real User Experience insight (iSeminar)

oracle real User Experience insight: implementation Case study at oracle (White paper)

oracle real User Experience insight: Dashboard (Screenwatch)

oracle real User Experience insight: performance analysis - Error replay (Screenwatch)

view

view

view

view

view

view

view

view

view

view

Page 15: Oracle 0174

sponsored by

COMPUTERWORLD 15 of 15

EntErprisE ManagEMEnt FlyovEr an interactive eBook

Navigating to Customer Success

Test for Success

Featured Resources

Application Testing Suite Resources

Real Application Testing Resources

Data Masking Resources

Real User Insight

Application Management Resources

Resourcesapplication Management

achieving a superior ownership Experience in Manageability and Quality for oracle E-Business suite (White paper)

achieving a superior ownership Experience in Manageability and Quality for siebel CrM (White paper)

achieving a superior ownership Experience in Manageability and Quality for peoplesoft Enterprise (White paper)

achieving a superior ownership Experience for oracle Business intelligence Enterprise Edition (White paper)

oracle real User Experience insight accelerator for oracle E-Business suite (Data sheet)

oracle real User Experience insight accelerator for oracle siebel (Data sheet)

oracle real User Experience insight accelerator for peoplesoft (Data sheet)

Monitoring the real User Experience of oracle E-Business suite Users (White paper)

Monitoring the real User Experience of siebel Users (White paper)

oracle application testing suite siebel testing accelerators (Data sheet)

view

view

view

view

view

view

view

view

view

view