Application Software Testing and Distribution Strategies

Presented by:Cindi Popek, Jones DayCarol Creagan, Baker HostetlerRichard Harris, Freshfields Bruckhaus Deringer

Moderator:David Carlson, Kraft & Kennedy, Inc.

Agenda

IntroductionsEstablishing Standards & Best PracticesgOrganization & ProcessApplication Integration & DistributionApplication Integration & DistributionTesting & Quality AssuranceMaintenance & Operations

Today’s Panel

Cindi Popek Carol Creagan Richard Harris

2300 Attorneys 600 Attorneys 2500 Attorneysy31 OfficesCleveland, OH

600 Attorneys10 OfficesCleveland, OH

2500 Attorneys27 OfficesNew York, NY

Distribution Evolves

Where We StartedLogon scriptsBasic tool for software updatesLimited reporting – status

MaturityEnterprise desktop management systemsEnterprise desktop management systemsAdvanced scriptingHardware agnosticHardware agnostic

Trends

Dynamic DesktopySeparation of operating system and applicationsSupporting multiple platformspp g p p

Virtualization

VIRTUALIZATIONVIRTUALIZATION VIRTUALIZATION

Vendors

Establishing Standards & Best Practices

IS Operations FrameworkHow we get new things into the environmentHow did we arrive here – a little history

Consistency Format, approach and application

FundamentalsEMS supports standardization Secure the desktop. No local administrators!Replicate all packages to all locationsEstablish a regular reboot/release schedule

Organization & Process

IS Operations FrameworkProject Management

Project PortfolioRelease Management

Transition from Project Management to OperationsOperations

The things we do every day to support and care for our environment

Organization & Process

Application LifecycleOwnership - Business & Technical RequirementsIntegration & PackagingTesting/QADistributionSupport & MaintainRetire

Organization & ProcessR l d R ibilitiRoles and Responsibilities

Functional / Business OwnerC fi ti f t f ti ti b Configuration, features, functions – many times becomes the subject matter expert for the applicationDefine Integration points – application matrixCreate and own test criteria

Application / Technical Owner Architecture, configuration and installation of server softwareCollaborate with Functional Owner to support delivery of pp yfeatures and functions

Application Integration & Distribution

What do we need to move forward?Critical Information – Vendor, Version, KeysWho, What & When?DocumentationCommunicationDependencies/Prerequisitesp qUser Impact

Application Integration & Distribution

Integration and packaging considerationsArchitectural design

Web application (ActiveX)2 or 3-tier applicationsA li ti fil f t li tApplication server, file server, fat client

PlatformD kt Cit i W b b dDesktop, Citrix, Web-based

Native MSI vs. Repackaged executableVi t li i li tiVirtualizing applications

Application Integration & Distribution

Packager needs good all around knowledgeVirtual machines are ideal packaging environmentsg gDefine packaging standardsScript snippetsScript snippetsPackage naming conventionRollup package updates into master package

Testing & Quality Assurance

Consider 3 types of testingUnit testing

Basic functions - open, create, save, printCritical functions - based on business requirementsI t ti f ti t t th id tifi d i t ti i tIntegration functions - tests the identified integration points

User acceptance testingM ti th d f th b i Meeting the needs of the business sponsor

Performance testingBenchmarking to validate adequate performance / Benchmarking to validate adequate performance / scalability

Testing & Quality Assurance

Define Test TeamHelp Desk/Trainers/Subject Matter Experts/Dedicated QA Team

Formal test scriptsProvided by both business & technical SponsorsCan be used for automated testing and load testing (if g g (needed)

Document and review resultsPre-pilots and pilots

Maintenance & Operations

Deployment/MonitoringOut of hours is less disruptive (Wake On LAN)Block user interaction until deployment is completeMonitor deployments in real-timeUtilize staff in other times zonesUtilize staff in other times zonesStreamline/automate issue follow upAnalyze deployment resultsAnalyze deployment resultsRecord issues and workarounds

Maintenance & Operations

When Problems OccurWidespread problems overwhelm helpdesk quicklyHave experts standing by to troubleshootCommunication is key

Follow the planRegular updatesSet expectationsSet expectationsCarefully weigh the options for correctingIncident report

Major problems are major lessons!

Final Thoughts

Developing and following standards is key!Understand the environment and packages you deployTesting and issue tracking reduces deployment headachesCommunication is essential for all phasesEvery distribution is an opportunity to build experience

Questions?

Cindi Popek cpopek@jonesday.comCindi Popek cpopek@jonesday.comCarol Creagan ccreagan@bakerlaw.comRichard Harris richard harris@freshfields comRichard Harris richard.harris@freshfields.comDavid Carlson carlson@kraftkennedy.com