HammerCloud Functional tests
description
Transcript of HammerCloud Functional tests
![Page 1: HammerCloud Functional tests](https://reader036.fdocuments.in/reader036/viewer/2022062410/568151d6550346895dc01189/html5/thumbnails/1.jpg)
IT-SDC : Support for Distributed Computing
HammerCloud Functional tests
Valentina MancinelliIT/SDC
28/2/2014
![Page 2: HammerCloud Functional tests](https://reader036.fdocuments.in/reader036/viewer/2022062410/568151d6550346895dc01189/html5/thumbnails/2.jpg)
Title 2IT-SDC
What is HammerCloud
HammerCloud is a Distributed framework for testing distribuited system.
Frequent validation and stress testing for different resources of a grid site.
Available in three flavours (applications) for ATLAS, CMS, LHCb
Date
![Page 3: HammerCloud Functional tests](https://reader036.fdocuments.in/reader036/viewer/2022062410/568151d6550346895dc01189/html5/thumbnails/3.jpg)
Title 3IT-SDC
What is HammerCloud
The HC service is composed of: a backend which submits and monitors the
test jobs a user frontend which allows users to
schedule tests and to watch the progress of running tests or review completed tests.
Jobs are submitted and monitored using GANGA. GANGA use a plugin structure to provide interfaces for different systems
Date
![Page 4: HammerCloud Functional tests](https://reader036.fdocuments.in/reader036/viewer/2022062410/568151d6550346895dc01189/html5/thumbnails/4.jpg)
Title 4IT-SDC
Use Cases
Date
Functional (automated) testing: test configured by experts/admins, which frequently submits a few "ping" jobs. Are autoscheduled, configure once, run forever. Used for basic site validation.
![Page 5: HammerCloud Functional tests](https://reader036.fdocuments.in/reader036/viewer/2022062410/568151d6550346895dc01189/html5/thumbnails/5.jpg)
Title 5IT-SDC
Test and Templates Test: main object managed and monitored by HC, it
has a start and end time
Test template: description of a class of tests, contains all the
information needed to make the logic behind HammerCloud work
Stress test templates Functional test templates
Generating new test = create new test object from a template
Functional tests = Automatically generated from functional test templates
Date
![Page 6: HammerCloud Functional tests](https://reader036.fdocuments.in/reader036/viewer/2022062410/568151d6550346895dc01189/html5/thumbnails/6.jpg)
Title 6IT-SDC Date
Functional test
For every active functional template the HC cron Create a new test if there are none already running or scheduled
![Page 7: HammerCloud Functional tests](https://reader036.fdocuments.in/reader036/viewer/2022062410/568151d6550346895dc01189/html5/thumbnails/7.jpg)
Title 7IT-SDC
How to create a new functional template
Usually HC operators, permits can be given to users
Need to provide:1. Job template: template for a Ganga job, specify all
the parameters that don’t need to be configurable at test level Analysis job parameters Sw configurationDepends on the Ganga plugin used (backend)
2. User code: what to run (analysis, shell scripts…) can vary depending on the system on which Ganga submit
Date
![Page 8: HammerCloud Functional tests](https://reader036.fdocuments.in/reader036/viewer/2022062410/568151d6550346895dc01189/html5/thumbnails/8.jpg)
Title 8IT-SDC
Job Template example
Date
![Page 9: HammerCloud Functional tests](https://reader036.fdocuments.in/reader036/viewer/2022062410/568151d6550346895dc01189/html5/thumbnails/9.jpg)
Title 9IT-SDC
How to create a new functional template
HC Operators can create and modify Test templates from the HC GUI
Demonstration:http://hammercloud.cern.ch/
Date
![Page 10: HammerCloud Functional tests](https://reader036.fdocuments.in/reader036/viewer/2022062410/568151d6550346895dc01189/html5/thumbnails/10.jpg)
Title 10IT-SDC Date
Functional tests created automatically by the HC cron
![Page 11: HammerCloud Functional tests](https://reader036.fdocuments.in/reader036/viewer/2022062410/568151d6550346895dc01189/html5/thumbnails/11.jpg)
Title 11IT-SDC Date
TPL
DBTest configuration SitesUsercode…
Ganga Job template Ganga jobs
![Page 12: HammerCloud Functional tests](https://reader036.fdocuments.in/reader036/viewer/2022062410/568151d6550346895dc01189/html5/thumbnails/12.jpg)
Title 12IT-SDC Date
Ganga jobs
GANGA System
Jobs submission
Site
Site
Site
![Page 13: HammerCloud Functional tests](https://reader036.fdocuments.in/reader036/viewer/2022062410/568151d6550346895dc01189/html5/thumbnails/13.jpg)
Title 13IT-SDC Date
GANGA
SystemSite
Site
Site
DB- Job status- Job results- Test status
![Page 14: HammerCloud Functional tests](https://reader036.fdocuments.in/reader036/viewer/2022062410/568151d6550346895dc01189/html5/thumbnails/14.jpg)
Title 14IT-SDC Date
DB
- Job status- Job results- Test status- Test statistics
HC GUI
![Page 15: HammerCloud Functional tests](https://reader036.fdocuments.in/reader036/viewer/2022062410/568151d6550346895dc01189/html5/thumbnails/15.jpg)
Title 15IT-SDC
Statistics
Test statisticsgenerated from results of the jobs submitted by the test
Statistics from different levels of aggregationsviews created aggregating data related to different tests, developed depending on the application (ATLAS, CMS, …)
Date
![Page 16: HammerCloud Functional tests](https://reader036.fdocuments.in/reader036/viewer/2022062410/568151d6550346895dc01189/html5/thumbnails/16.jpg)
Title 16IT-SDC
Main use
ATLAS: Site functional tests (AFT/PFT used for
Site auto-exclusion ) Panda pilot development test jobs Athena Nightly Build SystemCMS: Functional tests: HC provides Job Robot
functionality for grid operators with site performances evaluation
Date
![Page 17: HammerCloud Functional tests](https://reader036.fdocuments.in/reader036/viewer/2022062410/568151d6550346895dc01189/html5/thumbnails/17.jpg)
Title 17IT-SDC
About 30 Functional tests running 40k jobs submitted every day
Date
![Page 18: HammerCloud Functional tests](https://reader036.fdocuments.in/reader036/viewer/2022062410/568151d6550346895dc01189/html5/thumbnails/18.jpg)
Title 18IT-SDC
Questions
Date
![Page 19: HammerCloud Functional tests](https://reader036.fdocuments.in/reader036/viewer/2022062410/568151d6550346895dc01189/html5/thumbnails/19.jpg)
Title 19IT-SDC
Implementation
Date
![Page 20: HammerCloud Functional tests](https://reader036.fdocuments.in/reader036/viewer/2022062410/568151d6550346895dc01189/html5/thumbnails/20.jpg)
Title 20IT-SDC
Architecture
Date
hammercloud
hc-services
volhcb29vocms3
8
Web service, internal services
dev_atlas
dev_cms
dev_lhcb
dev_core
Main databases
submission
volhcb29vocms3
8submission
Dynamic submission cluster
![Page 21: HammerCloud Functional tests](https://reader036.fdocuments.in/reader036/viewer/2022062410/568151d6550346895dc01189/html5/thumbnails/21.jpg)
Title 21IT-SDC Date