Automated Testing: Saving time and money
-
Upload
blayn-parkinson -
Category
Education
-
view
114 -
download
0
Transcript of Automated Testing: Saving time and money
![Page 1: Automated Testing: Saving time and money](https://reader036.fdocuments.in/reader036/viewer/2022062522/589bc6901a28ab082b8b62ed/html5/thumbnails/1.jpg)
Automated TestingSaving Time & MoneyBlayn ParkinsonE-Learning & training Support AssistantUniversity of York (UK)
![Page 2: Automated Testing: Saving time and money](https://reader036.fdocuments.in/reader036/viewer/2022062522/589bc6901a28ab082b8b62ed/html5/thumbnails/2.jpg)
ABOUT ME
Blayn ParkinsonE-Learning & training Support AssistantUniversity of York (UK)[email protected]
I have used Blackboard for 3 years.
![Page 3: Automated Testing: Saving time and money](https://reader036.fdocuments.in/reader036/viewer/2022062522/589bc6901a28ab082b8b62ed/html5/thumbnails/3.jpg)
ABOUT MY INSTITUTION
University of York
15,330 Students
Using Blackboard since 2005.
Central e-Learning team 6 members (some departments have their own provision)
![Page 4: Automated Testing: Saving time and money](https://reader036.fdocuments.in/reader036/viewer/2022062522/589bc6901a28ab082b8b62ed/html5/thumbnails/4.jpg)
WHAT WE ARE GOING TO LEARN TODAY
• The benefits of using automated testing strategies.
• Limits to automated testing
• Suggestions on future collaboration in this area
![Page 5: Automated Testing: Saving time and money](https://reader036.fdocuments.in/reader036/viewer/2022062522/589bc6901a28ab082b8b62ed/html5/thumbnails/5.jpg)
OUR CHALLENGE
Thorough testing cycle each (software not deployed without testing).3 months: April – June (One window a year to achieve this).
• Lack of agility in responding to new releases, due to the testing time that we need to devote to a release.
• Needed to lock in to a release at a particular time.• Spread the load across the team in terms of manual testing.
![Page 6: Automated Testing: Saving time and money](https://reader036.fdocuments.in/reader036/viewer/2022062522/589bc6901a28ab082b8b62ed/html5/thumbnails/6.jpg)
OUR CHALLENGE
Functional testing • is necessary• is time consuming• can be ambiguous
Thorough testing cycle each (software not deployed without testing).3 months: April – June (One window a year to achieve this).
• Lack of agility in responding to new releases, due to the testing time that we need to devote to a release.
• Needed to lock in to a release at a particular time.• Spread the load across the team in terms of manual testing.
![Page 7: Automated Testing: Saving time and money](https://reader036.fdocuments.in/reader036/viewer/2022062522/589bc6901a28ab082b8b62ed/html5/thumbnails/7.jpg)
OUR CHALLENGE
Functional testing • is necessary• is time consuming• can be ambiguous
Automated testing is• consistent• easily repeatable• reusable
Thorough testing cycle each (software not deployed without testing).3 months: April – June (One window a year to achieve this).
• Lack of agility in responding to new releases, due to the testing time that we need to devote to a release.
• Needed to lock in to a release at a particular time.• Spread the load across the team in terms of manual testing.
![Page 8: Automated Testing: Saving time and money](https://reader036.fdocuments.in/reader036/viewer/2022062522/589bc6901a28ab082b8b62ed/html5/thumbnails/8.jpg)
ORGANISING TESTS
![Page 9: Automated Testing: Saving time and money](https://reader036.fdocuments.in/reader036/viewer/2022062522/589bc6901a28ab082b8b62ed/html5/thumbnails/9.jpg)
RECORDING SCRIPTS
Tests
Command
Target (Locator)
Value
Speed
![Page 10: Automated Testing: Saving time and money](https://reader036.fdocuments.in/reader036/viewer/2022062522/589bc6901a28ab082b8b62ed/html5/thumbnails/10.jpg)
EXAMPLE SCRIPT
2_LoginTestStudentAccount
open https://vle.york.ac.uk/webapps/login/?action=relogin
type id=user_id studtesta
type id=password ********
clickAndWait css=input[name="login"]
![Page 11: Automated Testing: Saving time and money](https://reader036.fdocuments.in/reader036/viewer/2022062522/589bc6901a28ab082b8b62ed/html5/thumbnails/11.jpg)
TEST MANAGER
![Page 12: Automated Testing: Saving time and money](https://reader036.fdocuments.in/reader036/viewer/2022062522/589bc6901a28ab082b8b62ed/html5/thumbnails/12.jpg)
TEST MANAGER
![Page 13: Automated Testing: Saving time and money](https://reader036.fdocuments.in/reader036/viewer/2022062522/589bc6901a28ab082b8b62ed/html5/thumbnails/13.jpg)
CONSTRUCTING GOOD TESTS
▪ A good test– Mirror user behaviour– Independent– Report accurately
▪ HTML present?▪ Text present?▪ Screenshot
![Page 14: Automated Testing: Saving time and money](https://reader036.fdocuments.in/reader036/viewer/2022062522/589bc6901a28ab082b8b62ed/html5/thumbnails/14.jpg)
SOURCE CONTROL
TEST SCRIPT (A1.3) ADD BLOG POST (ROLE STUDENT)
BLOCK 1 Login as test student
BLOCK 2 Navigate to the test course site
BLOCK 3 Navigate the left hand menu to access the blog tool
NEW SCRIPT Enter the blog and click the Add New Entry button
BLOCK 4 Add content to the content editor
BLOCK 5 Click the submit button
BLOCK 6 Take a screenshot for human inspection/verification
NEW SCRIPT Verify text on the page is present
BLOCK 7 Logout of the VLE
![Page 15: Automated Testing: Saving time and money](https://reader036.fdocuments.in/reader036/viewer/2022062522/589bc6901a28ab082b8b62ed/html5/thumbnails/15.jpg)
RUNNING THE PROCESS
Pass
Pass pending check
Fail
Test Script IDExecute
Test Suite
Test Results Web Service
Test Manager Results
![Page 16: Automated Testing: Saving time and money](https://reader036.fdocuments.in/reader036/viewer/2022062522/589bc6901a28ab082b8b62ed/html5/thumbnails/16.jpg)
TEST CASES & RUNS
Case = Browser/Platform combination
Run = Results against a particular case
![Page 17: Automated Testing: Saving time and money](https://reader036.fdocuments.in/reader036/viewer/2022062522/589bc6901a28ab082b8b62ed/html5/thumbnails/17.jpg)
TEST RESULTS
![Page 18: Automated Testing: Saving time and money](https://reader036.fdocuments.in/reader036/viewer/2022062522/589bc6901a28ab082b8b62ed/html5/thumbnails/18.jpg)
PROS AND CONS
Saved time Maintenance burden
Reusable Human intervention
![Page 19: Automated Testing: Saving time and money](https://reader036.fdocuments.in/reader036/viewer/2022062522/589bc6901a28ab082b8b62ed/html5/thumbnails/19.jpg)
TAKING THIS FORWARD
• Automate more• Maintenance• Continuous testing• Load testing• Blackboard client assisted testing?
![Page 20: Automated Testing: Saving time and money](https://reader036.fdocuments.in/reader036/viewer/2022062522/589bc6901a28ab082b8b62ed/html5/thumbnails/20.jpg)
OUR RESULTS
• 50% of tests automated (from 2013 testing cycle)
• 2014 Upgrade locking into SP16
• How much maintenance is needed, BB switch from iframe’s to HTML5 will impact on this.
• Can we extend the current % of automated tests
• Review this summer of complete process
![Page 21: Automated Testing: Saving time and money](https://reader036.fdocuments.in/reader036/viewer/2022062522/589bc6901a28ab082b8b62ed/html5/thumbnails/21.jpg)
DO THIS NEXT
Think about how the adoption of automated testing processes might benefit your institution.
Jointly (with Blackboard) could we come up with a solution to better help the testing processes within our own institutions.
![Page 22: Automated Testing: Saving time and money](https://reader036.fdocuments.in/reader036/viewer/2022062522/589bc6901a28ab082b8b62ed/html5/thumbnails/22.jpg)
THANK YOU!
Blayn ParkinsonE-Learning & training Support AssistantUniversity of York (UK)[email protected]