[Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit
-
Upload
applitools -
Category
Engineering
-
view
644 -
download
2
Transcript of [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit
![Page 1: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/1.jpg)
Continuous Testing at Code.org
@bcjordanBrian Jordan, software engineer at Code.org
![Page 2: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/2.jpg)
Code.org
![Page 3: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/3.jpg)
non-profit
![Page 4: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/4.jpg)
expanding participation in CS
![Page 5: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/5.jpg)
Hour of Code
![Page 6: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/6.jpg)
![Page 7: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/7.jpg)
230 million tried Hour of Code
![Page 8: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/8.jpg)
now what?
![Page 9: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/9.jpg)
full curricula, district partnerships,
professional development, policy change
![Page 10: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/10.jpg)
K-12 CS Curriculum
![Page 11: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/11.jpg)
25k K-12 teachers trained
![Page 12: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/12.jpg)
courses: 300k teachers 10mm students
![Page 13: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/13.jpg)
![Page 14: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/14.jpg)
![Page 15: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/15.jpg)
how did Code.org start automated testing?
![Page 16: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/16.jpg)
development in 2013-2014
![Page 17: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/17.jpg)
why test? what is Code.org's testing context?
![Page 18: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/18.jpg)
the context
![Page 19: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/19.jpg)
the context
![Page 20: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/20.jpg)
the context
![Page 21: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/21.jpg)
the context
![Page 22: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/22.jpg)
the context
![Page 23: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/23.jpg)
so how do we test all that?
![Page 24: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/24.jpg)
how we started Selenium testing
![Page 25: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/25.jpg)
how our tests are organized and run
selenium-webdriver cucumber
![Page 26: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/26.jpg)
![Page 27: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/27.jpg)
![Page 28: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/28.jpg)
takeaways
![Page 29: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/29.jpg)
Build a library of steps
![Page 30: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/30.jpg)
Build a library of test levels
![Page 31: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/31.jpg)
Build a library of annotations
@no_mobile@no_ie9
@skip
@db_access@as_student
@eyes
![Page 32: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/32.jpg)
who writes tests?
![Page 33: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/33.jpg)
who/what runs tests?
![Page 34: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/34.jpg)
![Page 35: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/35.jpg)
what challenges did we end up facing?
![Page 36: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/36.jpg)
challenge:multiple browsers
![Page 37: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/37.jpg)
solution:selenium-webdriver
Sauce Labs
![Page 38: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/38.jpg)
![Page 39: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/39.jpg)
![Page 40: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/40.jpg)
![Page 41: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/41.jpg)
challenge:testing new changes
![Page 42: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/42.jpg)
solution:chromedriver sauce-connect
![Page 43: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/43.jpg)
solution (soon):pull request tests in CI
![Page 44: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/44.jpg)
challenge:
interaction, drag-and-drop
![Page 45: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/45.jpg)
solution:jQuery Simulate
$(selector).drag…
![Page 46: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/46.jpg)
challenge:
visual, responsive changes
![Page 47: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/47.jpg)
hackathon solution?
![Page 48: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/48.jpg)
not easy...
![Page 49: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/49.jpg)
actual thing!
![Page 50: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/50.jpg)
using eyes
![Page 51: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/51.jpg)
converted feature
![Page 52: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/52.jpg)
![Page 53: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/53.jpg)
ignoring regions
![Page 54: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/54.jpg)
![Page 55: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/55.jpg)
![Page 56: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/56.jpg)
![Page 57: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/57.jpg)
![Page 58: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/58.jpg)
![Page 59: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/59.jpg)
what do tests look like when running?
![Page 60: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/60.jpg)
(not) wasting time
![Page 61: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/61.jpg)
speeding up test runs
![Page 62: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/62.jpg)
2014: 60-90 min of tests
![Page 63: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/63.jpg)
parallelizationat runner level
![Page 64: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/64.jpg)
2015: 60-90 min of tests
to 20-30 min of tests
![Page 65: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/65.jpg)
justifying tests
![Page 66: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/66.jpg)
the bug collection
![Page 67: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/67.jpg)
missing button
![Page 68: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/68.jpg)
duplicate button
![Page 69: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/69.jpg)
Firefox getBBox()
![Page 70: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/70.jpg)
JS % error: node build issue
![Page 71: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/71.jpg)
Chrome 50 offsetWidth
![Page 72: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/72.jpg)
my favorite bug ever
![Page 73: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/73.jpg)
![Page 74: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/74.jpg)
![Page 75: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/75.jpg)
![Page 76: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/76.jpg)
![Page 77: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/77.jpg)
who investigates failures?
what about failures pass tests?
![Page 78: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/78.jpg)
dev of the day
![Page 79: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/79.jpg)
![Page 80: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/80.jpg)
what's next?
![Page 81: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/81.jpg)
per-PR tests
![Page 82: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/82.jpg)
managing more eyes tests
![Page 83: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/83.jpg)
cross-browser responsive eyes tests
github.com/tourdedave/responsive-web-testing
![Page 84: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/84.jpg)
takeaways
![Page 85: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/85.jpg)
start small
![Page 86: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/86.jpg)
everybody tests
![Page 87: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/87.jpg)
periodically invest in speed-ups
![Page 88: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/88.jpg)
code.org/help
github.com/code-dot-org
Thanks!
@bcjordanBrian Jordan, software engineer at Code.org
![Page 89: [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit](https://reader034.fdocuments.in/reader034/viewer/2022042907/58892a4d1a28ab77528b6d17/html5/thumbnails/89.jpg)
code.org/help
github.com/code-dot-org
Thanks!
@bcjordanBrian Jordan, software engineer at Code.org