Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s...
Transcript of Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s...
![Page 1: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank](https://reader034.fdocuments.in/reader034/viewer/2022042510/5aa99e397f8b9a81188d07fa/html5/thumbnails/1.jpg)
Ranorex Research Projects
28.09.2017
![Page 2: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank](https://reader034.fdocuments.in/reader034/viewer/2022042510/5aa99e397f8b9a81188d07fa/html5/thumbnails/2.jpg)
Agenda
Research @Ranorex
Docker – putting tests in a container
What’s the “smell” of my tests?
What about robustness?
![Page 3: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank](https://reader034.fdocuments.in/reader034/viewer/2022042510/5aa99e397f8b9a81188d07fa/html5/thumbnails/3.jpg)
Research @Ranorex
![Page 4: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank](https://reader034.fdocuments.in/reader034/viewer/2022042510/5aa99e397f8b9a81188d07fa/html5/thumbnails/4.jpg)
![Page 5: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank](https://reader034.fdocuments.in/reader034/viewer/2022042510/5aa99e397f8b9a81188d07fa/html5/thumbnails/5.jpg)
Research @Ranorex
• Small prototypes
• POCs
• Tool integrations
Always trying to think outside the box
![Page 6: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank](https://reader034.fdocuments.in/reader034/viewer/2022042510/5aa99e397f8b9a81188d07fa/html5/thumbnails/6.jpg)
DockerPutting tests in a container
![Page 7: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank](https://reader034.fdocuments.in/reader034/viewer/2022042510/5aa99e397f8b9a81188d07fa/html5/thumbnails/7.jpg)
Docker
Quick Intro
Anybody not familiar with docker/containers?
![Page 8: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank](https://reader034.fdocuments.in/reader034/viewer/2022042510/5aa99e397f8b9a81188d07fa/html5/thumbnails/8.jpg)
Two options
• Running Rx test in a container
• Mobile tests (POC with BitBar)
• Selenium tests
• Running SUT in container
• Web-apps
![Page 9: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank](https://reader034.fdocuments.in/reader034/viewer/2022042510/5aa99e397f8b9a81188d07fa/html5/thumbnails/9.jpg)
Limitations of Windows containers
• Native Windows apps supported by docker
Windows containers
• No GUI-apps supported yet
• No RDP (or similar) possible
It is on our radar
![Page 10: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank](https://reader034.fdocuments.in/reader034/viewer/2022042510/5aa99e397f8b9a81188d07fa/html5/thumbnails/10.jpg)
Quick Demo
• Run single web test locally
Automate Wordpress bootstrapping process
Can only be run once per WP instances
• Move to Containers
• Spawn Docker container with Ranorex
• Run test on Selenium Box
• Destroy Docker container
Multiple parallel executions possible
![Page 11: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank](https://reader034.fdocuments.in/reader034/viewer/2022042510/5aa99e397f8b9a81188d07fa/html5/thumbnails/11.jpg)
What’s the “smell” of my tests?
An add-on provided by Qualicen
![Page 12: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank](https://reader034.fdocuments.in/reader034/viewer/2022042510/5aa99e397f8b9a81188d07fa/html5/thumbnails/12.jpg)
Ranorex test meta analysis
• Based on an add-on provided by Qualicen
https://www.qualicen.de
• Analysis of
• Recording modules
• Test suite
… more to come
• Webinar planned
![Page 13: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank](https://reader034.fdocuments.in/reader034/viewer/2022042510/5aa99e397f8b9a81188d07fa/html5/thumbnails/13.jpg)
Demo
![Page 14: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank](https://reader034.fdocuments.in/reader034/viewer/2022042510/5aa99e397f8b9a81188d07fa/html5/thumbnails/14.jpg)
What about robustness?
![Page 15: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank](https://reader034.fdocuments.in/reader034/viewer/2022042510/5aa99e397f8b9a81188d07fa/html5/thumbnails/15.jpg)
How to achieve robustness?
![Page 16: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank](https://reader034.fdocuments.in/reader034/viewer/2022042510/5aa99e397f8b9a81188d07fa/html5/thumbnails/16.jpg)
Multiple selectors
• „Fuzzy“ selectors
• Structural / positional /
attribute based
• Attribute matching• String distances
• Position• In tree
• On screen
![Page 17: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank](https://reader034.fdocuments.in/reader034/viewer/2022042510/5aa99e397f8b9a81188d07fa/html5/thumbnails/17.jpg)
Element not found…
Really?
• “Element not found” errors
“Earlier” error
Screen did not change
Consider whole UI
Remember automation “path”
![Page 18: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank](https://reader034.fdocuments.in/reader034/viewer/2022042510/5aa99e397f8b9a81188d07fa/html5/thumbnails/18.jpg)
Element not found…
Dynamic ID/label?
• Feature calculation on ID
• Numbers
• String-Lengths
…
Classification with SVM/LDA/…
• ID matching regex “growing”
80-90% accuracy
![Page 19: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank](https://reader034.fdocuments.in/reader034/viewer/2022042510/5aa99e397f8b9a81188d07fa/html5/thumbnails/19.jpg)
@github
![Page 20: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank](https://reader034.fdocuments.in/reader034/viewer/2022042510/5aa99e397f8b9a81188d07fa/html5/thumbnails/20.jpg)
Things available @github
• Ranorex github repository
http://www.github.com/ranorex
• “Private” repo with Ranorex-projects
http://www.github.com/cbreit
… unofficial
![Page 21: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank](https://reader034.fdocuments.in/reader034/viewer/2022042510/5aa99e397f8b9a81188d07fa/html5/thumbnails/21.jpg)
A few more things
![Page 22: Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s the “smell” of my tests? What about robustness? ... •JMeter/Gatling integration. Thank](https://reader034.fdocuments.in/reader034/viewer/2022042510/5aa99e397f8b9a81188d07fa/html5/thumbnails/22.jpg)
Other experiments
• Centralized reporting
• Elasticsearch connection
• Appium
• JMeter/Gatling integration