Post on 13-Apr-2017
Emerging trends in test automation
I AM SRIRAM ANGAJALA – Eurostar Trains
I am here because I love AUTOMATION since 2003. Worked in Silk Test, Winrunner, QTP, Selenium RC….
Find me at “sriram.angajala” in Linkedin
3
I have a Question?
4
What Percentage of the tests are Automated in
your Company?X%
5
Similar conversation happened.
QA from Eurostar and QA from other company
6
“7
“8
“9
“10
“11
“12
“13
“14
“15
“16
“17
“18
“19
“20
What more can be automated apart from functional tests, load , Api???
Visual Automated Tests
Look and Feel across browsers, devices and
responsiveness - Automation.
Mock – the – Services – Test
Run automated tests while mocking the
services – and test every edge case.
Dev ops Automation(CI,CD)
Run automated test on every merge of code.
21
. Visual Regression Testing
If it doesn't break any functionality, but doesn't look the way it should, then that's a visual regression
22
Then Visual Regression testing … is taking the screen shots for every page and compare them with past...
Many of companies does this..
23
Then Visual Regression testing … is taking the screen shots for every page and compare them with past...
NO
Many of companies does this..
24
What to look in Visual Automated Tool ⬞ Adds extra pairs of eyes to our existing
tests⬞ Fit into BDD along with functional steps⬞ Focus on specific elements only – not on
dynamic content and take screen shots against baseline
⬞ Capable of fine tuning the results⬞ Run across browsers and mobile devices
25
What to look in Visual Automated Tool ▪ Feature: Eurostar’s direct Train’s Pages
⬞ Scenario: Traveller can buy a tickets through new responsive website
Given a Traveller is in the new booking magnetWhen he go to travel to “Paris” pageThen the user experience looks as expected on booking magnet sectionWhen he continues his bookingThen the print at home tickets looks great with new design and qr code is readable
26
Tools – Fits BDD ▪ PhantomCSS▪ Applitools – not open source▪ Webdrivercss – Works with
Webdriver.IO▪ Galen Framework
27
DEMO – How it works▪ WebdriverCSS▪ Mocha▪ Webdriver-Admin-Panel – Reports
▪ Meetup – Sriram Angajala – East london testers
28
Mock Services
our office
29
How Mock Services works
our office
30
What to look in mock service Automation▪ Feature: Loyal customer books tickets
⬞ Scenarios: Traveller with Loyalty card books ticketsGiven traveller selects his travel details with last name “lewis”Then his loyalty card shows 10000 points balanceWhen he buys ticket and current points add to loyaltyThen he can get 30% discount in his travel costAnd the loyalty system responds SYSTEM ERRORThen user receives a warning and can continue his booking
31
How to mockIntegrate mock service
tools to automation framework.
Java – Cucumber – Selenium - Wiremock
Set predefined rules and response
Eg. Always respond with 200
Filter Responses based in Requests.
Eg. If user name is “Lewis” then respond
with 10000 points
32
Error scenario simulation and
edgecase.Eg. If the user is
“lewis” fail a specific response with 400
Record and playback the real
requests and responses
System under tests is now fully tested
Tools– Wiremock – Used in Eurostar– Apiary– Mockable.IO– Soap UI– Charles
– Meet up – East london testers
33
Advantages of MockingReduce cost by not hitting external apiMinimize the downtime from external systems Emulated test conditions which cannot be tested in real services – Network down Emulate network delays and test how the system reactsDevelop Front end with out the apis. For POC etc
34
Continuous Integration – Deployment – Devops Automation Testing
Automation can help to make deployments faster by adding quality gates in GIT Flow – Tests - Part of Development Build
Test Automation should be embedded into Dev-ops automation process to enable Trash and Rebuild environment – Run Tests- Provide confidence on deployments
35
36
Future
▪Gesture controls▪Record play back SDK plugins for
mobile apps ▪Script less testing
▪Cucumber Pro
37
Summary / Conclusion
ConclusionAutomation tests can be extended
beyond what we think1. Visual testing2. Mock Services3. Dev-ops Automation4. And More…
Q&A Session
Questions
Thank You !
THANK YOU ALL!Search for “Sriram Angajala”