7 Keys for Unattended Test AUtomation webinar deck

5/13/2016 1© 2016, Perfecto Mobile Ltd. All Rights Reserved.

7 key recommendations for building a solid test automation suiteMay 2016

Eran KinsbrunerDirector, Tech. Evangelist

PerfectoUzi Eilon

Technology DirectorPerfecto

Daniel KnottMobile Senior Test Engineer

Xing AG

Some housekeeping before we start


Submit questions using the Q&A panel. Participate in the polls.

Watch your email for a copy of the recording and slides. Complete the survey following the presentation.

Webinar Agenda


Mobile Test Automation Challenges Strategy for defining the right digital test coverage

Practices For Robust Test AutomationThe 7 Keys for Unattended Mobile Test Automation

Live Demo!Q & A


I SAIDI WAS FINE.

I LIED.

Poll – Mobile Test Automation Challenges


Code / Test – Common Challenges

1) Execution of One script across platforms2) Automating build/deploy and acceptance testing during CI3) Test results analysis4) Object id Identification5) Does it work over time ?6) Maintenance of scripts and Objects7) Matching Dev/Testers skill set

DevOps – challenges

Tools

Reports

Flows

Time Stability

False negatives

Collaboration

The Test Coverage Conversation – What To Answer?Which Devices?Which OS Versions? How Many platforms are Enough?When Should I refresh my test lab?Who is in charge of coverage?


Mobile Test Coverage Method

Recommended OS – Usage & Quality Rationale

Usage & Quality Issues

Wi-Fi IssuesBattery Drain

Latest REF Android OS

WHY AUTOMATE?

UIIntegrationUnit Testing

Performance Security

Digital Transformation Requires Changes Around Test Automation

Target Devices TargetEnv.OSOS versionsForm factorsCPU & MemoryManufacturersWearablesIOT

NetworksOrientationLocationNotificationsEventsDevice events

Object Identification Is Key For Robust Automation


• Selenium• Appium• XCTest• UIAutomation• Perfecto

• Abby OCR• Applitools• Perfecto

Device/System Level Control is Critical

14

Assure Proper Error Handling

15

System level control Application control

Device control

3 Layers Involved In Test Automation Optimization


App• Info.Plist (iOS)• Manifest.MF (Android)

Test Cases• Define Desired Capabilities

Device• Supports Feature• Doesn’t Support

Facebook App Testing Diversity


Test Scenario iPhone 6/iPhone 5S iPhone 6S/6S Plus iPad Tablets

Login YES YES YESWrite Post (FB UI) YES YES YESWrite Post (FB Force Touch) NO YES NOUpload Photo/Video(FB UI) YES YES YESUpload Photo/Video(FB Force Touch) NO YES NOTake Photo/Video(FB UI) YES YES YESTake Photo/Video(FB Force Touch) NO YES NO

More Examples: Android Doze & Multi Window


Android 6 and AboveAndroid N and Above

Validate Feature Compliance & Test Accordingly


IOS Developer LibraryINFO.PLIST

7 Keys for Successful Unattended Automation and CI


Start small & Grow Accept that not every test enters CI Debug & Debug Again across few platforms Make your script reusable

Validate within and between the tests Plan for unexpected events Keep channel between Engineering, Ops and Biz opened

Zero Effort Automation Demo

More Example


Smart Monkey Automation


Webinar Agenda


Mobile Test Automation Challenges Strategy for defining the right digital test coverage

Practices For Robust Test AutomationThe 7 Keys for Unattended Mobile Test Automation

Live Demo!Q & A

Q & A


Special Offers to Webinar Attendees


New Whitepaper – Early Release!The Ultimate Digital Test Coverage GuideContact Eran [email protected] to get your free copy!

Thank You

7 Keys for Unattended Test AUtomation webinar deck

Technology

Transcript of 7 Keys for Unattended Test AUtomation webinar deck