Vienna Mobile Quality Crew Auf die Plätze, Fertig, …...Vienna Mobile Quality Crew Auf die...

36
1 16. Mai 2014 Customer Visual Best Practices in Mobile App Testing Daniel Knott | @dnlkntt Vienna Mobile Quality Crew Auf die Plätze, Fertig, APP!

Transcript of Vienna Mobile Quality Crew Auf die Plätze, Fertig, …...Vienna Mobile Quality Crew Auf die...

Page 1: Vienna Mobile Quality Crew Auf die Plätze, Fertig, …...Vienna Mobile Quality Crew Auf die Plätze, Fertig, APP! Who am I ? • Daniel Knott • Software Test Manager @AOE • Mobile

1 16 Mai 2014

Customer Visual

Best Practices in Mobile App Testing

Daniel Knott | dnlkntt

Vienna Mobile Quality Crew

Auf die Plaumltze Fertig APP

Who am I

bull Daniel Knott

bull Software Test Manager AOE

bull Mobile Testing since the end of 2010

bull Before AOE Team Lead QA XING Mobile Team

bull Blogger and Speaker

httpwwwadventuresinqacom

dnlkntt

httpwwwlinkedincompubdaniel-knott1a925993

httpswwwxingcomprofileDaniel_Knott

3 16 Mai 2014

I Company Profile

Intro

Current Status Mobile Challenges

The Customer

Mobile Specific

Testing

Security

Tools

5 16 Mai 2014

I Current Status

Author Barry Caruth httpswwwflickrcomphotoscaruth8401943928

Current Status | Some Numbers

2+ millions apps available

100+ billion downloads

80 ndash 90 of apps are deleted after the first usage

56 of apps that requires a registration gets deleted

Average user checks device 150 times per day

45 are not well tested

7 16 Mai 2014

I Mobile Challenges

Mobile Challenges | All known

httpopensignalcomreportsfragmentation-2013

Mobile Challenges | All known

httpopensignalcomreportsfragmentation-2013

Mobile Challenges | How to handle fragmentation

Group your devices A B C

Test only on those devices

Test on real device

Donrsquot use simulators or emulators

Know the target group

Mobile Challenges | How to handle fragmentation

Group 1 Prio A

bull High End

Devices

bull Dual Quad Core

CPU

bull RAM gt1024MB

bull Retina Full HD

Display gt 45ldquo

Group 2 Prio B

bull Mid-range

devices

bull Dual Core CPU

bull RAM lt1024MB

bull Screen size lt 4ldquo

bull Software not

older than 1 year

Group 3 Prio C

bull Small devices

bull Single Core

bull RAM lt 512MB

bull Low screen size

and resolution

bull Older OS older

browser

Based on your target group

Author Davide Vizzini Limbte httpwwwflickrcomphotoslimbte4007115435

Mobile Challenges | Morehellip

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

13 16 Mai 2014

I The Customer

Author Michael Newman httpswwwflickrcomphotosmzn371226016289

The Customer | Better know them

Know the target group

Talk to your customer

Will downsize testing effort

Do usability testing with them

Invite them to a beta testing program (Sonos FB

Twitter)

Author Grzegorz Lobinski httpwwwflickrcomphotosgregloby3515990945

15 16 Mai 2014

I Mobile Specific Testing

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Known functional testing is still required

bull Boundary values

bull Equivalence classes

bull Testing against acceptance criteria

Test the app as black box

bull Try to break it

bull Be creative and think in edge cases

Mobile Specific Testing

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Ian Britton httpwwwflickrcomphotosfreefoto728651045

Author Moyan Brenn httpswwwflickrcomphotosaigle_dore5626341059

Author Doug88888 httpwwwflickrcomphotosdoug888887149187135

Author Dan Levy httpwwwflickrcomphotosdanlevy5607259711

Mobile Specific Testing

Author amateur_photo_bore httpwwwflickrcomphotosandresv233667770

Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

Author Daniel Sancho httpwwwflickrcomphotosteclasorg2852716491

Mobile Specific Testing

Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4311105154 Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4464587302

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Android

bull JouleUnit to measure battery usage

bull Monkey to stress test the app

iOS

bull Energy Usage in Instruments

bull UI AutoMonkey to stress test the app

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

23 16 Mai 2014

I Tools

Author OZinOH httpwwwflickrcomphotos75905404N007126147125

Tools

Do test automation

Start simple and discover different tools

Donrsquot buy huge test automation tools

No tool is perfect

See which tool fits in your development environment

Tools | Android

Robotium (ExtSolo)

Selendroid

Spoon

Calabash for Android

Robolectric

Espresso

Monkey

Great mobile tools provided by the company square httpsquaregithubio

MonkeyTalk

Appium

Tools | iOS

UIAutomation

MonkeyTalk

Keep It Functional

Calabash for iOS

ios-driver

Kiwi

XCTest

Appium

27 16 Mai 2014

I Security

Author Alexandre Dulaunoy httpwwwflickrcomphotosadulau7712545428

Security

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244 Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Security

Security testing is not easy

Get help from experts

Check the OWASP mobile security page

httpswwwowasporgindexphpOWASP_Mobile_

Security_Project

Think twice about app permissions

30 16 Mai 2014

I Summary

Mobile Specific Testing | Summary

Combine your in house testing with crowd testing

Be up to date Know your target group

Keep the mobile features in mind

Do test automation and know the right tools

Do security testing

Be creative and on the move while testing mobile apps

Questions

Thank you for your attention

httpwwwadventuresinqacom

33 16 Mai 2014

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 2: Vienna Mobile Quality Crew Auf die Plätze, Fertig, …...Vienna Mobile Quality Crew Auf die Plätze, Fertig, APP! Who am I ? • Daniel Knott • Software Test Manager @AOE • Mobile

Who am I

bull Daniel Knott

bull Software Test Manager AOE

bull Mobile Testing since the end of 2010

bull Before AOE Team Lead QA XING Mobile Team

bull Blogger and Speaker

httpwwwadventuresinqacom

dnlkntt

httpwwwlinkedincompubdaniel-knott1a925993

httpswwwxingcomprofileDaniel_Knott

3 16 Mai 2014

I Company Profile

Intro

Current Status Mobile Challenges

The Customer

Mobile Specific

Testing

Security

Tools

5 16 Mai 2014

I Current Status

Author Barry Caruth httpswwwflickrcomphotoscaruth8401943928

Current Status | Some Numbers

2+ millions apps available

100+ billion downloads

80 ndash 90 of apps are deleted after the first usage

56 of apps that requires a registration gets deleted

Average user checks device 150 times per day

45 are not well tested

7 16 Mai 2014

I Mobile Challenges

Mobile Challenges | All known

httpopensignalcomreportsfragmentation-2013

Mobile Challenges | All known

httpopensignalcomreportsfragmentation-2013

Mobile Challenges | How to handle fragmentation

Group your devices A B C

Test only on those devices

Test on real device

Donrsquot use simulators or emulators

Know the target group

Mobile Challenges | How to handle fragmentation

Group 1 Prio A

bull High End

Devices

bull Dual Quad Core

CPU

bull RAM gt1024MB

bull Retina Full HD

Display gt 45ldquo

Group 2 Prio B

bull Mid-range

devices

bull Dual Core CPU

bull RAM lt1024MB

bull Screen size lt 4ldquo

bull Software not

older than 1 year

Group 3 Prio C

bull Small devices

bull Single Core

bull RAM lt 512MB

bull Low screen size

and resolution

bull Older OS older

browser

Based on your target group

Author Davide Vizzini Limbte httpwwwflickrcomphotoslimbte4007115435

Mobile Challenges | Morehellip

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

13 16 Mai 2014

I The Customer

Author Michael Newman httpswwwflickrcomphotosmzn371226016289

The Customer | Better know them

Know the target group

Talk to your customer

Will downsize testing effort

Do usability testing with them

Invite them to a beta testing program (Sonos FB

Twitter)

Author Grzegorz Lobinski httpwwwflickrcomphotosgregloby3515990945

15 16 Mai 2014

I Mobile Specific Testing

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Known functional testing is still required

bull Boundary values

bull Equivalence classes

bull Testing against acceptance criteria

Test the app as black box

bull Try to break it

bull Be creative and think in edge cases

Mobile Specific Testing

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Ian Britton httpwwwflickrcomphotosfreefoto728651045

Author Moyan Brenn httpswwwflickrcomphotosaigle_dore5626341059

Author Doug88888 httpwwwflickrcomphotosdoug888887149187135

Author Dan Levy httpwwwflickrcomphotosdanlevy5607259711

Mobile Specific Testing

Author amateur_photo_bore httpwwwflickrcomphotosandresv233667770

Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

Author Daniel Sancho httpwwwflickrcomphotosteclasorg2852716491

Mobile Specific Testing

Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4311105154 Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4464587302

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Android

bull JouleUnit to measure battery usage

bull Monkey to stress test the app

iOS

bull Energy Usage in Instruments

bull UI AutoMonkey to stress test the app

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

23 16 Mai 2014

I Tools

Author OZinOH httpwwwflickrcomphotos75905404N007126147125

Tools

Do test automation

Start simple and discover different tools

Donrsquot buy huge test automation tools

No tool is perfect

See which tool fits in your development environment

Tools | Android

Robotium (ExtSolo)

Selendroid

Spoon

Calabash for Android

Robolectric

Espresso

Monkey

Great mobile tools provided by the company square httpsquaregithubio

MonkeyTalk

Appium

Tools | iOS

UIAutomation

MonkeyTalk

Keep It Functional

Calabash for iOS

ios-driver

Kiwi

XCTest

Appium

27 16 Mai 2014

I Security

Author Alexandre Dulaunoy httpwwwflickrcomphotosadulau7712545428

Security

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244 Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Security

Security testing is not easy

Get help from experts

Check the OWASP mobile security page

httpswwwowasporgindexphpOWASP_Mobile_

Security_Project

Think twice about app permissions

30 16 Mai 2014

I Summary

Mobile Specific Testing | Summary

Combine your in house testing with crowd testing

Be up to date Know your target group

Keep the mobile features in mind

Do test automation and know the right tools

Do security testing

Be creative and on the move while testing mobile apps

Questions

Thank you for your attention

httpwwwadventuresinqacom

33 16 Mai 2014

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 3: Vienna Mobile Quality Crew Auf die Plätze, Fertig, …...Vienna Mobile Quality Crew Auf die Plätze, Fertig, APP! Who am I ? • Daniel Knott • Software Test Manager @AOE • Mobile

3 16 Mai 2014

I Company Profile

Intro

Current Status Mobile Challenges

The Customer

Mobile Specific

Testing

Security

Tools

5 16 Mai 2014

I Current Status

Author Barry Caruth httpswwwflickrcomphotoscaruth8401943928

Current Status | Some Numbers

2+ millions apps available

100+ billion downloads

80 ndash 90 of apps are deleted after the first usage

56 of apps that requires a registration gets deleted

Average user checks device 150 times per day

45 are not well tested

7 16 Mai 2014

I Mobile Challenges

Mobile Challenges | All known

httpopensignalcomreportsfragmentation-2013

Mobile Challenges | All known

httpopensignalcomreportsfragmentation-2013

Mobile Challenges | How to handle fragmentation

Group your devices A B C

Test only on those devices

Test on real device

Donrsquot use simulators or emulators

Know the target group

Mobile Challenges | How to handle fragmentation

Group 1 Prio A

bull High End

Devices

bull Dual Quad Core

CPU

bull RAM gt1024MB

bull Retina Full HD

Display gt 45ldquo

Group 2 Prio B

bull Mid-range

devices

bull Dual Core CPU

bull RAM lt1024MB

bull Screen size lt 4ldquo

bull Software not

older than 1 year

Group 3 Prio C

bull Small devices

bull Single Core

bull RAM lt 512MB

bull Low screen size

and resolution

bull Older OS older

browser

Based on your target group

Author Davide Vizzini Limbte httpwwwflickrcomphotoslimbte4007115435

Mobile Challenges | Morehellip

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

13 16 Mai 2014

I The Customer

Author Michael Newman httpswwwflickrcomphotosmzn371226016289

The Customer | Better know them

Know the target group

Talk to your customer

Will downsize testing effort

Do usability testing with them

Invite them to a beta testing program (Sonos FB

Twitter)

Author Grzegorz Lobinski httpwwwflickrcomphotosgregloby3515990945

15 16 Mai 2014

I Mobile Specific Testing

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Known functional testing is still required

bull Boundary values

bull Equivalence classes

bull Testing against acceptance criteria

Test the app as black box

bull Try to break it

bull Be creative and think in edge cases

Mobile Specific Testing

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Ian Britton httpwwwflickrcomphotosfreefoto728651045

Author Moyan Brenn httpswwwflickrcomphotosaigle_dore5626341059

Author Doug88888 httpwwwflickrcomphotosdoug888887149187135

Author Dan Levy httpwwwflickrcomphotosdanlevy5607259711

Mobile Specific Testing

Author amateur_photo_bore httpwwwflickrcomphotosandresv233667770

Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

Author Daniel Sancho httpwwwflickrcomphotosteclasorg2852716491

Mobile Specific Testing

Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4311105154 Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4464587302

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Android

bull JouleUnit to measure battery usage

bull Monkey to stress test the app

iOS

bull Energy Usage in Instruments

bull UI AutoMonkey to stress test the app

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

23 16 Mai 2014

I Tools

Author OZinOH httpwwwflickrcomphotos75905404N007126147125

Tools

Do test automation

Start simple and discover different tools

Donrsquot buy huge test automation tools

No tool is perfect

See which tool fits in your development environment

Tools | Android

Robotium (ExtSolo)

Selendroid

Spoon

Calabash for Android

Robolectric

Espresso

Monkey

Great mobile tools provided by the company square httpsquaregithubio

MonkeyTalk

Appium

Tools | iOS

UIAutomation

MonkeyTalk

Keep It Functional

Calabash for iOS

ios-driver

Kiwi

XCTest

Appium

27 16 Mai 2014

I Security

Author Alexandre Dulaunoy httpwwwflickrcomphotosadulau7712545428

Security

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244 Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Security

Security testing is not easy

Get help from experts

Check the OWASP mobile security page

httpswwwowasporgindexphpOWASP_Mobile_

Security_Project

Think twice about app permissions

30 16 Mai 2014

I Summary

Mobile Specific Testing | Summary

Combine your in house testing with crowd testing

Be up to date Know your target group

Keep the mobile features in mind

Do test automation and know the right tools

Do security testing

Be creative and on the move while testing mobile apps

Questions

Thank you for your attention

httpwwwadventuresinqacom

33 16 Mai 2014

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 4: Vienna Mobile Quality Crew Auf die Plätze, Fertig, …...Vienna Mobile Quality Crew Auf die Plätze, Fertig, APP! Who am I ? • Daniel Knott • Software Test Manager @AOE • Mobile

Intro

Current Status Mobile Challenges

The Customer

Mobile Specific

Testing

Security

Tools

5 16 Mai 2014

I Current Status

Author Barry Caruth httpswwwflickrcomphotoscaruth8401943928

Current Status | Some Numbers

2+ millions apps available

100+ billion downloads

80 ndash 90 of apps are deleted after the first usage

56 of apps that requires a registration gets deleted

Average user checks device 150 times per day

45 are not well tested

7 16 Mai 2014

I Mobile Challenges

Mobile Challenges | All known

httpopensignalcomreportsfragmentation-2013

Mobile Challenges | All known

httpopensignalcomreportsfragmentation-2013

Mobile Challenges | How to handle fragmentation

Group your devices A B C

Test only on those devices

Test on real device

Donrsquot use simulators or emulators

Know the target group

Mobile Challenges | How to handle fragmentation

Group 1 Prio A

bull High End

Devices

bull Dual Quad Core

CPU

bull RAM gt1024MB

bull Retina Full HD

Display gt 45ldquo

Group 2 Prio B

bull Mid-range

devices

bull Dual Core CPU

bull RAM lt1024MB

bull Screen size lt 4ldquo

bull Software not

older than 1 year

Group 3 Prio C

bull Small devices

bull Single Core

bull RAM lt 512MB

bull Low screen size

and resolution

bull Older OS older

browser

Based on your target group

Author Davide Vizzini Limbte httpwwwflickrcomphotoslimbte4007115435

Mobile Challenges | Morehellip

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

13 16 Mai 2014

I The Customer

Author Michael Newman httpswwwflickrcomphotosmzn371226016289

The Customer | Better know them

Know the target group

Talk to your customer

Will downsize testing effort

Do usability testing with them

Invite them to a beta testing program (Sonos FB

Twitter)

Author Grzegorz Lobinski httpwwwflickrcomphotosgregloby3515990945

15 16 Mai 2014

I Mobile Specific Testing

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Known functional testing is still required

bull Boundary values

bull Equivalence classes

bull Testing against acceptance criteria

Test the app as black box

bull Try to break it

bull Be creative and think in edge cases

Mobile Specific Testing

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Ian Britton httpwwwflickrcomphotosfreefoto728651045

Author Moyan Brenn httpswwwflickrcomphotosaigle_dore5626341059

Author Doug88888 httpwwwflickrcomphotosdoug888887149187135

Author Dan Levy httpwwwflickrcomphotosdanlevy5607259711

Mobile Specific Testing

Author amateur_photo_bore httpwwwflickrcomphotosandresv233667770

Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

Author Daniel Sancho httpwwwflickrcomphotosteclasorg2852716491

Mobile Specific Testing

Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4311105154 Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4464587302

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Android

bull JouleUnit to measure battery usage

bull Monkey to stress test the app

iOS

bull Energy Usage in Instruments

bull UI AutoMonkey to stress test the app

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

23 16 Mai 2014

I Tools

Author OZinOH httpwwwflickrcomphotos75905404N007126147125

Tools

Do test automation

Start simple and discover different tools

Donrsquot buy huge test automation tools

No tool is perfect

See which tool fits in your development environment

Tools | Android

Robotium (ExtSolo)

Selendroid

Spoon

Calabash for Android

Robolectric

Espresso

Monkey

Great mobile tools provided by the company square httpsquaregithubio

MonkeyTalk

Appium

Tools | iOS

UIAutomation

MonkeyTalk

Keep It Functional

Calabash for iOS

ios-driver

Kiwi

XCTest

Appium

27 16 Mai 2014

I Security

Author Alexandre Dulaunoy httpwwwflickrcomphotosadulau7712545428

Security

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244 Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Security

Security testing is not easy

Get help from experts

Check the OWASP mobile security page

httpswwwowasporgindexphpOWASP_Mobile_

Security_Project

Think twice about app permissions

30 16 Mai 2014

I Summary

Mobile Specific Testing | Summary

Combine your in house testing with crowd testing

Be up to date Know your target group

Keep the mobile features in mind

Do test automation and know the right tools

Do security testing

Be creative and on the move while testing mobile apps

Questions

Thank you for your attention

httpwwwadventuresinqacom

33 16 Mai 2014

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 5: Vienna Mobile Quality Crew Auf die Plätze, Fertig, …...Vienna Mobile Quality Crew Auf die Plätze, Fertig, APP! Who am I ? • Daniel Knott • Software Test Manager @AOE • Mobile

5 16 Mai 2014

I Current Status

Author Barry Caruth httpswwwflickrcomphotoscaruth8401943928

Current Status | Some Numbers

2+ millions apps available

100+ billion downloads

80 ndash 90 of apps are deleted after the first usage

56 of apps that requires a registration gets deleted

Average user checks device 150 times per day

45 are not well tested

7 16 Mai 2014

I Mobile Challenges

Mobile Challenges | All known

httpopensignalcomreportsfragmentation-2013

Mobile Challenges | All known

httpopensignalcomreportsfragmentation-2013

Mobile Challenges | How to handle fragmentation

Group your devices A B C

Test only on those devices

Test on real device

Donrsquot use simulators or emulators

Know the target group

Mobile Challenges | How to handle fragmentation

Group 1 Prio A

bull High End

Devices

bull Dual Quad Core

CPU

bull RAM gt1024MB

bull Retina Full HD

Display gt 45ldquo

Group 2 Prio B

bull Mid-range

devices

bull Dual Core CPU

bull RAM lt1024MB

bull Screen size lt 4ldquo

bull Software not

older than 1 year

Group 3 Prio C

bull Small devices

bull Single Core

bull RAM lt 512MB

bull Low screen size

and resolution

bull Older OS older

browser

Based on your target group

Author Davide Vizzini Limbte httpwwwflickrcomphotoslimbte4007115435

Mobile Challenges | Morehellip

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

13 16 Mai 2014

I The Customer

Author Michael Newman httpswwwflickrcomphotosmzn371226016289

The Customer | Better know them

Know the target group

Talk to your customer

Will downsize testing effort

Do usability testing with them

Invite them to a beta testing program (Sonos FB

Twitter)

Author Grzegorz Lobinski httpwwwflickrcomphotosgregloby3515990945

15 16 Mai 2014

I Mobile Specific Testing

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Known functional testing is still required

bull Boundary values

bull Equivalence classes

bull Testing against acceptance criteria

Test the app as black box

bull Try to break it

bull Be creative and think in edge cases

Mobile Specific Testing

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Ian Britton httpwwwflickrcomphotosfreefoto728651045

Author Moyan Brenn httpswwwflickrcomphotosaigle_dore5626341059

Author Doug88888 httpwwwflickrcomphotosdoug888887149187135

Author Dan Levy httpwwwflickrcomphotosdanlevy5607259711

Mobile Specific Testing

Author amateur_photo_bore httpwwwflickrcomphotosandresv233667770

Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

Author Daniel Sancho httpwwwflickrcomphotosteclasorg2852716491

Mobile Specific Testing

Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4311105154 Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4464587302

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Android

bull JouleUnit to measure battery usage

bull Monkey to stress test the app

iOS

bull Energy Usage in Instruments

bull UI AutoMonkey to stress test the app

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

23 16 Mai 2014

I Tools

Author OZinOH httpwwwflickrcomphotos75905404N007126147125

Tools

Do test automation

Start simple and discover different tools

Donrsquot buy huge test automation tools

No tool is perfect

See which tool fits in your development environment

Tools | Android

Robotium (ExtSolo)

Selendroid

Spoon

Calabash for Android

Robolectric

Espresso

Monkey

Great mobile tools provided by the company square httpsquaregithubio

MonkeyTalk

Appium

Tools | iOS

UIAutomation

MonkeyTalk

Keep It Functional

Calabash for iOS

ios-driver

Kiwi

XCTest

Appium

27 16 Mai 2014

I Security

Author Alexandre Dulaunoy httpwwwflickrcomphotosadulau7712545428

Security

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244 Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Security

Security testing is not easy

Get help from experts

Check the OWASP mobile security page

httpswwwowasporgindexphpOWASP_Mobile_

Security_Project

Think twice about app permissions

30 16 Mai 2014

I Summary

Mobile Specific Testing | Summary

Combine your in house testing with crowd testing

Be up to date Know your target group

Keep the mobile features in mind

Do test automation and know the right tools

Do security testing

Be creative and on the move while testing mobile apps

Questions

Thank you for your attention

httpwwwadventuresinqacom

33 16 Mai 2014

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 6: Vienna Mobile Quality Crew Auf die Plätze, Fertig, …...Vienna Mobile Quality Crew Auf die Plätze, Fertig, APP! Who am I ? • Daniel Knott • Software Test Manager @AOE • Mobile

Current Status | Some Numbers

2+ millions apps available

100+ billion downloads

80 ndash 90 of apps are deleted after the first usage

56 of apps that requires a registration gets deleted

Average user checks device 150 times per day

45 are not well tested

7 16 Mai 2014

I Mobile Challenges

Mobile Challenges | All known

httpopensignalcomreportsfragmentation-2013

Mobile Challenges | All known

httpopensignalcomreportsfragmentation-2013

Mobile Challenges | How to handle fragmentation

Group your devices A B C

Test only on those devices

Test on real device

Donrsquot use simulators or emulators

Know the target group

Mobile Challenges | How to handle fragmentation

Group 1 Prio A

bull High End

Devices

bull Dual Quad Core

CPU

bull RAM gt1024MB

bull Retina Full HD

Display gt 45ldquo

Group 2 Prio B

bull Mid-range

devices

bull Dual Core CPU

bull RAM lt1024MB

bull Screen size lt 4ldquo

bull Software not

older than 1 year

Group 3 Prio C

bull Small devices

bull Single Core

bull RAM lt 512MB

bull Low screen size

and resolution

bull Older OS older

browser

Based on your target group

Author Davide Vizzini Limbte httpwwwflickrcomphotoslimbte4007115435

Mobile Challenges | Morehellip

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

13 16 Mai 2014

I The Customer

Author Michael Newman httpswwwflickrcomphotosmzn371226016289

The Customer | Better know them

Know the target group

Talk to your customer

Will downsize testing effort

Do usability testing with them

Invite them to a beta testing program (Sonos FB

Twitter)

Author Grzegorz Lobinski httpwwwflickrcomphotosgregloby3515990945

15 16 Mai 2014

I Mobile Specific Testing

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Known functional testing is still required

bull Boundary values

bull Equivalence classes

bull Testing against acceptance criteria

Test the app as black box

bull Try to break it

bull Be creative and think in edge cases

Mobile Specific Testing

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Ian Britton httpwwwflickrcomphotosfreefoto728651045

Author Moyan Brenn httpswwwflickrcomphotosaigle_dore5626341059

Author Doug88888 httpwwwflickrcomphotosdoug888887149187135

Author Dan Levy httpwwwflickrcomphotosdanlevy5607259711

Mobile Specific Testing

Author amateur_photo_bore httpwwwflickrcomphotosandresv233667770

Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

Author Daniel Sancho httpwwwflickrcomphotosteclasorg2852716491

Mobile Specific Testing

Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4311105154 Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4464587302

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Android

bull JouleUnit to measure battery usage

bull Monkey to stress test the app

iOS

bull Energy Usage in Instruments

bull UI AutoMonkey to stress test the app

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

23 16 Mai 2014

I Tools

Author OZinOH httpwwwflickrcomphotos75905404N007126147125

Tools

Do test automation

Start simple and discover different tools

Donrsquot buy huge test automation tools

No tool is perfect

See which tool fits in your development environment

Tools | Android

Robotium (ExtSolo)

Selendroid

Spoon

Calabash for Android

Robolectric

Espresso

Monkey

Great mobile tools provided by the company square httpsquaregithubio

MonkeyTalk

Appium

Tools | iOS

UIAutomation

MonkeyTalk

Keep It Functional

Calabash for iOS

ios-driver

Kiwi

XCTest

Appium

27 16 Mai 2014

I Security

Author Alexandre Dulaunoy httpwwwflickrcomphotosadulau7712545428

Security

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244 Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Security

Security testing is not easy

Get help from experts

Check the OWASP mobile security page

httpswwwowasporgindexphpOWASP_Mobile_

Security_Project

Think twice about app permissions

30 16 Mai 2014

I Summary

Mobile Specific Testing | Summary

Combine your in house testing with crowd testing

Be up to date Know your target group

Keep the mobile features in mind

Do test automation and know the right tools

Do security testing

Be creative and on the move while testing mobile apps

Questions

Thank you for your attention

httpwwwadventuresinqacom

33 16 Mai 2014

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 7: Vienna Mobile Quality Crew Auf die Plätze, Fertig, …...Vienna Mobile Quality Crew Auf die Plätze, Fertig, APP! Who am I ? • Daniel Knott • Software Test Manager @AOE • Mobile

7 16 Mai 2014

I Mobile Challenges

Mobile Challenges | All known

httpopensignalcomreportsfragmentation-2013

Mobile Challenges | All known

httpopensignalcomreportsfragmentation-2013

Mobile Challenges | How to handle fragmentation

Group your devices A B C

Test only on those devices

Test on real device

Donrsquot use simulators or emulators

Know the target group

Mobile Challenges | How to handle fragmentation

Group 1 Prio A

bull High End

Devices

bull Dual Quad Core

CPU

bull RAM gt1024MB

bull Retina Full HD

Display gt 45ldquo

Group 2 Prio B

bull Mid-range

devices

bull Dual Core CPU

bull RAM lt1024MB

bull Screen size lt 4ldquo

bull Software not

older than 1 year

Group 3 Prio C

bull Small devices

bull Single Core

bull RAM lt 512MB

bull Low screen size

and resolution

bull Older OS older

browser

Based on your target group

Author Davide Vizzini Limbte httpwwwflickrcomphotoslimbte4007115435

Mobile Challenges | Morehellip

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

13 16 Mai 2014

I The Customer

Author Michael Newman httpswwwflickrcomphotosmzn371226016289

The Customer | Better know them

Know the target group

Talk to your customer

Will downsize testing effort

Do usability testing with them

Invite them to a beta testing program (Sonos FB

Twitter)

Author Grzegorz Lobinski httpwwwflickrcomphotosgregloby3515990945

15 16 Mai 2014

I Mobile Specific Testing

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Known functional testing is still required

bull Boundary values

bull Equivalence classes

bull Testing against acceptance criteria

Test the app as black box

bull Try to break it

bull Be creative and think in edge cases

Mobile Specific Testing

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Ian Britton httpwwwflickrcomphotosfreefoto728651045

Author Moyan Brenn httpswwwflickrcomphotosaigle_dore5626341059

Author Doug88888 httpwwwflickrcomphotosdoug888887149187135

Author Dan Levy httpwwwflickrcomphotosdanlevy5607259711

Mobile Specific Testing

Author amateur_photo_bore httpwwwflickrcomphotosandresv233667770

Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

Author Daniel Sancho httpwwwflickrcomphotosteclasorg2852716491

Mobile Specific Testing

Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4311105154 Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4464587302

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Android

bull JouleUnit to measure battery usage

bull Monkey to stress test the app

iOS

bull Energy Usage in Instruments

bull UI AutoMonkey to stress test the app

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

23 16 Mai 2014

I Tools

Author OZinOH httpwwwflickrcomphotos75905404N007126147125

Tools

Do test automation

Start simple and discover different tools

Donrsquot buy huge test automation tools

No tool is perfect

See which tool fits in your development environment

Tools | Android

Robotium (ExtSolo)

Selendroid

Spoon

Calabash for Android

Robolectric

Espresso

Monkey

Great mobile tools provided by the company square httpsquaregithubio

MonkeyTalk

Appium

Tools | iOS

UIAutomation

MonkeyTalk

Keep It Functional

Calabash for iOS

ios-driver

Kiwi

XCTest

Appium

27 16 Mai 2014

I Security

Author Alexandre Dulaunoy httpwwwflickrcomphotosadulau7712545428

Security

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244 Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Security

Security testing is not easy

Get help from experts

Check the OWASP mobile security page

httpswwwowasporgindexphpOWASP_Mobile_

Security_Project

Think twice about app permissions

30 16 Mai 2014

I Summary

Mobile Specific Testing | Summary

Combine your in house testing with crowd testing

Be up to date Know your target group

Keep the mobile features in mind

Do test automation and know the right tools

Do security testing

Be creative and on the move while testing mobile apps

Questions

Thank you for your attention

httpwwwadventuresinqacom

33 16 Mai 2014

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 8: Vienna Mobile Quality Crew Auf die Plätze, Fertig, …...Vienna Mobile Quality Crew Auf die Plätze, Fertig, APP! Who am I ? • Daniel Knott • Software Test Manager @AOE • Mobile

Mobile Challenges | All known

httpopensignalcomreportsfragmentation-2013

Mobile Challenges | All known

httpopensignalcomreportsfragmentation-2013

Mobile Challenges | How to handle fragmentation

Group your devices A B C

Test only on those devices

Test on real device

Donrsquot use simulators or emulators

Know the target group

Mobile Challenges | How to handle fragmentation

Group 1 Prio A

bull High End

Devices

bull Dual Quad Core

CPU

bull RAM gt1024MB

bull Retina Full HD

Display gt 45ldquo

Group 2 Prio B

bull Mid-range

devices

bull Dual Core CPU

bull RAM lt1024MB

bull Screen size lt 4ldquo

bull Software not

older than 1 year

Group 3 Prio C

bull Small devices

bull Single Core

bull RAM lt 512MB

bull Low screen size

and resolution

bull Older OS older

browser

Based on your target group

Author Davide Vizzini Limbte httpwwwflickrcomphotoslimbte4007115435

Mobile Challenges | Morehellip

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

13 16 Mai 2014

I The Customer

Author Michael Newman httpswwwflickrcomphotosmzn371226016289

The Customer | Better know them

Know the target group

Talk to your customer

Will downsize testing effort

Do usability testing with them

Invite them to a beta testing program (Sonos FB

Twitter)

Author Grzegorz Lobinski httpwwwflickrcomphotosgregloby3515990945

15 16 Mai 2014

I Mobile Specific Testing

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Known functional testing is still required

bull Boundary values

bull Equivalence classes

bull Testing against acceptance criteria

Test the app as black box

bull Try to break it

bull Be creative and think in edge cases

Mobile Specific Testing

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Ian Britton httpwwwflickrcomphotosfreefoto728651045

Author Moyan Brenn httpswwwflickrcomphotosaigle_dore5626341059

Author Doug88888 httpwwwflickrcomphotosdoug888887149187135

Author Dan Levy httpwwwflickrcomphotosdanlevy5607259711

Mobile Specific Testing

Author amateur_photo_bore httpwwwflickrcomphotosandresv233667770

Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

Author Daniel Sancho httpwwwflickrcomphotosteclasorg2852716491

Mobile Specific Testing

Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4311105154 Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4464587302

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Android

bull JouleUnit to measure battery usage

bull Monkey to stress test the app

iOS

bull Energy Usage in Instruments

bull UI AutoMonkey to stress test the app

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

23 16 Mai 2014

I Tools

Author OZinOH httpwwwflickrcomphotos75905404N007126147125

Tools

Do test automation

Start simple and discover different tools

Donrsquot buy huge test automation tools

No tool is perfect

See which tool fits in your development environment

Tools | Android

Robotium (ExtSolo)

Selendroid

Spoon

Calabash for Android

Robolectric

Espresso

Monkey

Great mobile tools provided by the company square httpsquaregithubio

MonkeyTalk

Appium

Tools | iOS

UIAutomation

MonkeyTalk

Keep It Functional

Calabash for iOS

ios-driver

Kiwi

XCTest

Appium

27 16 Mai 2014

I Security

Author Alexandre Dulaunoy httpwwwflickrcomphotosadulau7712545428

Security

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244 Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Security

Security testing is not easy

Get help from experts

Check the OWASP mobile security page

httpswwwowasporgindexphpOWASP_Mobile_

Security_Project

Think twice about app permissions

30 16 Mai 2014

I Summary

Mobile Specific Testing | Summary

Combine your in house testing with crowd testing

Be up to date Know your target group

Keep the mobile features in mind

Do test automation and know the right tools

Do security testing

Be creative and on the move while testing mobile apps

Questions

Thank you for your attention

httpwwwadventuresinqacom

33 16 Mai 2014

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 9: Vienna Mobile Quality Crew Auf die Plätze, Fertig, …...Vienna Mobile Quality Crew Auf die Plätze, Fertig, APP! Who am I ? • Daniel Knott • Software Test Manager @AOE • Mobile

Mobile Challenges | All known

httpopensignalcomreportsfragmentation-2013

Mobile Challenges | How to handle fragmentation

Group your devices A B C

Test only on those devices

Test on real device

Donrsquot use simulators or emulators

Know the target group

Mobile Challenges | How to handle fragmentation

Group 1 Prio A

bull High End

Devices

bull Dual Quad Core

CPU

bull RAM gt1024MB

bull Retina Full HD

Display gt 45ldquo

Group 2 Prio B

bull Mid-range

devices

bull Dual Core CPU

bull RAM lt1024MB

bull Screen size lt 4ldquo

bull Software not

older than 1 year

Group 3 Prio C

bull Small devices

bull Single Core

bull RAM lt 512MB

bull Low screen size

and resolution

bull Older OS older

browser

Based on your target group

Author Davide Vizzini Limbte httpwwwflickrcomphotoslimbte4007115435

Mobile Challenges | Morehellip

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

13 16 Mai 2014

I The Customer

Author Michael Newman httpswwwflickrcomphotosmzn371226016289

The Customer | Better know them

Know the target group

Talk to your customer

Will downsize testing effort

Do usability testing with them

Invite them to a beta testing program (Sonos FB

Twitter)

Author Grzegorz Lobinski httpwwwflickrcomphotosgregloby3515990945

15 16 Mai 2014

I Mobile Specific Testing

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Known functional testing is still required

bull Boundary values

bull Equivalence classes

bull Testing against acceptance criteria

Test the app as black box

bull Try to break it

bull Be creative and think in edge cases

Mobile Specific Testing

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Ian Britton httpwwwflickrcomphotosfreefoto728651045

Author Moyan Brenn httpswwwflickrcomphotosaigle_dore5626341059

Author Doug88888 httpwwwflickrcomphotosdoug888887149187135

Author Dan Levy httpwwwflickrcomphotosdanlevy5607259711

Mobile Specific Testing

Author amateur_photo_bore httpwwwflickrcomphotosandresv233667770

Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

Author Daniel Sancho httpwwwflickrcomphotosteclasorg2852716491

Mobile Specific Testing

Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4311105154 Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4464587302

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Android

bull JouleUnit to measure battery usage

bull Monkey to stress test the app

iOS

bull Energy Usage in Instruments

bull UI AutoMonkey to stress test the app

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

23 16 Mai 2014

I Tools

Author OZinOH httpwwwflickrcomphotos75905404N007126147125

Tools

Do test automation

Start simple and discover different tools

Donrsquot buy huge test automation tools

No tool is perfect

See which tool fits in your development environment

Tools | Android

Robotium (ExtSolo)

Selendroid

Spoon

Calabash for Android

Robolectric

Espresso

Monkey

Great mobile tools provided by the company square httpsquaregithubio

MonkeyTalk

Appium

Tools | iOS

UIAutomation

MonkeyTalk

Keep It Functional

Calabash for iOS

ios-driver

Kiwi

XCTest

Appium

27 16 Mai 2014

I Security

Author Alexandre Dulaunoy httpwwwflickrcomphotosadulau7712545428

Security

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244 Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Security

Security testing is not easy

Get help from experts

Check the OWASP mobile security page

httpswwwowasporgindexphpOWASP_Mobile_

Security_Project

Think twice about app permissions

30 16 Mai 2014

I Summary

Mobile Specific Testing | Summary

Combine your in house testing with crowd testing

Be up to date Know your target group

Keep the mobile features in mind

Do test automation and know the right tools

Do security testing

Be creative and on the move while testing mobile apps

Questions

Thank you for your attention

httpwwwadventuresinqacom

33 16 Mai 2014

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 10: Vienna Mobile Quality Crew Auf die Plätze, Fertig, …...Vienna Mobile Quality Crew Auf die Plätze, Fertig, APP! Who am I ? • Daniel Knott • Software Test Manager @AOE • Mobile

Mobile Challenges | How to handle fragmentation

Group your devices A B C

Test only on those devices

Test on real device

Donrsquot use simulators or emulators

Know the target group

Mobile Challenges | How to handle fragmentation

Group 1 Prio A

bull High End

Devices

bull Dual Quad Core

CPU

bull RAM gt1024MB

bull Retina Full HD

Display gt 45ldquo

Group 2 Prio B

bull Mid-range

devices

bull Dual Core CPU

bull RAM lt1024MB

bull Screen size lt 4ldquo

bull Software not

older than 1 year

Group 3 Prio C

bull Small devices

bull Single Core

bull RAM lt 512MB

bull Low screen size

and resolution

bull Older OS older

browser

Based on your target group

Author Davide Vizzini Limbte httpwwwflickrcomphotoslimbte4007115435

Mobile Challenges | Morehellip

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

13 16 Mai 2014

I The Customer

Author Michael Newman httpswwwflickrcomphotosmzn371226016289

The Customer | Better know them

Know the target group

Talk to your customer

Will downsize testing effort

Do usability testing with them

Invite them to a beta testing program (Sonos FB

Twitter)

Author Grzegorz Lobinski httpwwwflickrcomphotosgregloby3515990945

15 16 Mai 2014

I Mobile Specific Testing

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Known functional testing is still required

bull Boundary values

bull Equivalence classes

bull Testing against acceptance criteria

Test the app as black box

bull Try to break it

bull Be creative and think in edge cases

Mobile Specific Testing

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Ian Britton httpwwwflickrcomphotosfreefoto728651045

Author Moyan Brenn httpswwwflickrcomphotosaigle_dore5626341059

Author Doug88888 httpwwwflickrcomphotosdoug888887149187135

Author Dan Levy httpwwwflickrcomphotosdanlevy5607259711

Mobile Specific Testing

Author amateur_photo_bore httpwwwflickrcomphotosandresv233667770

Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

Author Daniel Sancho httpwwwflickrcomphotosteclasorg2852716491

Mobile Specific Testing

Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4311105154 Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4464587302

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Android

bull JouleUnit to measure battery usage

bull Monkey to stress test the app

iOS

bull Energy Usage in Instruments

bull UI AutoMonkey to stress test the app

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

23 16 Mai 2014

I Tools

Author OZinOH httpwwwflickrcomphotos75905404N007126147125

Tools

Do test automation

Start simple and discover different tools

Donrsquot buy huge test automation tools

No tool is perfect

See which tool fits in your development environment

Tools | Android

Robotium (ExtSolo)

Selendroid

Spoon

Calabash for Android

Robolectric

Espresso

Monkey

Great mobile tools provided by the company square httpsquaregithubio

MonkeyTalk

Appium

Tools | iOS

UIAutomation

MonkeyTalk

Keep It Functional

Calabash for iOS

ios-driver

Kiwi

XCTest

Appium

27 16 Mai 2014

I Security

Author Alexandre Dulaunoy httpwwwflickrcomphotosadulau7712545428

Security

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244 Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Security

Security testing is not easy

Get help from experts

Check the OWASP mobile security page

httpswwwowasporgindexphpOWASP_Mobile_

Security_Project

Think twice about app permissions

30 16 Mai 2014

I Summary

Mobile Specific Testing | Summary

Combine your in house testing with crowd testing

Be up to date Know your target group

Keep the mobile features in mind

Do test automation and know the right tools

Do security testing

Be creative and on the move while testing mobile apps

Questions

Thank you for your attention

httpwwwadventuresinqacom

33 16 Mai 2014

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 11: Vienna Mobile Quality Crew Auf die Plätze, Fertig, …...Vienna Mobile Quality Crew Auf die Plätze, Fertig, APP! Who am I ? • Daniel Knott • Software Test Manager @AOE • Mobile

Mobile Challenges | How to handle fragmentation

Group 1 Prio A

bull High End

Devices

bull Dual Quad Core

CPU

bull RAM gt1024MB

bull Retina Full HD

Display gt 45ldquo

Group 2 Prio B

bull Mid-range

devices

bull Dual Core CPU

bull RAM lt1024MB

bull Screen size lt 4ldquo

bull Software not

older than 1 year

Group 3 Prio C

bull Small devices

bull Single Core

bull RAM lt 512MB

bull Low screen size

and resolution

bull Older OS older

browser

Based on your target group

Author Davide Vizzini Limbte httpwwwflickrcomphotoslimbte4007115435

Mobile Challenges | Morehellip

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

13 16 Mai 2014

I The Customer

Author Michael Newman httpswwwflickrcomphotosmzn371226016289

The Customer | Better know them

Know the target group

Talk to your customer

Will downsize testing effort

Do usability testing with them

Invite them to a beta testing program (Sonos FB

Twitter)

Author Grzegorz Lobinski httpwwwflickrcomphotosgregloby3515990945

15 16 Mai 2014

I Mobile Specific Testing

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Known functional testing is still required

bull Boundary values

bull Equivalence classes

bull Testing against acceptance criteria

Test the app as black box

bull Try to break it

bull Be creative and think in edge cases

Mobile Specific Testing

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Ian Britton httpwwwflickrcomphotosfreefoto728651045

Author Moyan Brenn httpswwwflickrcomphotosaigle_dore5626341059

Author Doug88888 httpwwwflickrcomphotosdoug888887149187135

Author Dan Levy httpwwwflickrcomphotosdanlevy5607259711

Mobile Specific Testing

Author amateur_photo_bore httpwwwflickrcomphotosandresv233667770

Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

Author Daniel Sancho httpwwwflickrcomphotosteclasorg2852716491

Mobile Specific Testing

Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4311105154 Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4464587302

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Android

bull JouleUnit to measure battery usage

bull Monkey to stress test the app

iOS

bull Energy Usage in Instruments

bull UI AutoMonkey to stress test the app

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

23 16 Mai 2014

I Tools

Author OZinOH httpwwwflickrcomphotos75905404N007126147125

Tools

Do test automation

Start simple and discover different tools

Donrsquot buy huge test automation tools

No tool is perfect

See which tool fits in your development environment

Tools | Android

Robotium (ExtSolo)

Selendroid

Spoon

Calabash for Android

Robolectric

Espresso

Monkey

Great mobile tools provided by the company square httpsquaregithubio

MonkeyTalk

Appium

Tools | iOS

UIAutomation

MonkeyTalk

Keep It Functional

Calabash for iOS

ios-driver

Kiwi

XCTest

Appium

27 16 Mai 2014

I Security

Author Alexandre Dulaunoy httpwwwflickrcomphotosadulau7712545428

Security

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244 Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Security

Security testing is not easy

Get help from experts

Check the OWASP mobile security page

httpswwwowasporgindexphpOWASP_Mobile_

Security_Project

Think twice about app permissions

30 16 Mai 2014

I Summary

Mobile Specific Testing | Summary

Combine your in house testing with crowd testing

Be up to date Know your target group

Keep the mobile features in mind

Do test automation and know the right tools

Do security testing

Be creative and on the move while testing mobile apps

Questions

Thank you for your attention

httpwwwadventuresinqacom

33 16 Mai 2014

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 12: Vienna Mobile Quality Crew Auf die Plätze, Fertig, …...Vienna Mobile Quality Crew Auf die Plätze, Fertig, APP! Who am I ? • Daniel Knott • Software Test Manager @AOE • Mobile

Author Davide Vizzini Limbte httpwwwflickrcomphotoslimbte4007115435

Mobile Challenges | Morehellip

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

13 16 Mai 2014

I The Customer

Author Michael Newman httpswwwflickrcomphotosmzn371226016289

The Customer | Better know them

Know the target group

Talk to your customer

Will downsize testing effort

Do usability testing with them

Invite them to a beta testing program (Sonos FB

Twitter)

Author Grzegorz Lobinski httpwwwflickrcomphotosgregloby3515990945

15 16 Mai 2014

I Mobile Specific Testing

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Known functional testing is still required

bull Boundary values

bull Equivalence classes

bull Testing against acceptance criteria

Test the app as black box

bull Try to break it

bull Be creative and think in edge cases

Mobile Specific Testing

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Ian Britton httpwwwflickrcomphotosfreefoto728651045

Author Moyan Brenn httpswwwflickrcomphotosaigle_dore5626341059

Author Doug88888 httpwwwflickrcomphotosdoug888887149187135

Author Dan Levy httpwwwflickrcomphotosdanlevy5607259711

Mobile Specific Testing

Author amateur_photo_bore httpwwwflickrcomphotosandresv233667770

Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

Author Daniel Sancho httpwwwflickrcomphotosteclasorg2852716491

Mobile Specific Testing

Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4311105154 Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4464587302

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Android

bull JouleUnit to measure battery usage

bull Monkey to stress test the app

iOS

bull Energy Usage in Instruments

bull UI AutoMonkey to stress test the app

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

23 16 Mai 2014

I Tools

Author OZinOH httpwwwflickrcomphotos75905404N007126147125

Tools

Do test automation

Start simple and discover different tools

Donrsquot buy huge test automation tools

No tool is perfect

See which tool fits in your development environment

Tools | Android

Robotium (ExtSolo)

Selendroid

Spoon

Calabash for Android

Robolectric

Espresso

Monkey

Great mobile tools provided by the company square httpsquaregithubio

MonkeyTalk

Appium

Tools | iOS

UIAutomation

MonkeyTalk

Keep It Functional

Calabash for iOS

ios-driver

Kiwi

XCTest

Appium

27 16 Mai 2014

I Security

Author Alexandre Dulaunoy httpwwwflickrcomphotosadulau7712545428

Security

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244 Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Security

Security testing is not easy

Get help from experts

Check the OWASP mobile security page

httpswwwowasporgindexphpOWASP_Mobile_

Security_Project

Think twice about app permissions

30 16 Mai 2014

I Summary

Mobile Specific Testing | Summary

Combine your in house testing with crowd testing

Be up to date Know your target group

Keep the mobile features in mind

Do test automation and know the right tools

Do security testing

Be creative and on the move while testing mobile apps

Questions

Thank you for your attention

httpwwwadventuresinqacom

33 16 Mai 2014

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 13: Vienna Mobile Quality Crew Auf die Plätze, Fertig, …...Vienna Mobile Quality Crew Auf die Plätze, Fertig, APP! Who am I ? • Daniel Knott • Software Test Manager @AOE • Mobile

13 16 Mai 2014

I The Customer

Author Michael Newman httpswwwflickrcomphotosmzn371226016289

The Customer | Better know them

Know the target group

Talk to your customer

Will downsize testing effort

Do usability testing with them

Invite them to a beta testing program (Sonos FB

Twitter)

Author Grzegorz Lobinski httpwwwflickrcomphotosgregloby3515990945

15 16 Mai 2014

I Mobile Specific Testing

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Known functional testing is still required

bull Boundary values

bull Equivalence classes

bull Testing against acceptance criteria

Test the app as black box

bull Try to break it

bull Be creative and think in edge cases

Mobile Specific Testing

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Ian Britton httpwwwflickrcomphotosfreefoto728651045

Author Moyan Brenn httpswwwflickrcomphotosaigle_dore5626341059

Author Doug88888 httpwwwflickrcomphotosdoug888887149187135

Author Dan Levy httpwwwflickrcomphotosdanlevy5607259711

Mobile Specific Testing

Author amateur_photo_bore httpwwwflickrcomphotosandresv233667770

Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

Author Daniel Sancho httpwwwflickrcomphotosteclasorg2852716491

Mobile Specific Testing

Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4311105154 Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4464587302

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Android

bull JouleUnit to measure battery usage

bull Monkey to stress test the app

iOS

bull Energy Usage in Instruments

bull UI AutoMonkey to stress test the app

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

23 16 Mai 2014

I Tools

Author OZinOH httpwwwflickrcomphotos75905404N007126147125

Tools

Do test automation

Start simple and discover different tools

Donrsquot buy huge test automation tools

No tool is perfect

See which tool fits in your development environment

Tools | Android

Robotium (ExtSolo)

Selendroid

Spoon

Calabash for Android

Robolectric

Espresso

Monkey

Great mobile tools provided by the company square httpsquaregithubio

MonkeyTalk

Appium

Tools | iOS

UIAutomation

MonkeyTalk

Keep It Functional

Calabash for iOS

ios-driver

Kiwi

XCTest

Appium

27 16 Mai 2014

I Security

Author Alexandre Dulaunoy httpwwwflickrcomphotosadulau7712545428

Security

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244 Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Security

Security testing is not easy

Get help from experts

Check the OWASP mobile security page

httpswwwowasporgindexphpOWASP_Mobile_

Security_Project

Think twice about app permissions

30 16 Mai 2014

I Summary

Mobile Specific Testing | Summary

Combine your in house testing with crowd testing

Be up to date Know your target group

Keep the mobile features in mind

Do test automation and know the right tools

Do security testing

Be creative and on the move while testing mobile apps

Questions

Thank you for your attention

httpwwwadventuresinqacom

33 16 Mai 2014

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 14: Vienna Mobile Quality Crew Auf die Plätze, Fertig, …...Vienna Mobile Quality Crew Auf die Plätze, Fertig, APP! Who am I ? • Daniel Knott • Software Test Manager @AOE • Mobile

The Customer | Better know them

Know the target group

Talk to your customer

Will downsize testing effort

Do usability testing with them

Invite them to a beta testing program (Sonos FB

Twitter)

Author Grzegorz Lobinski httpwwwflickrcomphotosgregloby3515990945

15 16 Mai 2014

I Mobile Specific Testing

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Known functional testing is still required

bull Boundary values

bull Equivalence classes

bull Testing against acceptance criteria

Test the app as black box

bull Try to break it

bull Be creative and think in edge cases

Mobile Specific Testing

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Ian Britton httpwwwflickrcomphotosfreefoto728651045

Author Moyan Brenn httpswwwflickrcomphotosaigle_dore5626341059

Author Doug88888 httpwwwflickrcomphotosdoug888887149187135

Author Dan Levy httpwwwflickrcomphotosdanlevy5607259711

Mobile Specific Testing

Author amateur_photo_bore httpwwwflickrcomphotosandresv233667770

Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

Author Daniel Sancho httpwwwflickrcomphotosteclasorg2852716491

Mobile Specific Testing

Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4311105154 Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4464587302

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Android

bull JouleUnit to measure battery usage

bull Monkey to stress test the app

iOS

bull Energy Usage in Instruments

bull UI AutoMonkey to stress test the app

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

23 16 Mai 2014

I Tools

Author OZinOH httpwwwflickrcomphotos75905404N007126147125

Tools

Do test automation

Start simple and discover different tools

Donrsquot buy huge test automation tools

No tool is perfect

See which tool fits in your development environment

Tools | Android

Robotium (ExtSolo)

Selendroid

Spoon

Calabash for Android

Robolectric

Espresso

Monkey

Great mobile tools provided by the company square httpsquaregithubio

MonkeyTalk

Appium

Tools | iOS

UIAutomation

MonkeyTalk

Keep It Functional

Calabash for iOS

ios-driver

Kiwi

XCTest

Appium

27 16 Mai 2014

I Security

Author Alexandre Dulaunoy httpwwwflickrcomphotosadulau7712545428

Security

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244 Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Security

Security testing is not easy

Get help from experts

Check the OWASP mobile security page

httpswwwowasporgindexphpOWASP_Mobile_

Security_Project

Think twice about app permissions

30 16 Mai 2014

I Summary

Mobile Specific Testing | Summary

Combine your in house testing with crowd testing

Be up to date Know your target group

Keep the mobile features in mind

Do test automation and know the right tools

Do security testing

Be creative and on the move while testing mobile apps

Questions

Thank you for your attention

httpwwwadventuresinqacom

33 16 Mai 2014

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 15: Vienna Mobile Quality Crew Auf die Plätze, Fertig, …...Vienna Mobile Quality Crew Auf die Plätze, Fertig, APP! Who am I ? • Daniel Knott • Software Test Manager @AOE • Mobile

15 16 Mai 2014

I Mobile Specific Testing

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Known functional testing is still required

bull Boundary values

bull Equivalence classes

bull Testing against acceptance criteria

Test the app as black box

bull Try to break it

bull Be creative and think in edge cases

Mobile Specific Testing

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Ian Britton httpwwwflickrcomphotosfreefoto728651045

Author Moyan Brenn httpswwwflickrcomphotosaigle_dore5626341059

Author Doug88888 httpwwwflickrcomphotosdoug888887149187135

Author Dan Levy httpwwwflickrcomphotosdanlevy5607259711

Mobile Specific Testing

Author amateur_photo_bore httpwwwflickrcomphotosandresv233667770

Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

Author Daniel Sancho httpwwwflickrcomphotosteclasorg2852716491

Mobile Specific Testing

Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4311105154 Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4464587302

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Android

bull JouleUnit to measure battery usage

bull Monkey to stress test the app

iOS

bull Energy Usage in Instruments

bull UI AutoMonkey to stress test the app

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

23 16 Mai 2014

I Tools

Author OZinOH httpwwwflickrcomphotos75905404N007126147125

Tools

Do test automation

Start simple and discover different tools

Donrsquot buy huge test automation tools

No tool is perfect

See which tool fits in your development environment

Tools | Android

Robotium (ExtSolo)

Selendroid

Spoon

Calabash for Android

Robolectric

Espresso

Monkey

Great mobile tools provided by the company square httpsquaregithubio

MonkeyTalk

Appium

Tools | iOS

UIAutomation

MonkeyTalk

Keep It Functional

Calabash for iOS

ios-driver

Kiwi

XCTest

Appium

27 16 Mai 2014

I Security

Author Alexandre Dulaunoy httpwwwflickrcomphotosadulau7712545428

Security

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244 Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Security

Security testing is not easy

Get help from experts

Check the OWASP mobile security page

httpswwwowasporgindexphpOWASP_Mobile_

Security_Project

Think twice about app permissions

30 16 Mai 2014

I Summary

Mobile Specific Testing | Summary

Combine your in house testing with crowd testing

Be up to date Know your target group

Keep the mobile features in mind

Do test automation and know the right tools

Do security testing

Be creative and on the move while testing mobile apps

Questions

Thank you for your attention

httpwwwadventuresinqacom

33 16 Mai 2014

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 16: Vienna Mobile Quality Crew Auf die Plätze, Fertig, …...Vienna Mobile Quality Crew Auf die Plätze, Fertig, APP! Who am I ? • Daniel Knott • Software Test Manager @AOE • Mobile

Mobile Specific Testing

Known functional testing is still required

bull Boundary values

bull Equivalence classes

bull Testing against acceptance criteria

Test the app as black box

bull Try to break it

bull Be creative and think in edge cases

Mobile Specific Testing

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Ian Britton httpwwwflickrcomphotosfreefoto728651045

Author Moyan Brenn httpswwwflickrcomphotosaigle_dore5626341059

Author Doug88888 httpwwwflickrcomphotosdoug888887149187135

Author Dan Levy httpwwwflickrcomphotosdanlevy5607259711

Mobile Specific Testing

Author amateur_photo_bore httpwwwflickrcomphotosandresv233667770

Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

Author Daniel Sancho httpwwwflickrcomphotosteclasorg2852716491

Mobile Specific Testing

Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4311105154 Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4464587302

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Android

bull JouleUnit to measure battery usage

bull Monkey to stress test the app

iOS

bull Energy Usage in Instruments

bull UI AutoMonkey to stress test the app

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

23 16 Mai 2014

I Tools

Author OZinOH httpwwwflickrcomphotos75905404N007126147125

Tools

Do test automation

Start simple and discover different tools

Donrsquot buy huge test automation tools

No tool is perfect

See which tool fits in your development environment

Tools | Android

Robotium (ExtSolo)

Selendroid

Spoon

Calabash for Android

Robolectric

Espresso

Monkey

Great mobile tools provided by the company square httpsquaregithubio

MonkeyTalk

Appium

Tools | iOS

UIAutomation

MonkeyTalk

Keep It Functional

Calabash for iOS

ios-driver

Kiwi

XCTest

Appium

27 16 Mai 2014

I Security

Author Alexandre Dulaunoy httpwwwflickrcomphotosadulau7712545428

Security

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244 Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Security

Security testing is not easy

Get help from experts

Check the OWASP mobile security page

httpswwwowasporgindexphpOWASP_Mobile_

Security_Project

Think twice about app permissions

30 16 Mai 2014

I Summary

Mobile Specific Testing | Summary

Combine your in house testing with crowd testing

Be up to date Know your target group

Keep the mobile features in mind

Do test automation and know the right tools

Do security testing

Be creative and on the move while testing mobile apps

Questions

Thank you for your attention

httpwwwadventuresinqacom

33 16 Mai 2014

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 17: Vienna Mobile Quality Crew Auf die Plätze, Fertig, …...Vienna Mobile Quality Crew Auf die Plätze, Fertig, APP! Who am I ? • Daniel Knott • Software Test Manager @AOE • Mobile

Mobile Specific Testing

Author Juan de Dios Santander Vela httpwwwflickrcomphotosjuandesant209098053

Author Ian Britton httpwwwflickrcomphotosfreefoto728651045

Author Moyan Brenn httpswwwflickrcomphotosaigle_dore5626341059

Author Doug88888 httpwwwflickrcomphotosdoug888887149187135

Author Dan Levy httpwwwflickrcomphotosdanlevy5607259711

Mobile Specific Testing

Author amateur_photo_bore httpwwwflickrcomphotosandresv233667770

Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

Author Daniel Sancho httpwwwflickrcomphotosteclasorg2852716491

Mobile Specific Testing

Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4311105154 Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4464587302

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Android

bull JouleUnit to measure battery usage

bull Monkey to stress test the app

iOS

bull Energy Usage in Instruments

bull UI AutoMonkey to stress test the app

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

23 16 Mai 2014

I Tools

Author OZinOH httpwwwflickrcomphotos75905404N007126147125

Tools

Do test automation

Start simple and discover different tools

Donrsquot buy huge test automation tools

No tool is perfect

See which tool fits in your development environment

Tools | Android

Robotium (ExtSolo)

Selendroid

Spoon

Calabash for Android

Robolectric

Espresso

Monkey

Great mobile tools provided by the company square httpsquaregithubio

MonkeyTalk

Appium

Tools | iOS

UIAutomation

MonkeyTalk

Keep It Functional

Calabash for iOS

ios-driver

Kiwi

XCTest

Appium

27 16 Mai 2014

I Security

Author Alexandre Dulaunoy httpwwwflickrcomphotosadulau7712545428

Security

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244 Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Security

Security testing is not easy

Get help from experts

Check the OWASP mobile security page

httpswwwowasporgindexphpOWASP_Mobile_

Security_Project

Think twice about app permissions

30 16 Mai 2014

I Summary

Mobile Specific Testing | Summary

Combine your in house testing with crowd testing

Be up to date Know your target group

Keep the mobile features in mind

Do test automation and know the right tools

Do security testing

Be creative and on the move while testing mobile apps

Questions

Thank you for your attention

httpwwwadventuresinqacom

33 16 Mai 2014

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 18: Vienna Mobile Quality Crew Auf die Plätze, Fertig, …...Vienna Mobile Quality Crew Auf die Plätze, Fertig, APP! Who am I ? • Daniel Knott • Software Test Manager @AOE • Mobile

Mobile Specific Testing

Author amateur_photo_bore httpwwwflickrcomphotosandresv233667770

Author Rain Rabbit httpwwwflickrcomphotos37996583811N018033259053

Author Daniel Sancho httpwwwflickrcomphotosteclasorg2852716491

Mobile Specific Testing

Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4311105154 Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4464587302

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Android

bull JouleUnit to measure battery usage

bull Monkey to stress test the app

iOS

bull Energy Usage in Instruments

bull UI AutoMonkey to stress test the app

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

23 16 Mai 2014

I Tools

Author OZinOH httpwwwflickrcomphotos75905404N007126147125

Tools

Do test automation

Start simple and discover different tools

Donrsquot buy huge test automation tools

No tool is perfect

See which tool fits in your development environment

Tools | Android

Robotium (ExtSolo)

Selendroid

Spoon

Calabash for Android

Robolectric

Espresso

Monkey

Great mobile tools provided by the company square httpsquaregithubio

MonkeyTalk

Appium

Tools | iOS

UIAutomation

MonkeyTalk

Keep It Functional

Calabash for iOS

ios-driver

Kiwi

XCTest

Appium

27 16 Mai 2014

I Security

Author Alexandre Dulaunoy httpwwwflickrcomphotosadulau7712545428

Security

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244 Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Security

Security testing is not easy

Get help from experts

Check the OWASP mobile security page

httpswwwowasporgindexphpOWASP_Mobile_

Security_Project

Think twice about app permissions

30 16 Mai 2014

I Summary

Mobile Specific Testing | Summary

Combine your in house testing with crowd testing

Be up to date Know your target group

Keep the mobile features in mind

Do test automation and know the right tools

Do security testing

Be creative and on the move while testing mobile apps

Questions

Thank you for your attention

httpwwwadventuresinqacom

33 16 Mai 2014

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 19: Vienna Mobile Quality Crew Auf die Plätze, Fertig, …...Vienna Mobile Quality Crew Auf die Plätze, Fertig, APP! Who am I ? • Daniel Knott • Software Test Manager @AOE • Mobile

Mobile Specific Testing

Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4311105154 Author Surat Lozowick httpwwwflickrcomphotossuratlozowick4464587302

Author Theus Falcao httpwwwflickrcomphotostheusfalcao9563767145

Mobile Specific Testing

Android

bull JouleUnit to measure battery usage

bull Monkey to stress test the app

iOS

bull Energy Usage in Instruments

bull UI AutoMonkey to stress test the app

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

23 16 Mai 2014

I Tools

Author OZinOH httpwwwflickrcomphotos75905404N007126147125

Tools

Do test automation

Start simple and discover different tools

Donrsquot buy huge test automation tools

No tool is perfect

See which tool fits in your development environment

Tools | Android

Robotium (ExtSolo)

Selendroid

Spoon

Calabash for Android

Robolectric

Espresso

Monkey

Great mobile tools provided by the company square httpsquaregithubio

MonkeyTalk

Appium

Tools | iOS

UIAutomation

MonkeyTalk

Keep It Functional

Calabash for iOS

ios-driver

Kiwi

XCTest

Appium

27 16 Mai 2014

I Security

Author Alexandre Dulaunoy httpwwwflickrcomphotosadulau7712545428

Security

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244 Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Security

Security testing is not easy

Get help from experts

Check the OWASP mobile security page

httpswwwowasporgindexphpOWASP_Mobile_

Security_Project

Think twice about app permissions

30 16 Mai 2014

I Summary

Mobile Specific Testing | Summary

Combine your in house testing with crowd testing

Be up to date Know your target group

Keep the mobile features in mind

Do test automation and know the right tools

Do security testing

Be creative and on the move while testing mobile apps

Questions

Thank you for your attention

httpwwwadventuresinqacom

33 16 Mai 2014

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 20: Vienna Mobile Quality Crew Auf die Plätze, Fertig, …...Vienna Mobile Quality Crew Auf die Plätze, Fertig, APP! Who am I ? • Daniel Knott • Software Test Manager @AOE • Mobile

Mobile Specific Testing

Android

bull JouleUnit to measure battery usage

bull Monkey to stress test the app

iOS

bull Energy Usage in Instruments

bull UI AutoMonkey to stress test the app

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

23 16 Mai 2014

I Tools

Author OZinOH httpwwwflickrcomphotos75905404N007126147125

Tools

Do test automation

Start simple and discover different tools

Donrsquot buy huge test automation tools

No tool is perfect

See which tool fits in your development environment

Tools | Android

Robotium (ExtSolo)

Selendroid

Spoon

Calabash for Android

Robolectric

Espresso

Monkey

Great mobile tools provided by the company square httpsquaregithubio

MonkeyTalk

Appium

Tools | iOS

UIAutomation

MonkeyTalk

Keep It Functional

Calabash for iOS

ios-driver

Kiwi

XCTest

Appium

27 16 Mai 2014

I Security

Author Alexandre Dulaunoy httpwwwflickrcomphotosadulau7712545428

Security

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244 Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Security

Security testing is not easy

Get help from experts

Check the OWASP mobile security page

httpswwwowasporgindexphpOWASP_Mobile_

Security_Project

Think twice about app permissions

30 16 Mai 2014

I Summary

Mobile Specific Testing | Summary

Combine your in house testing with crowd testing

Be up to date Know your target group

Keep the mobile features in mind

Do test automation and know the right tools

Do security testing

Be creative and on the move while testing mobile apps

Questions

Thank you for your attention

httpwwwadventuresinqacom

33 16 Mai 2014

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 21: Vienna Mobile Quality Crew Auf die Plätze, Fertig, …...Vienna Mobile Quality Crew Auf die Plätze, Fertig, APP! Who am I ? • Daniel Knott • Software Test Manager @AOE • Mobile

Mobile Specific Testing

Author Molly Holzschlag httpwwwflickrcomphotosmollyeh11272434559 Author Quinn Dombrowski httpwwwflickrcomphotosquinnanya4718635484

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

23 16 Mai 2014

I Tools

Author OZinOH httpwwwflickrcomphotos75905404N007126147125

Tools

Do test automation

Start simple and discover different tools

Donrsquot buy huge test automation tools

No tool is perfect

See which tool fits in your development environment

Tools | Android

Robotium (ExtSolo)

Selendroid

Spoon

Calabash for Android

Robolectric

Espresso

Monkey

Great mobile tools provided by the company square httpsquaregithubio

MonkeyTalk

Appium

Tools | iOS

UIAutomation

MonkeyTalk

Keep It Functional

Calabash for iOS

ios-driver

Kiwi

XCTest

Appium

27 16 Mai 2014

I Security

Author Alexandre Dulaunoy httpwwwflickrcomphotosadulau7712545428

Security

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244 Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Security

Security testing is not easy

Get help from experts

Check the OWASP mobile security page

httpswwwowasporgindexphpOWASP_Mobile_

Security_Project

Think twice about app permissions

30 16 Mai 2014

I Summary

Mobile Specific Testing | Summary

Combine your in house testing with crowd testing

Be up to date Know your target group

Keep the mobile features in mind

Do test automation and know the right tools

Do security testing

Be creative and on the move while testing mobile apps

Questions

Thank you for your attention

httpwwwadventuresinqacom

33 16 Mai 2014

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 22: Vienna Mobile Quality Crew Auf die Plätze, Fertig, …...Vienna Mobile Quality Crew Auf die Plätze, Fertig, APP! Who am I ? • Daniel Knott • Software Test Manager @AOE • Mobile

Mobile Specific Testing

Author minxlj httpwwwflickrcomphotosminxlj3270996158 Author Ryan B BulaPhotography httpwwwflickrcomphotosnayralub3763581778

Author Sterling Coffey httpwwwflickrcomphotosn0ssc7046915929

23 16 Mai 2014

I Tools

Author OZinOH httpwwwflickrcomphotos75905404N007126147125

Tools

Do test automation

Start simple and discover different tools

Donrsquot buy huge test automation tools

No tool is perfect

See which tool fits in your development environment

Tools | Android

Robotium (ExtSolo)

Selendroid

Spoon

Calabash for Android

Robolectric

Espresso

Monkey

Great mobile tools provided by the company square httpsquaregithubio

MonkeyTalk

Appium

Tools | iOS

UIAutomation

MonkeyTalk

Keep It Functional

Calabash for iOS

ios-driver

Kiwi

XCTest

Appium

27 16 Mai 2014

I Security

Author Alexandre Dulaunoy httpwwwflickrcomphotosadulau7712545428

Security

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244 Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Security

Security testing is not easy

Get help from experts

Check the OWASP mobile security page

httpswwwowasporgindexphpOWASP_Mobile_

Security_Project

Think twice about app permissions

30 16 Mai 2014

I Summary

Mobile Specific Testing | Summary

Combine your in house testing with crowd testing

Be up to date Know your target group

Keep the mobile features in mind

Do test automation and know the right tools

Do security testing

Be creative and on the move while testing mobile apps

Questions

Thank you for your attention

httpwwwadventuresinqacom

33 16 Mai 2014

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 23: Vienna Mobile Quality Crew Auf die Plätze, Fertig, …...Vienna Mobile Quality Crew Auf die Plätze, Fertig, APP! Who am I ? • Daniel Knott • Software Test Manager @AOE • Mobile

23 16 Mai 2014

I Tools

Author OZinOH httpwwwflickrcomphotos75905404N007126147125

Tools

Do test automation

Start simple and discover different tools

Donrsquot buy huge test automation tools

No tool is perfect

See which tool fits in your development environment

Tools | Android

Robotium (ExtSolo)

Selendroid

Spoon

Calabash for Android

Robolectric

Espresso

Monkey

Great mobile tools provided by the company square httpsquaregithubio

MonkeyTalk

Appium

Tools | iOS

UIAutomation

MonkeyTalk

Keep It Functional

Calabash for iOS

ios-driver

Kiwi

XCTest

Appium

27 16 Mai 2014

I Security

Author Alexandre Dulaunoy httpwwwflickrcomphotosadulau7712545428

Security

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244 Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Security

Security testing is not easy

Get help from experts

Check the OWASP mobile security page

httpswwwowasporgindexphpOWASP_Mobile_

Security_Project

Think twice about app permissions

30 16 Mai 2014

I Summary

Mobile Specific Testing | Summary

Combine your in house testing with crowd testing

Be up to date Know your target group

Keep the mobile features in mind

Do test automation and know the right tools

Do security testing

Be creative and on the move while testing mobile apps

Questions

Thank you for your attention

httpwwwadventuresinqacom

33 16 Mai 2014

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 24: Vienna Mobile Quality Crew Auf die Plätze, Fertig, …...Vienna Mobile Quality Crew Auf die Plätze, Fertig, APP! Who am I ? • Daniel Knott • Software Test Manager @AOE • Mobile

Tools

Do test automation

Start simple and discover different tools

Donrsquot buy huge test automation tools

No tool is perfect

See which tool fits in your development environment

Tools | Android

Robotium (ExtSolo)

Selendroid

Spoon

Calabash for Android

Robolectric

Espresso

Monkey

Great mobile tools provided by the company square httpsquaregithubio

MonkeyTalk

Appium

Tools | iOS

UIAutomation

MonkeyTalk

Keep It Functional

Calabash for iOS

ios-driver

Kiwi

XCTest

Appium

27 16 Mai 2014

I Security

Author Alexandre Dulaunoy httpwwwflickrcomphotosadulau7712545428

Security

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244 Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Security

Security testing is not easy

Get help from experts

Check the OWASP mobile security page

httpswwwowasporgindexphpOWASP_Mobile_

Security_Project

Think twice about app permissions

30 16 Mai 2014

I Summary

Mobile Specific Testing | Summary

Combine your in house testing with crowd testing

Be up to date Know your target group

Keep the mobile features in mind

Do test automation and know the right tools

Do security testing

Be creative and on the move while testing mobile apps

Questions

Thank you for your attention

httpwwwadventuresinqacom

33 16 Mai 2014

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 25: Vienna Mobile Quality Crew Auf die Plätze, Fertig, …...Vienna Mobile Quality Crew Auf die Plätze, Fertig, APP! Who am I ? • Daniel Knott • Software Test Manager @AOE • Mobile

Tools | Android

Robotium (ExtSolo)

Selendroid

Spoon

Calabash for Android

Robolectric

Espresso

Monkey

Great mobile tools provided by the company square httpsquaregithubio

MonkeyTalk

Appium

Tools | iOS

UIAutomation

MonkeyTalk

Keep It Functional

Calabash for iOS

ios-driver

Kiwi

XCTest

Appium

27 16 Mai 2014

I Security

Author Alexandre Dulaunoy httpwwwflickrcomphotosadulau7712545428

Security

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244 Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Security

Security testing is not easy

Get help from experts

Check the OWASP mobile security page

httpswwwowasporgindexphpOWASP_Mobile_

Security_Project

Think twice about app permissions

30 16 Mai 2014

I Summary

Mobile Specific Testing | Summary

Combine your in house testing with crowd testing

Be up to date Know your target group

Keep the mobile features in mind

Do test automation and know the right tools

Do security testing

Be creative and on the move while testing mobile apps

Questions

Thank you for your attention

httpwwwadventuresinqacom

33 16 Mai 2014

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 26: Vienna Mobile Quality Crew Auf die Plätze, Fertig, …...Vienna Mobile Quality Crew Auf die Plätze, Fertig, APP! Who am I ? • Daniel Knott • Software Test Manager @AOE • Mobile

Tools | iOS

UIAutomation

MonkeyTalk

Keep It Functional

Calabash for iOS

ios-driver

Kiwi

XCTest

Appium

27 16 Mai 2014

I Security

Author Alexandre Dulaunoy httpwwwflickrcomphotosadulau7712545428

Security

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244 Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Security

Security testing is not easy

Get help from experts

Check the OWASP mobile security page

httpswwwowasporgindexphpOWASP_Mobile_

Security_Project

Think twice about app permissions

30 16 Mai 2014

I Summary

Mobile Specific Testing | Summary

Combine your in house testing with crowd testing

Be up to date Know your target group

Keep the mobile features in mind

Do test automation and know the right tools

Do security testing

Be creative and on the move while testing mobile apps

Questions

Thank you for your attention

httpwwwadventuresinqacom

33 16 Mai 2014

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 27: Vienna Mobile Quality Crew Auf die Plätze, Fertig, …...Vienna Mobile Quality Crew Auf die Plätze, Fertig, APP! Who am I ? • Daniel Knott • Software Test Manager @AOE • Mobile

27 16 Mai 2014

I Security

Author Alexandre Dulaunoy httpwwwflickrcomphotosadulau7712545428

Security

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244 Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Security

Security testing is not easy

Get help from experts

Check the OWASP mobile security page

httpswwwowasporgindexphpOWASP_Mobile_

Security_Project

Think twice about app permissions

30 16 Mai 2014

I Summary

Mobile Specific Testing | Summary

Combine your in house testing with crowd testing

Be up to date Know your target group

Keep the mobile features in mind

Do test automation and know the right tools

Do security testing

Be creative and on the move while testing mobile apps

Questions

Thank you for your attention

httpwwwadventuresinqacom

33 16 Mai 2014

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 28: Vienna Mobile Quality Crew Auf die Plätze, Fertig, …...Vienna Mobile Quality Crew Auf die Plätze, Fertig, APP! Who am I ? • Daniel Knott • Software Test Manager @AOE • Mobile

Security

Author Anthony Catalano httpwwwflickrcomphotosbadwsky34164244 Author Dennis Wong httpwwwflickrcomphotosdenniswong2406135310

Acircuthor orkomedix httpwwwflickrcomphotosorkomedix5211437958

Security

Security testing is not easy

Get help from experts

Check the OWASP mobile security page

httpswwwowasporgindexphpOWASP_Mobile_

Security_Project

Think twice about app permissions

30 16 Mai 2014

I Summary

Mobile Specific Testing | Summary

Combine your in house testing with crowd testing

Be up to date Know your target group

Keep the mobile features in mind

Do test automation and know the right tools

Do security testing

Be creative and on the move while testing mobile apps

Questions

Thank you for your attention

httpwwwadventuresinqacom

33 16 Mai 2014

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 29: Vienna Mobile Quality Crew Auf die Plätze, Fertig, …...Vienna Mobile Quality Crew Auf die Plätze, Fertig, APP! Who am I ? • Daniel Knott • Software Test Manager @AOE • Mobile

Security

Security testing is not easy

Get help from experts

Check the OWASP mobile security page

httpswwwowasporgindexphpOWASP_Mobile_

Security_Project

Think twice about app permissions

30 16 Mai 2014

I Summary

Mobile Specific Testing | Summary

Combine your in house testing with crowd testing

Be up to date Know your target group

Keep the mobile features in mind

Do test automation and know the right tools

Do security testing

Be creative and on the move while testing mobile apps

Questions

Thank you for your attention

httpwwwadventuresinqacom

33 16 Mai 2014

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 30: Vienna Mobile Quality Crew Auf die Plätze, Fertig, …...Vienna Mobile Quality Crew Auf die Plätze, Fertig, APP! Who am I ? • Daniel Knott • Software Test Manager @AOE • Mobile

30 16 Mai 2014

I Summary

Mobile Specific Testing | Summary

Combine your in house testing with crowd testing

Be up to date Know your target group

Keep the mobile features in mind

Do test automation and know the right tools

Do security testing

Be creative and on the move while testing mobile apps

Questions

Thank you for your attention

httpwwwadventuresinqacom

33 16 Mai 2014

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 31: Vienna Mobile Quality Crew Auf die Plätze, Fertig, …...Vienna Mobile Quality Crew Auf die Plätze, Fertig, APP! Who am I ? • Daniel Knott • Software Test Manager @AOE • Mobile

Mobile Specific Testing | Summary

Combine your in house testing with crowd testing

Be up to date Know your target group

Keep the mobile features in mind

Do test automation and know the right tools

Do security testing

Be creative and on the move while testing mobile apps

Questions

Thank you for your attention

httpwwwadventuresinqacom

33 16 Mai 2014

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 32: Vienna Mobile Quality Crew Auf die Plätze, Fertig, …...Vienna Mobile Quality Crew Auf die Plätze, Fertig, APP! Who am I ? • Daniel Knott • Software Test Manager @AOE • Mobile

Questions

Thank you for your attention

httpwwwadventuresinqacom

33 16 Mai 2014

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 33: Vienna Mobile Quality Crew Auf die Plätze, Fertig, …...Vienna Mobile Quality Crew Auf die Plätze, Fertig, APP! Who am I ? • Daniel Knott • Software Test Manager @AOE • Mobile

33 16 Mai 2014

AOE GmbH

LuisenForum Kirchgasse 6

65185 Wiesbaden

Germany

Phone +49 6122 70 70 7 - 0

Fax +49 6122 70 70 7 - 199

E-Mail salesaoecom

Web wwwaoecom

I in Germany

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 34: Vienna Mobile Quality Crew Auf die Plätze, Fertig, …...Vienna Mobile Quality Crew Auf die Plätze, Fertig, APP! Who am I ? • Daniel Knott • Software Test Manager @AOE • Mobile

Links amp References

bull World Quality Report [httpwwwsogeticomen-uslooking-for-solutionsServicesSoftware-

Control-TestingThe-World-Quality-Report-2013--2014]

bull Robotium [httpscodegooglecomprobotium]

bull Spoon [httpsgithubcomsquarespoon]

bull Robolectric [httprobolectricorg]

bull Calabash for Android [httpsgithubcomcalabashcalabash-android]

bull Selendroid [httpselendroidio]

bull ExtSolo

[httpdocstestdroidcom_staticextSolodocscombitbarrecorderextensionsExtSolohtml]

bull Espresso [httpscodegooglecompandroid-test-kitwikiEspresso]

bull Monkey [httpdeveloperandroidcomtoolshelpmonkeyhtml]

bull UI AutoMonkey [httpsgithubcomjonathanpennui-auto-monkey]

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 35: Vienna Mobile Quality Crew Auf die Plätze, Fertig, …...Vienna Mobile Quality Crew Auf die Plätze, Fertig, APP! Who am I ? • Daniel Knott • Software Test Manager @AOE • Mobile

Links amp References

bull MonkeyTalk [httpswwwcloudmonkeymobilecommonkeytalk]

bull UIAutomation[httpsdeveloperapplecomlibrarymacdocumentationDeveloperToolsConceptual

InstrumentsUserGuideUsingtheAutomationInstrumentUsingtheAutomationInstrumenthtml]

bull Keep It Functional [httpsgithubcomkif-frameworkKIF]

bull XCTest

[httpsdeveloperapplecomlibraryiosdocumentationToolsLanguagesConceptualXcode_Overvi

ewUnitTestYourAppUnitTestYourApphtml]

bull Calabash for iOS [httpsgithubcomcalabashcalabash-ios]

bull ios-driver [httpios-drivergithubioios-driverpage=home]

bull Kiwi [httpsgithubcomallendingKiwi]

bull Appium [httpappiumio]

bull JouleJunit [httpscodegooglecompjouleunit]

bull Energy Usage Instruments

[httpsdeveloperapplecomlibraryiosdocumentationAnalysisToolsReferenceInstruments_User

_ReferenceEnergyUsageInstrumentEnergyUsageInstrumenthtml]

Page 36: Vienna Mobile Quality Crew Auf die Plätze, Fertig, …...Vienna Mobile Quality Crew Auf die Plätze, Fertig, APP! Who am I ? • Daniel Knott • Software Test Manager @AOE • Mobile