TESTING MOBILE WITH€¦ · 5/1/2014 Testing Mobile with Appium 2/24
Mobile game testing report
-
Upload
qa-madness -
Category
Documents
-
view
123 -
download
5
Transcript of Mobile game testing report
1
Mobile Game Testing Report
Version: example
2
Contents
1.0 Introduction…………………………………………………………………………… 3
1.1 Purpose……………………………………………………………………………... 3
2.0 Environment …………………………………………………………………………... 4
2.1 Android devices: …………………………………………………………………... 4
2.2 iOS devices…………………………………………………………………………. 4
3.0 Test Results……………………………………………………………………………. 5
3.1 List of functionalities that were checked………………………………………… 5
3.2 List of bugs…………………………………………………………………………. 8
3
1.0 Introduction
Game description Adventure
Supports High-end smartphones and tablets
Game localization English, Chinese, French, German, Italian, Japanese, Korean, Brazilian, Portuguese, Portuguese, Russian, Spanish
Supported platforms iOS, Android
Over quests to solve
● 66 locations to search; ● 43 puzzles and mini-games; ● Two game modes: expert and regular.
1.1 Purpose
This Test Report provides the summary of the results of test performed as outlined within this document. It shows to the best extent the testing environment, test results and the examples of bug reports.
4
2.0 Environment: The game is implemented on Android and iOS devices.
2.1 Android devices:
Resolution
Device model
Processor architecture
OS
Version
GPU
RAM, Mb
Processor
Test Result
1080x1920 Xiaomi Mi3 ARMv7 Android
4.4.3 Adreno 330 2Gb Qualcomm
Snapdragon 800 2,3 GHz
Passed
480 × 800 Samsung GT-I8160 ARMv7 Android
4.1.2 ARM
Cortex-A9 768 mb
NovaThor U8500 800 MHz Passed
1280x720 Huawei MT1-U06 ARMv7 Android
4.1.2 GC4000 2Gb Hi-Silicon K3V2, 1.5 GHz Passed
1080x1920 Xperia Z ARMv7 Android 4.4.4 Adreno 320 2Gb
Qualcomm Snapdragon S4 Pro APQ8064 1.5 GHz
quad-core Krait
Passed
1920x1080 Samsung Galaxy s4 ARMv7 Android
4.4.2 Exynos 5
Octa 2Gb Samsung Exynos 5 Octa 5410/1.6 GHz Passed
1280 x 800 Kindle Fire 2gen ARMv7 Android
4.0.3
Imagination Technologi
es PowerVR SGX540
1Gb Dual-core 1.2 GHz TI OMAP4 4430 Passed
2.2 iOS devices:
Device
OS Version
Resolution
Test Result
iPhone 6+ iOS 8.0.2 Retina HD 1080 × 1920 Passed
iPhone 5 iOS 8.0.2 Retina 640 × 1136 Passed
iPad Mini iOS 8.0.2 1024 × 768 Passed
iPad 3 iOS 7.1.2 2048 × 1536 Passed
iPod Touch iOS 6.1.3 960 x 640 Passed
5
3.0 Test Results
3.1 List of functionalities that were checked
Functionality Result
Check internet-connection on the device Passed
Check standart apps on the device Passed
Installation the game
Installing the game from Amazon Passed
Installing the game from Google Play Passed
Installing the game from iTunes Passed
Check test app icon on all device menus Passed
Check that the icon of the application corresponds to the approved marketing Passed
Note the name of the application under the icon on all device menus Passed
Check that game size corresponds to the approved marketing Passed
Splash Screen exists and displayed correctly after starting the game Passed
Rotating the screen
Check that rotating the device works on all game stage, on all screens Passed
Check that rotation is carried out smoothly Passed
Check that Splash screen is displayed correctly in all device rotation Failed
Check that rotation is carried out correctly on loading screens Passed
Check rotation functionality if it turned off in device settings Passed
User Interface
Check default user name during the first game start Passed
All graphic elements, texts and animations have high resolution Failed
In the main menu there is Settings button Passed
6
Tell a Friend functionality is implemented in the main menu screen Passed
Check the ability to return to previous screen from any screen Passed
Check the ability to put the game on pause on any game stage Passed
Check that scroll is working in game Failed
Check game process when hints are turned off Passed
Proper device operability after playing the app
Checking the device operability after playing the app Passed
Wifi works correctly Passed
All standard apps and downloaded apps work properly Passed
All emails can be sent and received Passed
Check hint functionality
Check that hints are worked correctly Passed
Hints appearing for new functionality Passed
Game progress saving
Checking saving sound settings. Failed
Checking saves after each level completed Failed
Checking the saves for full discharge device in the game Passed
Interaction with charging
Checking application interaction with the charger unit Passed
Suspend Events
Checking the correct operation of the application while leaving the device in Sleep Mode
Passed
Checking the correct operation of the application while the output device into sleep mode with button Power
Passed
Checking the correct operation of the application during the set reminders. Failed
Correct operation of the application, if during the game take the call. Passed
Correct operation of the application, with the lifting of the incoming call. Passed
7
Correct operation of the application, if during the game to take and view SMS. Passed
Check that the screen device fades after 2 minutes after the last touch on the screen Passed
Game localization
Checking the start of the game on the game supported languages. Check for all supported languages game
Failed
Checking the start of the game on the not supported languages Passed
In-App Purchase
Check that in-App Purchase is worked correctly Passed
Loading processes
Checking download time information screens. Passed
Check that loading on all screens/game phases is correctly displayed and works as expected
Passed
When loading takes more than 3 sec loading process should be displayed Passed
Remove an application
Checking the removal of the application running device. Passed
Checking the application after removing it from the device and install again. Passed
8
3.2 List of bugs
Key
Summary
Priority
Environment
Description
1 There is a gap between the area of the text and the edge of the screen while viewing comics
Minor Xiaomi MI3 Android 4.4.3
Steps to reproduce: 1. Run the application 2. Wait till comics are displayed 3. Pay attention to the area with the text Actual result: There is a gap between the area of the text and the edge of the screen while viewing comics Expected result: The gap between the area of the text and the edge of the screen shouldn’t be displayed while viewing comics
2 The map is not saved when you press the Power button and return to the game.
Major Xiaomi MI3 Android 4.4.3
Steps to reproduce: 1. Run the application 2. Start playing the game 3. Open Map 4. Press the Power button 5. Press the Power button again 6. Continue playing the game Actual result: The map is not saved when you press the Power button and return to the game. Expected result: The map should be saved when you press the Power button and return to the game.
3 Download window does not appear immediately
Major Huawei MT1-U06, Android 4.1.2
Steps to reproduce: 1. Install the application on the device. 2. Run the application. 3. Wait till main menu is loaded 4. Tap Play button Actual result: Download window does not appear immediately Expected result: Download window should appear immediately after Play button is tapped
9
4 After the localization is changed to Asian the user is logged out from Facebook
Major Samsung Galaxy s4, Exynos 5 Octa Huawei MT1-U06, Android 4.1.2
Steps to reproduce: 1. Install the application on the device. 2. Run the application. 3. Wait till main menu is loaded 4. Log in to Facebook 5. Change the language on the device 6. Go back to the app Actual result: After the localization is changed to Asian the user is logged out from Facebook Expected result: After the localization is changed to Asian the user should still be logged in to the Facebook account
5 Menu-pause is shown in a couple of seconds after the returning to the application after Sleep Mode
Minor Kindle Fire 2gen, Android 4.0.3
Steps to reproduce: 1. Install the application on the device. 2. Run the application. 3. Stop playing and wait till the app will go into the Sleep Mode 4. Open the app again Actual result: Menu-pause is shown in a couple of seconds after the returning to the application after Sleep Mode Expected result: Menu-pause should be shown immediately after the returning to the application after Sleep Mode
6 The game crashes after tapping on the screen a lot of times
Critical iPhone 5, iOS 8.0.2, iPhone 6+, iOS 8.0.2
Steps to reproduce: 1. Install the application on the device. 2. Run the application 3. Tap on the screen for more than 10 seconds Actual result: The game crashes after tapping on the screen a lot of times Expected result: The game should not be crashed after tapping on the screen a lot of times. Taps should not crash the game.
7 Device screen is not damped after 2
Minor iPad mini, iOS 8.0.2
Steps to reproduce: 1. Run the application
10
minutes of the last touch to the screen
2. Start playing the game 3. Do not touch the screen of the device for 2 minutes Actual result: Device screen is not damped after 2 minutes of the last touch to the screen Expected result: Device screen is damped after 2 minutes of the last touch to the screen
8 Command “ce_menubutton” is not displayed in the logs after clicking Main Menu button
Minor iPad 3, iOS 7.1.2 Steps to reproduce: 1. Start the game 2. Click any item in Main Menu 3. Minimize app 4. Maximize app 5. Collect the Logs Actual result: Command “ce_menubutton” is not displayed in the logs after clicking Main Menu button Expected result: Command “ce_menubutton” is displayed in the logs after clicking Main Menu button
9 It is impossible to swipe the map
Major iPod Touch, iOS 6.1.3
Steps to reproduce: 1. Start the game 2. Try to swipe map Actual result: It is impossible to swipe the map Expected result: It should be possible to swipe the map
10 Game description screen is displayed always in English
Major iPhone 5, iOS 8.0.2; iPhone 6+, iOS 8.0.2; iPad Mini, iOS 8.0.2; iPad 3, iOS 7.1.2
Steps to reproduce: 1. Set device language - Russian 2. Set game language - Auto 3. Launch game, look at the Game Description screen 4. Set device language - Spanish 5. Launch game, look at the Game Description screen
11
Actual result: Game Description is always in English Expected result: Game Description text adapts to device language