Mobile App Testing By Proko Chou 

About Me ● 8+ years mobile application testing experience in HTC and CloudMosa ● OS: ○ Android ○ iOS ○ Windows ○ Brew ● Applications: ○ Browser ○ Galery (Album) ○ Camera ○ Music ○ Video player ○ Voice recorder ○ MMS ○ …… 

Agenda ● Before Testing: Test Sample ● Test Coverage ○ Basic Function ○ Compatibility ○ Integration ○ Stress ○ Power Consumption ● Q & A 

Before testing: Prepare Test Sample ● Different Type: ○ Album: png, jpeg, bmp,gif, etc. ○ Music: mp3, wav, aiff, etc. ● Different Size: ○ Album: 0 bytes, normal size, big size image ○ Video player: 0 bytes, normal size, big size video ● Different Environment: ○ Camera: yellow light, sparkled item, colorful item ○ Internet: metallic box, 2G/3G/ 4G SIM, VPN account Sparkled Item Colorful Item Metallic box 

Before testing: Device Precondition ● Create datas on devices under testing (DUT) ○ Log in mail accounts ○ Messenger: Line, Whatsapp or Facebook messenger ○ Many SMS/ MMS messages ○ Many photos in ablum ○ Enable lockscreen ○ …... 

Test Coverage 

Basic Function ● 使用者介面 (UI / Multi-Language / IME Check) ● 邊界 (Boundary) ● 記憶體釋放 (Memory leakage) ● 錯誤處理 (Error Handling) ● 安裝(Install) 、反安裝 (Uninstall)、儲存至SD card (Move to SD card) ● 使用者資料保存 (Data Migration) ● 重啟 (After relaunching) ● 清除App資料 (After clearing application’s data) ● 清除整台機器的資料 (After resetting the device) 

Basic Function ● 使用者介面 (UI / Multi-Language / IME Check) ● 邊界 (Boundary) ● 記憶體釋放 (Memory leakage) ● 錯誤處理 (Error Handling) ● 重啟 (After relaunching) ● 使用者資料保存 (Data Migration) ● 取消該功能的使用 (Stop feature function) ● 安裝(Install) 、反安裝 (Uninstall) ● 清除App資料 (After clearing application’s data) ● 清除整台機器的資料 (After resetting the device) 

Test Coverage: Compatibility 

Compatibility: Different Devices ○ Device: ■ iOS: ○ iPad: iPad 2 ○ iPad with Retina: iPad 3 or iPad 4 ○ iPad with split function: iPad air 2, iPad pro ○ iPhone ○ Device with 3D touch function ■ Android: ○ Tablet /Phone ○ Device with Pen and Keyboard ○ Different devices test on Cloud: (250 mins free) ■ AWS Test: https://aws.amazon.com/tw/device-farm/ 

Compatibility: Different OS Version ● Support old and current version: ○ iOS: ■ iOS5~6 ■ iOS 7 ■ iOS8~ iOS9 ■ iOS 10 ○ Android: ■ Gingerbread 2.3–2.3.7 ■ Honeycomb (Tablet only) 3.0–3.2.6 ■ Ice Cream Sandwich 4.0–4.0.4 ■ Jelly Bean 4.1–4.3.1 ■ KitKat 4.4–4.4.4, 4.4W–4.4W.2 ■ Lollipop 5.0–5.1.1 ■ Marshmallow 6.0–6.0.1 ● Beta version test during July ~ September each year！！ 

Test Coverage: Integration 

Integration: Internet 

Integration: Internet (1/2) Airplane Mode VPN Under connecting or loading No Connection (Use Metallic box) Connect via proxy Weak signal (Use Elevator) Normal Connection Data Connection 

Integration: Internet (2/2) Emulate network connectivity: ● Facebook Augmented Traffic Control, ATC: Reference: Link 1, Link 2 ● iOS Developer Network Link Conditioner: Reference: Link Facebook ATC iOS Developer Tool 

Integration: Keyboard ● Android: Google, Samsung, Asus, bluetooth keyboard, pen, voice input, etc. ● iOS: iAcess, voice input and split keyboard (Link) iOS: Split keyboard Bluetooth keyboard Pen 

Integration: Other Apps’ functions ○ Other applications: ■ Incoming phone call ■ Alarm ■ Voice assistant (e.g., Siri) ■ Album ■ Camera ○ Device: ■ Power off/ Resume device ■ Support split screen function ■ Support 3D touch function 

Test Coverage: Stress and Power Consumption 

Stability: Stress Test ● Keep using over X times ● Keep using over X hours ● Keep relaunching X times ● Criteria: MTBF (Reference: link) ● Monkey test ○ Monkey script for Android: https://developer.android.com/studio/test/monkey.html ○ Monkey script for iOS: https://github.com/search?utf8=%E2%9C%93&q=ios+monkey 

Power Consumption ● How many hours does an application keep working? ● Criteria: Compare to other applications 

No content