Жизнь без QA

Александр Смирнов @ PapaJobs – MOSDROID #5 Boron

Обсудим как быть уверенными в качестве вашего приложения без специально обученных и выделенных для этого людей. Если же в вашей команде есть QA специалисты, вам доклад поможет уменьшить количество багов которые они заводят после того как вы поставили Done таску в JIRA.

Transcript

1. Life without QA ALEXANDER SMIRNOV 27.01.2017
3. WHOAMI ANDROID GDE ANDROID В ЛИЦАХ – @ANDROIDINFACES CTO IN PAPAJOBS MOSDROID
4. GOOD APP?
5. GOOD APP?
6. GOOD APP IT KNOWS ITS AUDIENCE ITS STABLE IT DOES ONE THING WELL ITS FAST ITS POLISHED
7. COMPLEXITY
8. JUST RELAX RETROFIT || OKHTTP || RXJAVA || COROUTINES CLEAN ARCHITECTURE || LIVE DATA || ROOM PICASSO || GLIDE || FRESCO MVVM || MVP || MVI || MVC KOTLIN
10. RELAX? 915 103 765
11. RELAX? 1 CASE PER MS = 1.5 WEEKS TO FINISH 1 CASE PER SECOND = 29 YEARS FOR TESTING
12. RELAX? 1 CASE PER MS = 1.5 WEEKS TO FINISH 1 CASE PER SECOND = 29 YEARS FOR TESTING MOST AT KILLS AND RELAUNCH APP WITH EACH TEST CASE
13. RELAX? YOU CAN’T TEST EVERY CASE DO AUTOMATIONS
14. REAL SITUATION A LACK OF AUTOMATION SOLO – IT’S WITHOUT TEST PLAN? TESTING IS HARD QA PROCESS PROBLEMS
15. AUTOMATIZATION TDD BDD UNIT TESTS INTEGRATION TESTS
16. TEST PLAN DIAGRAM TEST CASES TABLE TIME–TIME–TIME
17. TABLE CURRENT STATE STEPS NEW STATE TO VERIFY – Launch App Empty task manager state No tasks Press “+” Verify new task New task modal Create task Return to task list
 New task is present Single task is shown Press “done” Task is remove from list Empty task manager state Single task is shown Press “remove” Task is remove from list Empty task manager state
18. TEST CASES PRESS “+” INPUT RANDOM TEXT LAUNCH APPLICATION CHOOSE CATEGORY PRESS “DONE” VERIFY THE ITEM ON THE LIST
19. WHY TEST CASES HITS EVERY STATE A USER CAN READILY CONVERTIBLE TO TEST PLAN CLEAR AND CONCISE PATTERNS FOR APP USAGE FROM A “GOOD” STATE DIAGRAM CAN INFER REQUIREMENTS
20. TEST PLAN DO NOT NEED ANCILLARY REQUIREMENTS TO FOLLOW PLAN STRAIGHT FORWARD EXECUTION EASILY FLOWS FROM A STATE TABLE HIGHLY REPEATABLE + COVER ALL STATES PROVIDES COMPLETED VERSUS NOT-COMPLETED LIST ENABLES QA/TEAM REVIEW
21. WHAT SHOULD YOU TEST? ADHOC TESTING NEGATIVE TESTING ALWAYS TEST THE HAPPY PATH REPEAT TESTS LOOK AT ALL SUPPORTED OS LEVELS
22. UPGRADE RELEASE BUGS? LOOK FOR THE FOLLOWING: ALWAYS DO UPGRADE TESTS DATABASE/DATA ISSUES ENSURE NO DEBUG OPTIONS ARE LEFT DATA/SETTINGS ARE RETAINED
23. USE YOUR APP IN ANY FREE MINUTE – USE YOUR APP REPEAT SPEND SOME TIME GETTING TO KNOW YOUR APP
24. WHAT IF!? WHAT IF I DO SOMETHING!? WHAT IF USER DO SOMETHING!? WHAT IF THERE IS BETTER WAY TO DO SOMETHING!? WHAT IF DATA WILL STRANGE!?
25. ROADS OF USING APP RESUMED WITH MULTITASKING VIEW APP OPENED VIA DEEPLINK APP ICON TAPPED CLEAN APP LAUNCH REAL DEVICES
26. FARMS OPEN STF УПРАВЛЕНИЕ ФЕРМОЙ ANDROID УСТРОЙСТВ. ПАВЕЛ НОВИКОВ SAD BUT YOU DON’T NEED UI TESTS
27. CONSIDERATIONS PERMISSIONS + ZERO SCREENS API STATE NETWORK CONNECTIVITY (HELLO 2GTUESDAY) FIRST LAUNCH VS SUBSEQUENT LAUNCHES UPGRADE VS CLEAN INSTALL BACKGROUND VS FOREGROUND ACTIONS
28. RESTRICTIONS BROADCAST RESTRICTION BACKGROUND LIMITATIONS PERMISSIONS
29. OFFLINE LOSE INTERNET WHILE USING THE APP NO INTERNET FROM START OFFLINE SUPPORT: “TRY AGAIN, LATER”, NO MORE – YONATHAN LEVIN
30. STATE TRANSITION STATE TRANSITION POSSIBLE WHILE APP IS OPEN IS ALL OF THE DATA FOR A STATE TRANSITION PRESENT? APP IS BACKGROUNDED (BACKGROUND REFRESH) APP IS KILLED
31. STATE TRANSITION MISSED CONNECTIONS WHAT IF THE APP IS KILLED DURING STATE1, AND MISSES STATE2 ENTIRELY? IS ALL OF THE DATA FOR A STATE TRANSITION PRESENT? WHAT HAPPENS IF THE API HICCUPS, AND BYPASSES STATES2? CAN THE APP RECOVER AND SEAMLESSLY GO FROM STATE 1 TO STATE3?
32. BE PEDANT IS THIS SOMETHING THAT COULD HAPPEN? IS THIS SOMETHING THAT SHOULD BE EXPECTED? IS THIS REALLY A BUSINESS QUESTION
33. SHORT STORY USE AUTOMATION TOOLS TEST BLACK BOX LIKE AS USER NOT AS UNIT TESTS TALK WITH QA AND CREATE TEST CASES USE YOUR APP REVIEW – DO IT YOURSELF MAKE FUN
34. ENJOY sm@papajobs.ru @_smred @smred