Everything from Scratch: A journey as Software Engineer in Test to improve "Testing"

Hiroyuki Ito (LINE Corporation, DSE Center SET, @hageyahhoo)

LINE Developer Meetup #64 "Development and Test"
https://line.connpass.com/event/179721/

Transcript

1. )JSPZVLJ*UP
   !IBHFZBIIPP
   
   &WFSZUIJOH
   GSPN4DSBUDI
   "KPVSOFZBT
   4PGUXBSF&OHJOFFSJO5FTU 4&5
   
   UPJNQSPWF5FTUJOH
   

   View Slide

2. 2VFTUJPO
   
   4PNFNFNCFSTUFBNTPQQPTFE
   ZPVSBDUJWJUJFT
   )BWFZPVGBDFEXJUIGPMMPXJOHUSPVCMFT
   GPSZPVSUFTUSFMBUFEBDUJWJUJFT
   /PPOFVTFE UPPMTTPMVUJPOT
   ZPVJOWFOUFEJOUSPEVDFE
   5IFSFXFSFGFXNFNCFST
   XIPIBWFFOPVHI TLJMMTLOPXMFEHF
   

   View Slide

3. 5SPVCMFTBT4&5
   
   /PDMFBSHPBMT CZTFOJPSNBOBHFST
   %JTTFOTJPO BNPOH
   EFWFMPQFSTUFTUFSTNBOBHFST
   /FHBUJWFGFFECBDL
   UPPVSUPPMTTPMVUJPOT
   )JSP`T
   $BTF
   

   View Slide

4. 8FDBODIBOHFEJGGJDVMUJFT
   JOUPTPNFUIJOHTQFDJBM
   XJUIQSPQFSBQQSPBDIFT
   

   View Slide

5. 0VSUFBNJOWFOUFE
   OFXJEFBTUPPMTTPMVUJPOT
   GSPN4DSBUDI
   

   View Slide

6. (PBMPG5IJT4FTTJPO
   
   Given we have troubles of testing
   When we discuss and share troubles
   And I share our solutions
   Then we get hints to get over them
   

   View Slide

7. "HFOEB
   
   *NQPSUBODFPG(FUUJOH4VQQPSUT
   &YQFSJFODF)BSETIJQT5PHFUIFS
   /VSUVSF"MMGPS*OOPWBUJPOT
   

   View Slide

8. 
   *NQPSUBODFPG(FUUJOH4VQQPSUT
   &YQFSJFODF)BSETIJQT5PHFUIFS
   /VSUVSF"MMGPS*OOPWBUJPOT
   

   View Slide

9. -FU`T%JTDVTT NJO
   
   
   8IBUCMPDLTCMPDLFE
   5FTU"VUPNBUJPO
   JOZPVSPSHBOJ[BUJPO
   

   View Slide

10. #MPDLFST
    
    #ZEFDJTJPONBLFSTDPMMFBHVFT
    • /PDMFBSWJTJPOHPBMT
    • /PTIBSFEVOEFSTUBOEJOH
    • /PTVQQPSUT
    • 6ODMFBSOFFETEFNBOET
    )JSP`T
    $BTF
    

    View Slide

11. #MPDLFST
    
    #ZEFDJTJPONBLFSTDPMMFBHVFT
    • /PDMFBSWJTJPOHPBMT
    • /PTIBSFEVOEFSTUBOEJOH
    • /PTVQQPSUT
    • 6ODMFBSOFFETEFNBOET
    5IFZBSFDSJUJDBM
    /FFEUPTPMWF
    )JSP`T
    $BTF
    

    View Slide

12. ,FZ1PJOU
    
    )PXUPHFU
    TVQQPSUVOEFSTUBOEJOH
    GSPN
    • EFDJTJPONBLFST
    • DPMMFBHVFT
    

    View Slide

13. 5XP6TFGVM5FDIOJRVFT
    
    1SPEVDU%JTDPWFSZ
    (JWJOH*NQBDUT
    

    View Slide

14. 1SPEVDU%JTDPWFSZ
    
    %JTDPWFSJOHSFGJOJOHTPMVUJPOT
    CZJUFSBUJWFIZQPUIFTJTBOEUFTUDZDMF
    CZ%BWJE)VTTNBO
    • 1FSTPOB
    • 6TFS*OUFSWJFX
    • 6TFS4UPSZ.BQQJOH
    • .71
    • ,1*
    

    View Slide

15. %JTDPWFS SFBMDPODFSOT
    BOEWFSCBMJ[F UIFN
    GSPN
    • EFDJTJPONBLFST
    • DPMMFBHVFT
    

    View Slide

16. 7FSCBMJ[FE$PODFSOT
    
    *ODSFBTFPGPVUBHFT JO
    l$IBOOFM(BUFXBZzTFSWJDF $(8
    
    XBTDSJUJDBM
    /FFEGBJMVSFEFUFDUJPONFDIBOJTN
    GPS$(8
    5FTUJOH"1*TXBTJOTVGGJDJFOU
    JOFBDITFSWJDF
    .BJOMZEJEJUNBOVBMMZUIFO
    
    

    View Slide

17. (JWJOH*NQBDUT
    
    %PUIFNDPOTUBOUMZUPBUUSBDU
    EFDJTJPONBLFSTDPMMFBHVFT
    “How Google Tests Software”
    James A. Whittaker, Jason Arbon, and Jeff Carollo
    Addison-Wesley Professional (2012)
    ISBN-13: 9780132851558
    

    View Slide

18. *NQBDUTBT4&5
    
    %FMJWFS FYFDVUBCMF
    WBMVFTXFFLMZ
    )JSP`T
    $BTF
    

    View Slide

19. 7BMVFT%FMJWFSFE
    
    
    8FFL 4UBSUFE XSJUJOH UFTU TDSJQUT
    UP VOEFSTUBOE TFSWJDFT
    8FFL 1SPQPTFEGJSTUJEFBPG4&5BDUJWJUJFT
    UP EFDJTJPONBLFST
    8FFL #VJMUNFDIBOJTNUPSVOBOE SFQPSU
    TUBUJDDPEFBOBMZTJT SFHVMBSMZ
    8FFL 4IBSFEUPEFWFMPQFST
    IPXUPCVJME TUBUJDDPEFBOBMZTJT
    8FFL 1SPQPTFENJMFTUPOFTPGBDUJWJUJFT
    UP EFDJTJPONBLFST
    

    View Slide

20. 7BMVFT%FMJWFSFE
    
    
    8FFL "HSFFEXJUI QSPQPTBMTNJMFTUPOFT
    XJUIEFDJTJPONBLFST
    8FFL $PMMFDUFEJOGPSNBUJPO BOEUPPMT
    PG5FTUFST2"JOPOFQMBDF
    8FFL *NQMFNFOUFEGBJMVSFEFUFDUJPO
    GPS $(8
    8FFL (VJEFEUPTUBSUSFHVMBS NFFUJOHT
    XJUIEFWFMPQFSTBOE2"
    8FFL 4UBSUFETPMWJOHQSPCMFNT
    CZEFWFMPQFST TUFQCZTUFQ
    

    View Slide

21. 3FTVMUT
    
    8JUIJOUIFGJSTUNPOUIT*KPJOFE%
    .BOZDPMMFBHVFTTUBSUFE
    UBMLJOHBCPVU4&5
    %FDJTJPONBLFSTTUBSUFE
    TVQQPSUJOH4&5BDUJWJUJFTQPTJUJWFMZ
    4&5TUBSUFE
    JNQSPWFNFOUBDUJWJUJFT GPS$(8
    

    View Slide

22. 
    *NQPSUBODFPG(FUUJOH4VQQPSUT
    &YQFSJFODF)BSETIJQT5PHFUIFS
    /VSUVSF"MMGPS*OOPWBUJPOT
    

    View Slide

23. -FU`T%JTDVTT NJO
    
    
    )PXUPQFSTVBEF
    EFWFMPQFST
    UPXSJUFUFTUTDSJQUT
    

    View Slide

24. ,FZ1PJOU
    
    &YQFSJFODJOHIBSETIJQT
    XJUI
    QSPEVDUEFWFMPQNFOUUFBNT
    UPHFUIFS
    

    View Slide

25. 0VS&YQFSJFODF3FQPSU
    
    'BJMVSFEFUFDUJPOTZTUFN
    BU
    $(8
    

    View Slide

26. 4ZTUFN*NBHFPG$(8
    
    • 0GUFODBVTFEPVUBHFT
    • 5FOEFEUPEFMBZEFUFDUJOHGBJMVSFT
    5IJTJTBOJNBHF
    6TFS $(8
    4UPSF
    (BNF
    0UIFST
    

    View Slide

27. 7FSXJUI+6OJUBOE$*
    
    

    View Slide

28. 7FSXJUI+6OJUBOE$*
    
    %JEO`U
    CFDPNFFTUBCMJTIFE
    BUUIFUFBNL
    5FTUTDSJQUTBSFIBSE
    UPSFBEJNQMFNFOUNBJOUBJO
    GPSEFWFMPQFST1SPEVDU.BOBHFS
    

    View Slide

29. 1SPEVDU%JTDPWFSZ"HBJO
    
    

    View Slide

30. ,BSBUF BTB4PMVUJPO
    
    0QFOTPVSDFEGSBNFXPSL
    GPSUFTUJOH"1*T
    • 6TFT(IFSLJO TZOUBY
    • 4VQQPSUTUFTUJOH3&45GVM"1*T
    • &BTZUPFYQBOEUPUFTUH31$5ISJGU
    • :PVDBOGJOEJUPO5FDIOPMPHZ3BEBS
    

    View Slide

31. 7FSXJUI,BSBUF
    
    

    View Slide

32. 7FSXJUI+6OJUBOE$*
    
    

    View Slide

33. &YQFSJFODFE)BSETIJQT
    
    8JUI$(8NFNCFSTUPHFUIFS
    GPSNPOUIT
    $(8
    
    
    5IJTDBTFJTIBSE
    UPJNQMFNFOU
    )PXUPEPJU
    4&5
    
    
    0,)PXBCPVU
    BEEJOHB1MVHJO
    MJLFUIJT
    $(8
    
    
    8FMM IPXBCPVU
    BEEJOHUIJTGFBUVSF
    UPP
    

    View Slide

34. 3FTVMUT
    
    #FDBNFUIFNPEFMDBTFPG
    JNQSPWFNFOUTJOPVSDPNQBOZ
    • 0VUBHFT
    • "MMNFNCFSTIBWFCFFOXSJUJOHUFTUT
    • *ODMVEJOH1SPEVDU.BOBHFS
    

    View Slide

35. DPNQBTTJPO &/
    
    DPNQBUJP -"
    
    

    View Slide

36. 
    *NQPSUBODFPG(FUUJOH4VQQPSUT
    &YQFSJFODF)BSETIJQT5PHFUIFS
    /VSUVSF"MMGPS*OOPWBUJPOT
    

    View Slide

37. -FU`T%JTDVTT NJO
    
    
    8IBUJT
    UIFEJGGJDVMUZPG
    UFTUJOH.JDSPTFSWJDFT
    

    View Slide

38. )VHF#MPDLFST
    
    -BDLPGTLJMMTPG
    • %FWFMPQFST
    • 5FTUFST2"
    • 4&5 VT
    
    )JSP`T
    $BTF
    

    View Slide

39. ,FZ1PJOU
    
    /VSUVSF
    NFNCFSTUFBNTPSHT
    GPS
    PVSJOOPWBUJWFBDUJWJUJFT
    

    View Slide

40. -FBSOJOH4FTTJPOTJO4&5
    
    4UVEZTFTTJPOT
    EVSJOHCVTJOFTTIPVST%
    5BVHIUCZ$ISJT-VDJBO
    UIFJOWFOUPSPG
    .PC1SPHSBNNJOH
    BU"HJMF
    

    View Slide

41. 0VS5FBN`T3VMFT
    
    • NJOEBZ FWFSZEBZ
    • %VSJOH CVTJOFTT IPVSTBT B XPSL
    • "OZ UPQJDT0,GPS PVS EBJMZ XPSL
    • 8JUI .PC 1SPHSBNNJOH XBZ
    • /PDSJUJDJTNXJUIBGVO
    

    View Slide

42. 8IBU8F-FBSOFE
    
    • ,VCFSOFUFT
    • ,BSBUF "1*5FTUJOH
    
    • 7VFKT
    • 4IPSUDVULFZTPG*OUFMMJ+*%&"
    • 5IF%SVDLFS&YFSDJTF
    • )PXUPXSJUFBHPPESFQPSU
    

    View Slide

43. 3FTVMUT
    
    *OWFOUFEl4FCBT3FQPSUz
    • $BOQJOQPJOU UIFSPPUDBVTFPG
    GBJMVSFTPO.JDSPTFSWJDFT
    • $BOSFEVDF.553
    .FBO5JNF5P3FDPWFSZ
    
    • $BOUBNF UIFDPNQMFYJUZPG.JDSPTFSWJDFT
    

    View Slide

44. "3FQPSUJOH5PPM
    
    

    View Slide

45. 'PS,BSBUF6TFST
    
    

    View Slide

46. 1JOQPJOUUIF3PPU$BVTF
    
    

    View Slide

47. 7JTVBMMZ"OE7FSZ2VJDLMZ
    
    

    View Slide

48. #Z6TJOH8IBU8F-FBSOFE
    
    

    View Slide

49. 3FTVMUTPG4FCBT3FQPSU
    
    • *NQSPWFE.553
    • 'BJMVSFEFUFDUJPOXIST
    • *NQSPWFESFTJMJFODF
    • $BOSFDPWFSTFSWJDFTRVJDLMZ
    • 6TFSTBSFJODSFBTJOH
    • UFBNT BSFVTJOH
    
    

    View Slide

50. <"QQFOEJY>
    0UIFS"DUJWJUJFT
    

    View Slide

51. *OIPVTFQFSGPSNBODFUFTUJOHQMBUGPSN
    "ZBQFSG
    
    5IJTEJBHSBNJODMVEFTUIFXPSL
    UIBUJTEJTUSJCVUFEJOUIF"QBDIF-JDFOTF
    

    View Slide

52. %FTJHO4QSJOU
    
    %PGPMMPXJOHUBTLTXFFLMZ
    • $MBSJGZUFTUSFMBUFEJTTVFT
    • $IPPTFPOFBDUJPO
    • #VJMEJURVJDLMZ
    • (FUGFFECBDLGSPNlVTFSTz
    • $POUJOVFPSQJWPU
    “Sprint: How to Solve Big Problems
    and Test New Ideas in Just Five Days”
    Jake Knapp, John Zeratsky, and Braden Kowitz
    Simon & Schuster (2016)
    ISBN-13: 9781501121777
    

    View Slide

53. 5FTUBCMF*OGSBTUSVDUVSF
    
    5SZJOHUPQSPWJEFBQMBUGPSN
    UIBUDBODPQZUFTUFOWJSPONFOUT
    XJUI,VCFSOFUFT
    

    View Slide

54. $PODMVTJPO
    

    View Slide

55. 0VS*NQBDUT
    
    4PNFUFBNTTUBSUFEBDUJPOT
    CBTFEPOPVSBDUJWJUJFT
    0OFUFBNDPOUBDUFEVTBOE
    TUBSUFEVTJOH4FCBTBOE"ZBQFSG
    0OFUFBNTPMWFEJUTTMPXUFTUJTTVFT
    CZUIFJSPXO
    

    View Slide

56. 8FDBODIBOHF
    EJGGJDVMUJFT
    JOUP
    TPNFUIJOHTQFDJBM
    

    View Slide

57. XJUIQSPQFS
    BQQSPBDIFT
    

    View Slide

58. 0VS&YBNQMFT
    
    (FUUJOH1SPQFS4VQQPSUT
    &YQFSJFODF)BSETIJQT5PHFUIFS
    /VSUVSF"MMGPS*OOPWBUJPOT
    

    View Slide

59. -FU`T
    FYQFSJNFOU
    

    View Slide

60. IUUQTXXXBHJMFBMMJBODFPSHBHJMF
    

    View Slide