Everything from Scratch: A journey as Software Engineer in Test to improve "Testing"

Hiroyuki Ito (LINE Corporation, DSE Center SET, @hageyahhoo)

LINE Developer Meetup #64 "Development and Test"
https://line.connpass.com/event/179721/

Transcript

1. )JSPZVLJ
   *UP !IBHFZBIIPP &WFSZUIJOH GSPN
   4DSBUDI "
   KPVSOFZ
   BT 4PGUXBSF
   &OHJOFFS
   JO
   5FTU
   4&5 UP
   JNQSPWF
   5FTUJOH
2. 2VFTUJPO  4PNF
   NFNCFSTUFBNT
   PQQPTFE ZPVS
   BDUJWJUJFT )BWF
   ZPV
   GBDFE
   XJUI
   GPMMPXJOH
   USPVCMFT GPS
   ZPVS
   UFTUSFMBUFE
   BDUJWJUJFT /P
   POF
   VTFE UPPMTTPMVUJPOT ZPV
   JOWFOUFEJOUSPEVDFE 5IFSF
   XFSF
   GFX
   NFNCFST XIP
   IBWF
   FOPVHI TLJMMTLOPXMFEHF
3. 5SPVCMFT
   BT
   4&5  /P
   DMFBS
   HPBMT CZ
   TFOJPS
   NBOBHFST %JTTFOTJPO BNPOH EFWFMPQFSTUFTUFSTNBOBHFST /FHBUJWF
   GFFECBDL UP
   PVS
   UPPMTTPMVUJPOT )JSP`T $BTF
4. 8F
   DBO
   DIBOHF
   EJGGJDVMUJFT JOUP
   TPNFUIJOH
   TQFDJBM XJUI
   QSPQFS
   BQQSPBDIFT
5. 0VS
   UFBN
   JOWFOUFE OFX
   JEFBTUPPMTTPMVUJPOT GSPN
   4DSBUDI
6. (PBM
   PG
   5IJT
   4FTTJPO  Given we have troubles of testing When we discuss and share troubles And I share our solutions Then we get hints to get over them
7. "HFOEB  
   *NQPSUBODF
   PG
   (FUUJOH
   4VQQPSUT 
   &YQFSJFODF
   )BSETIJQT
   5PHFUIFS 
   /VSUVSF
   "MM
   GPS
   *OOPWBUJPOT
8.  
   *NQPSUBODF
   PG
   (FUUJOH
   4VQQPSUT 
   &YQFSJFODF
   )BSETIJQT
   5PHFUIFS 
   /VSUVSF
   "MM
   GPS
   *OOPWBUJPOT
9. -FU`T
   %JTDVTT
   
   NJO  8IBU
   CMPDLTCMPDLFE 5FTU
   "VUPNBUJPO JO
   ZPVS
   PSHBOJ[BUJPO
10. #MPDLFST  #Z
    EFDJTJPONBLFSTDPMMFBHVFT • /P
    DMFBS
    WJTJPOHPBMT • /P
    TIBSFE
    VOEFSTUBOEJOH • /P
    TVQQPSUT • 6ODMFBS
    OFFETEFNBOET )JSP`T $BTF
11. #MPDLFST  #Z
    EFDJTJPONBLFSTDPMMFBHVFT • /P
    DMFBS
    WJTJPOHPBMT • /P
    TIBSFE
    VOEFSTUBOEJOH • /P
    TVQQPSUT • 6ODMFBS
    OFFETEFNBOET 5IFZ
    BSF
    DSJUJDBM /FFE
    UP
    TPMWF )JSP`T $BTF
12. ,FZ
    1PJOU  )PX
    UP
    HFU TVQQPSUVOEFSTUBOEJOH GSPN • EFDJTJPONBLFST • DPMMFBHVFT
13. 5XP
    6TFGVM
    5FDIOJRVFT   1SPEVDU
    %JTDPWFSZ  (JWJOH
    *NQBDUT
14. 
    1SPEVDU
    %JTDPWFSZ  %JTDPWFSJOHSFGJOJOH
    TPMVUJPOT CZ
    JUFSBUJWF
    IZQPUIFTJT
    BOE
    UFTU
    DZDMF CZ
    %BWJE
    )VTTNBO • 1FSTPOB • 6TFS
    *OUFSWJFX • 6TFS
    4UPSZ
    .BQQJOH • .71 • ,1*
15. %JTDPWFS SFBM
    DPODFSOT BOE
    WFSCBMJ[F UIFN GSPN • EFDJTJPONBLFST • DPMMFBHVFT
16. 7FSCBMJ[FE
    $PODFSOT  *ODSFBTF
    PG
    PVUBHFT JO l$IBOOFM
    (BUFXBZz
    TFSWJDF
    $(8 XBT
    DSJUJDBM /FFE
    GBJMVSF
    EFUFDUJPO
    NFDIBOJTN GPS
    $(8 5FTUJOH
    "1*T
    XBT
    JOTVGGJDJFOU JO
    FBDI
    TFSWJDF .BJOMZ
    EJE
    JU
    NBOVBMMZ
    UIFO
17. 
    (JWJOH
    *NQBDUT  %P
    UIFN
    DPOTUBOUMZ
    UP
    BUUSBDU EFDJTJPONBLFSTDPMMFBHVFT “How Google Tests Software” James A. Whittaker, Jason Arbon, and Jeff Carollo Addison-Wesley Professional (2012) ISBN-13: 9780132851558
18. *NQBDUT
    BT
    4&5  %FMJWFS
    FYFDVUBCMF
    WBMVFT
    XFFLMZ )JSP`T $BTF
19. 7BMVFT
    %FMJWFSFE
      8FFL
     4UBSUFE XSJUJOH UFTU TDSJQUT UP VOEFSTUBOE TFSWJDFT 8FFL
     1SPQPTFE
    GJSTU
    JEFB
    PG
    4&5
    BDUJWJUJFT UP EFDJTJPONBLFST 8FFL
     #VJMU
    NFDIBOJTN
    UP
    SVO
    BOE SFQPSU TUBUJD
    DPEF
    BOBMZTJT SFHVMBSMZ 8FFL
     4IBSFE
    UP
    EFWFMPQFST IPX
    UP
    CVJME TUBUJD
    DPEF
    BOBMZTJT 8FFL
     1SPQPTFE
    NJMFTUPOFT
    PG
    BDUJWJUJFT UP EFDJTJPONBLFST
20. 7BMVFT
    %FMJWFSFE
      8FFL
     "HSFFE
    XJUI QSPQPTBMTNJMFTUPOFT XJUI
    EFDJTJPONBLFST 8FFL
     $PMMFDUFE
    JOGPSNBUJPO BOE
    UPPMT PG
    5FTUFST2"
    JO
    POF
    QMBDF 8FFL
     *NQMFNFOUFE
    GBJMVSF
    EFUFDUJPO GPS $(8 8FFL
     (VJEFE
    UP
    TUBSU
    SFHVMBS NFFUJOHT XJUI
    EFWFMPQFST
    BOE
    2" 8FFL 4UBSUFE
    TPMWJOH
    QSPCMFNT CZ
    EFWFMPQFST TUFQ
    CZ
    TUFQ
21. 3FTVMUT  8JUIJO
    UIF
    GJSTU
    
    NPOUIT
    *
    KPJOFE
    % .BOZ
    DPMMFBHVFT
    TUBSUFE UBMLJOH
    BCPVU
    4&5 %FDJTJPONBLFST
    TUBSUFE TVQQPSUJOH
    4&5
    BDUJWJUJFT
    QPTJUJWFMZ 4&5
    TUBSUFE JNQSPWFNFOU
    BDUJWJUJFT GPS
    $(8
22.  
    *NQPSUBODF
    PG
    (FUUJOH
    4VQQPSUT 
    &YQFSJFODF
    )BSETIJQT
    5PHFUIFS 
    /VSUVSF
    "MM
    GPS
    *OOPWBUJPOT
23. -FU`T
    %JTDVTT
    
    NJO  )PX
    UP
    QFSTVBEF EFWFMPQFST UP
    XSJUF
    UFTU
    TDSJQUT
24. ,FZ
    1PJOU  &YQFSJFODJOH
    IBSETIJQT XJUI QSPEVDU
    EFWFMPQNFOU
    UFBNT UPHFUIFS
25. 0VS
    &YQFSJFODF
    3FQPSU  'BJMVSF
    EFUFDUJPO
    TZTUFN BU $(8
26. 4ZTUFN
    *NBHF
    PG
    $(8  • 0GUFO
    DBVTFE
    PVUBHFT • 5FOEFE
    UP
    EFMBZ
    EFUFDUJOH
    GBJMVSFT 
    5IJT
    JT
    BO
    JNBHF
     6TFS $(8 4UPSF (BNF 0UIFST
27. 7FS
    XJUI
    +6OJU
    BOE
    $* 
28. 7FS
    XJUI
    +6OJU
    BOE
    $*  %JEO`U CFDPNF
    FTUBCMJTIFE BU
    UIF
    UFBN
    L 5FTU
    TDSJQUT
    BSF
    IBSE UP
    SFBEJNQMFNFOUNBJOUBJO GPS
    EFWFMPQFST1SPEVDU
    .BOBHFS
29. 1SPEVDU
    %JTDPWFSZ
    "HBJO 
30. ,BSBUF BT
    B
    4PMVUJPO  0QFOTPVSDFE
    GSBNFXPSL GPS
    UFTUJOH
    "1*T • 6TFT
    (IFSLJO TZOUBY • 4VQQPSUT
    UFTUJOH
    3&45GVM
    "1*T • &BTZ
    UP
    FYQBOE
    UP
    UFTU
    H31$5ISJGU • :PV
    DBO
    GJOE
    JU
    PO
    5FDIOPMPHZ
    3BEBS
31. 7FS
    XJUI
    ,BSBUF 
32. 7FS
    XJUI
    +6OJU
    BOE
    $* 
33. &YQFSJFODFE
    )BSETIJQT  8JUI
    $(8
    NFNCFST
    UPHFUIFS GPS
    
    NPOUIT $(8 
    5IJT
    DBTF
    JT
    IBSE
    UP
    JNQMFNFOU )PX
    UP
    EP
    JU 4&5 
    0,
    )PX
    BCPVU
    BEEJOH
    B
    1MVHJO MJLF
    UIJT $(8 
    8FMM
    IPX
    BCPVU
    BEEJOH
    UIJT
    GFBUVSF
    UPP
34. 3FTVMUT  #FDBNF
    UIF
    NPEFM
    DBTF
    PG JNQSPWFNFOUT
    JO
    PVS
    DPNQBOZ • 0VUBHFT
      • "MM
    NFNCFST
    IBWF
    CFFO
    XSJUJOH
    UFTUT • *ODMVEJOH
    1SPEVDU
    .BOBHFS
35. DPNQBTTJPO
    &/ DPNQBUJP
    -"
36.  
    *NQPSUBODF
    PG
    (FUUJOH
    4VQQPSUT 
    &YQFSJFODF
    )BSETIJQT
    5PHFUIFS 
    /VSUVSF
    "MM
    GPS
    *OOPWBUJPOT
37. -FU`T
    %JTDVTT
    
    NJO  8IBU
    JT UIF
    EJGGJDVMUZ
    PG UFTUJOH
    .JDSPTFSWJDFT
38. )VHF
    #MPDLFST  -BDL
    PG
    TLJMMT
    PG • %FWFMPQFST • 5FTUFST2" • 4&5
    VT )JSP`T $BTF
39. ,FZ
    1PJOU  /VSUVSF NFNCFSTUFBNTPSHT GPS PVS
    JOOPWBUJWF
    BDUJWJUJFT
40. -FBSOJOH
    4FTTJPOT
    JO
    4&5  4UVEZ
    TFTTJPOT EVSJOH
    CVTJOFTT
    IPVST
    % 5BVHIU
    CZ
    $ISJT
    -VDJBO UIF
    JOWFOUPS
    PG .PC
    1SPHSBNNJOH BU
    "HJMF
41. 0VS
    5FBN`T
    3VMFT  •    NJOEBZ FWFSZEBZ • %VSJOH CVTJOFTT IPVST
    BT B XPSL • "OZ UPQJDT
    0,
    GPS PVS EBJMZ XPSL • 8JUI .PC 1SPHSBNNJOH XBZ • /P
    DSJUJDJTN
    XJUI
    B
    GVO
42. 8IBU
    8F
    -FBSOFE  • ,VCFSOFUFT • ,BSBUF
    "1*
    5FTUJOH • 7VFKT • 4IPSUDVU
    LFZT
    PG
    *OUFMMJ+
    *%&" • 5IF
    %SVDLFS
    &YFSDJTF • )PX
    UP
    XSJUF
    B
    HPPE
    SFQPSU
43. 3FTVMUT  *OWFOUFE
    l4FCBT
    3FQPSUz • $BO
    QJOQPJOU UIF
    SPPU
    DBVTF
    PG GBJMVSFT
    PO
    .JDSPTFSWJDFT • $BO
    SFEVDF
    .553 .FBO
    5JNF
    5P
    3FDPWFSZ • $BO
    UBNF UIF
    DPNQMFYJUZ
    PG
    .JDSPTFSWJDFT
44. "
    3FQPSUJOH
    5PPM 
45. 'PS
    ,BSBUF
    6TFST 
46. 1JOQPJOU
    UIF
    3PPU
    $BVTF 
47. 7JTVBMMZ
    "OE
    7FSZ
    2VJDLMZ 
48. #Z
    6TJOH
    8IBU
    8F
    -FBSOFE 
49. 3FTVMUT
    PG
    4FCBT
    3FQPSU  • *NQSPWFE
    .553 • 'BJMVSF
    EFUFDUJPO
    X
    
    IST • *NQSPWFE
    SFTJMJFODF • $BO
    SFDPWFS
    TFSWJDFT
    RVJDLMZ • 6TFST
    BSF
    JODSFBTJOH • 
    UFBNT BSF
    VTJOH
    
50. <"QQFOEJY> 0UIFS
    "DUJWJUJFT
51. *OIPVTF
    QFSGPSNBODF
    UFTUJOH
    QMBUGPSN "ZBQFSG  5IJT
    EJBHSBN
    JODMVEFT
    UIF
    XPSL UIBU
    JT
    EJTUSJCVUFE
    JO
    UIF
    "QBDIF
    -JDFOTF
    
52. %FTJHO
    4QSJOU  %P
    GPMMPXJOH
    UBTLT
    XFFLMZ • $MBSJGZ
    UFTUSFMBUFE
    JTTVFT • $IPPTF
    POF
    BDUJPO • #VJME
    JU
    RVJDLMZ • (FU
    GFFECBDL
    GSPN
    lVTFSTz • $POUJOVF
    PS
    QJWPU “Sprint: How to Solve Big Problems and Test New Ideas in Just Five Days” Jake Knapp, John Zeratsky, and Braden Kowitz Simon & Schuster (2016) ISBN-13: 9781501121777
53. 5FTUBCMF
    *OGSBTUSVDUVSF  5SZJOH
    UP
    QSPWJEF
    B
    QMBUGPSN UIBU
    DBO
    DPQZ
    UFTU
    FOWJSPONFOUT XJUI
    ,VCFSOFUFT
54. $PODMVTJPO
55. 0VS
    *NQBDUT  4PNF
    UFBNT
    TUBSUFE
    BDUJPOT CBTFE
    PO
    PVS
    BDUJWJUJFT  0OF
    UFBN
    DPOUBDUFE
    VT
    BOE TUBSUFE
    VTJOH
    4FCBT
    BOE
    "ZBQFSG  0OF
    UFBN
    TPMWFE
    JUT
    TMPX
    UFTU
    JTTVFT CZ
    UIFJS
    PXO
56. 8F
    DBO
    DIBOHF EJGGJDVMUJFT JOUP TPNFUIJOH
    TQFDJBM
57. XJUI
    QSPQFS
    BQQSPBDIFT
58. 0VS
    &YBNQMFT  (FUUJOH
    1SPQFS
    4VQQPSUT &YQFSJFODF
    )BSETIJQT
    5PHFUIFS /VSUVSF
    "MM
    GPS
    *OOPWBUJPOT
59. -FU`T
    FYQFSJNFOU
60. IUUQTXXXBHJMFBMMJBODFPSHBHJMF