Breaking the Flaky Test Cycle

大阪Ruby会議03 ( https://rubykansai.github.io/osaka03/ ) の発表スライドです。

Transcript

1. !XJMMOFU
   #SFBLJOHUIF'MBLZ
   5FTU$ZDMF
   

   View Slide

2. Shinichi Maeshima
   
   
   
   
   
   
   
   @netwillnet
   @willnet
   https://blog.willnet.in
   Willnet Inc.
   

   View Slide

3. ٕज़ސ໰ۀΛ͍ͯ͠·͢
   

   View Slide

4. ͓࢓ࣄ4/4తͳ΋ͷΛ։ൃ
   ͍ͯ͠·͢
   

   View Slide

5. !XJMMOFU
   #SFBLJOHUIF'MBLZ
   5FTU$ZDMF
   ࠓ೔͸'MBLZͳςετͷ
   ࿩Ͱ͢
   

   View Slide

6. 'MBLZͳςετͱ͸ʁ
   w ࣮ߦ݁Ռ͕ෆ҆ఆͳςετ
   w ݪҼ͸༷ʑ
   w &&ςετͰΫϦοΫ࠲ඪΛؒҧ͑ͨ
   w ςετ࣌ͷมߋΛ໭͢ͷΛ๨Ε͍ͯͨ
   w ࣮ߦ͢Δ࣌ؒ΍೔ʹΑࣦͬͯഊ͢Δ
   w PSEFSCZ͕͍͍ͭͯͳ͍ΫΤϦൃߦ
   

   View Slide

7. 'MBLZͳςετ͕͋
   ͬͨΒͲ͏͢Δʁ
   

   View Slide

8. View Slide

9. ௨Δ·Ͱ࠶࣮ߦ
   

   View Slide

10. 🙅
    

    View Slide

11. ؾ࣋ͪ͸Θ͔Δ͚Ͳʜ
    w $*͕௨Δ·Ͱ଴͍ͬͯΔؒͷ࡞ۀ͕଺Δ😩
    w $*࣮ߦ࣌ؒɺΤϯδχΞͷ਺ɺςετͷࣦഊ཰ͦΕͧΕʹ
    ൺྫͯ͠଺Δ
    w ผͷ͜ͱΛ͍ͯͯ͠΋εΠονϯάίετ͕͔͔Δͧ
    w $*αʔϏε΁ͷ՝ֹۚ΋૿͑Δ💰
    w ςετ͕ΦΦΧϛগ೥Խ͢Δ🐺
    w ຊ౰͸࣮૷͕ѱͯ͘΋࠶࣮ߦͰ௨ͬͯ͠·ͬͨΒεϧʔ͞
    Εͯ͠·͏
    

    View Slide

12. ؇࿨ࡦ
    

    View Slide

13. IUUQTIBOBDIJOIBUFCMPKQFOUSZ
    

    View Slide

14. ࣦഊͨ͠ςετͷ࠶࣮ߦΛ
    ϫʔΫϑϩʔʹ૊ΈࠐΉ
    

    View Slide

15. ͋͘·Ͱ؇࿨ࡦ
    

    View Slide

16. ࠜຊղܾ͍ͨ͠ʂ
    

    View Slide

17. IUUQTCMPHXJMMOFUJOFOUSZ
    

    View Slide

18. ཁ໿͢Δͱ
    w ςετࣦഊ࣌ͷৼΔ෣͍Λௐ΂Δ ϩάɺεΫγϣɺσό
    οΨʹΑΔϒϨʔΫϙΠϯτͳͲ
    
    w ςετ͕Ͳ͏ಈ͍͍ͯΔͷ͔஌͓ͬͯ͘ඞཁ͕͋Δͧ
    w 3BJMTΛ஌Ζ͏
    w ςετͷઃఆΛ஌Ζ͏
    w DBQZCBSB TFMFOJVN
    ͕Ͳ͏ಈ͍͍ͯΔͷ͔஌Ζ͏
    

    View Slide

19. ݱঢ়ɺGMBLZ
    ςετͷݪҼΛ
    ௐࠪ͢Δʹ͸෯
    ޿͍஌͕ࣝඞཁ
    

    View Slide

20. ݁Ռͱͯ͠
    γχΞΤϯδχΞ
    ʹ࢓ࣄ͕ूத͢Δ
    

    View Slide

21. γχΞΤϯδχΞ͸ଞͷ
    ࢓ࣄ΋͋ΔͷͰͳ͔ͳ͔
    GMBLZςετ͸ݮΒͳ͍
    

    View Slide

22. ͭΒ͍
    

    View Slide

23. ࢓૊ΈͰঢ়گΛม͑
    ͍ͨ
    

    View Slide

24. ࣗ෼ͷ࡞ͬͨ࢓૊Έɺଞ
    ͷਓ͕࡞ͬͨ࢓૊ΈͰศ
    རͳ΋ͷΛ঺հ͠·͢
    

    View Slide

25. ࢓૊Έ
    

    View Slide

26. GMBLZςετ
    Λ๷͙࢓૊Έ
    

    View Slide

27. GMBLZͷݪҼͷ
    Ұͭ
    ΫϦοΫϛε
    

    View Slide

28. $BQZCBSB͕ཁૉΛΫϦοΫ͢Δ·Ͱ
    w ΫϦοΫ͍ͨ͠ཁૉͷ࠲ඪΛௐ΂Δ
    w ͜͜ʹগ͠λΠϜϥά͕͋Δ
    
    w ௐ΂ͨ࠲ඪΛΫϦοΫ͢Δ
    

    View Slide

29. %0.ཁૉ͕ಈ͘ͱ
    ΫϦοΫʹࣦഊ͢
    Δ͜ͱ͕͋Δ
    

    View Slide

30. $BQZCBSBEJTBCMF@BOJNBUJPOUSVF
    

    View Slide

31. IUUQTHJUIVCDPNUFBNDBQZCBSBDBQZCBSBCMPCBCGFBCCCFGDDDDGDMJCDBQZCBSBTFSWFSBOJNBUJPO@EJTBCMFSSC--
    

    View Slide

32. DTTͱK2VFSZ
    ىҼͷΞχϝʔ
    γϣϯΛΦϑʹ
    ͢Δ
    

    View Slide

33. K2VFSZҎ֎ͷ
    KTʹΑΔΞχϝʔ
    γϣϯ͸ະରԠ😇
    

    View Slide

34. 5*14։ൃ؀ڥͰDBQZCBSBͷΞχ
    ϝʔγϣϯΦϑ͕ޮ͍͍ͯΔ͔ࢼ͢
    w (FN
    fi
    MFͷDBQZCBSBͷHSPVQΛมߋͯ͠EFWFMPQNFOUͰ
    ΋༗ޮʹ͢Δ
    w DPO
    fi
    HBQQMJDBUJPOSCʹҎԼΛ௥ه
    

    View Slide

35. ଞʹ΋%0.ཁ
    ૉΛಈ͔͢෺͕
    ͋Δ
    

    View Slide

36. 🏞
    

    View Slide

37. ը૾ͷ ஗Ԇ
    ಡΈࠐΈλ
    ΠϛϯάͱΫϦοΫͷλ
    Πϛϯά͕Ұக͢Δͱ☠
    

    View Slide

38. XJMMOFUDBQZCBSBXBJU@JNBHF
    

    View Slide

39. View Slide

40. HFNΛಋೖ͢Δͩ
    ͚Ͱɺը૾ͷಡΈࠐ
    ΈىҼͷΫϦοΫϛ
    ε͕ແ͘ͳΔ
    

    View Slide

41. ࢓૊Έ
    

    View Slide

42. ָʹௐࠪͰ͖Δ࢓૊Έ
    

    View Slide

43. $*ͷΈ͔ͭكʹ͔͠
    ى͖ͳ͍GMBLZςε
    τௐࠪͰେࣄͳ΋ͷ
    

    View Slide

44. ϩά
    

    View Slide

45. Ͱ΋֘౰ͷςε
    τͷϩά͕ຒ΋
    Εͯ͠·͏
    

    View Slide

46. XPSLBSPVOE
    

    View Slide

47. .#௒͑ΔΑ͏ͳϩά
    ͔ΒHSFQ͢Δͷ͸͍ͨ΁Μ
    

    View Slide

48. XJMMOFUDJ@MPHHFS
    

    View Slide

49. ࣦഊͨ͠ςε
    τͷϩά͚ͩ
    ग़ྗͰ͖Δ
    

    View Slide

50. ࣍
    

    View Slide

51. &&ςετࣦഊ࣌ͷε
    ΫϦʔϯγϣοτ΋
    ௐࠪ࣌ʹ༗ޮ
    

    View Slide

52. $ZQSFTT΍
    1MBZXSJHIUΛ࢖͏ͱಈ
    ըͰϒϥ΢βͷಈ࡞Λ
    ݟΔ͜ͱ͕Ͱ͖ͯศར
    

    View Slide

53. ๻ͨͪ΋࢖͍͍ͨ
    

    View Slide

54. :VTVLF*XBLJ
    DBQZCBSBQMBZXSJHIU
    ESJWFS
    

    View Slide

55. υϥΠόΛม͑ͣ
    ʹಈըΛࡱΓ͍ͨ
    

    View Slide

56. ZZBHJUFTUSFDPSEFS
    

    View Slide

57. TFMFOJVNͰಈը͕ࡱΕ
    Δ DVQSJUF೿ͷํ͸͓·
    ͍ͪͩ͘͞
    
    

    View Slide

58. ͨͩ͠ɺςετ͕੒ޭ͠
    ͯ΋ৗʹεΫγϣ͔Βಈ
    ըΛੜ੒͢Δඞཁ͕͋Δ
    

    View Slide

59. ςετ͕੒ޭͯ͠΋d
    ׂͷΦʔόʔϔου͕͋
    Δ UFTUSFDPSEFS
    
    

    View Slide

60. ϓϩδΣΫτʹΑͬͯ͸Φ
    ʔόϔουΛݮΒ͢޻෉͕
    ඞཁ͔΋ ྫಈըࡱӨΛ
    GMBLZͳςετ͚ͩΛର৅
    ʹ͢Δ
    
    

    View Slide

61. ·ͱΊ
    

    View Slide

62. ࿩ͨ͜͠ͱ
    w
    fl
    BLZςετͰফ໣͢ΔͷΛ࢓૊ΈͰղܾ͍ͨ͠
    w
    fl
    BLZςετΛ๷͙࢓૊Έ
    w &&ςετͰΫϦοΫ࣌ʹը૾ىҼͰཁૉ͕ಈ͔ͳ͍Α͏ʹ
    ଴ͭ࢓૊ΈΛಋೖ DBQZCBSBXBJU@JNBHF
    
    w
    fl
    BLZςετΛָʹௐࠪ͢Δ࢓૊Έ
    w ςετࣦഊ࣌ͷΈϩάΛग़ྗ͢Δ࢓૊Έ DJ@MPHHFS
    
    w ςετࣦഊ࣌ʹಈըͰϒϥ΢βͷڍಈΛ֬ೝͰ͖Δ࢓૊Έ
    DBQZCBSBQMBZXSJHIUESJWFS UFTUSFDPSEFS
    
    

    View Slide

63. ·ͩ·ͩվળͰ͖Δ
    ༨஍͸͋Δ
    

    View Slide

64. ΈΜͳͰ࢓૊ΈΛ࡞
    ͍͖ͬͯ·͠ΐ͏ʂ
    

    View Slide

65. GMBLZςετΛݮΒͯ͠ɺ
    ΞϓϦέʔγϣϯίʔυʹ
    ޲͖߹͏࣌ؒΛ૿΍͍ͨ͠
    

    View Slide

66. Զͨͪͷઓ͍͸͜Ε
    ͔Βͩʂ
    

    View Slide