Breaking the Flaky Test Cycle

Slide 1

Slide 1 text

!XJMMOFU #SFBLJOHUIF'MBLZ 5FTU$ZDMF

Slide 2

Slide 2 text

Shinichi Maeshima    @netwillnet @willnet https://blog.willnet.in Willnet Inc.

Slide 3

Slide 3 text

ٕज़ސ໰ۀΛ͍ͯ͠·͢

Slide 4

Slide 4 text

͓࢓ࣄ4/4తͳ΋ͷΛ։ൃ ͍ͯ͠·͢

Slide 5

Slide 5 text

!XJMMOFU #SFBLJOHUIF'MBLZ 5FTU$ZDMF ࠓ೔͸'MBLZͳςετͷ ࿩Ͱ͢

Slide 6

Slide 6 text

'MBLZͳςετͱ͸ʁ w ࣮ߦ݁Ռ͕ෆ҆ఆͳςετ w ݪҼ͸༷ʑ w &&ςετͰΫϦοΫ࠲ඪΛؒҧ͑ͨ w ςετ࣌ͷมߋΛ໭͢ͷΛ๨Ε͍ͯͨ w ࣮ߦ͢Δ࣌ؒ΍೔ʹΑࣦͬͯഊ͢Δ w PSEFSCZ͕͍͍ͭͯͳ͍ΫΤϦൃߦ

Slide 7

Slide 7 text

'MBLZͳςετ͕͋ ͬͨΒͲ͏͢Δʁ

Slide 8

Slide 8 text

No content

Slide 9

Slide 9 text

௨Δ·Ͱ࠶࣮ߦ

Slide 10

Slide 10 text

🙅

Slide 11

Slide 11 text

ؾ࣋ͪ͸Θ͔Δ͚Ͳʜ w $*͕௨Δ·Ͱ଴͍ͬͯΔؒͷ࡞ۀ͕଺Δ😩 w $*࣮ߦ࣌ؒɺΤϯδχΞͷ਺ɺςετͷࣦഊ཰ͦΕͧΕʹ ൺྫͯ͠଺Δ w ผͷ͜ͱΛ͍ͯͯ͠΋εΠονϯάίετ͕͔͔Δͧ w $*αʔϏε΁ͷ՝ֹۚ΋૿͑Δ💰 w ςετ͕ΦΦΧϛগ೥Խ͢Δ🐺 w ຊ౰͸࣮૷͕ѱͯ͘΋࠶࣮ߦͰ௨ͬͯ͠·ͬͨΒεϧʔ͞ Εͯ͠·͏

Slide 12

Slide 12 text

؇࿨ࡦ

Slide 13

Slide 13 text

IUUQTIBOBDIJOIBUFCMPKQFOUSZ

Slide 14

Slide 14 text

ࣦഊͨ͠ςετͷ࠶࣮ߦΛ ϫʔΫϑϩʔʹ૊ΈࠐΉ

Slide 15

Slide 15 text

͋͘·Ͱ؇࿨ࡦ

Slide 16

Slide 16 text

ࠜຊղܾ͍ͨ͠ʂ

Slide 17

Slide 17 text

IUUQTCMPHXJMMOFUJOFOUSZ

Slide 18

Slide 18 text

ཁ໿͢Δͱ w ςετࣦഊ࣌ͷৼΔ෣͍Λௐ΂Δ ϩάɺεΫγϣɺσό οΨʹΑΔϒϨʔΫϙΠϯτͳͲ w ςετ͕Ͳ͏ಈ͍͍ͯΔͷ͔஌͓ͬͯ͘ඞཁ͕͋Δͧ w 3BJMTΛ஌Ζ͏ w ςετͷઃఆΛ஌Ζ͏ w DBQZCBSB TFMFOJVN ͕Ͳ͏ಈ͍͍ͯΔͷ͔஌Ζ͏

Slide 19

Slide 19 text

ݱঢ়ɺGMBLZ ςετͷݪҼΛ ௐࠪ͢Δʹ͸෯ ޿͍஌͕ࣝඞཁ

Slide 20

Slide 20 text

݁Ռͱͯ͠ γχΞΤϯδχΞ ʹ࢓ࣄ͕ूத͢Δ

Slide 21

Slide 21 text

γχΞΤϯδχΞ͸ଞͷ ࢓ࣄ΋͋ΔͷͰͳ͔ͳ͔ GMBLZςετ͸ݮΒͳ͍

Slide 22

Slide 22 text

ͭΒ͍

Slide 23

Slide 23 text

࢓૊ΈͰঢ়گΛม͑ ͍ͨ

Slide 24

Slide 24 text

ࣗ෼ͷ࡞ͬͨ࢓૊Έɺଞ ͷਓ͕࡞ͬͨ࢓૊ΈͰศ རͳ΋ͷΛ঺հ͠·͢

Slide 25

Slide 25 text

࢓૊Έ

Slide 26

Slide 26 text

GMBLZςετ Λ๷͙࢓૊Έ

Slide 27

Slide 27 text

GMBLZͷݪҼͷ Ұͭ ΫϦοΫϛε

Slide 28

Slide 28 text

$BQZCBSB͕ཁૉΛΫϦοΫ͢Δ·Ͱ w ΫϦοΫ͍ͨ͠ཁૉͷ࠲ඪΛௐ΂Δ w ͜͜ʹগ͠λΠϜϥά͕͋Δ w ௐ΂ͨ࠲ඪΛΫϦοΫ͢Δ

Slide 29

Slide 29 text

%0.ཁૉ͕ಈ͘ͱ ΫϦοΫʹࣦഊ͢ Δ͜ͱ͕͋Δ

Slide 30

Slide 30 text

$BQZCBSBEJTBCMF@BOJNBUJPOUSVF

Slide 31

Slide 31 text

IUUQTHJUIVCDPNUFBNDBQZCBSBDBQZCBSBCMPCBCGFBCCCFGDDDDGDMJCDBQZCBSBTFSWFSBOJNBUJPO@EJTBCMFSSC--

Slide 32

Slide 32 text

DTTͱK2VFSZ ىҼͷΞχϝʔ γϣϯΛΦϑʹ ͢Δ

Slide 33

Slide 33 text

K2VFSZҎ֎ͷ KTʹΑΔΞχϝʔ γϣϯ͸ະରԠ😇

Slide 34

Slide 34 text

5*14։ൃ؀ڥͰDBQZCBSBͷΞχ ϝʔγϣϯΦϑ͕ޮ͍͍ͯΔ͔ࢼ͢ w (FN fi MFͷDBQZCBSBͷHSPVQΛมߋͯ͠EFWFMPQNFOUͰ ΋༗ޮʹ͢Δ w DPO fi HBQQMJDBUJPOSCʹҎԼΛ௥ه

Slide 35

Slide 35 text

ଞʹ΋%0.ཁ ૉΛಈ͔͢෺͕ ͋Δ

Slide 36

Slide 36 text

🏞

Slide 37

Slide 37 text

ը૾ͷ ஗Ԇ ಡΈࠐΈλ ΠϛϯάͱΫϦοΫͷλ Πϛϯά͕Ұக͢Δͱ☠

Slide 38

Slide 38 text

XJMMOFUDBQZCBSBXBJU@JNBHF

Slide 39

Slide 39 text

No content

Slide 40

Slide 40 text

HFNΛಋೖ͢Δͩ ͚Ͱɺը૾ͷಡΈࠐ ΈىҼͷΫϦοΫϛ ε͕ແ͘ͳΔ

Slide 41

Slide 41 text

࢓૊Έ

Slide 42

Slide 42 text

ָʹௐࠪͰ͖Δ࢓૊Έ

Slide 43

Slide 43 text

$*ͷΈ͔ͭكʹ͔͠ ى͖ͳ͍GMBLZςε τௐࠪͰେࣄͳ΋ͷ

Slide 44

Slide 44 text

ϩά

Slide 45

Slide 45 text

Ͱ΋֘౰ͷςε τͷϩά͕ຒ΋ Εͯ͠·͏

Slide 46

Slide 46 text

XPSLBSPVOE

Slide 47

Slide 47 text

.#௒͑ΔΑ͏ͳϩά ͔ΒHSFQ͢Δͷ͸͍ͨ΁Μ

Slide 48

Slide 48 text

XJMMOFUDJ@MPHHFS

Slide 49

Slide 49 text

ࣦഊͨ͠ςε τͷϩά͚ͩ ग़ྗͰ͖Δ

Slide 50

Slide 50 text

࣍

Slide 51

Slide 51 text

&&ςετࣦഊ࣌ͷε ΫϦʔϯγϣοτ΋ ௐࠪ࣌ʹ༗ޮ

Slide 52

Slide 52 text

$ZQSFTT΍ 1MBZXSJHIUΛ࢖͏ͱಈ ըͰϒϥ΢βͷಈ࡞Λ ݟΔ͜ͱ͕Ͱ͖ͯศར

Slide 53

Slide 53 text

๻ͨͪ΋࢖͍͍ͨ

Slide 54

Slide 54 text

:VTVLF*XBLJ DBQZCBSBQMBZXSJHIU ESJWFS

Slide 55

Slide 55 text

υϥΠόΛม͑ͣ ʹಈըΛࡱΓ͍ͨ

Slide 56

Slide 56 text

ZZBHJUFTUSFDPSEFS

Slide 57

Slide 57 text

TFMFOJVNͰಈը͕ࡱΕ Δ DVQSJUF೿ͷํ͸͓· ͍ͪͩ͘͞

Slide 58

Slide 58 text

ͨͩ͠ɺςετ͕੒ޭ͠ ͯ΋ৗʹεΫγϣ͔Βಈ ըΛੜ੒͢Δඞཁ͕͋Δ

Slide 59

Slide 59 text

ςετ͕੒ޭͯ͠΋d ׂͷΦʔόʔϔου͕͋ Δ UFTUSFDPSEFS

Slide 60

Slide 60 text

ϓϩδΣΫτʹΑͬͯ͸Φ ʔόϔουΛݮΒ͢޻෉͕ ඞཁ͔΋ ྫಈըࡱӨΛ GMBLZͳςετ͚ͩΛର৅ ʹ͢Δ

Slide 61

Slide 61 text

·ͱΊ

Slide 62

Slide 62 text

࿩ͨ͜͠ͱ w fl BLZςετͰফ໣͢ΔͷΛ࢓૊ΈͰղܾ͍ͨ͠ w fl BLZςετΛ๷͙࢓૊Έ w &&ςετͰΫϦοΫ࣌ʹը૾ىҼͰཁૉ͕ಈ͔ͳ͍Α͏ʹ ଴ͭ࢓૊ΈΛಋೖ DBQZCBSBXBJU@JNBHF w fl BLZςετΛָʹௐࠪ͢Δ࢓૊Έ w ςετࣦഊ࣌ͷΈϩάΛग़ྗ͢Δ࢓૊Έ DJ@MPHHFS w ςετࣦഊ࣌ʹಈըͰϒϥ΢βͷڍಈΛ֬ೝͰ͖Δ࢓૊Έ DBQZCBSBQMBZXSJHIUESJWFS UFTUSFDPSEFS