テストの高速化と品質保証の第一歩 GitHub ActionsとRSpecの基本入門

CloudNative Days Fukuoka 2023 プレイベントに登壇しました。
https://cloudnativedays.connpass.com/event/289955/

Transcript

1. 2023-07-25 CloudNative Days Fukuoka 2023 ϓϨΠϕϯτ ςετͷߴ଎Խͱ඼࣭อূͷୈҰา
 GitHub ActionsͱRSpecͷجຊೖ໳ ࢁԼխਓ
2. • ࢁԼ խਓ • όοΫΤϯυΤϯδχΞ • ॴଐ: גࣜձࣾϚωʔϑΥϫʔυ • GitHub: @M-Yamashita01 • Twitter: @M_Yamashii ࣗݾ঺հ
3. • GitHubʹΑΔ։ൃऀମݧͷௐࠪ݁Ռ • ஗͍ςετͷվળ • Parallel tests gemʹΑΔςετͷߴ଎Խ • CodecovΛ࢖ͬͨΧόϨοδՄࢹԽ • Flaky TestͷൃੜͱରԠ Chapter
4. GitHubʹΑΔ։ൃऀମݧͷௐࠪ݁Ռ Survey reveals AI’s impact on the developer experience,
 Inval Shani, GitHub Sta ff https://github.blog/2023-06-13-survey-reveals-ais-impact-on-the-developer-experience/
5. >we wanted to get a better understanding from developers
 about how new tools—and current work fl ows—are impacting
 the overall developer experience. ৽͍͠πʔϧ΍ݱࡏͷϫʔΫϑϩʔ͕։ൃऀͷମݧશମʹͲͷΑ͏ͳ ӨڹΛٴ΅͍ͯ͠Δ͔ʹ͍ͭͯɺ։ൃऀͷཧղΛਂΊ͍ͨͱߟ͑ͨɻ Survey reveals AI’s impact on the developer experience,
 Inval Shani, GitHub Sta ff https://github.blog/2023-06-13-survey-reveals-ais-impact-on-the-developer-experience/
6. ͜ͷௐࠪ݁Ռͷ͏ͪͷ1ͭ
7. >What developers spend the most time on daily ։ൃऀ͕೔ʑ࠷΋࣌ؒΛඅ΍͍ͯ͠Δ͜ͱ Survey reveals AI’s impact on the developer experience,
 Inval Shani, GitHub Sta ff https://github.blog/2023-06-13-survey-reveals-ais-impact-on-the-developer-experience/
8. Survey reveals AI’s impact on the developer experience,
 Inval Shani, GitHub Sta ff https://github.blog/2023-06-13-survey-reveals-ais-impact-on-the-developer-experience/
9. Survey reveals AI’s impact on the developer experience,
 Inval Shani, GitHub Sta ff https://github.blog/2023-06-13-survey-reveals-ais-impact-on-the-developer-experience/
10. > Notably, developers say they spend the same amount of time
 waiting for builds and tests as they do writing new code. ։ൃऀ͕৽͍͠ίʔυΛॻ͘ͷͱಉ͚ͩ͡ͷ࣌ؒΛ Ϗϧυ΍ςετͷͨΊʹඅ΍͍ͯ͠Δ Survey reveals AI’s impact on the developer experience,
 Inval Shani, GitHub Sta ff https://github.blog/2023-06-13-survey-reveals-ais-impact-on-the-developer-experience/
11. ςετ଎౓ͷվળ͸։ൃऀͷ࣌ؒΛ࡞Γग़͢ ↓ ։ൃऀମݧͷ޲্ʹͭͳ͕Δ
12. ࢲ͕ग़ձͬͨ஗͍ςετͷվળ
13. • GitHubʹΑΔௐࠪ݁Ռ • ஗͍ςετͷվળ • Parallel tests gemʹΑΔςετͷߴ଎Խ • CodecovΛ࢖ͬͨΧόϨοδՄࢹԽ • Flaky TestͷൃੜͱରԠ Chapter
14. CI؀ڥͱςετͷঢ়ଶ
15. • GitHub ActionsΛ࢖༻ͨ͠ϫʔΫϑϩʔߏஙࡁΈ • GitHub-hosted runnerΛ࢖༻ • ݹΊͷRailsόʔδϣϯͰ࡞੒͞Εͨίʔυ • RSpecΛ࢖༻ CI؀ڥ
16. • ςετ࣮ߦ߹ܭ࣌ؒɿ30෼ʙ40෼ • ςετ࣮ߦํ๏ɿ௚ྻςετ • ςετέʔεͷϥϯμϜ࣮ߦɿͳ͠ • ΧόϨοδଌఆɿͳ͠ վળલͷঢ়ଶ
17. ςετ͕஗͘
 ίʔυͷ໢ཏੑ΋෼͔Βͳ͍
18. վળʹ޲͚ͨௐࠪ
19. • ϘτϧωοΫͱͳ͍ͬͯΔςετͱվળ༨஍ • ࢖༻Ͱ͖Δվળ޻਺ͱରԠ վળʹ޲͚ͨௐࠪ
20. • RSpecʹ͸஗͍ςετΛग़ྗͰ͖ΔΦϓγϣϯʢ—pro fi le xʣ͕͋Δ ϘτϧωοΫͷςετͷݕ஌
21. ݕ஌ͨ͠஗͍ςετͷվળΛݕ౼
22. ϘτϧωοΫͷςετ͸վળͰ͖Δ͔ʁ ཧղ͕೉͍͠
 ςετίʔυ ςετର৅ͷ
 ίʔυ͕ෳࡶ ςετίʔυͷ
 ໢ཏ۩߹ͷఔ౓͕ෆ໌
23. ϘτϧωοΫͷςετ͸վળͰ͖Δ͔ʁ ཧղ͕೉͍͠
 ςετίʔυ ςετର৅ͷ
 ίʔυ͕ෳࡶ ςετίʔυͷ
 ໢ཏ۩߹ͷఔ౓͕ෆ໌ վળͰ͖Δ͔΋͠Εͳ͍͕ɺ·ͱ·ͬͨ࣌ؒͱଟ͘ͷ޻਺͕ඞཁ
24. • ϘτϧωοΫͱͳ͍ͬͯΔςετͱվળ༨஍ • ࢖༻Ͱ͖Δվળ޻਺ͱରԠ վળʹ޲͚ͨௐࠪ
25. ࢖༻Ͱ͖Δվળ޻਺ͱରԠ ཧ૝ ݱ࣮ ޻਺ ·ͱ·ͬͨ޻਺Λ࢖༻Մೳ গͳ͍޻਺Λ࢖༻Մೳ
 (ຊདྷͷλεΫͷ๣ΒͰ࣮ࢪ) ରԠ ϦϑΝΫλϦϯάʹΑΔվળ
 (௕ظతͳ඼࣭ͱ଎౓ͷ޲্) πʔϧΛ࢖༻ͨ͠ςετߴ଎Խ
26. ࢖༻Ͱ͖Δվળ޻਺ͱରԠ ཧ૝ ݱ࣮ ޻਺ ·ͱ·ͬͨ޻਺Λ࢖༻Մೳ গͳ͍޻਺Λ࢖༻Մೳ
 (ຊདྷͷλεΫͷ๣ΒͰ࣮ࢪ) ରԠ ϦϑΝΫλϦϯάʹΑΔվળ
 (௕ظతͳ඼࣭ͱ଎౓ͷ޲্) πʔϧΛ࢖༻ͨ͠ςετߴ଎Խ
27. πʔϧΛ࢖༻ͨ͠ςετͷߴ଎Խ
28. • Minitest • Rails 6Ҏ߱ͷฒྻςετػೳ • parallel-tests gem ߴ଎Խख๏ͷީิҰཡ
29. • Minitest • →RSpecΛ࢖͍ͬͯΔͨΊର৅֎ • Rails 6Ҏ߱ͷฒྻςετػೳ • →࢖༻தͷRailsόʔδϣϯ͸6ະຬ • parallel_tests gem • →࠾༻ ߴ଎Խख๏ͷީิൺֱ
30. grosser/parallel_tests
31. • CPUͷ࿦ཧίΞΛ࢖ͬͨฒྻԽ • ϑΝΠϧαΠζ΋͘͠͸࣮ߦ࣌ʹΑΓςετϑΝΠϧΛ෼ׂ • ίΞ͝ͱʹಠཱͨ͠σʔλϕʔεΛ࢖༻ͨ͠ςετ • ಋೖ͕γϯϓϧ parallel_tests
32. parallel_testsͷಋೖ
33. • Gem fi leʹ௥Ճ • database.ymlʹ؀ڥม਺௥Ճ parallel_testsͷಋೖ1
34. • GitHub ActionsϫʔΫϑϩʔʹ
 parallel_testsίϚϯυΛ௥Ճ parallel_testsͷಋೖ2
35. parallel_testsͰ࢖༻͢ΔίΞ਺ݕ౼
36. • GitHub Actions͕ఏڙ͍ͯ͠ΔLinuxͷσϑΥϧτͷίΞ਺͸2ͭ • ͓ۚͷྗͰϥϯφʔͷϚγϯεϖοΫڧԽʹΑΔίΞ਺૿Ճ΋Մೳ ࢖༻ՄೳͳίΞ਺ About larger runners https://docs.github.com/en/actions/using-github-hosted-runners/about-larger-runners
37. • ϩʔΧϧʹͯ2ίΞͱ16ίΞͷ଎౓ൺֱΛͨ͠ͱ͜Ζɺ਺෼ఔ౓ͷࠩ • ݪҼΛௐࠪͰ͖͓ͯΒͣอཹ • ͨͩɺίΞ਺ʹԠͯ͡ςετ͕࣌ؒ1/2ɺ1/4ͱ୹ॖ͞ΕΔΑ͏Ͱ͸ͳͦ͞͏ ίΞ਺ΛͲ͜·Ͱ૿΍͔͢ʁ~଎౓ൺֱฤ~
38. • parallel_testsͰ͸֤ίΞͷςετ
 ऴྃ࣌ʹࣦഊͨ͠ςετ಺༰Λ
 දࣔ͢Δ
 ͨͩ͠ɺଞͷςετ࣮ߦதͷ৔߹
 ϩά͕ྲྀΕͯ͠·͏ • ࠷ޙͷαϚϦʔʹ͸ςετࣦഊ਺
 ͷΈදࣔ ίΞ਺ΛͲ͜·Ͱ૿΍͔͢ʁ~ը໘දࣔฤ~ ίΞ਺΍ςετࣦഊ਺૿ՃʹԠͯ͡ɺϩά୳ࡧʹख͕͔͔ͬͯ͠·͏
39. 2ίΞͰे෼ͦ͏
40. parallel_testsΛ࢖༻ͨ͠ςετ࣮ߦ݁Ռ 10෼ʙ15෼ఔ౓ʹ୹ॖ 🎉 30෼ʙ40෼͔͔͍ͬͯͨςετ
41. • GitHubʹΑΔௐࠪ݁Ռ • ஗͍ςετͷվળ • Parallel tests gemʹΑΔςετͷߴ଎Խ • CodecovΛ࢖ͬͨΧόϨοδՄࢹԽ • Flaky TestͷൃੜͱରԠ Chapter
42. ίʔυΧόϨοδ > ιϑτ΢ΣΞςετͷਐḿΛද͢ई౓ͷҰͭͰɺςετର৅ͷιʔείʔυͷ ͏ͪɺͲͷఔ౓ͷׂ߹ͷίʔυ͕ςετ͞Ε͔ͨΛද͢΋ͷɻ ςετΧόϨοδ ʲtest coverageʳ ίʔυΧόϨοδ / code coverage
 IT༻ޠࣙయ e-Words https://e-words.jp/w/%E3%83%86%E3%82%B9%E3%83%88%E3%82%AB%E3%83%90%E3%83%AC%E3%83%83%E3%82%B8.html
43. ΧόϨοδͳ͠ ↓ ίʔυ͕ςετͰΧόʔ͞Ε͍ͯΔ͔෼͔Βͳ͍ ↓ मਖ਼ΛͨΊΒ͏
44. ՄࢹԽ͔Β࢝ΊΑ͏
45. ΧόϨοδՄࢹԽπʔϧ
46. • Codecov্ͰίʔυΧόϨοδͷଌఆ΍දࣔɺमਖ਼લޙͷΧόϨοδΛ෼ੳ ͯ͘͠ΕΔαʔϏε • Pull Requestʹमਖ਼લޙͷΧόϨοδΛίϝϯτͱͯ͠දࣔ͢Δ Codecov Codecov https://about.codecov.io/
47. • GitHubͱCodecovͱͷ
 ࿈ܞΛઃఆʢৄࡉ͸ׂѪʣ • Gem fi leɺspec_helper.rbʹ௥ه Codecovͷಋೖ1
48. • GitHub ActionsϫʔΫϑϩʔʹ
 codecov/codecov-actionͷ
 εςοϓΛ௥Ճ Codecovͷಋೖ2
49. ΧόϨοδදࣔྫ
50. ໢ཏ཰ɺ100%Λҡ࣋ͨ͘͠ͳΓ·͢ΑͶ
51. ਺஋ʹͩ͜ΘΔ͜ͱ͸
 ͋·Γ͓͢͢Ί͠·ͤΜ
52. > ໢ཏ཰͸ϓϩμΫγϣϯɾίʔυ͕࣮ߦ͞Εͨ͜ͱΛ͚ࣔͩ͢Ͱɺ࣮ߦ݁Ռ͕ ֬ೝ͞Εͨ͜ͱΛอূ͢ΔΘ͚Ͱ͸ͳ͍
 ɾɾɾதུɾɾɾ
 > ໢ཏ཰͸ςετɾίʔυͷ࣭͕ѱ͍͜ͱΛ൑அ͢Δͷʹ͸ޮՌ͕͋ΔͷͰ͢ ͕ɺςετɾίʔυͷ࣭͕ྑ͍͜ͱΛ൑அ͢Δʹ͸޲͍͍ͯ·ͤΜɻ ΧόϨοδͱͷ޲͖߹͍ํ ୯ମςετͷߟ͑ํ/࢖͍ํ,
 Vladimir Khorikov,ਢాஐ೭,
 P17ɺP19
53. ΧόϨοδ͸໨҆ͱͯ͠࢖͍ ࣭ͷྑ͍ίʔυΛ࡞ΔͨΊͷ଍͕͔Γͱ͢Δ
54. • GitHubʹΑΔௐࠪ݁Ռ • ஗͍ςετͷվળ • Parallel tests gemʹΑΔςετͷߴ଎Խ • CodecovΛ࢖ͬͨΧόϨοδՄࢹԽ • Flaky TestͷൃੜͱରԠ Chapter
55. Flaky TestͷൃੜͱରԠ
56. Flaky Test Flaky Tests at Google and How We Mitigate Them
 John Micco https://testing.googleblog.com/2016/05/ fl aky-tests-at-google-and-how-we.html
57. > We de fi ne a " fl aky" test result as a test that exhibits both a passing and a failing result with the same code. ࢲͨͪ͸ɺ" fl aky" ςετ݁ՌΛɺಉ͡ίʔυͰ߹֨ͱෆ߹֨ͷ྆ํͷ ݁ՌΛࣔ͢ςετͱఆ͍ٛͯ͠·͢ɻ Flaky Tests at Google and How We Mitigate Them
 John Micco https://testing.googleblog.com/2016/05/ fl aky-tests-at-google-and-how-we.html
58. ͭ·Γɺِཅੑ
59. > ɾϓϩμΫγϣϯɾίʔυʹજΉ໰୊Λղܾ͠Α͏ͱ͢Δ։ൃऀͷೳྗͱҙࢥ ΛऑΊͯ͠·͏ɻͳͥͳΒ։ൃऀ͸ӕͷܯࠂ(ςετͷؒҧࣦͬͨഊ)ʹ׳Εͯ͠ ·͍ɺͦͷܯࠂʹ஫ҙΛ෷Θͳ͘ͳͬͯ͠·͏͔ΒͰ͋Δɻ
 ɾςετΛ৴པͰ͖ΔηʔϑςΟɾωοτͱͯ͠ݟΔ͜ͱ͕Ͱ͖ͳ͘ͳΓɺͦ ͷςετ΁ͷ৴པੑ͕ࣦΘΕΔ͜ͱʹͳΔɻ ِཅੑͷ໰୊఺ ୯ମςετͷߟ͑ํ/࢖͍ํ,
 Vladimir Khorikov,ਢాஐ೭,
 P129
60. ࠓճͷέʔε
61. • parallel_tests࠾༻ʹΑΓɺςετॱ͕มΘΔ͜ͱ͕ଟ͘ͳͬͨ • ίʔυमਖ਼࣌ʹશؔ͘܎ͳ͍ςετ͕མͪΔΑ͏ʹͳͬͨ • ࠶࣮ߦ͢Δͱύε͢Δ͜ͱ͕͋Δ Flaky Testͷൃੜ
62. ൃݟͨ͠Flaky Testͷ֓ཁ • ࢦఆ೔࣌Λ࣋ͭϨίʔυ࡞੒ • UTCͷࢦఆ೔࣌Ҏલͷ
 ϨίʔυΛऔಘ͢Δςετ • ผςετͰλΠϜκʔϯ͕
 มߋ͞Ε͓ͯΓࣦഊ
63. • ࠜຊݪҼͰ͋ΔλΠϜκʔϯมߋՕॴͷൃݟ͸ࠔ೉ • ผςετʹґଘ͢Δͭ͘ΓΛ΍ΊΔ • ೔࣌Λ࢖͏ςετͰ͸ɺtravel_toͰ೔࣌ࢦఆͷӨڹൣғΛہॴԽ͢Δ Flaky Test΁ͷରԠ
64. Flaky Test΁ͷରԠ • ࢦఆͨ͠೔࣌Λ࡞੒ • travel_toΛ࢖͍ɺͦͷ೔࣌Λ
 ΋ͱʹͯ͠ϨίʔυΛ࡞੒͠ɺ
 ςετΛ࣮ߦ
65. ·ͱΊ
66. • ஗͍ςετʹର͠ɺςετߴ଎ԽͱΧόϨοδՄࢹԽΛಋೖ • Flaky Test΁ͷରԠํ๏ • ࠓճ঺հͨ͠಺༰͸଎౓ͱ඼࣭޲্ͷ࢝·ΓͰ͋ΔͨΊ
 ϑΟʔυόοΫΛ΋ͱʹ࣭ͨ͠ͷྑ͍ίʔυ࡞੒ʹͭͳ͛Δ͜ͱ ·ͱΊ
67. ͋Γ͕ͱ͏͍͟͝·ͨ͠ʂ
68. • Survey reveals AI’s impact on the developer experience • ςετΧόϨοδ • ୯ମςετͷߟ͑ํ/࢖͍ํ • Codecov • Flaky Tests at Google and How We Mitigate Them ࢀߟࢿྉ