『スタディサプリ中学講座』における E2E Test の運用と計測による改善 / Improved E2E testing through measurement

by Takeshi Kondo

Slide 1

Slide 1 text

ʰελσΟαϓϦ தֶߨ࠲ʱʹ͓͚Δ E2E Test ͷӡ༻ͱܭଌʹΑΔվળ Takeshi Kondo / @chaspy 2023/07/14 MagicPodϢʔβʔLTձ

Slide 2

Slide 2 text

ʰελσΟαϓϦ தֶߨ࠲ʱʹ͓͚Δ E2E Test ͷӡ༻ͱܭଌʹΑΔվળ Takeshi Kondo / @chaspy 2023/07/14 MagicPodϢʔβʔLTձ

Slide 3

Slide 3 text

Who am I chaspy chaspy_ Engineering Manager Site Reliability and Web Application Development at Recruit Co., Ltd. Takeshi Kondo https://chaspy.me

Slide 4

Slide 4 text

ࠓ೔఻͍͑ͨ͜ͱ MagicPod ͷ੒ޭ཰ͱ࣮ߦ࣌ؒΛܭଌ͠Α͏

Slide 5

Slide 5 text

࠶ܝ: Release Flow 4UBHJOHʹσϓϩΠޙɺ .BHJD1PEΛ࣮ߦ ੒ޭͨ͠Βຊ൪΁ϦϦʔε͢Δ

Slide 6

Slide 6 text

΋͔ͯ͠͠ɺࢲͷ MagicPodɺ஗͗͢…ʁ

Slide 7

Slide 7 text

ਪଌ͢ΔͳɺܭଌͤΑ

Slide 8

Slide 8 text

ཁٻ੔ཧ: ԿΛܭଌ͍͔ͨ͠ʁ • Ұׅ࣮ߦ(BathRun) • ॴཁ࣌ؒ • ੒ޭ͔ࣦഊ͔ • ֤ςετέʔε • ॴཁ࣌ؒ • ੒ޭ͔ࣦഊ͔ • ্هΛ metrics ͱͯ͠อଘ͠ɺՄࢹԽ͍ͨ͠

Slide 9

Slide 9 text

chaspy/magicpod-datadog-action https://github.com/chaspy/magicpod-datadog-action

Slide 10

Slide 10 text

Architecture (JU)VC"DUJPOT ఆظ࣮ߦ GET batch_run ৘ใΛऔಘ submit metrics ։࢝࣌ؒͱऴྃ࣌ ͕ؒಘΒΕΔͷ Ͱɺࠩ෼Λܭࢉ

Slide 11

Slide 11 text

How to use

Slide 12

Slide 12 text

Dashboard

Slide 13

Slide 13 text

ܭଌͯ͠Կ͕ى͖͔ͨʁ • ӡ༻ͷมߋ • ςετέʔεमਖ਼தʹԿ౓΋࣮ߦ͍ͯͨ͠ͷΛ΍Ίͨ • ݕূ༻ͷςετέʔε͸෼཭ • Dashboard ΛִिͰ֬ೝ͠ɺѱԽͨ͠Βؾ͚ͮΔΑ͏ʹͨ͠ • ࣮ߦ࣌ؒվળ • ςετέʔεΛϦόϥϯε • ϩέʔλʔઃఆͰ ai ͷ෦෼Λ aria-label ΍ΧελϜσʔλଐੑΛ෇༩ • ։ൃऀࣗΒ࣮ࢪ

Slide 14

Slide 14 text

ܭଌ͞Ε͍ͯΔͱɺվળͨ͘͠ͳΔ ෼ͷ୹ॖʹ੒ޭʂ

Slide 15

Slide 15 text

ө͑Δάϥϑ ඵඵʹʂ

Slide 16

Slide 16 text

ө͑Δάϥϑ d d

Slide 17

Slide 17 text

ࠓ೔఻͍͑ͨ͜ͱ MagicPod ͷ੒ޭ཰ͱ࣮ߦ࣌ؒΛܭଌ͠Α͏

Slide 18

Slide 18 text

FAQ • GitHub Actions / Datadog Ҏ֎Ͱ΋΍Γ͍ͨͰ͢ • ఆظ࣮ߦ͕Ͱ͖Ε͹ͳΜͰ΋ྑ͍ • api Ͱऔಘͨ͠σʔλΛՃ޻ͯ͠ metrics ొ࿥͍ͯ͠Δ͚ͩ • ίʔυݟͯΈ͍ͯͩ͘͞

Slide 19

Slide 19 text

Who am I chaspy chaspy_ Engineering Manager Site Reliability and Web Application Development at Recruit Co., Ltd. Takeshi Kondo https://chaspy.me