『スタディサプリ 中学講座』における E2E Test の運用と計測による改善 / Improved E2E testing through measurement

https://trident-qa.connpass.com/event/283709/

Transcript

1. ʰελσΟαϓϦ தֶߨ࠲ʱʹ͓͚Δ E2E Test ͷӡ༻ͱܭଌʹΑΔվળ Takeshi Kondo / @chaspy 2023/07/14 MagicPodϢʔβʔLTձ
2. ʰελσΟαϓϦ தֶߨ࠲ʱʹ͓͚Δ E2E Test ͷӡ༻ͱܭଌʹΑΔվળ Takeshi Kondo / @chaspy 2023/07/14 MagicPodϢʔβʔLTձ
3. Who am I chaspy chaspy_ Engineering Manager Site Reliability and Web Application Development at Recruit Co., Ltd. Takeshi Kondo https://chaspy.me
4. ࠓ೔఻͍͑ͨ͜ͱ MagicPod ͷ੒ޭ཰ͱ࣮ߦ࣌ؒΛܭଌ͠Α͏
5. ࠶ܝ: Release Flow 4UBHJOH
   ʹσϓϩΠޙɺ .BHJD1PE
   Λ࣮ߦ
   ੒ޭͨ͠Βຊ൪΁ϦϦʔε͢Δ
6. ΋͔ͯ͠͠ɺࢲͷ MagicPodɺ஗͗͢…ʁ
7. ਪଌ͢ΔͳɺܭଌͤΑ
8. ཁٻ੔ཧ: ԿΛܭଌ͍͔ͨ͠ʁ • Ұׅ࣮ߦ(BathRun) • ॴཁ࣌ؒ • ੒ޭ͔ࣦഊ͔ • ֤ςετέʔε • ॴཁ࣌ؒ • ੒ޭ͔ࣦഊ͔ • ্هΛ metrics ͱͯ͠อଘ͠ɺՄࢹԽ͍ͨ͠
9. chaspy/magicpod-datadog-action https://github.com/chaspy/magicpod-datadog-action
10. Architecture (JU)VC
    "DUJPOT
    ఆظ࣮ߦ GET batch_run ৘ใΛऔಘ submit metrics ։࢝࣌ؒͱऴྃ࣌ ͕ؒಘΒΕΔͷ Ͱɺࠩ෼Λܭࢉ
11. How to use
12. Dashboard
13. ܭଌͯ͠Կ͕ى͖͔ͨʁ • ӡ༻ͷมߋ • ςετέʔεमਖ਼தʹԿ౓΋࣮ߦ͍ͯͨ͠ͷΛ΍Ίͨ • ݕূ༻ͷςετέʔε͸෼཭ • Dashboard ΛִिͰ֬ೝ͠ɺѱԽͨ͠Βؾ͚ͮΔΑ͏ʹͨ͠ • ࣮ߦ࣌ؒվળ • ςετέʔεΛϦόϥϯε • ϩέʔλʔઃఆͰ ai ͷ෦෼Λ aria-label ΍ΧελϜσʔλଐੑΛ෇༩ • ։ൃऀࣗΒ࣮ࢪ
14. ܭଌ͞Ε͍ͯΔͱɺվળͨ͘͠ͳΔ ෼ͷ୹ॖʹ੒ޭʂ
15. ө͑Δάϥϑ 
    ඵ
    
    ඵʹʂ
16. ө͑Δάϥϑ d d
17. ࠓ೔఻͍͑ͨ͜ͱ MagicPod ͷ੒ޭ཰ͱ࣮ߦ࣌ؒΛܭଌ͠Α͏
18. FAQ • GitHub Actions / Datadog Ҏ֎Ͱ΋΍Γ͍ͨͰ͢ • ఆظ࣮ߦ͕Ͱ͖Ε͹ͳΜͰ΋ྑ͍ • api Ͱऔಘͨ͠σʔλΛՃ޻ͯ͠ metrics ొ࿥͍ͯ͠Δ͚ͩ • ίʔυݟͯΈ͍ͯͩ͘͞
19. Who am I chaspy chaspy_ Engineering Manager Site Reliability and Web Application Development at Recruit Co., Ltd. Takeshi Kondo https://chaspy.me