『スタディサプリ 中学講座』における E2E Test の運用と計測による改善 / Improved E2E testing through measurement

https://trident-qa.connpass.com/event/283709/

Transcript

1. ʰελσΟαϓϦ தֶߨ࠲ʱʹ͓͚Δ
   
   
   E2E Test ͷӡ༻ͱܭଌʹΑΔվળ
   Takeshi Kondo / @chaspy
   
   
   2023/07/14
   
   
   MagicPodϢʔβʔLTձ
   

   View Slide

2. ʰελσΟαϓϦ தֶߨ࠲ʱʹ͓͚Δ
   
   
   E2E Test ͷӡ༻ͱܭଌʹΑΔվળ
   Takeshi Kondo / @chaspy
   
   
   2023/07/14
   
   
   MagicPodϢʔβʔLTձ
   

   View Slide

3. Who am I
   chaspy chaspy_
   Engineering Manager
   
   Site Reliability and Web Application Development
   
   at Recruit Co., Ltd.
   Takeshi Kondo
   https://chaspy.me
   

   View Slide

4. ࠓ೔఻͍͑ͨ͜ͱ
   
   
   MagicPod ͷ੒ޭ཰ͱ࣮ߦ࣌ؒΛܭଌ͠Α͏
   

   View Slide

5. ࠶ܝ: Release Flow
   4UBHJOHʹσϓϩΠޙɺ
   .BHJD1PEΛ࣮ߦ
   ੒ޭͨ͠Βຊ൪΁ϦϦʔε͢Δ
   

   View Slide

6. ΋͔ͯ͠͠ɺࢲͷ MagicPodɺ஗͗͢…ʁ
   

   View Slide

7. ਪଌ͢ΔͳɺܭଌͤΑ
   

   View Slide

8. ཁٻ੔ཧ: ԿΛܭଌ͍͔ͨ͠ʁ
   • Ұׅ࣮ߦ(BathRun)
   
   
   • ॴཁ࣌ؒ
   
   
   • ੒ޭ͔ࣦഊ͔
   
   
   • ֤ςετέʔε
   
   
   • ॴཁ࣌ؒ
   
   
   • ੒ޭ͔ࣦഊ͔
   
   
   • ্هΛ metrics ͱͯ͠อଘ͠ɺՄࢹԽ͍ͨ͠
   

   View Slide

9. chaspy/magicpod-datadog-action
   https://github.com/chaspy/magicpod-datadog-action
   

   View Slide

10. Architecture
    (JU)VC"DUJPOT
    ఆظ࣮ߦ
    GET batch_run
    
    
    ৘ใΛऔಘ submit metrics
    ։࢝࣌ؒͱऴྃ࣌
    ͕ؒಘΒΕΔͷ
    Ͱɺࠩ෼Λܭࢉ
    

    View Slide

11. How to use
    

    View Slide

12. Dashboard
    

    View Slide

13. ܭଌͯ͠Կ͕ى͖͔ͨʁ
    • ӡ༻ͷมߋ
    
    
    • ςετέʔεमਖ਼தʹԿ౓΋࣮ߦ͍ͯͨ͠ͷΛ΍Ίͨ
    
    
    • ݕূ༻ͷςετέʔε͸෼཭
    
    
    • Dashboard ΛִिͰ֬ೝ͠ɺѱԽͨ͠Βؾ͚ͮΔΑ͏ʹͨ͠
    
    
    • ࣮ߦ࣌ؒվળ
    
    
    • ςετέʔεΛϦόϥϯε
    
    
    • ϩέʔλʔઃఆͰ ai ͷ෦෼Λ aria-label ΍ΧελϜσʔλଐੑΛ෇༩
    
    
    • ։ൃऀࣗΒ࣮ࢪ
    

    View Slide

14. ܭଌ͞Ε͍ͯΔͱɺվળͨ͘͠ͳΔ
    ෼ͷ୹ॖʹ੒ޭʂ
    

    View Slide

15. ө͑Δάϥϑ
    ඵඵʹʂ
    

    View Slide

16. ө͑Δάϥϑ
    d
    d
    

    View Slide

17. ࠓ೔఻͍͑ͨ͜ͱ
    
    
    MagicPod ͷ੒ޭ཰ͱ࣮ߦ࣌ؒΛܭଌ͠Α͏
    

    View Slide

18. FAQ
    • GitHub Actions / Datadog Ҏ֎Ͱ΋΍Γ͍ͨͰ͢
    
    
    • ఆظ࣮ߦ͕Ͱ͖Ε͹ͳΜͰ΋ྑ͍
    
    
    • api Ͱऔಘͨ͠σʔλΛՃ޻ͯ͠ metrics ొ࿥͍ͯ͠Δ͚ͩ
    
    
    • ίʔυݟͯΈ͍ͯͩ͘͞
    

    View Slide

19. Who am I
    chaspy chaspy_
    Engineering Manager
    
    Site Reliability and Web Application Development
    
    at Recruit Co., Ltd.
    Takeshi Kondo
    https://chaspy.me
    

    View Slide