Upgrade to Pro — share decks privately, control downloads, hide ads and more …

『スタディサプリ 中学講座』における E2E Test の運用と計測による改善 / Improved E2E testing through measurement

『スタディサプリ 中学講座』における E2E Test の運用と計測による改善 / Improved E2E testing through measurement

Takeshi Kondo

July 14, 2023
Tweet

More Decks by Takeshi Kondo

Other Decks in Technology

Transcript

  1. ʰελσΟαϓϦ தֶߨ࠲ʱʹ͓͚Δ


    E2E Test ͷӡ༻ͱܭଌʹΑΔվળ
    Takeshi Kondo / @chaspy


    2023/07/14


    MagicPodϢʔβʔLTձ

    View Slide

  2. ʰελσΟαϓϦ தֶߨ࠲ʱʹ͓͚Δ


    E2E Test ͷӡ༻ͱܭଌʹΑΔվળ
    Takeshi Kondo / @chaspy


    2023/07/14


    MagicPodϢʔβʔLTձ

    View Slide

  3. Who am I
    chaspy chaspy_
    Engineering Manager

    Site Reliability and Web Application Development

    at Recruit Co., Ltd.
    Takeshi Kondo
    https://chaspy.me

    View Slide

  4. ࠓ೔఻͍͑ͨ͜ͱ


    MagicPod ͷ੒ޭ཰ͱ࣮ߦ࣌ؒΛܭଌ͠Α͏

    View Slide

  5. ࠶ܝ: Release Flow
    4UBHJOHʹσϓϩΠޙɺ
    .BHJD1PEΛ࣮ߦ
    ੒ޭͨ͠Βຊ൪΁ϦϦʔε͢Δ

    View Slide

  6. ΋͔ͯ͠͠ɺࢲͷ MagicPodɺ஗͗͢…ʁ

    View Slide

  7. ਪଌ͢ΔͳɺܭଌͤΑ

    View Slide

  8. ཁٻ੔ཧ: ԿΛܭଌ͍͔ͨ͠ʁ
    • Ұׅ࣮ߦ(BathRun)


    • ॴཁ࣌ؒ


    • ੒ޭ͔ࣦഊ͔


    • ֤ςετέʔε


    • ॴཁ࣌ؒ


    • ੒ޭ͔ࣦഊ͔


    • ্هΛ metrics ͱͯ͠อଘ͠ɺՄࢹԽ͍ͨ͠

    View Slide

  9. chaspy/magicpod-datadog-action
    https://github.com/chaspy/magicpod-datadog-action

    View Slide

  10. Architecture
    (JU)VC"DUJPOT
    ఆظ࣮ߦ
    GET batch_run


    ৘ใΛऔಘ submit metrics
    ։࢝࣌ؒͱऴྃ࣌
    ͕ؒಘΒΕΔͷ
    Ͱɺࠩ෼Λܭࢉ

    View Slide

  11. How to use

    View Slide

  12. Dashboard

    View Slide

  13. ܭଌͯ͠Կ͕ى͖͔ͨʁ
    • ӡ༻ͷมߋ


    • ςετέʔεमਖ਼தʹԿ౓΋࣮ߦ͍ͯͨ͠ͷΛ΍Ίͨ


    • ݕূ༻ͷςετέʔε͸෼཭


    • Dashboard ΛִिͰ֬ೝ͠ɺѱԽͨ͠Βؾ͚ͮΔΑ͏ʹͨ͠


    • ࣮ߦ࣌ؒվળ


    • ςετέʔεΛϦόϥϯε


    • ϩέʔλʔઃఆͰ ai ͷ෦෼Λ aria-label ΍ΧελϜσʔλଐੑΛ෇༩


    • ։ൃऀࣗΒ࣮ࢪ

    View Slide

  14. ܭଌ͞Ε͍ͯΔͱɺվળͨ͘͠ͳΔ
    ෼ͷ୹ॖʹ੒ޭʂ

    View Slide

  15. ө͑Δάϥϑ
    ඵඵʹʂ

    View Slide

  16. ө͑Δάϥϑ
    d
    d

    View Slide

  17. ࠓ೔఻͍͑ͨ͜ͱ


    MagicPod ͷ੒ޭ཰ͱ࣮ߦ࣌ؒΛܭଌ͠Α͏

    View Slide

  18. FAQ
    • GitHub Actions / Datadog Ҏ֎Ͱ΋΍Γ͍ͨͰ͢


    • ఆظ࣮ߦ͕Ͱ͖Ε͹ͳΜͰ΋ྑ͍


    • api Ͱऔಘͨ͠σʔλΛՃ޻ͯ͠ metrics ొ࿥͍ͯ͠Δ͚ͩ


    • ίʔυݟͯΈ͍ͯͩ͘͞

    View Slide

  19. Who am I
    chaspy chaspy_
    Engineering Manager

    Site Reliability and Web Application Development

    at Recruit Co., Ltd.
    Takeshi Kondo
    https://chaspy.me

    View Slide