Upgrade to Pro — share decks privately, control downloads, hide ads and more …

10분 만에 확인하는 선물하기 서비스 품질

kakao
PRO
December 09, 2022

10분 만에 확인하는 선물하기 서비스 품질

#QAAutomation #QAOps #CI/CD #Appium #Selenium

반복적인 기능 테스트를 자동화하여 업무 효율과 서비스 품질을 높일 방안을 고민해왔고,
커머스 개발실에서 최초로 테스트 자동화 및 운영 시스템인 Away From Keyboard를 도입했습니다.
본 세션에서는 기존 한계 사항과 해결 방법을 쉬운 이해를 도울 수 있는 사례와 함께 소개해 드리고,
앞으로의 방향성을 제시하면서 마무리합니다

발표자 : seon.flower
카카오 커머스QA파트의 Seon입니다. 효율적인 테스트 수행을 연구합니다.

kakao
PRO

December 09, 2022
Tweet

More Decks by kakao

Other Decks in Programming

Transcript

  1. 10࠙ ݅ী ഛੋೞח ࢶޛೞӝ ࢲ࠺झ ಿ૕
    ܨࢲো seon.
    fl
    ower


    ஠஠য়
    Copyright 2022. Kakao Corp. All rights reserved. Redistribution or public display is not permitted without written permission from Kakao.
    if(kakao)2022

    View Slide

  2. Ѣ஘ ࢤп੄ QA৬ ࠛউೠ ׀ࡄ੄ TE

    Let’s Away From Keyboard
    !

    ழݠझ QAOps بੑ

    10࠙ ݅ী ഛੋೞח ࢶޛೞӝ ࢲ࠺झ ಿ૕
    NEXT

    View Slide

  3. Ѣ஘ ࢤп੄ QA৬ ࠛউೠ ׀ࡄ੄ TE

    Let’s Away From Keyboard
    !

    ழݠझ QAOps بੑ

    10࠙ ݅ী ഛੋೞח ࢶޛೞӝ ࢲ࠺झ ಿ૕
    NEXT

    View Slide

  4. ࢶޛೞӝ Develop Branch ੘স઺੉पөਃ?
    ࢲ࠺झ ੽ࣘ द য়ܨಕ੉૑о ߊࢤೞҊ ੓যࢲਃ~
    ঒ B೐۽ં౟ ੘স઺੉ۄ ߊࢤೞח Ѫ эणפ׮.
    A೐۽ં౟ QA
    B೐۽ં౟ Dev
    Branch ਗࠂ റ ҕਬܻ٘ѷणפ׮…………..!
    Pushо పझ౟ജ҃ী ՙ஖ח ৔ೱ

    View Slide

  5. ழݠझ ࠳ے஖ ҳઑ
    ೐۽ં౟A ࣻ೯઺

    ೐۽ં౟B ࣻ೯઺


    ೐۽ં౟C ࣻ೯઺

    ೐۽ં౟A ѐߊޛ
    ೐۽ં౟B ѐߊޛ
    ೐۽ં౟C ѐߊޛ

    QA పझ౟ ജ҃
    Feature Branch Develop Branch
    Local Branch

    View Slide

  6. TRY?
    “ୡӝಿ૕ ഛࠁܳ ਤೠ ডࣘਸ ੿೧ࠄ׮ݶ?”

    View Slide

  7. ୡӝ ಿ૕ೱ࢚ਸ ਤೠ ডࣘ
    OPEN IN PROGRESS RESOLVED IN DEV IN SANDBOX IN BETA CLOSED

    View Slide

  8. ୡӝ ಿ૕ೱ࢚ਸ ਤೠ ডࣘ
    ডࣘ 1. ѐߊ੗ ా೤ పझ౟ ૓೯৮ܐ ࢚క
    OPEN IN PROGRESS RESOLVED IN DEV IN SANDBOX IN BETA CLOSED
    IN SANDBOX IN BETA

    View Slide

  9. ୡӝ ಿ૕ೱ࢚ਸ ਤೠ ডࣘ
    ডࣘ 2. ӝദ੗ ӝמ పझ౟ ૓೯৮ܐ ࢚క
    ডࣘ 1. ѐߊ੗ ా೤ పझ౟ ૓೯৮ܐ ࢚క
    OPEN IN PROGRESS RESOLVED IN DEV IN SANDBOX IN BETA CLOSED
    IN SANDBOX IN BETA

    View Slide

  10. ୡӝ ಿ૕ೱ࢚ਸ ਤೠ ডࣘ
    ডࣘ 2. ӝദ੗ ӝמ పझ౟ ૓೯৮ܐ ࢚క
    ডࣘ 1. ѐߊ੗ ా೤ పझ౟ ૓೯৮ܐ ࢚క
    ডࣘ 1&2 ղਊ Ѩష റ QA ૓ੑ
    OPEN IN PROGRESS RESOLVED IN DEV IN SANDBOX IN BETA CLOSED
    IN SANDBOX IN BETA

    View Slide

  11. BUT!
    “ইஜ݃׮ ׳ۄ૑ח ࢲ࠺झಿ૕!”

    View Slide

  12. QA
    TE
    DEV

    View Slide

  13. Ѣ஘ ࢤп੄ QA৬ ࠛউೠ ׀ࡄ੄ TE

    Let’s Away From Keyboard
    !

    ழݠझ QAOps بੑ

    10࠙ ݅ী ഛੋೞח ࢶޛೞӝ ࢲ࠺झ ಿ૕
    NEXT

    View Slide

  14. ఃࠁ٘ܳ যڌѱ ځաࠅө!?
    ӝઓ ೠ҅੼ ೧Ѿ ߑউ
    ࠽٘ Ѩૐ పझ౟ ࠗ੤
    BVT ࣻ೯ بੑ
    పझ౟ ੗زച
    ૑ࣘ੸ ࢲ࠺झ ઁҕ ࠗ੤ పझ౟ ਍৔ ജ҃
    >
    >
    *Build Veri
    fi
    cation Test

    View Slide

  15. AFK, Away From Keyboard ~~~

    View Slide

  16. Ѣ஘ ࢤп੄ QA৬ ࠛউೠ ׀ࡄ੄ TE

    Let’s Away From Keyboard
    !

    ழݠझ QAOps بੑ

    10࠙ ݅ী ഛੋೞח ࢶޛೞӝ ࢲ࠺झ ಿ૕
    NEXT

    View Slide

  17. ݻदী য٣ীࢲ যڌѱ ࣻ೯ غաਃ?
    ੗زചػ పझ౟ா੉झ?

    View Slide

  18. QAOps ۆ?
    QA OPS
    Quality Assurance OPerationS
    +

    View Slide

  19. QAOpsীࢲ QAо ೡ ࣻ ੓ח Ҋ޹ٜ?
    ੗زച
    TC Ѿҗҕਬ
    ߧਤ? ਬ૑ࠁࣻ? ೐ۨ੐ਕ௼? ஠స? JIRA?

    View Slide

  20. QAOps ࣻ೯൒ܴ
    ҅ദ ੗زച Ѿҗ ߓನ
    QA ߈ࠂ੸ పझ౟ ߧਤ పझ౟ா੉झ ѐߊ JIRA ੉ग ١੤ ߓನ
    OPS పझ౟ ࣻ೯ ઱ӝ ੗ز పझ౟ ࣻ೯ ਬҙࠗࢲ ҕਬ ߓನ
    > > >

    View Slide

  21. ݻदী য٣ীࢲ যڌѱ ࣻ೯ غաਃ?
    ੗زചػ పझ౟ா੉झ?
    ∴ QA : ఃਕ٘ ӝ߈ పझ౟੗زച بੑ
    ∴ OPS : ૑ࣘ੸ੋ ࢲ࠺झ ઁҕ ജ҃ ਍৔

    View Slide

  22. ఃਕ٘ ӝ߈ పझ౟੗زച بੑ

    View Slide

  23. যځೠ ੗زച ೐ۨ੐ਕ௼ܳ ࢶ੿ೡ Ѫੋо?
    Ҋ۰ࢎ೦ ࢶ੿ ೐ۨ੐ਕ௼
    ਢ/ݽ߄ੌ పझ౟ ѐߊ Selenium/Appium ۄ੉࠳۞ܻ ૑ਗ
    ѐߊ ঱যী ؀ೠ ੽Ӕࢿ ఃਕ٘ ӝ߈ పझ౟ ா੉झ ੘ࢿ/ҙܻ
    ۄ੉࠳۞ܻ ഛ੢ ղ੢/৻੢ ۄ੉࠳۞ܻ ࣻ੿ ߂ ୶о оמ
    పझ౟߬٘ ਗѺࣻ೯ ਗѺ పझ౟ ۄ੉࠳۞ܻ ૑ਗ
    CI/CD োز ઃఅझ ೒۞Ӓੋ ઁҕ
    >
    >
    >
    >
    >

    View Slide

  24. যځೠ ੗زച ೐ۨ੐ਕ௼ܳ ࢶ੿ೡ Ѫੋо?
    Ҋ۰ࢎ೦ ࢶ੿ ೐ۨ੐ਕ௼
    ਢ/ݽ߄ੌ పझ౟ ѐߊ Selenium/Appium ۄ੉࠳۞ܻ ૑ਗ
    ѐߊ ঱যী ؀ೠ ੽Ӕࢿ ఃਕ٘ ӝ߈ పझ౟ ா੉झ ੘ࢿ/ҙܻ
    ۄ੉࠳۞ܻ ഛ੢ ղ੢/৻੢ ۄ੉࠳۞ܻ ࣻ੿ ߂ ୶о оמ
    పझ౟߬٘ ਗѺࣻ೯ ਗѺ పझ౟ ۄ੉࠳۞ܻ ૑ਗ
    CI/CD োز ઃఅझ ೒۞Ӓੋ ઁҕ
    >
    >
    >
    >
    >

    View Slide

  25. যځೠ ੗زച ೐ۨ੐ਕ௼ܳ ࢶ੿ೡ Ѫੋо?
    Ҋ۰ࢎ೦ Robot Framework
    ਢ/ݽ߄ੌ పझ౟ ѐߊ Selenium/Appium ۄ੉࠳۞ܻ ૑ਗ
    ѐߊ ঱যী ؀ೠ ੽Ӕࢿ ఃਕ٘ ӝ߈ పझ౟ ா੉झ ੘ࢿ/ҙܻ
    ۄ੉࠳۞ܻ ഛ੢ ղ੢/৻੢ ۄ੉࠳۞ܻ ࣻ੿ ߂ ୶о оמ
    పझ౟߬٘ ਗѺࣻ೯ ਗѺ పझ౟ ۄ੉࠳۞ܻ ૑ਗ
    CI/CD োز ઃఅझ ೒۞Ӓੋ ઁҕ
    >
    >
    >
    >
    >

    View Slide

  26. ఃਕ٘ ӝ߈ పझ౟ ੗زച ѐߊ ҳઑ
    ӝ߈঱য ۄ੉࠳۞ܻ ೐ۨ੐ਕ௼ ఃਕ٘ పझ౟
    Python ղ੢ ۄ੉࠳۞ܻ Robot Framework ҕా ఃਕ٘ Test Suite
    ৻੢ ۄ੉࠳۞ܻ ਬ੷ ఃਕ٘ Test Case
    >
    > > >

    View Slide

  27. ఃਕ٘ ӝ߈ పझ౟ ੗زച ѐߊ ҳઑ
    ӝ߈঱য ۄ੉࠳۞ܻ ೐ۨ੐ਕ௼ ఃਕ٘ పझ౟
    Python ղ੢ ۄ੉࠳۞ܻ Robot Framework ҕా ఃਕ٘ Test Suite
    ৻੢ ۄ੉࠳۞ܻ ਬ੷ ఃਕ٘ Test Case
    >
    > > >

    View Slide

  28. ҕా ఃਕ٘ۆ?
    *** Keywords ***


    ࢶޛೞӝ ۽Ӓੋ


    [Arguments] ${id} ${pw}


    Wait Until Element Is Visible xpath=${۽Ӓੋಕ੉૑૓ੑ_҃۽} 10s


    Click Element xpath=${۽Ӓੋಕ੉૑૓ੑ_҃۽}


    Wait Until Element Is Visible xpath=${۽Ӓੋই੉٣ੑ۱_҃۽} 10s


    Input Text ${۽Ӓੋই੉٣ੑ۱} ${id}


    Wait Until Element Is Visible xpath=${۽Ӓੋಁझਕ٘_ੑ۱} 10s


    Input Text ${۽Ӓੋಁझਕ٘_ੑ۱} ${pw}


    Wait Until Element Is Visible xpath=${۽Ӓੋࣻ೯ߡౡ_҃۽} 10s


    Click Element xpath=${۽Ӓੋࣻ೯ߡౡ_҃۽}
    ߧਊ੸ਵ۽ औѱ ੗زചܳ ҳഅೞӝ ਤೠ ೣࣻ
    ࢲ࠺झ ױਤ۽ ҕਊ ఃਕ٘ ਍৔
    ߸҃ࢎ೦ী ؀ೠ ૑ࣘ੸ੋ ਬ૑ࠁࣻ ߂ ߓನ
    ex. “աীѱ ࢶޛೞӝ”, “ࢶ଱ࣽ ѱ੐”, “ࣳೝನੋ౟۽ Ѿઁೞӝ” ١

    View Slide

  29. ਬ੷ ఃਕ٘ۆ?
    *** Keywords ***


    ࢶ଱ࣽ ѱ੐ ಕ੉૑ ૓ੑ पಁ द


    Wait Until Element Is Visible xpath={GNBײӝߡౡ_҃۽} 10s


    Click Element xpath={GNBײӝߡౡ_҃۽}


    ࢶ଱ࣽ ѱ੐




    ࢶޛѱ੐ ૓ੑ पಁ द ࢶ଱ࣽ ѱ੐ ੤૓೯


    Wait Until Keyword Succeeds 2 min 5 sec ࢶ଱ࣽ ѱ੐ ಕ੉૑ ૓ੑ पಁ द
    ߧਊ ఃਕ٘ ৻ী ੗زച ҳഅ ઺ ೙ਃೠ ೣࣻ


    ѐੋ ױਤ۽ ѐ߹ ਍৔


    ߸҃ࢎ೦ী ؀ೠ ૑ࣘ੸ੋ ਬ૑ࠁࣻ O ߂ ߓನ
    X

    ex. ҕਊ ఃਕ٘ੋ “ࢶ଱ࣽ ѱ੐” ਸ ഝਊೞৈ ѐ߹ పझ౟ী ೙ਃೠ ఃਕ٘ ࢤࢿ

    View Slide

  30. ఃਕ٘ ӝ߈ਵ۽ పझ౟ ੗زചܳ ҳࢿೞݶ যڃ ݽणੌө?
    ੌ߈ Ӓܛ଻౴ߑীࢲ ࢶ଱ࣽ ࢶޛѱ੐ ૓೯


    ଻౴ߑ ૓ੑ ੗زച_ੌ߈Ӓܛ


    ${status} Run Keyword And Return Status ࢶ଱ࣽ ѱ੐


    Run Keyword If "${status}" == "False" ࢶޛѱ੐ ૓ੑ पಁ द ࢶ଱ࣽ ѱ੐ ੤૓೯


    Ѿઁ ৮ܐ ಕ੉૑ ೻؊ ഛੋ


    GNB ೻؊ ײӝ ߡౡ ௿ܼ


    ଻౴ߑ ૓ੑ ഛੋ


    ࢶ଱ࣽ ࢶޛѱ੐ ૓೯ ঌܿస ࣻन ഛੋ


    ࢶޛѱ੐ ׼୎੗ ഛੋ ಕ੉૑ ૓ੑ


    ఃਕ٘ ೠ ઴ == పझ౟ झయ ೠ ѐ
    ఃਕ٘ݺਸ ੗োয۽ ੘ࢿ
    ∴ ӝദ/ѐߊ/QA ݽف ੉೧ೡ ࣻ ੓ח ૒ҙ੸ੋ పझ౟ ௏٘ ఍ࢤ
    !

    View Slide

  31. ఃਕ٘ ӝ߈ਵ۽ పझ౟ ੗زചܳ ҳࢿೞݶ যڃ ݽणੌө?
    ੌ߈ Ӓܛ଻౴ߑীࢲ ࢶ଱ࣽ ࢶޛѱ੐ ૓೯


    ଻౴ߑ ૓ੑ ੗زച_ੌ߈Ӓܛ


    ${status} Run Keyword And Return Status ࢶ଱ࣽ ѱ੐


    Run Keyword If "${status}" == "False" ࢶޛѱ੐ ૓ੑ पಁ द ࢶ଱ࣽ ѱ੐ ੤૓೯


    Ѿઁ ৮ܐ ಕ੉૑ ೻؊ ഛੋ


    GNB ೻؊ ײӝ ߡౡ ௿ܼ


    ଻౴ߑ ૓ੑ ഛੋ


    ࢶ଱ࣽ ࢶޛѱ੐ ૓೯ ঌܿస ࣻन ഛੋ


    ࢶޛѱ੐ ׼୎੗ ഛੋ ಕ੉૑ ૓ੑ


    ఃਕ٘ ೠ ઴ == పझ౟ झయ ೠ ѐ
    ఃਕ٘ݺਸ ੗োয۽ ੘ࢿ
    ∴ ӝദ/ѐߊ/QA ݽف ੉೧ೡ ࣻ ੓ח ૒ҙ੸ੋ పझ౟ ௏٘ ఍ࢤ
    !

    View Slide

  32. ૑ࣘ੸ੋ ࢲ࠺झ ઁҕ ജ҃ ਍৔

    View Slide

  33. ૑ࣘ੸ੋ ࢲ࠺झ ઁҕ ജ҃ ਍৔ਸ ਤೠ ডࣘ
    Ҋ۰؀࢚ ডࣘ
    ੿ӝ పझ౟ పझ౟ ജ҃ ߹ BVT పझ౟
    ࢚द పझ౟ ೙ਃ द ૒੽ ࣻ೯

    View Slide

  34. CODE CI/CD بҳ FRAMEWORK Library పझ౟ ജ҃
    PC ജ҃ https://git-scm.com/
    downloads/logos
    Mobile ജ҃
    ਍৔ ജ҃ਸ যڌѱ ҳࢿೡ Ѫੋо?
    GIT ROBOT Selenium
    Appium
    Jenkins
    DeviceFarm
    VM/PM Test Bed
    GIT ROBOT
    Jenkins
    GIT : https://git-scm.com/downloads/logos
    Jenkins : https://get.jenkins.io/art/
    ROBOT : https://github.com/robotframework/visual-identity#logo
    Selenium : https://github.com/SeleniumHQ/selenium
    Appium : https://github.com/appium/appium.io/tree/gh-pages/img 


    View Slide

  35. CODE CI/CD بҳ FRAMEWORK Library పझ౟ ജ҃
    PC ജ҃
    Mobile ജ҃
    ਍৔ ജ҃ਸ যڌѱ ҳࢿೡ Ѫੋо?
    GIT ROBOT Selenium
    Appium
    Jenkins
    DeviceFarm
    VM/PM Test Bed
    GIT ROBOT
    Jenkins

    View Slide

  36. ழݠझ QAOps ਍৔
    ѐߊ Jenkins
    QA Jenkins
    develop/beta ডࣘ 2. ݒੌ য়੹ 8द
    ѐߊ, ӝദ, QA
    BT BVT(PC)
    QA Jenkins
    develop/sandbox ডࣘ 1. ݒੌ য়੹ 7द
    ѐߊ, ӝദ, QA
    SB BVT(PC)
    QA Jenkins
    develop/real ডࣘ 3. ݒੌ য়੹ 9द
    ѐߊ, ӝദ, QA
    RL BVT(PC)
    QA Jenkins
    ೙ਃद ࢚द. ૒੽ ࣻ೯
    ࣻ೯੗
    SB/BT/RL BVT(PC/MO)
    Ѿҗ ࠁҊࢲ
    Ѿҗ ࠁҊࢲ
    Ѿҗ ࠁҊࢲ
    Ѿҗ ࠁҊࢲ

    View Slide

  37. ழݠझ QAOps ਍৔
    ѐߊ Jenkins
    QA Jenkins
    develop/beta ডࣘ 2. ݒੌ য়੹ 8द
    ѐߊ, ӝദ, QA
    BT BVT(PC)
    QA Jenkins
    develop/sandbox ডࣘ 1. ݒੌ য়੹ 7द
    ѐߊ, ӝദ, QA
    SB BVT(PC)
    QA Jenkins
    develop/real ডࣘ 3. ݒੌ য়੹ 9द
    ѐߊ, ӝദ, QA
    RL BVT(PC)
    QA Jenkins
    ೙ਃद ࢚द. ૒੽ ࣻ೯
    ࣻ೯੗
    SB/BT/RL BVT(PC/MO)
    Ѿҗ ࠁҊࢲ
    Ѿҗ ࠁҊࢲ
    Ѿҗ ࠁҊࢲ
    Ѿҗ ࠁҊࢲ

    View Slide

  38. ழݠझ QAOps ਍৔
    ѐߊ Jenkins
    QA Jenkins
    develop/beta Ѿҗ ࠁҊࢲ
    BT BVT(PC)
    QA Jenkins
    develop/sandbox Ѿҗ ࠁҊࢲ
    ডࣘ 1. ݒੌ য়੹ 7द
    ѐߊ, ӝദ, QA
    SB BVT(PC)
    QA Jenkins
    develop/real Ѿҗ ࠁҊࢲ
    ডࣘ 3. ݒੌ য়੹ 9द
    ѐߊ, ӝദ, QA
    RL BVT(PC)
    QA Jenkins
    ೙ਃद Ѿҗ ࠁҊࢲ
    ࢚द. ૒੽ ࣻ೯
    ࣻ೯੗
    SB/BT/RL BVT(PC/MO)
    ডࣘ 2. ݒੌ য়੹ 8द
    BT BVT(PC) ѐߊ, ӝദ, QA

    View Slide

  39. Ѣ஘ ࢤп੄ QA৬ ࠛউೠ ׀ࡄ੄ TE

    Let’s Away From Keyboard
    !

    ழݠझ QAOps بੑ

    10࠙ ݅ী ഛੋೞח ࢶޛೞӝ ࢲ࠺झ ಿ૕
    NEXT

    View Slide

  40. যڃ Ѫਸ ੗زച ೡ Ѫੋо?
    ૑ࣘ
    ߈ࠂ ੗ਗ

    View Slide

  41. যڃ Ѫਸ ੗زച ೡ Ѫੋо?
    ߈ࠂ੸ ӝמపझ౟ܳ


    ૑ࣘ੸ੋ ಿ૕۽ ਬ૑ೞৈ


    সޖ ੗ਗਸ ബਯ੸ਵ۽


    ਍৔ೡ ࣻ ੓ח పझ౟ா੉झ

    View Slide

  42. BVT 1. ࢶޛೞӝ ӝࠄ ӝמపझ౟

    View Slide

  43. ߈ࠂ੸ ӝמపझ౟
    Will continue…
    2023… 2024… 2025…

    View Slide

  44. ૑ࣘ੸ੋ ಿ૕ ਬ૑
    Ѿઁ
    ࢚ಿਬഋ ࢶޛ؀࢚
    ߓ࢚࣠ಿ? Үജӂ? ࢿҕ? पಁ? ஘ҳ? ա?

    View Slide

  45. সޖ ੗ਗ੄ ബਯ੸ ਍৔
    NO పझ౟ா੉झ ࣻ೯ दр
    1 ࢚ಿਬഋ : ߓ࢚࣠ಿ ޖ২࣌ | Ѿઁࣻױ : ޖా੢ ੑӘ അӘ৔ࣻૐ O | ࢶޛਬഋ : ੗ӝҳݒ 25sec
    2 ࢚ಿਬഋ : ߓ࢚࣠ಿ ઑ೤+੘ࢿ | Ѿઁࣻױ : ޖా੢ ੑӘ അӘ৔ࣻૐ X | ࢶޛਬഋ : ஘ҳ 2ݺ ࢶޛೞӝ 32sec
    3 ࢚ಿਬഋ : Үജӂ | Ѿઁࣻױ : ࣳೝನੋ౟ | ࢶޛਬഋ : ੗ӝҳݒ 24sec
    4 ࢚ಿਬഋ : ߓ࢚࣠ಿ ઑ೤+੘ࢿ | Ѿઁࣻױ : ࣳೝನੋ౟ | ࢶޛਬഋ : ஘ҳ 1ݺ ࢶޛೞӝ 27sec
    5 ࢚ಿਬഋ : ߓ࢚࣠ಿ ة݀+੘ࢿ | Ѿઁࣻױ : ࣳೝನੋ౟ | ࢶޛਬഋ : ஘ҳ 2ݺ ࢶޛೞӝ 30sec
    6 ࢚ಿਬഋ : Үജӂ & ߓ࢚࣠ಿ ઑ೤ | Ѿઁࣻױ : ࣳೝನੋ౟ | ࢶޛਬഋ : ੢߄ҳפ ੗ӝҳݒ 41sec
    7 ࢚ಿਬഋ : Үജӂ | Ѿઁࣻױ : ࣳೝನੋ౟ | ࢶޛਬഋ : ௏٘ࢶޛ ੗ӝ١۾ 28sec

    View Slide

  46. সޖ ੗ਗ੄ ബਯ੸ ਍৔
    NO పझ౟ா੉झ ࣻ೯ दр
    1 ࢚ಿਬഋ : ߓ࢚࣠ಿ ޖ২࣌ | Ѿઁࣻױ : ޖా੢ ੑӘ അӘ৔ࣻૐ O | ࢶޛਬഋ : ੗ӝҳݒ 25sec
    2 ࢚ಿਬഋ : ߓ࢚࣠ಿ ઑ೤+੘ࢿ | Ѿઁࣻױ : ޖా੢ ੑӘ അӘ৔ࣻૐ X | ࢶޛਬഋ : ஘ҳ 2ݺ ࢶޛೞӝ 32sec
    3 ࢚ಿਬഋ : Үജӂ | Ѿઁࣻױ : ࣳೝನੋ౟ | ࢶޛਬഋ : ੗ӝҳݒ 24sec
    4 ࢚ಿਬഋ : ߓ࢚࣠ಿ ઑ೤+੘ࢿ | Ѿઁࣻױ : ࣳೝನੋ౟ | ࢶޛਬഋ : ஘ҳ 1ݺ ࢶޛೞӝ 27sec
    5 ࢚ಿਬഋ : ߓ࢚࣠ಿ ة݀+੘ࢿ | Ѿઁࣻױ : ࣳೝನੋ౟ | ࢶޛਬഋ : ஘ҳ 2ݺ ࢶޛೞӝ 30sec
    6 ࢚ಿਬഋ : Үജӂ & ߓ࢚࣠ಿ ઑ೤ | Ѿઁࣻױ : ࣳೝನੋ౟ | ࢶޛਬഋ : ੢߄ҳפ ੗ӝҳݒ 41sec
    7 ࢚ಿਬഋ : Үജӂ | Ѿઁࣻױ : ࣳೝನੋ౟ | ࢶޛਬഋ : ௏٘ࢶޛ ੗ӝ١۾ 28sec

    View Slide

  47. View Slide

  48. 20ߓ ബਯਸ ݍࠁ׮!
    ੗زച ਍৔ ੹ ੗زച ਍৔ റ
    ࣻ೯दр ড 60min ড 3min

    View Slide

  49. BVT 2. ࢶޛೞӝ ҕా ೻؊

    View Slide

  50. ҕా ೻؊

    View Slide

  51. ߈ࠂ੸ ӝמపझ౟
    ড 58ѐ੄ ੌх
    2022.01 ~ 2022.09

    View Slide

  52. ૑ࣘ੸ੋ ಿ૕ ਬ૑
    ࢶޛೣ

    ࢶޛݫࣁ૑ ࢶޛѱ੐

    View Slide

  53. সޖ ੗ਗ੄ ബਯ੸ ਍৔
    పझ౟ ग౟ పझ౟ா੉झ ࣻ೯ दр
    ക స 4చਵ۽ ࢶޛೞӝ ૓ੑ റ ೻؊ ഛੋ 4sec
    ക ࢶޛ࢚੗ ௿ܼ റ ೻؊ ഛੋ 24sec
    ക ࢶޛೞӝ ۽Ҋ ௿ܼ റ ೻؊ ഛੋ 22sec
    ക Ѩ࢝ ߡౡ ௿ܼ റ ೻؊ ഛੋ 29sec
    ക ۘఊచ ߡౡ ௿ܼ ߂ ೻؊ ഛੋ 30sec
    ക ࠳ے٘ ߡౡ ௿ܼ ߂ ೻؊ ഛੋ 39sec
    ക ࢶޛೣ ߡౡ ௿ܼ ߂ ೻؊ ഛੋ 34sec
    ക negative test : ٍ۽оӝ ߡౡ 2ѐ ࢤࢿ - Ѩ࢝ ߡౡ ௿ܼറ ࢶޛೣచ ߡౡ ௿ܼ റ ೻؊ ഛੋ 48sec
    ࢶޛೣ ࢶޛೞӝ ૓ੑ > ࢶޛೣ చ 6sec
    ࢶޛೣ ࢶޛೣ > ߉਷ࢶޛೣ 21sec
    ࢶޛೣ ࢶޛೣ > ߉਷ࢶޛೣ > ߉਷ࢶޛೣ࢚ࣁ 8sec

    View Slide

  54. పझ౟ ग౟ పझ౟ா੉झ ࣻ೯ दр
    ࢶޛೣ ࢶޛೣ > ਤदܻझ౟ ಕ੉૑ 19sec
    ࢶޛೣ ࢶޛೣ > ઱ޙղ৉ 24sec
    ࢶޛೣ ࢶޛೣ > ࢶޛ റӝ 9sec
    ࢶޛೣ ࢶޛೣ > ࢶޛ௏٘ࢶޛ ١۾ 16sec
    ࢶޛݫࣁ૑ ઱ޙ৮ܐ ಕ੉૑ ೻؊ ഛੋ 68sec
    ࢶޛݫࣁ૑ ઱ޙղ৉ ૓ੑ ೻؊ ഛੋ 17sec
    ࢶޛݫࣁ૑ ݫࣁ૑஠٘ ૓ੑ ೻؊ ഛੋ 17sec
    ࢶޛݫࣁ૑ ߓ࣠૑ ੑ۱ೞӝ ૓ੑ ೻؊ ഛੋ 34sec
    ࢶޛѱ੐ য়೑Ӓܛ > ےؒѱ੐ 51sec
    ࢶޛѱ੐ ੌ߈Ӓܛ > ࢶ଱ࣽѱ੐ 50sec

    View Slide

  55. పझ౟ ग౟ పझ౟ா੉झ ࣻ೯ दр
    ࢶޛೣ ࢶޛೣ > ਤदܻझ౟ ಕ੉૑ 19sec
    ࢶޛೣ ࢶޛೣ > ઱ޙղ৉ 24sec
    ࢶޛೣ ࢶޛೣ > ࢶޛ റӝ 9sec
    ࢶޛೣ ࢶޛೣ > ࢶޛ௏٘ࢶޛ ١۾ 16sec
    ࢶޛݫࣁ૑ ઱ޙ৮ܐ ಕ੉૑ ೻؊ ഛੋ 68sec
    ࢶޛݫࣁ૑ ઱ޙղ৉ ૓ੑ ೻؊ ഛੋ 17sec
    ࢶޛݫࣁ૑ ݫࣁ૑஠٘ ૓ੑ ೻؊ ഛੋ 17sec
    ࢶޛݫࣁ૑ ߓ࣠૑ ੑ۱ೞӝ ૓ੑ ೻؊ ഛੋ 34sec
    ࢶޛѱ੐ য়೑Ӓܛ > ےؒѱ੐ 51sec
    ࢶޛѱ੐ ੌ߈Ӓܛ > ࢶ଱ࣽѱ੐ 50sec

    View Slide

  56. పझ౟ ग౟ పझ౟ா੉झ ࣻ೯ दр
    ࢶޛೣ ࢶޛೣ > ਤदܻझ౟ ಕ੉૑ 19sec
    ࢶޛೣ ࢶޛೣ > ઱ޙղ৉ 24sec
    ࢶޛೣ ࢶޛೣ > ࢶޛ റӝ 9sec
    ࢶޛೣ ࢶޛೣ > ࢶޛ௏٘ࢶޛ ١۾ 16sec
    ࢶޛݫࣁ૑ ઱ޙ৮ܐ ಕ੉૑ ೻؊ ഛੋ 68sec
    ࢶޛݫࣁ૑ ઱ޙղ৉ ૓ੑ ೻؊ ഛੋ 17sec
    ࢶޛݫࣁ૑ ݫࣁ૑஠٘ ૓ੑ ೻؊ ഛੋ 17sec
    ࢶޛݫࣁ૑ ߓ࣠૑ ੑ۱ೞӝ ૓ੑ ೻؊ ഛੋ 34sec
    ࢶޛѱ੐ য়೑Ӓܛ > ےؒѱ੐ 51sec
    ࢶޛѱ੐ ੌ߈Ӓܛ > ࢶ଱ࣽѱ੐ 50sec

    View Slide

  57. ࢶޛѱ੐ ૓ੑ

    View Slide

  58. ࢶޛѱ੐࠳݁૑&࢚ಿ࢚ࣁ

    View Slide

  59. ઱ޙࢲ&઱ޙ৮ܐ

    View Slide

  60. ׼୎੗ ഛੋ

    View Slide

  61. 15ߓ ബਯਸ ݍࠁ׮!
    ੗زച ਍৔ ੹ ੗زച ਍৔ റ
    ࣻ೯दр ড 120min ড 8m

    View Slide

  62. 15ߓ
    20ߓ ಣӐ 17ߓ
    ӝࠄӝמ ೻؊ BVT
    ࢎۈ੉ ೞ؍ ੌਸ ௿ܼ ೠ ߣਵ۽🎉🎉🎉

    View Slide

  63. Ѣ஘ ࢤп੄ QA৬ ࠛউೠ ׀ࡄ੄ TE!?

    View Slide

  64. TEٜ࠙ ~! ੷൞ QAOps റী ѐࢶػ ੼ ੓ਸөਃ!?
    ӝࠄ ҃۽࢚੄ ߡӒо അ੷൤ ੸ѱ ߊ஀ؾפ׮.
    QA ࣌
    ࢶޛೞӝ TE
    ҅ദػ పझ౟ ٜਸ ઺ױ হ੉ ૓೯ೡ ࣻ ੓যࢲ
    ؊੉࢚ ࠛউೞ૑ ঋणפ׮~🎉🎉🎉
    🎉🎉🎉೯ࠂ೤פ׮🎉🎉🎉
    QA ࣌

    View Slide

  65. Ѣ஘ ࢤп੄ QA৬ ࠛউೠ ׀ࡄ੄ TE

    Let’s Away From Keyboard
    !

    ழݠझ QAOps بੑ

    10࠙ ݅ী ഛੋೞח ࢶޛೞӝ ࢲ࠺झ ಿ૕
    NEXT

    View Slide

  66. View Slide

  67. ؘ੉ఠ࠙ࢳ
    ߊ੗ஂ दաܻয়

    View Slide

  68. ੗زపझ౟ா੉झ ੗زࢤࢿ
    DB ߊ੗ஂ ۽Ӓ ؘ੉ఠ࠙ࢳ दաܻয় ࢤࢿ ੗ز పझ౟
    > > > >

    View Slide

  69. E.O.D

    View Slide