10분 만에 확인하는 선물하기 서비스 품질

#QAAutomation #QAOps #CI/CD #Appium #Selenium

반복적인 기능 테스트를 자동화하여 업무 효율과 서비스 품질을 높일 방안을 고민해왔고,
커머스 개발실에서 최초로 테스트 자동화 및 운영 시스템인 Away From Keyboard를 도입했습니다.
본 세션에서는 기존 한계 사항과 해결 방법을 쉬운 이해를 도울 수 있는 사례와 함께 소개해 드리고,
앞으로의 방향성을 제시하면서 마무리합니다

발표자 : seon.flower
카카오 커머스QA파트의 Seon입니다. 효율적인 테스트 수행을 연구합니다.

Transcript

1. 10࠙ ݅ী ഛੋೞח ࢶޛೞӝ ࢲ࠺झ ಿ૕
   ܨࢲো seon.
   fl
   ower
   
   
   ஠஠য়
   Copyright 2022. Kakao Corp. All rights reserved. Redistribution or public display is not permitted without written permission from Kakao.
   if(kakao)2022
   

   View Slide

2. Ѣ஘ ࢤп੄ QA৬ ࠛউೠ ׀ࡄ੄ TE

   Let’s Away From Keyboard
   !
   
   ழݠझ QAOps بੑ

   10࠙ ݅ী ഛੋೞח ࢶޛೞӝ ࢲ࠺झ ಿ૕
   NEXT
   

   View Slide

3. Ѣ஘ ࢤп੄ QA৬ ࠛউೠ ׀ࡄ੄ TE

   Let’s Away From Keyboard
   !
   
   ழݠझ QAOps بੑ

   10࠙ ݅ী ഛੋೞח ࢶޛೞӝ ࢲ࠺झ ಿ૕
   NEXT
   

   View Slide

4. ࢶޛೞӝ Develop Branch ੘স઺੉पөਃ?
   ࢲ࠺झ ੽ࣘ द য়ܨಕ੉૑о ߊࢤೞҊ ੓যࢲਃ~
   ঒ B೐۽ં౟ ੘স઺੉ۄ ߊࢤೞח Ѫ эणפ׮.
   A೐۽ં౟ QA
   B೐۽ં౟ Dev
   Branch ਗࠂ റ ҕਬܻ٘ѷणפ׮…………..!
   Pushо పझ౟ജ҃ী ՙ஖ח ৔ೱ
   

   View Slide

5. ழݠझ ࠳ے஖ ҳઑ
   ೐۽ં౟A ࣻ೯઺
   …
   ೐۽ં౟B ࣻ೯઺
   …
   …
   ೐۽ં౟C ࣻ೯઺
   …
   ೐۽ં౟A ѐߊޛ
   ೐۽ં౟B ѐߊޛ
   ೐۽ં౟C ѐߊޛ
   …
   QA పझ౟ ജ҃
   Feature Branch Develop Branch
   Local Branch
   

   View Slide

6. TRY?
   “ୡӝಿ૕ ഛࠁܳ ਤೠ ডࣘਸ ੿೧ࠄ׮ݶ?”
   

   View Slide

7. ୡӝ ಿ૕ೱ࢚ਸ ਤೠ ডࣘ
   OPEN IN PROGRESS RESOLVED IN DEV IN SANDBOX IN BETA CLOSED
   

   View Slide

8. ୡӝ ಿ૕ೱ࢚ਸ ਤೠ ডࣘ
   ডࣘ 1. ѐߊ੗ ా೤ పझ౟ ૓೯৮ܐ ࢚క
   OPEN IN PROGRESS RESOLVED IN DEV IN SANDBOX IN BETA CLOSED
   IN SANDBOX IN BETA
   

   View Slide

9. ୡӝ ಿ૕ೱ࢚ਸ ਤೠ ডࣘ
   ডࣘ 2. ӝദ੗ ӝמ పझ౟ ૓೯৮ܐ ࢚క
   ডࣘ 1. ѐߊ੗ ా೤ పझ౟ ૓೯৮ܐ ࢚క
   OPEN IN PROGRESS RESOLVED IN DEV IN SANDBOX IN BETA CLOSED
   IN SANDBOX IN BETA
   

   View Slide

10. ୡӝ ಿ૕ೱ࢚ਸ ਤೠ ডࣘ
    ডࣘ 2. ӝദ੗ ӝמ పझ౟ ૓೯৮ܐ ࢚క
    ডࣘ 1. ѐߊ੗ ా೤ పझ౟ ૓೯৮ܐ ࢚క
    ডࣘ 1&2 ղਊ Ѩష റ QA ૓ੑ
    OPEN IN PROGRESS RESOLVED IN DEV IN SANDBOX IN BETA CLOSED
    IN SANDBOX IN BETA
    

    View Slide

11. BUT!
    “ইஜ݃׮ ׳ۄ૑ח ࢲ࠺झಿ૕!”
    

    View Slide

12. QA
    TE
    DEV
    

    View Slide

13. Ѣ஘ ࢤп੄ QA৬ ࠛউೠ ׀ࡄ੄ TE

    Let’s Away From Keyboard
    !
    
    ழݠझ QAOps بੑ

    10࠙ ݅ী ഛੋೞח ࢶޛೞӝ ࢲ࠺झ ಿ૕
    NEXT
    

    View Slide

14. ఃࠁ٘ܳ যڌѱ ځաࠅө!?
    ӝઓ ೠ҅੼ ೧Ѿ ߑউ
    ࠽٘ Ѩૐ పझ౟ ࠗ੤
    BVT ࣻ೯ بੑ
    పझ౟ ੗زച
    ૑ࣘ੸ ࢲ࠺झ ઁҕ ࠗ੤ పझ౟ ਍৔ ജ҃
    >
    >
    *Build Veri
    fi
    cation Test
    

    View Slide

15. AFK, Away From Keyboard ~~~
    

    View Slide

16. Ѣ஘ ࢤп੄ QA৬ ࠛউೠ ׀ࡄ੄ TE

    Let’s Away From Keyboard
    !
    
    ழݠझ QAOps بੑ

    10࠙ ݅ী ഛੋೞח ࢶޛೞӝ ࢲ࠺झ ಿ૕
    NEXT
    

    View Slide

17. ݻदী য٣ীࢲ যڌѱ ࣻ೯ غաਃ?
    ੗زചػ పझ౟ா੉झ?
    

    View Slide

18. QAOps ۆ?
    QA OPS
    Quality Assurance OPerationS
    +
    

    View Slide

19. QAOpsীࢲ QAо ೡ ࣻ ੓ח Ҋ޹ٜ?
    ੗زച
    TC Ѿҗҕਬ
    ߧਤ? ਬ૑ࠁࣻ? ೐ۨ੐ਕ௼? ஠స? JIRA?
    

    View Slide

20. QAOps ࣻ೯൒ܴ
    ҅ദ ੗زച Ѿҗ ߓನ
    QA ߈ࠂ੸ పझ౟ ߧਤ పझ౟ா੉झ ѐߊ JIRA ੉ग ١੤ ߓನ
    OPS పझ౟ ࣻ೯ ઱ӝ ੗ز పझ౟ ࣻ೯ ਬҙࠗࢲ ҕਬ ߓನ
    > > >
    

    View Slide

21. ݻदী য٣ীࢲ যڌѱ ࣻ೯ غաਃ?
    ੗زചػ పझ౟ா੉झ?
    ∴ QA : ఃਕ٘ ӝ߈ పझ౟੗زച بੑ
    ∴ OPS : ૑ࣘ੸ੋ ࢲ࠺झ ઁҕ ജ҃ ਍৔
    

    View Slide

22. ఃਕ٘ ӝ߈ పझ౟੗زച بੑ
    

    View Slide

23. যځೠ ੗زച ೐ۨ੐ਕ௼ܳ ࢶ੿ೡ Ѫੋо?
    Ҋ۰ࢎ೦ ࢶ੿ ೐ۨ੐ਕ௼
    ਢ/ݽ߄ੌ పझ౟ ѐߊ Selenium/Appium ۄ੉࠳۞ܻ ૑ਗ
    ѐߊ ঱যী ؀ೠ ੽Ӕࢿ ఃਕ٘ ӝ߈ పझ౟ ா੉झ ੘ࢿ/ҙܻ
    ۄ੉࠳۞ܻ ഛ੢ ղ੢/৻੢ ۄ੉࠳۞ܻ ࣻ੿ ߂ ୶о оמ
    పझ౟߬٘ ਗѺࣻ೯ ਗѺ పझ౟ ۄ੉࠳۞ܻ ૑ਗ
    CI/CD োز ઃఅझ ೒۞Ӓੋ ઁҕ
    >
    >
    >
    >
    >
    

    View Slide

24. যځೠ ੗زച ೐ۨ੐ਕ௼ܳ ࢶ੿ೡ Ѫੋо?
    Ҋ۰ࢎ೦ ࢶ੿ ೐ۨ੐ਕ௼
    ਢ/ݽ߄ੌ పझ౟ ѐߊ Selenium/Appium ۄ੉࠳۞ܻ ૑ਗ
    ѐߊ ঱যী ؀ೠ ੽Ӕࢿ ఃਕ٘ ӝ߈ పझ౟ ா੉झ ੘ࢿ/ҙܻ
    ۄ੉࠳۞ܻ ഛ੢ ղ੢/৻੢ ۄ੉࠳۞ܻ ࣻ੿ ߂ ୶о оמ
    పझ౟߬٘ ਗѺࣻ೯ ਗѺ పझ౟ ۄ੉࠳۞ܻ ૑ਗ
    CI/CD োز ઃఅझ ೒۞Ӓੋ ઁҕ
    >
    >
    >
    >
    >
    

    View Slide

25. যځೠ ੗زച ೐ۨ੐ਕ௼ܳ ࢶ੿ೡ Ѫੋо?
    Ҋ۰ࢎ೦ Robot Framework
    ਢ/ݽ߄ੌ పझ౟ ѐߊ Selenium/Appium ۄ੉࠳۞ܻ ૑ਗ
    ѐߊ ঱যী ؀ೠ ੽Ӕࢿ ఃਕ٘ ӝ߈ పझ౟ ா੉झ ੘ࢿ/ҙܻ
    ۄ੉࠳۞ܻ ഛ੢ ղ੢/৻੢ ۄ੉࠳۞ܻ ࣻ੿ ߂ ୶о оמ
    పझ౟߬٘ ਗѺࣻ೯ ਗѺ పझ౟ ۄ੉࠳۞ܻ ૑ਗ
    CI/CD োز ઃఅझ ೒۞Ӓੋ ઁҕ
    >
    >
    >
    >
    >
    

    View Slide

26. ఃਕ٘ ӝ߈ పझ౟ ੗زച ѐߊ ҳઑ
    ӝ߈঱য ۄ੉࠳۞ܻ ೐ۨ੐ਕ௼ ఃਕ٘ పझ౟
    Python ղ੢ ۄ੉࠳۞ܻ Robot Framework ҕా ఃਕ٘ Test Suite
    ৻੢ ۄ੉࠳۞ܻ ਬ੷ ఃਕ٘ Test Case
    >
    > > >
    

    View Slide

27. ఃਕ٘ ӝ߈ పझ౟ ੗زച ѐߊ ҳઑ
    ӝ߈঱য ۄ੉࠳۞ܻ ೐ۨ੐ਕ௼ ఃਕ٘ పझ౟
    Python ղ੢ ۄ੉࠳۞ܻ Robot Framework ҕా ఃਕ٘ Test Suite
    ৻੢ ۄ੉࠳۞ܻ ਬ੷ ఃਕ٘ Test Case
    >
    > > >
    

    View Slide

28. ҕా ఃਕ٘ۆ?
    *** Keywords ***
    
    
    ࢶޛೞӝ ۽Ӓੋ
    
    
    [Arguments] ${id} ${pw}
    
    
    Wait Until Element Is Visible xpath=${۽Ӓੋಕ੉૑૓ੑ_҃۽} 10s
    
    
    Click Element xpath=${۽Ӓੋಕ੉૑૓ੑ_҃۽}
    
    
    Wait Until Element Is Visible xpath=${۽Ӓੋই੉٣ੑ۱_҃۽} 10s
    
    
    Input Text ${۽Ӓੋই੉٣ੑ۱} ${id}
    
    
    Wait Until Element Is Visible xpath=${۽Ӓੋಁझਕ٘_ੑ۱} 10s
    
    
    Input Text ${۽Ӓੋಁझਕ٘_ੑ۱} ${pw}
    
    
    Wait Until Element Is Visible xpath=${۽Ӓੋࣻ೯ߡౡ_҃۽} 10s
    
    
    Click Element xpath=${۽Ӓੋࣻ೯ߡౡ_҃۽}
    ߧਊ੸ਵ۽ औѱ ੗زചܳ ҳഅೞӝ ਤೠ ೣࣻ
    ࢲ࠺झ ױਤ۽ ҕਊ ఃਕ٘ ਍৔
    ߸҃ࢎ೦ী ؀ೠ ૑ࣘ੸ੋ ਬ૑ࠁࣻ ߂ ߓನ
    ex. “աীѱ ࢶޛೞӝ”, “ࢶ଱ࣽ ѱ੐”, “ࣳೝನੋ౟۽ Ѿઁೞӝ” ١
    

    View Slide

29. ਬ੷ ఃਕ٘ۆ?
    *** Keywords ***
    
    
    ࢶ଱ࣽ ѱ੐ ಕ੉૑ ૓ੑ पಁ द
    
    
    Wait Until Element Is Visible xpath={GNBײӝߡౡ_҃۽} 10s
    
    
    Click Element xpath={GNBײӝߡౡ_҃۽}
    
    
    ࢶ଱ࣽ ѱ੐
    
    
    
    
    ࢶޛѱ੐ ૓ੑ पಁ द ࢶ଱ࣽ ѱ੐ ੤૓೯
    
    
    Wait Until Keyword Succeeds 2 min 5 sec ࢶ଱ࣽ ѱ੐ ಕ੉૑ ૓ੑ पಁ द
    ߧਊ ఃਕ٘ ৻ী ੗زച ҳഅ ઺ ೙ਃೠ ೣࣻ
    
    
    ѐੋ ױਤ۽ ѐ߹ ਍৔
    
    
    ߸҃ࢎ೦ী ؀ೠ ૑ࣘ੸ੋ ਬ૑ࠁࣻ O ߂ ߓನ
    X
    
    ex. ҕਊ ఃਕ٘ੋ “ࢶ଱ࣽ ѱ੐” ਸ ഝਊೞৈ ѐ߹ పझ౟ী ೙ਃೠ ఃਕ٘ ࢤࢿ
    

    View Slide

30. ఃਕ٘ ӝ߈ਵ۽ పझ౟ ੗زചܳ ҳࢿೞݶ যڃ ݽणੌө?
    ੌ߈ Ӓܛ଻౴ߑীࢲ ࢶ଱ࣽ ࢶޛѱ੐ ૓೯
    
    
    ଻౴ߑ ૓ੑ ੗زച_ੌ߈Ӓܛ
    
    
    ${status} Run Keyword And Return Status ࢶ଱ࣽ ѱ੐
    
    
    Run Keyword If "${status}" == "False" ࢶޛѱ੐ ૓ੑ पಁ द ࢶ଱ࣽ ѱ੐ ੤૓೯
    
    
    Ѿઁ ৮ܐ ಕ੉૑ ೻؊ ഛੋ
    
    
    GNB ೻؊ ײӝ ߡౡ ௿ܼ
    
    
    ଻౴ߑ ૓ੑ ഛੋ
    
    
    ࢶ଱ࣽ ࢶޛѱ੐ ૓೯ ঌܿస ࣻन ഛੋ
    
    
    ࢶޛѱ੐ ׼୎੗ ഛੋ ಕ੉૑ ૓ੑ
    
    
    ఃਕ٘ ೠ ઴ == పझ౟ झయ ೠ ѐ
    ఃਕ٘ݺਸ ੗োয۽ ੘ࢿ
    ∴ ӝദ/ѐߊ/QA ݽف ੉೧ೡ ࣻ ੓ח ૒ҙ੸ੋ పझ౟ ௏٘ ఍ࢤ
    !
    
    

    View Slide

31. ఃਕ٘ ӝ߈ਵ۽ పझ౟ ੗زചܳ ҳࢿೞݶ যڃ ݽणੌө?
    ੌ߈ Ӓܛ଻౴ߑীࢲ ࢶ଱ࣽ ࢶޛѱ੐ ૓೯
    
    
    ଻౴ߑ ૓ੑ ੗زച_ੌ߈Ӓܛ
    
    
    ${status} Run Keyword And Return Status ࢶ଱ࣽ ѱ੐
    
    
    Run Keyword If "${status}" == "False" ࢶޛѱ੐ ૓ੑ पಁ द ࢶ଱ࣽ ѱ੐ ੤૓೯
    
    
    Ѿઁ ৮ܐ ಕ੉૑ ೻؊ ഛੋ
    
    
    GNB ೻؊ ײӝ ߡౡ ௿ܼ
    
    
    ଻౴ߑ ૓ੑ ഛੋ
    
    
    ࢶ଱ࣽ ࢶޛѱ੐ ૓೯ ঌܿస ࣻन ഛੋ
    
    
    ࢶޛѱ੐ ׼୎੗ ഛੋ ಕ੉૑ ૓ੑ
    
    
    ఃਕ٘ ೠ ઴ == పझ౟ झయ ೠ ѐ
    ఃਕ٘ݺਸ ੗োয۽ ੘ࢿ
    ∴ ӝദ/ѐߊ/QA ݽف ੉೧ೡ ࣻ ੓ח ૒ҙ੸ੋ పझ౟ ௏٘ ఍ࢤ
    !
    
    

    View Slide

32. ૑ࣘ੸ੋ ࢲ࠺झ ઁҕ ജ҃ ਍৔
    

    View Slide

33. ૑ࣘ੸ੋ ࢲ࠺झ ઁҕ ജ҃ ਍৔ਸ ਤೠ ডࣘ
    Ҋ۰؀࢚ ডࣘ
    ੿ӝ పझ౟ పझ౟ ജ҃ ߹ BVT పझ౟
    ࢚द పझ౟ ೙ਃ द ૒੽ ࣻ೯
    

    View Slide

34. CODE CI/CD بҳ FRAMEWORK Library పझ౟ ജ҃
    PC ജ҃ https://git-scm.com/
    downloads/logos
    Mobile ജ҃
    ਍৔ ജ҃ਸ যڌѱ ҳࢿೡ Ѫੋо?
    GIT ROBOT Selenium
    Appium
    Jenkins
    DeviceFarm
    VM/PM Test Bed
    GIT ROBOT
    Jenkins
    GIT : https://git-scm.com/downloads/logos
    Jenkins : https://get.jenkins.io/art/
    ROBOT : https://github.com/robotframework/visual-identity#logo
    Selenium : https://github.com/SeleniumHQ/selenium
    Appium : https://github.com/appium/appium.io/tree/gh-pages/img 

    

    View Slide

35. CODE CI/CD بҳ FRAMEWORK Library పझ౟ ജ҃
    PC ജ҃
    Mobile ജ҃
    ਍৔ ജ҃ਸ যڌѱ ҳࢿೡ Ѫੋо?
    GIT ROBOT Selenium
    Appium
    Jenkins
    DeviceFarm
    VM/PM Test Bed
    GIT ROBOT
    Jenkins
    

    View Slide

36. ழݠझ QAOps ਍৔
    ѐߊ Jenkins
    QA Jenkins
    develop/beta ডࣘ 2. ݒੌ য়੹ 8द
    ѐߊ, ӝദ, QA
    BT BVT(PC)
    QA Jenkins
    develop/sandbox ডࣘ 1. ݒੌ য়੹ 7द
    ѐߊ, ӝദ, QA
    SB BVT(PC)
    QA Jenkins
    develop/real ডࣘ 3. ݒੌ য়੹ 9द
    ѐߊ, ӝദ, QA
    RL BVT(PC)
    QA Jenkins
    ೙ਃद ࢚द. ૒੽ ࣻ೯
    ࣻ೯੗
    SB/BT/RL BVT(PC/MO)
    Ѿҗ ࠁҊࢲ
    Ѿҗ ࠁҊࢲ
    Ѿҗ ࠁҊࢲ
    Ѿҗ ࠁҊࢲ
    

    View Slide

37. ழݠझ QAOps ਍৔
    ѐߊ Jenkins
    QA Jenkins
    develop/beta ডࣘ 2. ݒੌ য়੹ 8द
    ѐߊ, ӝദ, QA
    BT BVT(PC)
    QA Jenkins
    develop/sandbox ডࣘ 1. ݒੌ য়੹ 7द
    ѐߊ, ӝദ, QA
    SB BVT(PC)
    QA Jenkins
    develop/real ডࣘ 3. ݒੌ য়੹ 9द
    ѐߊ, ӝദ, QA
    RL BVT(PC)
    QA Jenkins
    ೙ਃद ࢚द. ૒੽ ࣻ೯
    ࣻ೯੗
    SB/BT/RL BVT(PC/MO)
    Ѿҗ ࠁҊࢲ
    Ѿҗ ࠁҊࢲ
    Ѿҗ ࠁҊࢲ
    Ѿҗ ࠁҊࢲ
    

    View Slide

38. ழݠझ QAOps ਍৔
    ѐߊ Jenkins
    QA Jenkins
    develop/beta Ѿҗ ࠁҊࢲ
    BT BVT(PC)
    QA Jenkins
    develop/sandbox Ѿҗ ࠁҊࢲ
    ডࣘ 1. ݒੌ য়੹ 7द
    ѐߊ, ӝദ, QA
    SB BVT(PC)
    QA Jenkins
    develop/real Ѿҗ ࠁҊࢲ
    ডࣘ 3. ݒੌ য়੹ 9द
    ѐߊ, ӝദ, QA
    RL BVT(PC)
    QA Jenkins
    ೙ਃद Ѿҗ ࠁҊࢲ
    ࢚द. ૒੽ ࣻ೯
    ࣻ೯੗
    SB/BT/RL BVT(PC/MO)
    ডࣘ 2. ݒੌ য়੹ 8द
    BT BVT(PC) ѐߊ, ӝദ, QA
    

    View Slide

39. Ѣ஘ ࢤп੄ QA৬ ࠛউೠ ׀ࡄ੄ TE

    Let’s Away From Keyboard
    !
    
    ழݠझ QAOps بੑ

    10࠙ ݅ী ഛੋೞח ࢶޛೞӝ ࢲ࠺झ ಿ૕
    NEXT
    

    View Slide

40. যڃ Ѫਸ ੗زച ೡ Ѫੋо?
    ૑ࣘ
    ߈ࠂ ੗ਗ
    

    View Slide

41. যڃ Ѫਸ ੗زച ೡ Ѫੋо?
    ߈ࠂ੸ ӝמపझ౟ܳ
    
    
    ૑ࣘ੸ੋ ಿ૕۽ ਬ૑ೞৈ
    
    
    সޖ ੗ਗਸ ബਯ੸ਵ۽
    
    
    ਍৔ೡ ࣻ ੓ח పझ౟ா੉झ
    

    View Slide

42. BVT 1. ࢶޛೞӝ ӝࠄ ӝמపझ౟
    

    View Slide

43. ߈ࠂ੸ ӝמపझ౟
    Will continue…
    2023… 2024… 2025…
    

    View Slide

44. ૑ࣘ੸ੋ ಿ૕ ਬ૑
    Ѿઁ
    ࢚ಿਬഋ ࢶޛ؀࢚
    ߓ࢚࣠ಿ? Үജӂ? ࢿҕ? पಁ? ஘ҳ? ա?
    

    View Slide

45. সޖ ੗ਗ੄ ബਯ੸ ਍৔
    NO పझ౟ா੉झ ࣻ೯ दр
    1 ࢚ಿਬഋ : ߓ࢚࣠ಿ ޖ২࣌ | Ѿઁࣻױ : ޖా੢ ੑӘ അӘ৔ࣻૐ O | ࢶޛਬഋ : ੗ӝҳݒ 25sec
    2 ࢚ಿਬഋ : ߓ࢚࣠ಿ ઑ೤+੘ࢿ | Ѿઁࣻױ : ޖా੢ ੑӘ അӘ৔ࣻૐ X | ࢶޛਬഋ : ஘ҳ 2ݺ ࢶޛೞӝ 32sec
    3 ࢚ಿਬഋ : Үജӂ | Ѿઁࣻױ : ࣳೝನੋ౟ | ࢶޛਬഋ : ੗ӝҳݒ 24sec
    4 ࢚ಿਬഋ : ߓ࢚࣠ಿ ઑ೤+੘ࢿ | Ѿઁࣻױ : ࣳೝನੋ౟ | ࢶޛਬഋ : ஘ҳ 1ݺ ࢶޛೞӝ 27sec
    5 ࢚ಿਬഋ : ߓ࢚࣠ಿ ة݀+੘ࢿ | Ѿઁࣻױ : ࣳೝನੋ౟ | ࢶޛਬഋ : ஘ҳ 2ݺ ࢶޛೞӝ 30sec
    6 ࢚ಿਬഋ : Үജӂ & ߓ࢚࣠ಿ ઑ೤ | Ѿઁࣻױ : ࣳೝನੋ౟ | ࢶޛਬഋ : ੢߄ҳפ ੗ӝҳݒ 41sec
    7 ࢚ಿਬഋ : Үജӂ | Ѿઁࣻױ : ࣳೝನੋ౟ | ࢶޛਬഋ : ௏٘ࢶޛ ੗ӝ١۾ 28sec
    

    View Slide

46. সޖ ੗ਗ੄ ബਯ੸ ਍৔
    NO పझ౟ா੉झ ࣻ೯ दр
    1 ࢚ಿਬഋ : ߓ࢚࣠ಿ ޖ২࣌ | Ѿઁࣻױ : ޖా੢ ੑӘ അӘ৔ࣻૐ O | ࢶޛਬഋ : ੗ӝҳݒ 25sec
    2 ࢚ಿਬഋ : ߓ࢚࣠ಿ ઑ೤+੘ࢿ | Ѿઁࣻױ : ޖా੢ ੑӘ അӘ৔ࣻૐ X | ࢶޛਬഋ : ஘ҳ 2ݺ ࢶޛೞӝ 32sec
    3 ࢚ಿਬഋ : Үജӂ | Ѿઁࣻױ : ࣳೝನੋ౟ | ࢶޛਬഋ : ੗ӝҳݒ 24sec
    4 ࢚ಿਬഋ : ߓ࢚࣠ಿ ઑ೤+੘ࢿ | Ѿઁࣻױ : ࣳೝನੋ౟ | ࢶޛਬഋ : ஘ҳ 1ݺ ࢶޛೞӝ 27sec
    5 ࢚ಿਬഋ : ߓ࢚࣠ಿ ة݀+੘ࢿ | Ѿઁࣻױ : ࣳೝನੋ౟ | ࢶޛਬഋ : ஘ҳ 2ݺ ࢶޛೞӝ 30sec
    6 ࢚ಿਬഋ : Үജӂ & ߓ࢚࣠ಿ ઑ೤ | Ѿઁࣻױ : ࣳೝನੋ౟ | ࢶޛਬഋ : ੢߄ҳפ ੗ӝҳݒ 41sec
    7 ࢚ಿਬഋ : Үജӂ | Ѿઁࣻױ : ࣳೝನੋ౟ | ࢶޛਬഋ : ௏٘ࢶޛ ੗ӝ١۾ 28sec
    

    View Slide

47. View Slide

48. 20ߓ ബਯਸ ݍࠁ׮!
    ੗زച ਍৔ ੹ ੗زച ਍৔ റ
    ࣻ೯दр ড 60min ড 3min
    

    View Slide

49. BVT 2. ࢶޛೞӝ ҕా ೻؊
    

    View Slide

50. ҕా ೻؊
    

    View Slide

51. ߈ࠂ੸ ӝמపझ౟
    ড 58ѐ੄ ੌх
    2022.01 ~ 2022.09
    

    View Slide

52. ૑ࣘ੸ੋ ಿ૕ ਬ૑
    ࢶޛೣ
    ക
    ࢶޛݫࣁ૑ ࢶޛѱ੐
    

    View Slide

53. সޖ ੗ਗ੄ ബਯ੸ ਍৔
    పझ౟ ग౟ పझ౟ா੉झ ࣻ೯ दр
    ക స 4చਵ۽ ࢶޛೞӝ ૓ੑ റ ೻؊ ഛੋ 4sec
    ക ࢶޛ࢚੗ ௿ܼ റ ೻؊ ഛੋ 24sec
    ക ࢶޛೞӝ ۽Ҋ ௿ܼ റ ೻؊ ഛੋ 22sec
    ക Ѩ࢝ ߡౡ ௿ܼ റ ೻؊ ഛੋ 29sec
    ക ۘఊచ ߡౡ ௿ܼ ߂ ೻؊ ഛੋ 30sec
    ക ࠳ے٘ ߡౡ ௿ܼ ߂ ೻؊ ഛੋ 39sec
    ക ࢶޛೣ ߡౡ ௿ܼ ߂ ೻؊ ഛੋ 34sec
    ക negative test : ٍ۽оӝ ߡౡ 2ѐ ࢤࢿ - Ѩ࢝ ߡౡ ௿ܼറ ࢶޛೣచ ߡౡ ௿ܼ റ ೻؊ ഛੋ 48sec
    ࢶޛೣ ࢶޛೞӝ ૓ੑ > ࢶޛೣ చ 6sec
    ࢶޛೣ ࢶޛೣ > ߉਷ࢶޛೣ 21sec
    ࢶޛೣ ࢶޛೣ > ߉਷ࢶޛೣ > ߉਷ࢶޛೣ࢚ࣁ 8sec
    

    View Slide

54. పझ౟ ग౟ పझ౟ா੉झ ࣻ೯ दр
    ࢶޛೣ ࢶޛೣ > ਤदܻझ౟ ಕ੉૑ 19sec
    ࢶޛೣ ࢶޛೣ > ઱ޙղ৉ 24sec
    ࢶޛೣ ࢶޛೣ > ࢶޛ റӝ 9sec
    ࢶޛೣ ࢶޛೣ > ࢶޛ௏٘ࢶޛ ١۾ 16sec
    ࢶޛݫࣁ૑ ઱ޙ৮ܐ ಕ੉૑ ೻؊ ഛੋ 68sec
    ࢶޛݫࣁ૑ ઱ޙղ৉ ૓ੑ ೻؊ ഛੋ 17sec
    ࢶޛݫࣁ૑ ݫࣁ૑஠٘ ૓ੑ ೻؊ ഛੋ 17sec
    ࢶޛݫࣁ૑ ߓ࣠૑ ੑ۱ೞӝ ૓ੑ ೻؊ ഛੋ 34sec
    ࢶޛѱ੐ য়೑Ӓܛ > ےؒѱ੐ 51sec
    ࢶޛѱ੐ ੌ߈Ӓܛ > ࢶ଱ࣽѱ੐ 50sec
    

    View Slide

55. పझ౟ ग౟ పझ౟ா੉झ ࣻ೯ दр
    ࢶޛೣ ࢶޛೣ > ਤदܻझ౟ ಕ੉૑ 19sec
    ࢶޛೣ ࢶޛೣ > ઱ޙղ৉ 24sec
    ࢶޛೣ ࢶޛೣ > ࢶޛ റӝ 9sec
    ࢶޛೣ ࢶޛೣ > ࢶޛ௏٘ࢶޛ ١۾ 16sec
    ࢶޛݫࣁ૑ ઱ޙ৮ܐ ಕ੉૑ ೻؊ ഛੋ 68sec
    ࢶޛݫࣁ૑ ઱ޙղ৉ ૓ੑ ೻؊ ഛੋ 17sec
    ࢶޛݫࣁ૑ ݫࣁ૑஠٘ ૓ੑ ೻؊ ഛੋ 17sec
    ࢶޛݫࣁ૑ ߓ࣠૑ ੑ۱ೞӝ ૓ੑ ೻؊ ഛੋ 34sec
    ࢶޛѱ੐ য়೑Ӓܛ > ےؒѱ੐ 51sec
    ࢶޛѱ੐ ੌ߈Ӓܛ > ࢶ଱ࣽѱ੐ 50sec
    

    View Slide

56. పझ౟ ग౟ పझ౟ா੉झ ࣻ೯ दр
    ࢶޛೣ ࢶޛೣ > ਤदܻझ౟ ಕ੉૑ 19sec
    ࢶޛೣ ࢶޛೣ > ઱ޙղ৉ 24sec
    ࢶޛೣ ࢶޛೣ > ࢶޛ റӝ 9sec
    ࢶޛೣ ࢶޛೣ > ࢶޛ௏٘ࢶޛ ١۾ 16sec
    ࢶޛݫࣁ૑ ઱ޙ৮ܐ ಕ੉૑ ೻؊ ഛੋ 68sec
    ࢶޛݫࣁ૑ ઱ޙղ৉ ૓ੑ ೻؊ ഛੋ 17sec
    ࢶޛݫࣁ૑ ݫࣁ૑஠٘ ૓ੑ ೻؊ ഛੋ 17sec
    ࢶޛݫࣁ૑ ߓ࣠૑ ੑ۱ೞӝ ૓ੑ ೻؊ ഛੋ 34sec
    ࢶޛѱ੐ য়೑Ӓܛ > ےؒѱ੐ 51sec
    ࢶޛѱ੐ ੌ߈Ӓܛ > ࢶ଱ࣽѱ੐ 50sec
    

    View Slide

57. ࢶޛѱ੐ ૓ੑ
    

    View Slide

58. ࢶޛѱ੐࠳݁૑&࢚ಿ࢚ࣁ
    

    View Slide

59. ઱ޙࢲ&઱ޙ৮ܐ
    

    View Slide

60. ׼୎੗ ഛੋ
    

    View Slide

61. 15ߓ ബਯਸ ݍࠁ׮!
    ੗زച ਍৔ ੹ ੗زച ਍৔ റ
    ࣻ೯दр ড 120min ড 8m
    

    View Slide

62. 15ߓ
    20ߓ ಣӐ 17ߓ
    ӝࠄӝמ ೻؊ BVT
    ࢎۈ੉ ೞ؍ ੌਸ ௿ܼ ೠ ߣਵ۽🎉🎉🎉
    

    View Slide

63. Ѣ஘ ࢤп੄ QA৬ ࠛউೠ ׀ࡄ੄ TE!?
    

    View Slide

64. TEٜ࠙ ~! ੷൞ QAOps റী ѐࢶػ ੼ ੓ਸөਃ!?
    ӝࠄ ҃۽࢚੄ ߡӒо അ੷൤ ੸ѱ ߊ஀ؾפ׮.
    QA ࣌
    ࢶޛೞӝ TE
    ҅ദػ పझ౟ ٜਸ ઺ױ হ੉ ૓೯ೡ ࣻ ੓যࢲ
    ؊੉࢚ ࠛউೞ૑ ঋणפ׮~🎉🎉🎉
    🎉🎉🎉೯ࠂ೤פ׮🎉🎉🎉
    QA ࣌
    

    View Slide

65. Ѣ஘ ࢤп੄ QA৬ ࠛউೠ ׀ࡄ੄ TE

    Let’s Away From Keyboard
    !
    
    ழݠझ QAOps بੑ

    10࠙ ݅ী ഛੋೞח ࢶޛೞӝ ࢲ࠺झ ಿ૕
    NEXT
    

    View Slide

66. View Slide

67. ؘ੉ఠ࠙ࢳ
    ߊ੗ஂ दաܻয়
    

    View Slide

68. ੗زపझ౟ா੉झ ੗زࢤࢿ
    DB ߊ੗ஂ ۽Ӓ ؘ੉ఠ࠙ࢳ दաܻয় ࢤࢿ ੗ز పझ౟
    > > > >
    

    View Slide

69. E.O.D
    

    View Slide