presentation.pdf

WWDC 2018のWhat's New in Testingのダイジェスト版です。

Transcript

1. What's New in Testing
   

   View Slide

2. What's New in Testing
   2018
   

   View Slide

3. ࣗݾ঺հ
   ۄ৓৴ޛ
   iOS Engineer
   Appium
   

   View Slide

4. Agenda
   1. Code Coverage
   2. Test Selection and Order
   3. Parallel Testing
   

   View Slide

5. Code Coverage
   

   View Slide

6. Code CoverageʢXcode 9.3ʣ
   • ΧόϨοδදࣔ·Ͱͷ࣌ؒ୹ॖ
   • Xcode9ͱൺ΂95%ߴ଎Խ
   • ΧόϨοδϑΝΠϧͷαΠζμ΢ϯ
   • Xcode9ͱൺ΂1/10ҎԼ
   • C++ʹ͓͚ΔϔομϑΝΠϧʹهड़͞Ε࣮ͨ૷ͷΧόϨοδ
   ऩू͕Մೳʹ
   

   View Slide

7. Code CoverageʢXcode 9.3ʣ
   • λʔήοτͷબ୒
   • ΧόϨοδऩूͷର৅Λλʔήοτ୯ҐͰબ୒Մೳ
   • ex) ϥΠϒϥϦͷαϯϓϧίʔυͷΧόϨοδͷ৘ใ͸
   ཉ͘͠ͳ͍
   

   View Slide

8. xccov
   • ΧόϨοδσʔλΛѻ͏CLIπʔϧ
   • Coverage data
   • xccovreport: ֤λʔήοτɺιʔεϑΝΠϧɺ͓Αͼؔ਺
   ͷΧόϨοδͷׂ߹ͳͲؚ͕·ΕΔ
   • xccovarchive: Ϩϙʔτ಺ͷ֤ϑΝΠϧͷੜͷ࣮ߦճ਺͕
   ؚ·ΕΔ
   

   View Slide

9. xccov
   • xccov view hoge.xccovreport
   Name Coverage
   ---------------------------------------------------------------------------------- -------------
   SampleLib.framework 100.00% (3/3)
   /Users/you/SampleLib/Classes/SampleLib.swift 100.00% (3/3)
   static SampleLib.SampleLib.foo() -> Swift.String 100.00% (3/3)
   

   View Slide

10. xccov
    • xccov view hoge.xccovreport --json | jq
    {
    "coveredLines": 3,
    "lineCoverage": 1,
    "targets": [
    {
    "coveredLines": 3,
    "lineCoverage": 1,
    "files": [
    {
    "coveredLines": 3,
    "lineCoverage": 1,
    "path": "/Users/you/SampleLib/Classes/SampleLib.swift",
    "functions": [
    {
    "coveredLines": 3,
    "lineCoverage": 1,
    "lineNumber": 11,
    "executionCount": 1,
    "name": "static SampleLib.SampleLib.foo() -> Swift.String",
    "executableLines": 3
    }
    ],
    "name": "SampleLib.swift",
    "executableLines": 3
    }
    ],
    "name": "SampleLib.framework",
    "executableLines": 3,
    "buildProductPath": "/Users/you/Library/Developer/Xcode/DerivedData/.../SampleLib.framework/SampleLib"
    }
    ],
    "executableLines": 3
    }
    

    View Slide

11. Test Selection and Order
    

    View Slide

12. Test Selection and Order
    • εΩʔϜຖʹλʔήοτͷςετΛࣗಈ௥Ճ͢Δ͔Ͳ͏͔બ
    ΂ΔΑ͏ʹͳͬͨ
    • ςετͷ࣮ߦॱΛϥϯμϜʹग़དྷΔ༷ʹͳͬͨ
    • ࣮ߦॱংʹґଘͨ͠ςετΛݕग़͠΍͘͢ͳΔ
    • ґଘΛແ͘͠setup/teardownΛ࢖ͬͯඞཁͳঢ়ଶ͸࡞Γ
    ·͠ΐ͏
    

    View Slide

13. Parallel Testing
    

    View Slide

14. !
    

    View Slide

15. Parallel Testing
    • ͜Ε·Ͱͷฒྻςετ
    • ෳ਺ͷγϛϡϨʔλͰશͯͷςετΛ࣮ߦ
    • xcodebuild͔ΒͷΈαϙʔτ͍ͯͨ͠
    

    View Slide

16. View Slide

17. Parallel Distributed Testing
    • ಉҰγϛϡϨʔλͰͷςετͷฒྻ࣮ߦ͕Մೳʹͳͬͨ
    • Xcodeͱxcodebuildͷ྆ํͰߦ͑Δ
    • ςετΫϥε୯ҐͰ෼ࢄ͞ΕΔ
    • ςετ͸ࢦఆͨ͠γϛϡϨʔλͷΫϩʔϯ͕ඞཁͳ͚ͩىಈ
    ࣮͠ߦ͞ΕΔ
    

    View Slide

18. View Slide

19. Ҏ্
    

    View Slide

20. ͓·͚
    

    View Slide

21. man xccov
    xccovͷ࢖͍ํΛৄࡉʹ஌Γ͍ͨ৔߹͸man xccovΛݟͨํ͕ྑ
    ͍
    xccov help΍xccov help viewͰදࣔ͞ΕΔ৘ใ͸؆ૉʹॻ͔Ε
    ͍ͯΔ
    

    View Slide

22. xcrunলུ͍ͨ͠
    xcrunൈ͖Ͱxccovୟ͖͍ͨͳΒ
    /Applications/Xcode.app/Contents/Developer/usr/bin/
    ʹύε௨͠·͠ΐ͏
    simctlͳͲͷଞͷ։ൃऀπʔϧΛ࢖͏ͷʹ΋ศརͰ͢ɻ
    

    View Slide

23. xcodebuild option
    ฒྻςετ༻ͷΦϓγϣϯ͕૿͑·ͨ͠
    //ฒྻςετͷϫʔΧʔ਺ͷࢦఆ
    -parallel-testing-worker-count n
    //ฒྻςετͷ࣮ߦΦϓγϣϯ
    -parallel-testing-enabled YES | NO
    

    View Slide

24. ࢀߟURL
    What's New in Testing
    https://developer.apple.com/videos/play/wwdc2018/403/
    xccov: Xcode Code Coverage Report for Humans
    https://medium.com/xcblog/xccov-xcode-code-coverage-
    report-for-humans-466a4865aa18
    

    View Slide