Slide 1
Slide 1 text
What’s new in Testing
WWDC18
#wwdc_rusuban 2018/06/11
@yokoyas000
Slide 2
Slide 2 text
◾ ·ͱΊ
◾ Code Coverage
ɾ xccovίϚϯυͰΧόϨοδϨϙʔτΛ͍͍ײ͡ʹͰ͖Δ
◾ Test Selection And Ordering
ɾ ৽͍͠ςετΛ࣮ߦରʹؚΊΔ/ؚΊͳ͍ ΛબͰ͖Δ
ɾ ςετ͕ϥϯμϜ࣮ߦͰ͖ΔΑ͏ʹͳͬͨɻݎ࿚ੑ61⤴
◾ Parallel Testing
ɾ ฒྻͰςετΛ࣮ߦͰ͖ͯૣ͍
Slide 3
Slide 3 text
Code Coverage
Slide 4
Slide 4 text
◾ Code Coverage
※ Ҏલ͔Β͋Δػೳ
ذॲཧΛςετͰͲΕ͚ͩཏͰ͖ͯΔ͔ݟΕΔػೳ
Slide 5
Slide 5 text
◾ Code Coverage
■ Code coverage Λ༗ޮʹͨ͠ঢ়ଶͰςετ࣮ߦͨ͠ޙ
ɾςετͰ࣮ߦ͞Εͨߦ
ɾςετͰ࣮ߦ͞Εͳ͔ͬͨߦ
Slide 6
Slide 6 text
◾ Code Coverage(Xcode 9.3 ~)
■ ύϑΥʔϚϯεͱਖ਼֬͞ͷվળ
■ ςετλʔήοτΛબΔ
■ xccovίϚϯυͰΧόϨοδใΛݟΕΔ
Slide 7
Slide 7 text
◾ Code Coverage(Xcode 9.3 ~)
■ ύϑΥʔϚϯεͱਖ਼֬͞ͷվળ
■ ςετλʔήοτΛબΔ
■ xccovίϚϯυͰΧόϨοδใΛݟΕΔ
Slide 8
Slide 8 text
◾ xccov
■ xccov
ΧόϨοδϨϙʔτΛͬͯͳΜ͔ΜͰ͖ΔίϚϯυ
■ ΧόϨοδϨϙʔτ
ΧόϨοδΛ༗ޮʹͨ͠ঢ়ଶͰςετΛ࣮ߦ͢Δͱੜ͞ΕΔϑΝΠϧ
ɾ.xccovreport֦ுࢠ
ɾΧόϨοδͷׂ߹͕ॻ͔Ε͍ͯΔ
ɾ.xccovarchive֦ுࢠ
ɾ ΞϓϦέʔγϣϯίʔυͷ֤ϑΝΠϧͷ࣮ߦΧϯτ
Slide 9
Slide 9 text
◾ xccov
■ xccovίϚϯυͰΧόϨοδϨϙʔτΛৄ͘͠ݟΕΔ
$ man xccov
NAME
xccov - view Xcode coverage data in human-readable or
machine-parseable format.
Slide 10
Slide 10 text
◾ xccov
■ xccov ΛͬͯΧόϨοδϨϙʔτΛਓ͕ؒݟΕΔܗͰग़ྗ͢Δ
$ xcrun xccov view XXXX.xccovreport
Name Coverage
------------------------------------------------------------------ ---------------
HelloWorld.app 57.89% (11/19)
/tmp/HelloWorld/HelloWorld/AppDelegate.m 50.00% (3/6)
-[AppDelegate applicationWillTerminate:] 0.00% (0/3)
-[AppDelegate applicationDidFinishLaunching:] 100.00% (3/3)
/tmp/HelloWorld/HelloWorld/ViewController.m 50.00% (5/10)
-[ViewController setRepresentedObject:] 0.00% (0/5)
-[ViewController viewDidLoad] 100.00% (5/5)
/tmp/HelloWorld/HelloWorld/main.m 100.00% (3/3)
main
Slide 11
Slide 11 text
◾ xccov
■ xccov Φϓγϣϯ
xccov view --json XXXX.xccovreport
ɾKTPOܗࣜͰग़ྗ
xccov view --file-list XXXX.xccovarchive/
ɾΧόϨοδσʔλΛ࣋ͭͯ͢ͷϑΝΠϧΛҰཡදࣔ
xccov view --file /tmp/HelloWorld/HelloWorldTests/HelloWorldTests.m
XXXX.xccovarchive/`
ɾ̍ϑΝΠϧͷΧόϨοδ͚ͩग़ྗ
Լͭͷ͍ॴ͕Α͘Θ͔Βͳ͍...
Slide 12
Slide 12 text
Test Selection And
Ordering
Slide 13
Slide 13 text
◾ Test Selection And Ordering
※ Xcode 10 ͔Βͷ৽ػೳ
■ Test Selection
■ Test Ordering
Slide 14
Slide 14 text
◾ Test Selection And Ordering
■ Test Selection
■ Test Ordering
Slide 15
Slide 15 text
◾ Test “Selection”
εΩʔϜผʹ৽͘͠Ճͨ͠ςετΛ࣮ߦ͢Δ/͠ͳ͍ΛબΔ
ɾEdit Scheme -> Test -> Info -> Options -> Automatically includes new tests
■ ׆༻ྫ
ɾUIςετφΠτϦʔϏϧυͰར༻͢ΔεΩʔϜͷΈ Automatically includes new
tests Λ ON ʹ͢Δ
Slide 16
Slide 16 text
◾ Test Selection And Ordering
■ Test Selection
■ Test Ordering
Slide 17
Slide 17 text
◾ Test “Ordering”
XCTestCase ͷαϒΫϥε୯Ґ ͰɺςετΛϥϯμϜ࣮ߦ͢Δ
※ࠓ·ͰΞϧϑΝϕοτॱͩͬͨ
ɾEdit Scheme -> Test -> Info -> Options -> Randomize execution order
■ ར
ɾຖճಉ͡ॱ൪ͩͱʮͨ·ͨ·͏·͍ͬͯ͘Δςετʯͷଘࡏʹؾ͚ͮͳ͍
Slide 18
Slide 18 text
◾ Test “Ordering”
■ ʮͨ·ͨ·͏·͍ͬͯ͘Δςετʯͱʁ
ҎԼͷͭͷςετΫϥε͕͋ͬͨͱ͠·͢ɻ
ɾATestsΫϥε: UserςʔϒϧΛ࡞
ɾBTestsΫϥε: UserςʔϒϧՃ
ɾCTestsΫϥε: Userςʔϒϧͷআ
্هςετɺ A->B->C ͷॱ൪ʹ࣮ߦͨ࣌͠ޭ͠·͢ɻ
͔͠͠ɺ B,C͔Β࢝·Δͱࣦഊ͠·͢ɻ
Slide 19
Slide 19 text
◾ Test “Ordering”
■ ʮͨ·ͨ·͏·͍ͬͯ͘Δςετʯͱʁ
ɾຊ ࣦഊ͖͢ςετ ͕ޭͯ͠͠·͍ͬͯΔɻ
ɾςετؒʹ ґଘ ͕͋ΔͷʹɺͦΕΛݕग़Ͱ͖͍ͯͳ͍ɻ
Slide 20
Slide 20 text
◾ Test “Ordering”
■ ʮͨ·ͨ·͏·͍ͬͯ͘Δςετʯͱʁ
ɾຊ ࣦഊ͖͢ςετ ͕ޭͯ͠͠·͍ͬͯΔɻ
ɾςετؒʹ ґଘ ͕͋ΔͷʹɺͦΕΛݕग़Ͱ͖͍ͯͳ͍ɻ
ϥϯμϜ࣮ߦͰʮͨ·ͨ·͏·͍ͬͯ͘ΔςετʯΛແ͘͢
ݎ࿚ੑ61⤴
Slide 21
Slide 21 text
◾ Test “Ordering”
ɾςετؒͰґଘ͕ແ͍Α͏ʹ͠·͠ΐ͏
ɾࣄલ/ࣄޙॲཧ͕ඞཁͰ͋ΕɺTFUVQ
teardown Λ͍·͠ΐ͏
Slide 22
Slide 22 text
Parallel Testing
Slide 23
Slide 23 text
◾ Parallel Testing
※ࠓ·Ͱͷ1BSBMMFM Testing
γϛϡϨʔλΛෳ ্ཱͪ͛ͯฒྻ࣮ߦ
■ Parallel “Destination” Testing
xcodebuild test
-destination ‘platform=iOS,name=iPhone X’
-destination ‘platform=iOS,name=iPad’
Slide 24
Slide 24 text
◾ Parallel Testing
※ࠓ·Ͱͷ1BSBMMFM Testing
γϛϡϨʔλΛෳ ্ཱͪ͛ͯฒྻ࣮ߦ
■ Parallel “Destination” Testing
xcodebuild test
-destination ‘platform=iOS,name=iPhone X’
-destination ‘platform=iOS,name=iPad’
ɾiPhone X ͱ iPad ͷ γϛϡϨʔλͰฒྻ࣮ߦ
ɾ֤γϛϡϨʔλͰ࣮ߦ͢Δςετέʔεಉ͡
Slide 25
Slide 25 text
◾ Parallel Testing
※৽͍͠1BSBMMFM Testing
̍ͭͷγϛϡϨʔλͷ ΫϩʔϯΛෳ ্ཱͪ͛ͯฒྻ࣮ߦ
ɾiPhone X ͷΫϩʔϯΛෳ্ཱͪ͛ͯฒྻ࣮ߦ
ɾ֤ΫϩʔϯͰ ςετέʔεΛ୲ͯ͠ ࣮ߦ͢Δ
ɾૣ͍
■ Parallel “Distributed” Testing
Slide 26
Slide 26 text
◾ Parallel “Distributed” Testing
■ ֤ΫϩʔϯͰςετέʔεΛ୲࣮ͯ͠ߦ͢Δ
XCTestCase ͷαϒΫϥε୯Ґ Ͱ୲͢Δɻ
TestClass TestClass
TestClass TestClass
TestClass TestClass
Slide 27
Slide 27 text
◾ Parallel “Distributed” Testing
■ ֤ΫϩʔϯͰςετέʔεΛ୲࣮ͯ͠ߦ͢Δ
TestClass TestClass
TestClass TestClass
֤ΫϩʔϯͰࢀর͢ΔϑΝΠϧ͔Ε͍ͯΔͷͰɺ
ʮଞͷΫϩʔϯ͕ઌʹϑΝΠϧ"Λ࿔͚ͬͨ࣌ͩςετ͕མͪΔ…ʯ
ͱ͍͏Α͏ͳ͜ͱແ͍ɻ
Slide 28
Slide 28 text
◾ Parallel “Distributed” Testing
■ Ϋϥε୯ҐͰόϥόϥʹ͢Δཧ༝
ɾςετΫϥεؒͷґଘΛͳ͘͢(ϥϯμϜςετͱಉ͡)
ɾsetup, teardown ͦΕͧΕ̍ճͣͭݺΜͰཉ͍͠
ɾΫϥε୯ҐΑΓখ͘͢͞ΔͱɺTFUVQ
teardownΛෳճݺͿ͜ͱʹ…
Slide 29
Slide 29 text
◾ Parallel “Distributed” Testing
■ xcodebuild ίϚϯυͰɺฒྻςετʹؔ͢ΔΦϓγϣϯΛมߋͰ
͖Δ
-parallel-testing-worker-count n
ɾฒྻςετதʹੜ͞ΕΔςετϥϯφʔͷ
-parallel-testing-enabled YES | NO
ɾεΩʔϜͷλʔήοτ͝ͱͷઃఆΛ্ॻ͖͢Δ
-maximum-concurrent-test-device-destinations n
ɾಉ࣌ʹςετ͢ΔσόΠεѼઌͷ࠷େ
-maximum-concurrent-test-simulator-destinations n
ɾಉ࣌ʹςετ͢ΔγϛϡϨʔλѼઌͷ࠷େ
Slide 30
Slide 30 text
◾ Parallel Testing Tips
■ ̍ͭͷେ͖ͳςετΫϥεͭҎ্ʹׂ͠·͠ΐ͏
ɹɾʮେ͖ͳςετΫϥεʯ͕ऴΘΒͳ͍ݶΓςετऴྃʹͳΒͳ͍
■ ύϑΥʔϚϯεςετฒྻςετͱผʹςετ͠·͠ΐ͏
■ ύϥϨϧʹ ͍͍ͯͳ͍ ςετΛΓ·͠ΐ͏
ɾʮෳͷΫϩʔϯ͕ ڞ௨ͷ%#ʹΞΫηε͢ΔʯͳͲ
Slide 31
Slide 31 text
◾ Testing Tips & Tricks ͔Βͷൈਮ
... Λ͠Α͏ͱࢥ͚ͬͨͲ͕࣌ؒΓͳͦ͏ɻ
Optimazation App Launch When Testing("Testing Tips & Tricks"ͷ 34: 57 ~)
ྑ͛͞ͳΞϓϩʔνͰͨ͠(ײ)
ɾεΩʔϜ͝ͱʹڥมΛࢦఆ͠ɺʮ୯ମςετ࣌ʹෆཁͳॲཧ࣮ߦ͠ͳ͍ʯͳͲ
Λߦ͏͜ͱͰςετΛૣ͘͢Δ
Slide 32
Slide 32 text
What's New in Testing
https://developer.apple.com/videos/play/wwdc2018/403
Testing Tips & Tricks
https://developer.apple.com/videos/play/wwdc2018/417