Core ML vs MPS vs BNNS #fincwwdc

2017.7.24 WWDC2017振り返り勉強会＠FiNC
での発表資料です。

Transcript

1. Core ML vs MPSCNN vs BNNS Shuichi Tsutsumi @shu223
2. !!!Core ML!!!
4. Core MLͷηογϣϯ͸ Ұ൪େ͖͍ձ৔Ͱ΄΅ຬһ
5. ਖ਼ࣜϦϦʔεલʹͯ͠طʹଟ͘ͷਓ͕࿩୊ʹ
6. ͪΐɺͪΐͬͱ଴ͬͯ
7. ଞͷػցֶशπʔϧͰֶशͨ͠ϞσϧΛ iOSΞϓϦʹ͖࣋ͬͯͯʮਪ࿦ʯΛߦ͏
8. ଞͷػցֶशπʔϧͰֶशͨ͠ϞσϧΛ iOSΞϓϦʹ͖࣋ͬͯͯʮਪ࿦ʯΛߦ͏ → ͜Εࣗମ͸ iOS 10 ͔ΒͰ͖ͨ
9. Metal Performance Shaders Accelerate (BNNS) Core ML Vision Your App
10. Metal Performance Shaders Accelerate (BNNS) Core ML Vision Your App iOS 11
11. Metal Performance Shaders Accelerate (BNNS) Core ML Vision Your App iOS 11 iOS 10
12. Metal Performance Shaders Accelerate (BNNS) Your App iOS 10
13. Metal Performance Shaders Accelerate (BNNS) Your App iOS 10
14. Metal Performance Shaders Accelerate (BNNS) Your App iOS 10 ͜ΕͰ΋OK
15. Metal Performance Shaders Accelerate (BNNS) Your App iOS 10 • iOS 10Ͱ΋࢖͑Δ • ౰વMetalͰॲཧ͞ΕΔʢMPSCNNͷ৔߹ʣ • ֶशଆ΋ɺTensorFlowͰ΋KerasͰ΋جຊతʹԿͰ΋OK ͜ΕͰ΋OK
16. ΋͏ਖ਼ࣜϦϦʔε͔Β1೥ۙ͘ܦͭͷʹ ΄ͱΜͲ࿩୊ʹͳͬͯͳ͍
17. ʢ୭͔ͷ੠ʣʮલ͔Β͋Δͬͯͷ͸Θ͔ͬͯ ·͢ΑɻͰ΋MPSCNNͬͯػցֶशϑ ϨʔϜϫʔΫ͔Βॻ͖ग़ͨ͠Ϟσϧͷωο τϫʔΫͷߏ଄·ͰಡΜͰ͘Εͳ͍Ͱ͠ΐʁ Ͱɺࣗ෼Ͱͦ͜Λ࣮૷͢ΔΜͰ͠ΐʁͦΜ ͳͷΊΜͲͯ͘͘͞΍ͬͯΒΕͳ͍Ͱ͢Αʯ
18. ͜Ε͸ͦͷ௨Γ
19. ͨͩɺ • ͜Ε΄Ͳͷ஫໨౓ͷ͕ࠩɺMPSCNNͷ۩ମతͳܽ఺͔Βདྷ͍ͯΔͱ͸ࢥ͑ͳ͍ • ୯ʹʮMPSCNNͰʰͦΕʱ͕Ͱ͖Δʯͱ͍͏͜ͱ͕஌ΒΕ͍ͯͳ͔͚ͬͨͩͰ͸ʁ • ͔֬ʹɺ৘ใݯ͕Appleͷαϯϓϧ͙Β͍͔͠ͳ͔ͬͨ
20. ࣮૷खॱ͕໌ࣔ͞ΕͯΕ͹΋ͬͱ࢖͏ਓ͕ग़ͯ͘Δ ͷͰ͸ͳ͍͔ʁ ʢগͳ͘ͱ΋Core MLʹڵຯ͕͋Δਓ͸ͪ͜Β΋ݕ౼ͯ͠Έͯ΋͍͍͸ͣʣ ࣮૷खॱ͸ʢΘ͔ͬͯΈΕ͹ʣҙ֎ͱγϯϓϧ
21. MPSCNNΛ༻͍ͨػցֶशػೳͷ ࣮૷खॱ ̏εςοϓ
22. Step 1: ϞσϧΛͭ͘Δ
23. ֶशπʔϧɿͳΜͰ΋͍͍ Train ʢ˞$//ͷֶश͕Ͱ͖ͯύϥϝʔλΛॻ͖ग़ͤΔ΋ͷͰ͋Ε͹ʣ
24. ֶशπʔϧɿͳΜͰ΋͍͍ ϞσϧͷϑΥʔϚοτɿͳΜͰ΋͍͍ Train Model (Trained Params) dat or hdf5 • χϡʔϥϧωοτϫʔΫͷʮॏΈʯ ͱʮόΠΞεʯͱ͍͏ύϥϝʔλ͕ ೖ͍ͬͯΔ • dat͸ͨͩͷόΠφϦϑΝΠϧ • iOSΞϓϦͰಡΈࠐΊ͑͢͞Ε͹ͳ ΜͰ΋͍͍ ʢ˞$//ͷֶश͕Ͱ͖ͯύϥϝʔλΛॻ͖ग़ͤΔ΋ͷͰ͋Ε͹ʣ
25. Step 2: ωοτϫʔΫΛ࣮૷͢Δ
27. MPSCNNConvolution MPSCNNFullyConnected MPSCNNPooling MPSCNNConvolution MPSCNNConvolution MPSCNNPooling
28. MPSCNNConvolution MPSCNNFullyConnected MPSCNNPooling MPSCNNConvolution MPSCNNConvolution MPSCNNPooling CNNͷ֤૚ʹରԠͨ͠Ϋϥε͕MPSʹ༻ҙ͞Ε͍ͯΔ
29. MPSCNNConvolution MPSCNNFullyConnected MPSCNNPooling MPSCNNConvolution MPSCNNConvolution MPSCNNPooling CNNͷ֤૚ʹରԠͨ͠Ϋϥε͕MPSʹ༻ҙ͞Ε͍ͯΔ • Convolution Layer -> MPSCNNConvolution ͱ໊લ΋ͦͷ··ͳͷͰɺ࣮૷ʹͦΕ ΄Ͳ໎͏͜ͱ͸ͳ͍ • ΍΍͍͜͠ߦྻܭࢉ΍ɺGPUͰͷฒྻԋࢉͷ࠷దԽ౳Λࣗ෼Ͱҙࣝ͢Δඞཁ΋ͳ͍ • Step1Ͱֶͭͬͨ͘शࡁΈύϥϝʔλ͸ϑΝΠϧ͔ΒಡΜͰ͖ͯϙΠϯλΛ౉͢
30. Step 3: ਪ࿦ͷ࣮ߦॲཧΛॻ͘
31. Input image MPSImage Result (UInt, etc.) CNN • Step 2Ͱ࣮૷ͨ͠ωοτϫʔΫ • Step 1Ͱֶͭͬͨ͘शࡁΈϞσϧ ʢύϥϝʔλʣΛಡΈࠐΜͰ͍Δ Do something
32. ؆୯ͦ͏Ͱ͠ΐʁ
33. MPSCNNͰ࣮૷ͨ͠ Swiftϩΰೝࣝ • MPSCNNͳͷͰiOS 10Ͱಈ͘
34. BUT
35. ϩΰೝࣝͷωοτϫʔΫ
36. GoogLeNet (Inception v3: Ұൠ෺ମೝࣝ༻ͷϞσϧ)
37. GoogLeNet (Inception v3: Ұൠ෺ମೝࣝ༻ͷϞσϧ) ஈҧ͍ʹෳࡶ
38. GoogLeNet (Inception v3: Ұൠ෺ମೝࣝ༻ͷϞσϧ)) MPSCNNΛ༻͍ͨAppleʹΑΔެ࣮ࣜ૷
39. GoogLeNet (Inception v3: Ұൠ෺ମೝࣝ༻ͷϞσϧ)) MPSCNNΛ༻͍ͨAppleʹΑΔެ࣮ࣜ૷
40. GoogLeNet (Inception v3: Ұൠ෺ମೝࣝ༻ͷϞσϧ)) MPSCNNΛ༻͍ͨAppleʹΑΔެ࣮ࣜ૷
41. GoogLeNet (Inception v3: Ұൠ෺ମೝࣝ༻ͷϞσϧ)) MPSCNNΛ༻͍ͨAppleʹΑΔެ࣮ࣜ૷
42. GoogLeNet (Inception v3: Ұൠ෺ମೝࣝ༻ͷϞσϧ)) MPSCNNΛ༻͍ͨAppleʹΑΔެ࣮ࣜ૷
43. GoogLeNet (Inception v3: Ұൠ෺ମೝࣝ༻ͷϞσϧ)) MPSCNNΛ༻͍ͨAppleʹΑΔެ࣮ࣜ૷
44. GoogLeNet (Inception v3: Ұൠ෺ମೝࣝ༻ͷϞσϧ)) MPSCNNΛ༻͍ͨAppleʹΑΔެ࣮ࣜ૷
45. GoogLeNet (Inception v3: Ұൠ෺ମೝࣝ༻ͷϞσϧ)) MPSCNNΛ༻͍ͨAppleʹΑΔެ࣮ࣜ૷ 3,000ߦ" ʢωοτϫʔΫ෦෼͚ͩͰʣ
46. ͜ΕҎ֎ʹ΋ • ػցֶशπʔϧଆͰόΠφϦϑΝΠϧΛॻ͖ग़͢Α͏ʹ͢Δͷ΋ଟগΊΜͲ͍͘͞ • ֶशࡁΈύϥϝʔλͷೖͬͨόΠφϦσʔλΛಡΈࠐΜͰϙΠϯλΛ౉͢ͱ͔Cͬ Ά͍࣮૷͕ඞཁ • ೖग़ྗͷࡍʹMPSImageͱ͍͏ΫϥεΛѻ͏ඞཁ͕͋Γɺೖྗը૾Λม׵ͨ͠Γ ਪ࿦݁ՌΛऔΓग़ͨ͠Γ͢ΔࡍʹMetalͷϨΠϠʔͰΞϨίϨ͢Δඞཁ͕͋Δ
47. ͜ΕҎ֎ʹ΋ • ػցֶशπʔϧଆͰόΠφϦϑΝΠϧΛॻ͖ग़͢Α͏ʹ͢Δͷ΋ଟগΊΜͲ͍͘͞ • ֶशࡁΈύϥϝʔλͷೖͬͨόΠφϦσʔλΛಡΈࠐΜͰϙΠϯλΛ౉͢ͱ͔Cͬ Ά͍࣮૷͕ඞཁ • ೖग़ྗͷࡍʹMPSImageͱ͍͏ΫϥεΛѻ͏ඞཁ͕͋Γɺೖྗը૾Λม׵ͨ͠Γ ਪ࿦݁ՌΛऔΓग़ͨ͠Γ͢ΔࡍʹMetalͷϨΠϠʔͰΞϨίϨ͢Δඞཁ͕͋Δ → ֓೦͸γϯϓϧ͕ͩ΍ͬͺΓ৭ʑΊΜͲ͍͘͞
48. Core ML͸πʔϧͰม׵ͯ͠Xcodeϓϩ δΣΫτʹυϥοάˍυϩοϓ͢Δ͚ͩʂ
49. VisionΛ࢖͑͹CIImageܕͰೖྗͰ ͖ɺ݁ՌͷऔΓग़͠΋؆୯ → MetalϨΠϠʹҰ੾λον͢Δඞཁͳ͠
50. ͦ͏͍͏Θ͚Ͱ
51. Metal Performance Shaders Accelerate (BNNS) Your App iOS 10
52. Metal Performance Shaders Accelerate (BNNS) Core ML Vision Your App iOS 11 iOS 10
53. ΍ͬͺΓ͋Γ͕͍ͨ###
54. ·ͱΊ • Core ML͕͜Μͳʹ׻ܴ͞ΕͯΔͷʹʮࠓ͙͢ϦϦʔε൛Ͱ࢖͑ ΔʯMPSCNN͕͋·Γ࿩୊ʹͳͬͯͳ͍ - ৘ใ͕গͳ͘ɺ࢖͍ํ͕఻Θͬͯͳ͍͚ͩͰ͸ͳ͍͔ • MPSCNNΛར༻࣮ͨ͠૷खॱ3εςοϓ - Ϟσϧ࡞੒ˠωοτϫʔΫ࣮૷ˠਪ࿦࣮ߦ - େہతʹΈΕ͹ҙ֎ͱγϯϓϧʹ࢖͑Δ - ͔͠͠ਖ਼௚ͳͱ͜Ζେมͳ෦෼͸͋Δ • ͦ͜Λܶతʹ؆୯ʹͨ͠ͷ͕Core ML & Vision
55. ͝ਗ਼ௌ͋Γ͕ɾɾɾ
56. Core ML vs MPSCNN vs BNNS
57. ๨Εͯͨɾɾɾ Metal Performance Shaders Accelerate (BNNS) Core ML Vision Your App
58. CNN on CPU?$
59. WWDC17ͷMetalϥϘͰฉ͍ͯΈ·ͨ͠ ʮͲ͏΍ͬͯMPSCNNͱBNNSΛ࢖͍෼ ͚ͨΒ͍͍ͷʁʯ
60. ʮجຊతʹMPSCNN࢖ͬͯΕ͹͍͍Αʯ %
61. ʮ͑ͬɺ͡Ό͋BNNS͍ͭ࢖͏ͷʁʯ
62. “I don’t know.” %
63. • ͦͷޙɺʮ͋ɺͰ΋Apple Watch͸GPUͳ͍͔ΒɺwatchOSͱ͔͸ BNNSͷ࢖͍Ͳ͜Ζ͔΋Ͷʯͱݴͬͯͨ • ಈ͘ɺͱ͸͍ͬͯ΋͕͢͞ʹ⌚Ͱ͸Ϛγϯύϫʔ͕͖͍ͭͷͰ͸ͳ͍͔ ͱʢ˞࣮ػͰࢼͨ͜͠ͱ͸ͳ͍Ͱ͢ʣ • খ͍͞ωοτϫʔΫͰ͸BNNSͷํ͕଎͔ͬͨͱ͍͏هࣄ͸ݟͨ͜ͱ͕ ͋Δʢ+25%ʣ • جຊతʹ͸ BNNSͷ͜ͱ͸๨ΕͯΑͦ͞͏ʢݸਓత݁࿦ʣ
64. ͝ਗ਼ௌ͋Γ͕ͱ͏͍͟͝·ͨ͠ʂ