オンデバイスで学習可能になったCreate MLで画像分類器を作ってみた💪 / Developing an app to train an image classifier on iOS Device using Create ML

[Online] potatotips #75 iOS/Android開発Tips共有会
https://potatotips.connpass.com/event/218185/

サンプルアプリ: https://github.com/rockname/PhotoSelectionClassifier

Transcript

1. ΦϯσόΠεͰֶशՄೳʹͳͬͨ
   Create MLͰը૾෼ྨثΛ࡞ͬͯΈͨ💪
   גࣜձࣾϛΫγΟ ΈͯͶࣄۀ෦
   ϩΫωϜ @_rockname
   

   View Slide

2. mixi, Inc.
   ࣗݾ঺հ
   ϩΫωϜ / rockname
   • ϛΫγΟͰʮՈ଒ΞϧόϜΈͯͶʯͱ͍͏ΞϓϦΛ

   ։ൃͯ͠Δ
   • iOSϝΠϯɺAndroid, RailsͳͲ΋ॻ͍ͯΔ
   • εϚϒϥ͕޷͖
   

   View Slide

3. mixi, Inc.
   Create MLͱ͸
   • Mac OS্ͰػցֶशϞσϧΛ࡞੒͓ΑͼτϨʔχϯά͢Δ͜ͱ͕Ͱ͖ΔFramewor
   k
   
   • ੜ੒ͨ͠Ϟσϧ͸Core MLΛ༻͍ͯΞϓϦͰ࢖༻͢Δ͜ͱ͕Ͱ͖Δ
   

   View Slide

4. mixi, Inc.
   Create MLΛ࢖ͬͯΦϯσόΠεͰϞσϧͷֶश͕Մೳʹʂ
   • WWDC 21ͷηογϣϯʮBuild dynamic iOS apps with the Create ML frameworkʯͰ͸ɺࠓ·ͰMac OS্Ͱ
   ͔͠ಈ͔͢͜ͱ͕Ͱ͖ͳ͔ͬͨCreate ML͕iOSσόΠε্Ͱ΋ར༻ՄೳʹͳΔͱ͍͏Ξφ΢ϯε͕͋Γ·͠
   ͨ (΋ͪΖΜiOS15Ҏ߱ͷ࿩)
   

   View Slide

5. mixi, Inc.
   iOSσόΠε্Ͱը૾෼ྨثΛֶश͢ΔΞϓϦΛ࡞ͬͯΈͨ💪
   https://github.com/rockname/PhotoSelectionClassifier
   • બ୒͞ΕͨࣸਅΛֶशͯࣸ͠ਅͷબ୒/ඇબ୒Λ෼ྨ͢ΔϞσϧΛ࡞੒͠ɺࣸਅͷࣗಈબ
   ୒ػೳΛఏڙ͢ΔΞϧόϜΞϓϦΛ࡞ͬͯΈ·ͨ͠
   

   View Slide

6. mixi, Inc.
   Demo
   • ৯΂෺ͷࣸਅͷத͔ΒϋϯόʔΨʔͷࣸਅͷΈΛબ୒ͯ͠ΞϧόϜʹڞ༗͢Δ͜ͱͰɺϞσϧ͕
   े෼ʹֶश͞ΕͨΒϋϯόʔΨʔͷࣸਅ͕ࣗಈબ୒͞ΕΔɺͱ͍͏σϞΛߦ͍·͢
   

   View Slide

7. Ϟσϧͷֶश͔Β࢖༻·ͰͷྲྀΕ♻
   

   View Slide

8. mixi, Inc.
   1. σʔλ͕े෼ʹ͋Δ͔Ͳ͏͔Λ൑ఆ
   

   View Slide

9. mixi, Inc.
   2. બ୒/ඇબ୒ͷࣸਅ਺Λἧ͑Δ
   

   View Slide

10. mixi, Inc.
    3. ը૾σʔλऔಘˠ୹ล300pxʹϦαΠζˠϑΝΠϧग़ྗ
    

    View Slide

11. mixi, Inc.
    4. ෼ྨثͷֶश
    

    View Slide

12. mixi, Inc.
    5. ੜ੒͞ΕͨϞσϧΛίϯύΠϧͯ͠อଘ
    

    View Slide

13. mixi, Inc.
    6. Ϟσϧͷ࢖༻
    

    View Slide

14. ॾ஫ҙ🙊
    

    View Slide

15. mixi, Inc.
    iPhone XҎ߱ͷχϡʔϥϧΤϯδϯΛ౥ࡌͨ͠ ࣮ػͰ͔͠ϏϧυͰ͖ͳ͍
    • Create ML͕χϡʔϥϧΤϯδϯΛ׆༻͢Δ౎߹্ɺCreateMLΛimportͨ͠ॠؒʹ
    SimulatorΛର৅ʹϏϧυͰ͖ͳ͘ͳΓ·͢
    • iPhone XҎ߱ͷ ࣮ػΛର৅ʹϏϧυ͢Δඞཁ͕͋Γ·͢
    ௥ه(2021/08/13) : χϡʔϥϧΤϯδϯΛ౥ࡌ͍ͯ͠ͳ͍࣮ػͰ΋ϏϧυՄೳͰͨ͠🙇🙇🙇
    

    View Slide

16. mixi, Inc.
    Ϟσϧͷֶश͸όοΫάϥ΢ϯυͰ
    • Ϟσϧͷֶश͸ͦΕͳΓʹ͕͔͔࣌ؒΓɺCPU΋৯͏ͷͰɺΞϓϦ͕όοΫάϥ΢ϯυ
    ঢ়ଶͷ৔߹ʹߦ͑Δͱྑͦ͞͏Ͱ͢
    • ۩ମతʹ͸ Background Tasks Λ࢖ͬͯσόΠε͕Wi
    f
    ԼͰॆిதʹͪ·ͪ·ֶशͰ͖ͯ
    ͍Δͱཧ૝తͰ͢
    

    View Slide

17. Thank you!!!
    

    View Slide