FirebaseMLKit入門.pdf

ML Kitの概要の3つの使用パターンを説明し、Vision、自然言語についてQuickstartを実際に動かしてみた結果を共有します。

Transcript

1. .-
   ,JU
   GPS
   'JSFCBTFೖ໳ %FWFMPQFST*0
   
   0TBLB
   !കాεΧΠϏϧ
   ೥݄೔
   ࢁຊঘل
   !NPT 1 #cmdevio
2. ࢁຊ
   ঘل ΍·΋ͱ
   ͳ͓͖ ೥ʙ
   8FCΞϓϦ։ൃ
   ೥ʙ
   "OESPJEΞϓϦ։ൃ
   ೥ʙ
   ΫϥεϝιουʹδϣΠϯ !NPT ࣗݾ঺հ $9ࣄۀຊ෦
   ϞόΠϧΞϓϦΤϯδχΞ 2
3. ໨త w .-
   ,JU
   GPS
   'JSFCBTFͰͲΜͳ͜ͱ͕ Ͱ͖Δͷ͔ࢼͨ݁͠ՌΛڞ༗ 3
4. ΞδΣϯμ w .-
   ,JU
   GPS
   'JSFCBTFͱ͸
   w .-
   ,JU
   ೖ໳
   w ·ͱΊ 4
5. .-
   ,JU
   GPS
   'JSFCBTFͱ͸ 5
6. w (PPHMF͕ఏڙ͢ΔϞόΠϧ։ൃϓϥοτϑΥʔϜ N#BB4
   w όοΫΤϯυ͸'JSFCBTFʹ೚ͤΞϓϦΤϯδχΞ͚ͩͰ։ൃ 'JSFCBTFʹ͍ͭͯ 'JSFCBTF
   IUUQTpSFCBTFHPPHMFDPN 6
7. .-
   
   .BDIJOF
   -FBSOJOH w "OESPJE
   
   J04ΞϓϦʹػցֶशͷػೳΛ௥ Ճ͢Δ͜ͱ͕Ͱ͖Δ4%,
   ɾ(PPHMF
   *0
   
   .PCJMF
   pSTU
   UP
   "*
   pSTU
   w (PPHMF
   *0
   Ͱൃද
   w (PPHMF
   *0
   Ͱ৽ػೳ௥Ճ
   w ೥݄ݱࡏɺϕʔλ͸औΕ͍ͯͳ͍ʂ .-
   ,JUʹ͍ͭͯ 7
8. .-
   ,JU
   ೖ໳ 8
9. .-
   ,JU
   Λ࢖͏ͭͷύλʔϯ 7JTJPO
   
   
   7JTJPOʢࢹ֮ʣͷֶशࡁΈͷϞσϧΛ࢖༻͢Δ
   ࣗવݴޠ
   
   
   
   ࣗવݴޠͷֶशࡁΈͷϞσϧΛ࢖༻͢Δ
   ΧελϜϞσϧ
   
   
   ಠࣗͷτϨʔχϯάσʔλ͔ΒΧελϜը૾෼ྨϞ σϧΛ࡞੒ͨ͠ΓɺϞόΠϧ༻ͷΧελϜϞσϧΛ࢖ ༻͢Δ 9
10. 7JTJPO w ςΩετೝࣝ
    w όʔίʔυεΩϟϯ
    w إݕग़
    w ը૾ϥϕϧ෇͚
    w ϥϯυϚʔΫೝࣝ
    w ΦϒδΣΫτͷݕग़ͱτϥοΩϯά NEW! 10
11. ΦϯσόΠε
    w ϥςϯจࣈͷΈରԠ
    w ϦΞϧλΠϜॲཧ
    w ·͹Βͳจࣈͷೝࣝ
    Ϋϥ΢υʢ༗ྉʣ
    w ଟݴޠରԠ
    w ߴਫ਼౓ͷςΩετೝࣝ
    ɾ·͹ΒͳจࣈͷೝࣝͱυΩϡϝϯτͷೝࣝ ςΩετೝࣝ 7JTJPO 11
12. ·͹Βͳจࣈͷೝࣝ
    w ಓ࿏ඪࣝͷςΩετͳͲ
    w ϥςϯจࣈͷΈରԠͳͷͰ౰વ ೔ຊޠʹ͸൓Ԡ͠ͳ͍ 7JTJPO ςΩετೝࣝʢΦϯσόΠεʣ ը૾ͷจࣈͷ্ʹɺೝࣝ͞Εͨจࣈ͕ දࣔ͞Εͨ ML Kit for Firebase Quickstart (Android) https://github.com/firebase/quickstart-android/tree/master/mlkit 12
13. 7JTJPO ςΩετೝࣝʢΫϥ΢υʣ ·͹Βͳจࣈͷೝࣝ
    w ೔ຊޠ΋ೝࣝ
    w Ϋϥ΢υʹૹ৴͢Δඞཁ͋Γ ը૾ͷจࣈͷ্ʹɺೝࣝ͞Εͨจࣈ͕ දࣔ͞Εͨ 13
14. 7JTJPO ςΩετೝࣝʢΫϥ΢υʣ υΩϡϝϯτ
    w จࣈΛࡉ͔͘ೝࣝ
    w Ϋϥ΢υʹૹ৴͢Δඞཁ͋Γ ը૾ͷจࣈͷ্ʹɺೝࣝ͞Εͨจࣈ͕ දࣔ͞Εͨ 14
15. إݕग़ w إͷಛ௃Λೝࣝʢ໨ɺࣖɺ๹ɺඓɺޱʣ
    w ද৘ͷೝࣝ
    ʢস͍ͬͯΔɺ໨Λด͍ͯ͡Δʣ
    w إͷಛ௃ͷྠֲΛೝࣝʢإɺ໨ɺඑɺ৶ɺඓʣ ϦΞϧλΠϜͰإݕग़͕Ͱ͖Δ"1* 7JTJPO 15
16. إͷಛ௃ͷೝࣝʢ໨ɺࣖɺ๹ɺඓɺޱʣ 7JTJPO ද৘ͷೝࣝ
    ʢস͍ͬͯΔɺ໨Λด͍ͯ͡Δʣ w ϦΞϧλΠϜͰ͔ͬ͠Γೝࣝ ঁੑͷhappiness 0.95 உੑͷhappiness 0.01 16
17. 7JTJPO w ϦΞϧλΠϜͰྠֲΛೝࣝ إͷಛ௃ͷྠֲʢإɺ໨ɺඑɺ৶ɺඓʣ 17
18. όʔίʔυεΩϟϯ 7JTJPO w ༷ʑͳܗࣜͷόʔίʔυʹରԠ
    w ࣗಈͰܗࣜΛݕग़͢Δ
    w όʔίʔυ͸ํ޲ʹؔ܎ͳ͘ೝࣝɺ εΩϟϯͰ͖Δ
    w ωοτϫʔΫෆཁ ը૾ͷ্ʹɺೝࣝ͞Εͨจࣈ͕දࣔ͞ Εͨ 18
19. ରԠܗࣜ
    w ઢܗܗࣜ
    $PEBCBSɺ$PEFɺ$PEFɺ$PEFɺ &"/ɺ&"/ɺ*5'ɺ61$"ɺ61$&
    w %
    ܗࣜ
    "[UFDɺ%BUB
    .BUSJYɺ1%'ɺ23
    ίʔυ αϙʔτ͞Ε͍ͯΔ৘ใͷछྨ
    w 63-ɺ࿈བྷઌ৘ใɺΧϨϯμʔ
    ΠϕϯτɺϝʔϧΞυϨεɺ ి࿩൪߸ɺ4.4
    ϝοηʔδ
    ϓϩϯϓτɺ*4#/ɺ8J'J
    ઀ ଓ৘ใɺ஍Ҭɺ"".7"
    ඪ४υϥΠό৘ใͳͲ 7JTJPO όʔίʔυεΩϟϯ 19
20. ը૾ϥϕϧ෇͚ʢΦϯσόΠεʣ w ແྉ
    w Ұൠతͳࣸਅͷछྨͷϥϕϧ෇͚
    w (PPHMFφϨοδάϥϑΤϯςΟςΟ *%ରԠʢϥϕϧͰද͞ΕΔΤϯςΟ ςΟΛҰҙʹࣝผ͢Δ*%ʣ
    ΧςΰϦ ϥϕϧͷྫ ਓ෺ Crowd Selfie Smile ΞΫςΟϏςΟ Dancing Eating Surfing ΋ͷ Car Piano Receipt ಈ෺ Bird Cat Dog ২෺ Flower Fruit Vegetable ৔ॴ Beach Lake Mountain 7JTJPO 20
21. ը૾ϥϕϧ෇͚ʢΦϯσόΠεʣ 7JTJPO w Ұൠతͳϥϕϧ͕ཉ͍͠ͳΒ 21
22. ը૾ϥϕϧ෇͚ʢΫϥ΢υʣ w ༗ྉʢຖ݄ճ෼͸ແྉʣ
    w छྨҎ্ͷϥϕϧ෇͚
    w φϨοδάϥϑΤϯςΟςΟ*% ରԠ
    w σϞαΠτͰ֬ೝՄೳ ΧςΰϦ ϥϕϧͷྫ ΞʔτɺΤϯλʔςΠϯϝϯτ Sculpture Musical Instrument Dance Ϗδωεɺ࢈ۀ Restaurant Factory Airline σβΠϯ Floral Pattern Wood Stain Cloud Vision API σϞαΠτ https://cloud.google.com/vision/docs/drag-and-drop 7JTJPO 22
23. 7JTJPO w ੩ࢭըΛΫϥ΢υʹૹΔඞཁ͋Γ
    w ΑΓଟ͘ͷϥϕϧ͕औಘͰ͖Δ ը૾ϥϕϧ෇͚ʢΫϥ΢υʣ 23
24. ΦϒδΣΫτͷݕग़ͱτϥοΩϯά w ΦϯσόΠε
    w ΦϒδΣΫτͷݕग़ͱτϥοΩϯά
    w ͓͓·͔ͳ෼ྨ
    
    
    
    
    
    Ոఉ༻඼ɺϑΝογϣϯ
    άοζɺ৯඼ɺ২෺ɺ৔ॴɺෆ໌ 7JTJPO NEW! 24
25. τϥοΩϯά ID 20 ΧςΰϦ Fashion good ෼ྨͷ৴པ౓ 0.527343 7JTJPO ΦϒδΣΫτͷݕग़ͱτϥοΩϯά ΦϒδΣΫτͷݕग़
    w ΧςΰϦ͸ग़ͳ͍͜ͱ͕ଟ͔ͬͨ
    τϥοΩϯά
    w ΧϝϥΛಈ͔ͨ͠Γ΋ͷ͕ಈ͍ͯ΋ τϥοΩϯά͸͍ͯͨ͠ 25
26. ϥϯυϚʔΫೝࣝ w ϥϯυϚʔΫͷ໊લͱ஍ཧ࠲ඪɺը૾ྖҬ
    w (PPHMFφϨοδάϥϑΤϯςΟςΟ*%ͷऔಘ
    w ݄ճ·Ͱແྉ 7JTJPO Cloud Vision API σϞαΠτ https://cloud.google.com/vision/docs/drag-and-drop 26
27. 7JTJPO ϥϯυϚʔΫೝࣝ w Ϋϥ΢υʹૹ৴͢Δඞཁ͋Γ
    w ϥϯυϚʔΫͷઆ໌ɺ஍ཧ৘ใɺ φϨοδάϥϑΤϯςΟςΟ*%ɺ ڥքϙϦΰϯɺ৴པείΞ͕औಘ Ͱ͖Δ ʮTower of the Sunʯͱ ೝࣝ͞Εͨ 27
28. ࣗવݴޠ w ݴޠࣝผ
    w εϚʔτϦϓϥΠ
    w ΦϯσόΠε຋༁ NEW! 28
29. ݴޠࣝผ w ΦϯσόΠε
    w ςΩετͷݴޠΛࣝผ
    w 
    छྨͷݴޠ͕ωΠςΟϒͷจࣈͰೝࣝ
    w ϩʔϚࣈςΩετͰ΋ࣝผՄೳ ML Kit ͷݴޠࣝผ: αϙʔτ͞Ε͍ͯΔݴޠ https://firebase.google.com/docs/ml-kit/langid-support ࣗવݴޠ 29
30. ࣗવݴޠ ݴޠࣝผ w ωΠςΟϒจࣈͰ΋ϩʔϚࣈͰ΋ ݴޠ͕ࣝผͰ͖ͨ
    w ෳ਺ͷݴޠͷՄೳੑ΋औಘՄೳ ʮ͜Μʹͪ͸ʯͱೖྗͯ͠ ࣝผϘλϯΛԡ͢ͱɺ ʮjaʯͱೝࣝ͞Εͨ ML Kit Language ID for Firebase Quickstart (Android) https://github.com/firebase/quickstart-android/tree/master/mlkit-langid 30
31. εϚʔτϦϓϥΠ w ձ࿩ͷཤྺΛ౉͢ͱϦϓϥΠΛఏҊͯ͘͠ΕΔ
    w ձ࿩ͷཤྺ͸࠷େ݅
    w ΧδϡΞϧͳձ࿩Λ૝ఆ
    w ରԠݴޠ͕ࠓͷͱ͜ΖӳޠͷΈͰɺผͳݴޠ͕ ࢖ΘΕ͍ͯΔͱԿ΋ఏҊ͠ͳ͍ ࣗવݴޠ 31
32. ࣗવݴޠ εϚʔτϦϓϥΠ w ೔ຊޠʹରԠ͍ͯ͠ͳ͍ͷ͸௧͍ ձ࿩ͷཤྺΛ΋ͱʹϦϓϥ ΠͷఏҊ͕͞Εͨ ML Kit Smart Reply for Firebase Quickstart (Android) https://github.com/firebase/quickstart-android/tree/master/mlkit-smartreply 32
33. σόΠε຋༁ w ΦϯσόΠεʢΦϑϥΠϯͰ࢖༻Մೳʣ
    w ͷݴޠؒͰ຋༁
    w (PPHMF຋༁ΞϓϦͷΦϑϥΠϯϞʔυͰ ࢖༻͞Ε͍ͯΔϞσϧ
    w ݴޠύοΫΛಈతʹμ΢ϯϩʔυͰ͖Δ ML Kit ͷݴޠ຋༁: αϙʔτ͞Ε͍ͯΔݴޠ https://firebase.google.com/docs/ml-kit/translation-language-support ࣗવݴޠ NEW! 33
34. ຋༁ͷ੍ݶࣄ߲
    ؼଐදࣔɾ੍ݶࣄ߲ ؼଐදࣔ
    w (PPHMF΁ͷؼଐදࣔΛදࣔ͢Δඞཁ͋ΓʢϩΰͳͲʣ
    ੍ݶࣄ߲
    w (PPHMFͷڐ୚ͳ͘ɺंɺςϨϏɺՈి੡඼ɺεϐʔΧʔ ͳͲͷ૊ΈࠐΈػثͷΞϓϦͱͯ͠࢖༻Ͱ͖ͳ͍ɻ ࣗવݴޠ 34
35. ࣗવݴޠ w ΧδϡΞϧͳ຋༁ͱׂΓ੾Δ σόΠε຋༁ ML Kit Translate for Firebase Quickstart (Android) https://github.com/firebase/quickstart-android/tree/master/mlkit-translate 35
36. ΧελϜϞσϧ w ϞσϧαʔϏε
    w "VUP.-
    7JTJPO
    &EHF NEW! 36
37. ϞσϧαʔϏε ΧελϜϞσϧ w .-
    ,JUͷࣄલߏஙࡁΈϞσϧͰ͸χʔζΛ ຬͨͤͳ͍৔߹ɺ5FOTPS'MPX
    -JUFܗࣜͷ ΧελϜϞσϧΛ࢖༻Ͱ͖Δ
    w Ϟσϧ͸ΞϓϦʹόϯυϧ͢Δ͔ɺ 'JSFCBTFͰϗετͰ͖Δ 37
38. "VUP.-
    7JTJPO
    &EHF NEW! w ಠࣗͷτϨʔχϯάσʔλΛ࢖ͬͯΧελ Ϝը૾ϥϕϧ෇͚ϞσϧΛࣗಈతʹτϨʔ χϯάͯ͘͠ΕΔ
    w Ϟσϧ͸ΞϓϦʹόϯυϧ͢Δ͔ɺ 'JSFCBTFͰϗετͰ͖Δ 38 ΧελϜϞσϧ
39. ·ͱΊ 39
40. w .-
    ,JU͸ϞόΠϧΞϓϦ޲͚ͷ4%,
    w ແྉͰఏڙ͞Ε͍ͯΔػೳͰ΋༷ʑͳ ೝ͕ࣝͰ͖Δ
    w কདྷָ͕͠ΈʂʂʢCFUB͸͍ͭऴΘΔ ΜͩΖ͏͔ʜʣ ML Kit ֓ཁ https://firebase.google.com/docs/ml-kit 40
41. ͝੩ௌ͋Γ͕ͱ͏͍͟͝·ͨ͠ 41