Natural Language APIとその裏側を覗く〜完全版〜

by akatsuki174

Slide 1

Slide 1 text

Natural Language APIͱ ͦͷཪଆΛ೷͘ ʙ׬શ൛ʙ @akatsuki174

Slide 2

Slide 2 text

ࣗݾ঺հ • ਢ౻ຘ • iOSΤϯδχΞ • גࣜձࣾZaimॴଐ • Twitter, Qiita, SlideShare, Github, SpeakerDeck →akatsuki174

Slide 3

Slide 3 text

No content

Slide 4

Slide 4 text

એ఻̍ 10/13(ۚ)ɺ10/20(ۚ)ͷ2days 19:20ʙ

Slide 5

Slide 5 text

એ఻̎ 9/1(ۚ) 19:30ʙ

Slide 6

Slide 6 text

ࢲͱࣗવݴޠॲཧ ɾେֶͷଔۀݚڀͰΏΔΏΔ1೥ؒ ʢॏཁޠ൑ఆʣ ɾ࠷ॳͷձࣾͰ2,3ϲ݄ ʢτϐοΫ൑ఆʣ ɾ2ࣾ໨ͰΏΔΏΔ൒೥ ʢSolrͰݕࡧνϡʔχϯάʣ

Slide 7

Slide 7 text

ࠓճͷࢿྉ͸ɺ͜ͷొஃࢿྉΛ࡞ΔաఔͰ୤ઢͯ͠ ௐ΂ͨ͜ͱΛ·ͱΊͨࢿྉʹͳΓ·͢ɻ 9/17(೔) Track C 14:40ʙΑΖ͓͘͠ئ͍͠·͢ʂ

Slide 8

Slide 8 text

ɾNatural Language Processing and your ɹApps[WWDC 2017]ͷͬ͘͟Γͱͨ͠಺༰ ɾཪଆͰ࢖ΘΕ͍ͯΔٕज़ʹ͍ͭͯ ࠓ೔࿩͢͜ͱ

Slide 9

Slide 9 text

ɾϑΝʔετύʔςΟΞϓϦͰͲͷΑ͏ͳ ɹ׆༻͕͞ΕΔ͔ ɾNLP APIͱ͸ ɾ͋ͳͨͷΞϓϦͰͲͷΑ͏ʹ࢖͏ͱ ɹྑ͍͔ʢͨͿΜɻ·ͩશ෦؍ͯͳ͍ʣ Natural Language Processing and your Apps

Slide 10

Slide 10 text

ɾϑΝʔετύʔςΟΞϓϦͰͲͷΑ͏ͳ ɹ׆༻͕͞ΕΔ͔ ɾNLP APIͱ͸ ɾ͋ͳͨͷΞϓϦͰͲͷΑ͏ʹ࢖͏ͱ ɹྑ͍͔ʢͨͿΜɻ·ͩશ෦؍ͯͳ͍ʣ Natural Language Processing and your Apps

Slide 11

Slide 11 text

Natural Language Processing and your Apps https://developer.apple.com/videos/play/wwdc2017/208/ Go to iMessage app

Slide 12

Slide 12 text

Natural Language Processing and your Apps https://developer.apple.com/videos/play/wwdc2017/208/ Go to News app

Slide 13

Slide 13 text

Natural Language Processing and your Apps https://developer.apple.com/videos/play/wwdc2017/208/ Back to iMessage app

Slide 14

Slide 14 text

ݻ༗දݱநग़ͷٕज़Λ࢖͍ͬͯΔ ͷͰɺͦ͜Λ۷ΓԼ͛ͯΈ·͢ ʢҎԼɺiOS͸શؔ͘܎ͳ͍࿩ʹͳΓ·͢ʣ ͓ͦΒ͘ɺ

Slide 15

Slide 15 text

ݻ༗໊ࢺʢਓ໊ɺ஍໊౳ʣɺ࣌ؒදݱ ʢ೔෇ɺ࣌ࠁʣͳͲΛςΩετ͔Βநग़͢Δٕज़ ͜ͷٕज़͕ొ৔ͨ͠എܠ ɹɾࣙॻʹ୯ޠ͕ొ࿥͞Ε͍ͯͳ͍ͱղੳ ɹɹޡΓΛҾ͖ى͜͢ͷͰࣗಈͰநग़͍ͨ͠ ɹɾจষʹ͓͍ͯॏཁͳ৘ใ͸্هͷ ɹɹΑ͏ͳݻ༗දݱͰ͋Δ ݻ༗දݱநग़ͱ͸

Slide 16

Slide 16 text

ଠ࿠͸5݄18೔ͷே9࣌ʹՖࢠʹձ͍ʹߦͬͨɻ ↓ɹநग़ʂ ଠ࿠ʢpersonʣ͸5݄18೔ʢdateʣͷே9࣌ ʢtimeʣʹՖࢠʢpersonʣʹձ͍ʹߦͬͨɻ ݻ༗දݱநग़ͷྫ

Slide 17

Slide 17 text

ɾ࣭໰Ԡ౴γεςϜɺର࿩γεςϜɹ ɹʢWatsonɺνϟοτϘοτ౳ʣ ɾ৘ใநग़ ݻ༗දݱநग़ͷ׆༻υίϩ

Slide 18

Slide 18 text

ɾ࣭໰Ԡ౴γεςϜɺର࿩γεςϜɹ ɹʢWatsonɺνϟοτϘοτ౳ʣ ɾ৘ใநग़ ݻ༗දݱநग़ͷ׆༻υίϩ ࣗવݴޠ͔Βݻ༗දݱΛநग़͠ɺͦͷݻ༗දݱΛ ΫΤϦͱͯ͠౤͛ͯจॻݕࡧΛߦ͏ɻಘΒΕͨճ౴ ͱݻ༗දݱΛ΋ͱʹճ౴ީิΛ࡞੒͠ɺͦͷதͰ είΞ͕ߴ͍΋ͷΛճ౴ͱ͢Δɻ

Slide 19

Slide 19 text

࣭໰Ԡ౴γεςϜɺର࿩γεςϜ ौ୩Ͱ໌೔19:30͔Β༧໿ Ͱ͖ΔళΛ୳ͯ͠ʂ q=ौ୩, ໌೔19:30 ճ౴ީิ࡞੒ ※࣮ࡍʹ͸ଞͷޠ΋౤͍͛ͯΔ͸ͣ ͳΔ΄Ͳ͒ʂ είΞܭࢉ

Slide 20

Slide 20 text

ɾ࣭໰Ԡ౴γεςϜɺର࿩γεςϜɹ ɹʢWatsonɺνϟοτϘοτ౳ʣ ɾ৘ใநग़ ݻ༗දݱநग़ͷ׆༻υίϩ ༧ΊܾΊͨʮ஌Γ͍ͨ͜ͱ߲໨ʯΛຒΊΔܗͰ৘ใ Λநग़͢Δ͜ͱɻߏ଄Խ͞Ε͍ͯͳ͍ςΩετ৘ใ Λߏ଄Խ͞Εͨσʔλϕʔεܗࣜʹม׵͢Δ͜ͱͱ ΋ଊ͑Δ͜ͱ͕Ͱ͖Δɻ

Slide 21

Slide 21 text

ݻ༗දݱநग़ͷ׆༻υίϩ ࡢ೔͋ͬͨ஍਒ͷ࠷େ਒౓ɺ Ϛάχνϡʔυɺ਒ݯ஍ʹ ͍ͭͯ஌Γ͍ͨ ਒౓ ʔʔʔ Ϛάχνϡʔυ Mʔ ਒ݯ஍ ʙݝʙࢢ ※ͪΐͬͱΠϝʔδਤҧ͏͔΋ ςΩετ͔Βݻ༗දݱΛநग़

Slide 22

Slide 22 text

ɾ஌ࣝϕʔεख๏ ɾ౷ܭతख๏ ݻ༗දݱநग़Λ͢Δʹ͸

Slide 23

Slide 23 text

ɾنଇʢύλʔϯʣΛਓखͰ࡞੒͠ɺ ɹͦΕʹ౰ͯ͸·Δ΋ͷΛநग़͢Δ ɹྫʣ໊ࢺʴʮ͞Μʯˠਓ໊ ɹɹɹ໊ࢺʴʮࢯʯˠ஍໊ ɾنଇΛ໢ཏతʹߏங͠Α͏ͱ͢Δͱ ɹലେͳίετ͕͔͔Δ ஌ࣝϕʔεख๏

Slide 24

Slide 24 text

ɾڭࢣ͋ΓֶशΛͤ͞ɺநग़نଇΛࣗಈ ɹֶश͢ΔΑ͏ʹ͢Δ ɾSVMʢSupport Vector Machine / ࣝผ ɹؔ਺ʣ΍CRFʢConditional Random ɹFields / ࣝผϞσϧʣ͕༗໊ ౷ܭతख๏

Slide 25

Slide 25 text

͍Ζ͍Ζ೉͍͠࿩͕ग़͖ͯͨ͠ɺ೔ຊޠͷ ղੳ͸ͱͯ΋ෳࡶ ͳͷͰݻ༗දݱநग़Λָʹ͢ΔπʔϧΛ ঺հͯ͠Έ·͢ɻ

Slide 26

Slide 26 text

ɾMeCab ͱڞʹ࢖͏୯ޠ෼͔ͪॻ͖ࣙॻ ɾ࠷௿݄2ճΞοϓσʔτ ɹɾ৽ޠɺݻ༗දݱʹڧ͍ ɾApache License 2.0 ɾࠃ࢈ mecab-ipadic-NEologd

Slide 27

Slide 27 text

ɾಈ࡞ʹඞཁͳϥΠϒϥϦͷΠϯετʔϧ $ brew install mecab mecab-ipadic git curl xz ɾgit clone $ git clone --depth 1 https://github.com/ neologd/mecab-ipadic-neologd.git ɾcloneͨ͠σΟϨΫτϦͰΠϯετʔϧ $ ./bin/install-mecab-ipadic-neologd -n Πϯετʔϧ

Slide 28

Slide 28 text

ɾશ෦ೖΓͳmecab-ipadic-NEologdΛ ɹΠϯετʔϧ $ ./bin/install-mecab-ipadic-neologd -n -a ɾΠϯετʔϧઌΛ֬ೝ $ echo `mecab-conﬁg --dicdir`"/mecab- ipadic-neologd" Πϯετʔϧ

Slide 29

Slide 29 text

ɾී௨ͷIPAࣙॻΛ࢖͏৔߹ $ mecab ɾNEologdΛ࢖͏৔߹ $ mecab -d [ΠϯετʔϧઌΛࢦఆ] ࢖ͬͯΈΔ

Slide 30

Slide 30 text

ɾී௨ͷIPAࣙॻ ྫจʣϝϩϯύϯΛ৯΂·ͨ͠ ϝϩϯ ໊ࢺ,Ұൠ,*,*,*,*,ϝϩϯ,ϝϩϯ,ϝϩϯ ύϯ ໊ࢺ,Ұൠ,*,*,*,*,ύϯ,ύϯ,ύϯ Λ ॿࢺ,֨ॿࢺ,Ұൠ,*,*,*,Λ,Ϯ,Ϯ ৯΂ ಈࢺ,ཱࣗ,*,*,Ұஈ,࿈༻ܗ,৯΂Δ,λϕ,λϕ ·͠ ॿಈࢺ,*,*,*,ಛघɾϚε,࿈༻ܗ,·͢,Ϛγ,Ϛγ ͨ ॿಈࢺ,*,*,*,ಛघɾλ,جຊܗ,ͨ,λ,λ ൺֱͯ͠ΈΔ̍

Slide 31

Slide 31 text

ɾNEologd ྫจʣϝϩϯύϯΛ৯΂·ͨ͠ ϝϩϯύϯ ໊ࢺ,ݻ༗໊ࢺ,Ұൠ,*,*,*,ϝϩϯύϯ,ϝ ϩϯύϯ,ϝϩϯύϯ Λ ॿࢺ,֨ॿࢺ,Ұൠ,*,*,*,Λ,Ϯ,Ϯ ৯΂ ಈࢺ,ཱࣗ,*,*,Ұஈ,࿈༻ܗ,৯΂Δ,λϕ,λϕ ·͠ ॿಈࢺ,*,*,*,ಛघɾϚε,࿈༻ܗ,·͢,Ϛγ,Ϛγ ͨ ॿಈࢺ,*,*,*,ಛघɾλ,جຊܗ,ͨ,λ,λ ൺֱͯ͠ΈΔ̍

Slide 32

Slide 32 text

ɾී௨ͷIPAࣙॻ ྫจʣ3݄ͷϥΠΦϯΛಡΜͩ 3 ໊ࢺ,਺,*,*,*,*,* ݄ ໊ࢺ,Ұൠ,*,*,*,*,݄,πΩ,πΩ ͷ ॿࢺ,࿈ମԽ,*,*,*,*,ͷ,ϊ,ϊ ϥΠΦϯ ໊ࢺ,Ұൠ,*,*,*,*,ϥΠΦϯ,ϥΠΦϯ,ϥΠΦϯ Λ ॿࢺ,֨ॿࢺ,Ұൠ,*,*,*,Λ,Ϯ,Ϯ ಡΜ ಈࢺ,ཱࣗ,*,*,ޒஈɾϚߦ,࿈༻λ઀ଓ,ಡΉ,Ϥϯ,Ϥϯ ͩ ॿಈࢺ,*,*,*,ಛघɾλ,جຊܗ,ͩ,μ,μ ൺֱͯ͠ΈΔ̎

Slide 33

Slide 33 text

ɾNEologd ྫจʣ3݄ͷϥΠΦϯΛಡΜͩ 3݄ͷϥΠΦϯ ໊ࢺ,ݻ༗໊ࢺ,Ұൠ,*,*,*,3݄ͷϥΠ Φϯ,αϯΨπϊϥΠΦϯ,αϯΨπϊϥΠΦϯ Λ ॿࢺ,֨ॿࢺ,Ұൠ,*,*,*,Λ,Ϯ,Ϯ ಡΜ ಈࢺ,ཱࣗ,*,*,ޒஈɾϚߦ,࿈༻λ઀ଓ,ಡΉ,Ϥ ϯ,Ϥϯ ͩ ॿಈࢺ,*,*,*,ಛघɾλ,جຊܗ,ͩ,μ,μ ൺֱͯ͠ΈΔ̎ ΞχϝλΠτϧ ͳͲ΋OK

Slide 34

Slide 34 text

ɾී௨ͷIPAࣙॻ ྫจʣApple WatchΛങͬͨɻ Apple ໊ࢺ,ݻ༗໊ࢺ,૊৫,*,*,*,* Watch ໊ࢺ,Ұൠ,*,*,*,*,* Λ ॿࢺ,֨ॿࢺ,Ұൠ,*,*,*,Λ,Ϯ,Ϯ ങͬ ಈࢺ,ཱࣗ,*,*,ޒஈɾϫߦଅԻศ,࿈༻λ઀ଓ,ങ͏, Χο,Χο ͨ ॿಈࢺ,*,*,*,ಛघɾλ,جຊܗ,ͨ,λ,λ ɻ ه߸,۟఺,*,*,*,*,ɻ,ɻ,ɻ ൺֱͯ͠ΈΔ̏

Slide 35

Slide 35 text

ɾNEologd ྫจʣApple WatchΛങͬͨɻ Apple Watch ໊ࢺ,ݻ༗໊ࢺ,Ұൠ,*,*,*,Apple Watch,Ξο ϓϧ΢Υον,Ξοϓϧ΢Υον Λ ॿࢺ,֨ॿࢺ,Ұൠ,*,*,*,Λ,Ϯ,Ϯ ങͬ ಈࢺ,ཱࣗ,*,*,ޒஈɾϫߦଅԻศ,࿈༻λ઀ଓ,ങ͏, Χο,Χο ͨ ॿಈࢺ,*,*,*,ಛघɾλ,جຊܗ,ͨ,λ,λ ɻ ه߸,۟఺,*,*,*,*,ɻ,ɻ,ɻ ൺֱͯ͠ΈΔ̏ ۭനεϖʔε͕ ͋ͬͯ΋OK