cookpad で学ぶ自然言語処理/internship2015

by j.harashima

Slide 1

Slide 1 text

DPPLQBEͰֶͿࣗવݴޠॲཧ ݪౡ७

Slide 2

Slide 2 text

ࣗݾ঺հ ɾݪౡ७ ɹɾॴଐɿݕࡧฤ੒෦ɺݚڀ։ൃνʔϜ ɹɾݞॻɿΤϯδχΞɺ৘ใֶത࢜ ɹɾઐ໳ɿࣗવݴޠॲཧ

Slide 3

Slide 3 text

ߨٛɿࣗવݴޠॲཧΛͬ͘͟Γֶ΅͏

Slide 4

Slide 4 text

ࣗવݴޠॲཧ ࣗવݴޠΛίϯϐϡʔλͰॲཧ͢ΔͨΊͷֶ໰෼໺ ࣗવݴޠࣗવൃੜతʹੜ·ΕͨݴޠʢFH೔ຊޠʣ ਓ޻ݴޠਓ޻తʹ࡞ΒΕͨݴޠʢFH$ݴޠʣ

Slide 5

Slide 5 text

ࣗવݴޠॲཧʹجͮ͘ΞϓϦέʔγϣϯ ɾݕࡧΤϯδϯ ɹɾ(PPHMFɺ:BIPPɺ ɾࣗಈ຋༁ ɹɾ(PPHMF຋༁ɺΤΩαΠτ຋༁ɺ ɾ࣭໰Ԡ౴ ɹɾ8BUTPOɺ4JSJɺ ɾԾ໊׽ࣈม׵ ɹɾ(PPHMF*.&ɺ"50,ɺ

Slide 6

Slide 6 text

جૅղੳ ܗଶૉղੳ ߏจղੳ ݻ༗දݱೝࣝ ֨ղੳ লུরԠղੳ ಉٛදݱೝࣝ ޠٛᐆດੑղফ ஊ࿩ߏ଄ղੳ ୯ޠϨϕϧ ߏจϨϕϧ จ຺Ϩϕϧ ҙຯϨϕϧ ΞϓϦέʔγϣϯ

Slide 7

Slide 7 text

ࠓ೔ͷτϐοΫ ɾجૅղੳ ɹɾܗଶૉղੳ ɹɾݻ༗දݱೝࣝ ɹɾߏจղੳ ɹɾলུরԠղੳ ɹɾஊ࿩ߏ଄ղੳ ɹɾ֨ղੳ ɹɾಉٛදݱೝࣝ ɹɾޠٛᐆດੑղফ ɾΞϓϦέʔγϣϯ ɹɾݕࡧΤϯδϯ ɹɾࣗಈ຋༁ ɹɾ࣭໰Ԡ౴ ɹɾ͔ͳ׽ࣈม׵

Slide 8

Slide 8 text

ܗଶૉղੳ ୯ޠͷ۠੾Γͱ඼ࢺɺݪܗΛࣝผ͢Δॲཧ ଠ࿠ ͸ ژ౎ ʹ ߦͬͨ ଠ࿠͸ژ౎ʹߦͬͨ ໊ࢺ ໊ࢺ ಈࢺ ॿࢺ ॿࢺ c c c c ߦ͘ ղੳ༻ͷࣙॻΛࢀরͯ͠ɺҰ൪΋ͬͱ΋Β͍͠ ʢҰ൪ίετͷ૯࿨͕௿͍ʣ୯ޠྻΛબ୒͢Δ ଠ࿠ ໊ࢺ ژ౎ ໊ࢺ ژ ໊ࢺ ౎ ໊ࢺ ࣙॻ ੜىίετ ੜىίετͷ΄͔ʹ୯ޠؒͷ࿈઀ίετ΋ߟྀ

Slide 9

Slide 9 text

ܗଶૉղੳJODPPLQBE ಲͷʹΜʹ͘ে༉ম͖ ͷ ʹΜʹ͘ ে༉ ໊ࢺ ໊ࢺ ॿࢺ ໊ࢺ c c c c ম͘ ಲ ম͖ ಈࢺ

Slide 10

Slide 10 text

ݻ༗දݱೝࣝ จதͷݻ༗දݱʢFHਓ໊ɺ஍໊ʣΛೝࣝ͢Δॲཧ ଠ࿠ ͸ ژ౎ ʹ ߦͬͨ ໊ࢺ ໊ࢺ ಈࢺ ॿࢺ ॿࢺ c c c c ߦ͘ ଠ࿠ ͸ ژ౎ ʹ ߦͬͨ ਓ໊ ஍໊ ܇࿅σʔλΛ༻ҙͯ͠ɺͲͷΑ͏ͳ୯ޠྻ͕ ͲͷΑ͏ͳݻ༗දݱʹͳΓ͏Δ͔Λֶश ࣍࿠͸ژ౎ʹߦͬͨɻ Ֆࢠ͸େࡕʹߦͬͨɻ ܇࿅σʔλ ਓ໊ ਓ໊ ஍໊ ஍໊ ݻ༗දݱೝࣝث

Slide 11

Slide 11 text

ಛച৘ใʢళฮ͔Β౤ߘʣ ݻ༗දݱೝࣝ ͨ·Ͷ͗ݸ ԁ ͨ·Ͷ͗υϨογϯά ԁ ͨ·Ͷ͗ɹݸ ঎඼໊ ͨ·Ͷ͗ɹυϨογϯά ঎඼໊ ʮͨ·Ͷ͗ʯͰొ࿥ ʮͨ·Ͷ͗υϨογϯάʯͰొ࿥ 0OMJOF Ϣʔβͷۙลͷళฮ͔Β ঎඼໊ʮͨ·Ͷ͗ʯΛݕࡧ ݻ༗දݱೝࣝJODPPLQBE

Slide 12

Slide 12 text

ߏจղੳ จͷߏ଄ʢ೔ຊޠͰ͸จઅͷ۠੾Γͱ܎ΓઌʣΛ໌Β͔ʹ͢Δॲཧ ҎԼͷ৘ใ͔Βࣝผ ɾจઅ͸લ͔ΒޙΖʹ܎Δ ɾจઅ͸ͨͩҰͭͷจઅʹ܎Δ ɾ܎Γड͚͸ޓ͍ʹަࠩ͠ͳ͍ ɾ࠷΋͍ۙจઅʹ܎Γ΍͍͢ ɾ ଠ࿠ ͸ ژ౎ ʹ ߦͬͨ ໊ࢺ ໊ࢺ ಈࢺ ॿࢺ ॿࢺ c c c c ߦ͘ ଠ࿠͸ ژ౎ʹ ߦͬͨ c c จઅͷ۠੾ΓΛࣝผ ߦͬͨ ଠ࿠͸ ژ౎ʹ จઅͷ܎ΓઌΛࣝผ จઅ͸ݸҎ্ͷ಺༰ޠʢFH໊ࢺʣͱݸ Ҏ্ͷ෇ଐޠʢFHॿࢺʣ͔ΒͳΔ

Slide 13

Slide 13 text

লུরԠղੳ রԠࢺ จষதͷಉҰදݱΛಉఆ͢Δॲཧ ઌߦࢺ রԠղੳ লུղੳʢθϩরԠղੳʣ ޲͔ͬͨ ൴͸ ਗ਼ਫࣉʹ ·ͣ ଠ࿠͸ ژ౎ʹ ߦͬͨ θϩ୅໊ࢺ ઌߦࢺ ޲͔ͬͨ ൴͸ ਗ਼ਫࣉʹ ·ͣ ଠ࿠͸ ژ౎ʹ ߦͬͨ θϩ୅໊ࢺʢলུ͞ΕͨরԠࢺʣʹؾ෇͘ͱ͜Ζ͔Β ελʔτ ҎԼͷ৘ใ͔Βಉఆ ɾরԠࢺͱઌߦࢺͷੑผ͸ಉ͡ ɾઌߦࢺ͸ʮ͸ʯΛ൐͍΍͍͢ ɾরԠࢺͱઌߦࢺ͸ͦΕ΄Ͳ཭Εͳ͍ ɾ

Slide 14

Slide 14 text

ߏจղੳBOEলུরԠղੳJODPPLQBE ɾࠓͷͱ͜Ζɺ࢖͍Ͳ͜Ζͳ͠ ɹɾࣗಈ຋༁ʢޙͰ঺հʣͰ࢖༻͢Δ͔΋ʁ

Slide 15

Slide 15 text

୯ޠϨϕϧ ߏจϨϕϧ ίϯϐϡʔλɹʹɹܭࢉػ ίϯϐϡʔλɹʹɹίϯϐϡʔλʔ ܠؾ͕ྫྷ͑Δɹʹɹܠؾ͕Լ͕Δ ಉٛදݱೝࣝ ಉ͡ҙຯΛ࣋ͭදݱΛೝࣝ͢Δॲཧ ্͸ҟදهಉٛʢಉ͡୯ޠͷදه༳Εʣ Լ͸ҟܗಉٛʢҟͳΔ୯ޠ͕ಉ͡ҙຯʣ ୯ޠϨϕϧͰ͸ʮྫྷ͑Δʯ㱠ʮԼ͕Δʯ͕ͩ ʮܠؾ͕ʯ͕෇͘ͱಉٛ

Slide 16

Slide 16 text

ಉٛදݱೝࣝJODPPLQBE

Slide 17

Slide 17 text

ݕࡧΤϯδϯ ΫΤϦʹؔ࿈͢ΔϦιʔεʢFHจॻʣΛऔಘ͢Δॲཧ ΠϯσΩγϯά సஔΠϯσοΫε ୯ޠ͔Βจॻ΁ͷϚοϐϯά 0⒐JOF 0OMJOF จॻଠ࿠͸ژ౎ʹߦͬͨ จॻ࣍࿠͸ژ౎ʹߦͬͨ ܗଶૉղੳ จॻଠ࿠c͸cژ౎cʹcߦͬͨ จॻ࣍࿠c͸cژ౎cʹcߦͬͨ ଠ࿠\^ ࣍࿠\^ ژ౎\ ^ ΫΤϦʮଠ࿠ʯ ݕࡧ݁Ռɿจॻ ΫΤϦʮژ౎ʯ ݕࡧ݁Ռɿจॻ จॻ

Slide 18

Slide 18 text

ݕࡧΤϯδϯJODPPLQBE

Slide 19

Slide 19 text

ࣗಈ຋༁ ίϯϐϡʔλʹΑΔผͷݴޠͷ౳Ձͳจষ΁ͷஔ׵ ೔ɿଠ࿠͸ژ౎ʹߦͬͨ ӳɿ5BSPXFOUUP,ZPUP ܗଶૉղੳɺߏจղੳɺ ݴޠ୯Ґ͝ͱʹ຋༁ ߦͬͨ ଠ࿠͸ ژ౎ʹ 5BSP UP,ZPUP XFOU MFBWF ࣗવจΛੜ੒ ೖྗจΛಛఆͷݴޠ୯ҐʢFH୯ޠɺ୯ޠྻʣ Ͱදݱ ୯Ґ͝ͱͷީิΛ૊Έ߹Θͤͯෳ਺ͷจΛੜ੒ ͦͷத͔Β΋ͬͱ΋ࣗવͳ΋ͷΛग़ྗ ର༁σʔλΛࢀߟʹ຋༁ީิΛੜ੒ʢσʔλ͸ ༧Ίߏங͓ͯ͘͠ʣ

Slide 20

Slide 20 text

ࣗಈ຋༁JODPPLQBE 8FBSFIJSJOH

Slide 21

Slide 21 text

࣮शɿܗଶૉղੳثΛ࢖ͬͯΈΑ͏

Slide 22

Slide 22 text

ܗଶૉղੳث +6."/ $IB4FO .F$BC ,Z5FB ػցֶशʢੜ੒ϞσϧʣʹΑΔίετௐ੔ ػցֶशʢࣝผϞσϧʣʹΑΔίετௐ੔ ֶशσʔλͷߏஙΛ༰қʹ ਓखʹΑΔίετௐ੔

Slide 23

Slide 23 text

.F$BC ɾݱࡏͷσϑΝΫτ ɹɾߴਫ਼౓Ͱ࢖͍΍͍͢ ɾ࢖͍ํ ɹɾ45%*/ʹͭͬ͜Ή͚ͩ NFDBC ଠ࿠͸ژ౎ʹߦͬͨ&OUFS ଠ࿠ɹ໊ࢺ ݻ༗໊ࢺ ਓ໊ ໊ ଠ࿠ λϩ΢ λϩʔ ͸ɹɹॿࢺ ܎ॿࢺ ͸ ϋ ϫ ژ౎ɹ໊ࢺ ݻ༗໊ࢺ ஍Ҭ Ұൠ ژ౎ Ωϣ΢τ Ωϣʔτ ʹɹɹॿࢺ ֨ॿࢺ Ұൠ ʹ χ χ ߦͬɹಈࢺ ཱࣗ ޒஈɾΧߦଅԻศ ࿈༻λ઀ଓ ߦ͘ Πο Πο ͨɹɹॿಈࢺ ಛघɾλ جຊܗ ͨ λ λ &04 ୯ޠͷ۠੾Γͱ඼ࢺɺݪܗ͕෼͔Δ ؆୯ͳ΋ͷͰ͋Ε͹ɺݻ༗දݱ΋෼͔Δ

Slide 24

Slide 24 text

࣮शϨγϐΛղੳ͠Α͏ Ϩγϐσʔλʢ ϨγϐͷλΠτϧʣΛऔಘ ɹɾDVSMPSFDJQFUYUlIUUQTYYYzʢ63-͸4MBDLࢀরʣ ܗଶૉղੳΛ࣮ߦ ɹɾNFDBCSFDJQFUYUʁ

Slide 25

Slide 25 text

࣮श୯ޠͷ෼෍Λௐࠪ͠Α͏ ग़ݱස౓Λܭ਺ ɹɾࢥ͍ࢥ͍ͷํ๏Ͱʂ ॱҐ ୯ޠ ग़ݱස౓ ʁ ʁ ؆୯ ̇ ࣽ Ϩγϐʹ ճҎ্ ग़ݱ͢Δ୯ޠͱ͸ʁ

Slide 26

Slide 26 text

࣮शδοϓͷ๏ଇΛ؍ଌ͠Α͏ ॱҐͱग़ݱ֬཰ΛάϥϑԽ ɹɾࢥ͍ࢥ͍ͷํ๏Ͱʂ શମͰL൪໨ͷग़ݱස౓Λ࣋ͭཁૉ͕શମʹ ઎ΊΔׂ߹ʢJFग़ݱ֬཰ʣ͸Lʹൺྫ ग़ ݱ ֬ ཰ ॱҐ ʁ

Slide 27

Slide 27 text

࣮श୯ޠΛొ࿥͠Α͏ ܗଶૉղੳΛ࣮ߦ ɹɾFDIPlΫοΫύουzcNFDBCʁ ࣗ෼༻ͷࣙॻΛ࡞੒ ɹɾ୯ޠͷ৘ใΛΧϯϚ۠੾ΓͰొ࿥ ࣙॻΛίϯύΠϧ ɹɾVTSMPDBM$FMMBSNFDBCMJCFYFDNFDBCNFDBCEJDUJOEFYE ɹɹVTSMPDBM$FMMBSNFDBCMJCNFDBCEJDJQBEJDVVTFSEJDVTFSDTWGVUGUVUG ܗଶૉղੳΛ࣮ߦ ɹɾFDIPlΫοΫύουzcNFDBCVVTFSEJDʁ ද૚ܗ ݪܗ ಡΈ ൃԻ ίετ ඼ࢺ ΫοΫύου ໊ࢺ ݻ༗໊ࢺ ૊৫ ΫοΫύου ΫοΫύου ΫοΫύου VTFSDTW

Slide 28

Slide 28 text

ಠशɿࣗવݴޠॲཧͱ஥ྑ͘ͳΖ͏

Slide 29

Slide 29 text

ؔ࿈ਤॻˍؔ࿈ֶձ ɾؔ࿈ਤॻ ɹɾࣗવݴޠॲཧʢ์ૹେֶڭҭৼڵձʣ ɹɾࣗવݴޠॲཧͷجૅʢίϩφࣾʣ ɹɾݴޠॲཧͷͨΊͷػցֶशೖ໳ʢίϩφࣾʣ ɾؔ࿈ֶձ ɹɾݴޠॲཧֶձ ɹɾࣗવݴޠॲཧݚڀձ ɹɾ/-1एखͷձ