Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
cookpad で学ぶ自然言語処理/internship2015
Search
j.harashima
August 26, 2015
4
36k
cookpad で学ぶ自然言語処理/internship2015
Summer Internship 2015 で使用した資料です。
https://recruit.cookpad.com/internship/summer2015-engineer/
j.harashima
August 26, 2015
Tweet
Share
More Decks by j.harashima
See All by j.harashima
日本語レシピデータセットの継続的な構築と複合的な利用/JED2022
junharashima
0
12k
自然言語処理の基礎と応用 〜 料理と医療を題材として 〜 /JADI2021
junharashima
0
4.8k
企業での研究開発の楽しさと苦労/WAP-Tech-Talk
junharashima
1
11k
クックパッドにおける研究開発/HCG2020
junharashima
0
4.1k
Calorie Estimation in a Real-World Recipe Service/iaai-20
junharashima
0
14k
クックパッドと機械学習(短縮版)/MLTBP
junharashima
0
9.1k
クックパッドと NLP/CV/nlpaper-challenge
junharashima
0
110
AI 部門の実戦投入/repro-tech-meetup
junharashima
0
4.1k
クックパッドと機械学習/uec-aix-seminar
junharashima
0
11k
Featured
See All Featured
Easily Structure & Communicate Ideas using Wireframe
afnizarnur
194
16k
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
sstephenson
162
15k
Testing 201, or: Great Expectations
jmmastey
45
7.7k
Fight the Zombie Pattern Library - RWD Summit 2016
marcelosomers
234
17k
Performance Is Good for Brains [We Love Speed 2024]
tammyeverts
12
1.2k
Facilitating Awesome Meetings
lara
56
6.6k
Six Lessons from altMBA
skipperchong
29
4k
Building an army of robots
kneath
306
46k
Building Applications with DynamoDB
mza
96
6.7k
Intergalactic Javascript Robots from Outer Space
tanoku
273
27k
Helping Users Find Their Own Way: Creating Modern Search Experiences
danielanewman
30
2.9k
Fashionably flexible responsive web design (full day workshop)
malarkey
407
66k
Transcript
DPPLQBEͰֶͿࣗવݴޠॲཧ ݪౡ७
ࣗݾհ ɾݪౡ७ ɹɾॴଐɿݕࡧฤ෦ɺݚڀ։ൃνʔϜ ɹɾݞॻɿΤϯδχΞɺใֶത࢜ ɹɾઐɿࣗવݴޠॲཧ
ߨٛɿࣗવݴޠॲཧΛͬ͘͟Γֶ΅͏
ࣗવݴޠॲཧ ࣗવݴޠΛίϯϐϡʔλͰॲཧ͢ΔͨΊͷֶ ࣗવݴޠࣗવൃੜతʹੜ·ΕͨݴޠʢFHຊޠʣ ਓݴޠਓతʹ࡞ΒΕͨݴޠʢFH$ݴޠʣ
ࣗવݴޠॲཧʹجͮ͘ΞϓϦέʔγϣϯ ɾݕࡧΤϯδϯ ɹɾ(PPHMFɺ:BIPPɺ ɾࣗಈ༁ ɹɾ(PPHMF༁ɺΤΩαΠτ༁ɺ ɾ࣭Ԡ ɹɾ8BUTPOɺ4JSJɺ ɾԾ໊ࣈม ɹɾ(PPHMF*.&ɺ"50,ɺ
جૅղੳ ܗଶૉղੳ ߏจղੳ ݻ༗දݱೝࣝ ֨ղੳ লུরԠղੳ ಉٛදݱೝࣝ ޠٛᐆດੑղফ ஊߏղੳ ୯ޠϨϕϧ
ߏจϨϕϧ จ຺Ϩϕϧ ҙຯϨϕϧ ΞϓϦέʔγϣϯ
ࠓͷτϐοΫ ɾجૅղੳ ɹɾܗଶૉղੳ ɹɾݻ༗දݱೝࣝ ɹɾߏจղੳ ɹɾলུরԠղੳ ɹɾஊߏղੳ ɹɾ֨ղੳ ɹɾಉٛදݱೝࣝ ɹɾޠٛᐆດੑղফ
ɾΞϓϦέʔγϣϯ ɹɾݕࡧΤϯδϯ ɹɾࣗಈ༁ ɹɾ࣭Ԡ ɹɾ͔ͳࣈม
ܗଶૉղੳ ୯ޠͷ۠ΓͱࢺɺݪܗΛࣝผ͢Δॲཧ ଠ ژ ʹ ߦͬͨ ଠژʹߦͬͨ ໊ࢺ ໊ࢺ
ಈࢺ ॿࢺ ॿࢺ c c c c ߦ͘ ղੳ༻ͷࣙॻΛࢀরͯ͠ɺҰ൪ͬͱΒ͍͠ ʢҰ൪ίετͷ૯͕͍ʣ୯ޠྻΛબ͢Δ ଠ ໊ࢺ ژ ໊ࢺ ژ ໊ࢺ ໊ࢺ ࣙॻ ੜىίετ ੜىίετͷ΄͔ʹ୯ޠؒͷ࿈ίετߟྀ
ܗଶૉղੳJODPPLQBE ಲͷʹΜʹ͘ে༉ম͖ ͷ ʹΜʹ͘ ে༉ ໊ࢺ ໊ࢺ ॿࢺ ໊ࢺ c
c c c ম͘ ಲ ম͖ ಈࢺ
ݻ༗දݱೝࣝ จதͷݻ༗දݱʢFHਓ໊ɺ໊ʣΛೝࣝ͢Δॲཧ ଠ ژ ʹ ߦͬͨ ໊ࢺ ໊ࢺ ಈࢺ
ॿࢺ ॿࢺ c c c c ߦ͘ ଠ ژ ʹ ߦͬͨ ਓ໊ ໊ ܇࿅σʔλΛ༻ҙͯ͠ɺͲͷΑ͏ͳ୯ޠྻ͕ ͲͷΑ͏ͳݻ༗දݱʹͳΓ͏Δ͔Λֶश ࣍ژʹߦͬͨɻ Ֆࢠେࡕʹߦͬͨɻ ܇࿅σʔλ ਓ໊ ਓ໊ ໊ ໊ ݻ༗දݱೝࣝث
ಛചใʢళฮ͔Βߘʣ ݻ༗දݱೝࣝ ͨ·Ͷ͗ݸ ԁ ͨ·Ͷ͗υϨογϯά ԁ ͨ·Ͷ͗ɹݸ ໊
ͨ·Ͷ͗ɹυϨογϯά ໊ ʮͨ·Ͷ͗ʯͰొ ʮͨ·Ͷ͗υϨογϯάʯͰొ 0OMJOF Ϣʔβͷۙลͷళฮ͔Β ໊ʮͨ·Ͷ͗ʯΛݕࡧ ݻ༗දݱೝࣝJODPPLQBE
ߏจղੳ จͷߏʢຊޠͰจઅͷ۠ΓͱΓઌʣΛ໌Β͔ʹ͢Δॲཧ ҎԼͷใ͔Βࣝผ ɾจઅલ͔ΒޙΖʹΔ ɾจઅͨͩҰͭͷจઅʹΔ ɾΓड͚ޓ͍ʹަࠩ͠ͳ͍ ɾ࠷͍ۙจઅʹΓ͍͢ ɾ ଠ
ژ ʹ ߦͬͨ ໊ࢺ ໊ࢺ ಈࢺ ॿࢺ ॿࢺ c c c c ߦ͘ ଠ ژʹ ߦͬͨ c c จઅͷ۠ΓΛࣝผ ߦͬͨ ଠ ژʹ จઅͷΓઌΛࣝผ จઅݸҎ্ͷ༰ޠʢFH໊ࢺʣͱݸ Ҏ্ͷଐޠʢFHॿࢺʣ͔ΒͳΔ
লུরԠղੳ রԠࢺ จষதͷಉҰදݱΛಉఆ͢Δॲཧ ઌߦࢺ রԠղੳ লུղੳʢθϩরԠղੳʣ ͔ͬͨ ൴ ਗ਼ਫࣉʹ ·ͣ
ଠ ژʹ ߦͬͨ θϩ໊ࢺ ઌߦࢺ ͔ͬͨ ൴ ਗ਼ਫࣉʹ ·ͣ ଠ ژʹ ߦͬͨ θϩ໊ࢺʢলུ͞ΕͨরԠࢺʣʹؾ͘ͱ͜Ζ͔Β ελʔτ ҎԼͷใ͔Βಉఆ ɾরԠࢺͱઌߦࢺͷੑผಉ͡ ɾઌߦࢺʮʯΛ͍͍͢ ɾরԠࢺͱઌߦࢺͦΕ΄ͲΕͳ͍ ɾ
ߏจղੳBOEলུরԠղੳJODPPLQBE ɾࠓͷͱ͜Ζɺ͍Ͳ͜Ζͳ͠ ɹɾࣗಈ༁ʢޙͰհʣͰ༻͢Δ͔ʁ
୯ޠϨϕϧ ߏจϨϕϧ ίϯϐϡʔλɹʹɹܭࢉػ ίϯϐϡʔλɹʹɹίϯϐϡʔλʔ ܠؾ͕ྫྷ͑Δɹʹɹܠؾ͕Լ͕Δ ಉٛදݱೝࣝ ಉ͡ҙຯΛ࣋ͭදݱΛೝࣝ͢Δॲཧ ্ҟදهಉٛʢಉ͡୯ޠͷදه༳Εʣ ԼҟܗಉٛʢҟͳΔ୯ޠ͕ಉ͡ҙຯʣ ୯ޠϨϕϧͰʮྫྷ͑Δʯ㱠ʮԼ͕Δʯ͕ͩ
ʮܠؾ͕ʯ͕͘ͱಉٛ
ಉٛදݱೝࣝJODPPLQBE
ݕࡧΤϯδϯ ΫΤϦʹؔ࿈͢ΔϦιʔεʢFHจॻʣΛऔಘ͢Δॲཧ ΠϯσΩγϯά సஔΠϯσοΫε ୯ޠ͔ΒจॻͷϚοϐϯά 0⒐JOF 0OMJOF จॻଠژʹߦͬͨ จॻ࣍ژʹߦͬͨ ܗଶૉղੳ
จॻଠccژcʹcߦͬͨ จॻ࣍ccژcʹcߦͬͨ ଠ\^ ࣍\^ ژ\ ^ ΫΤϦʮଠʯ ݕࡧ݁Ռɿจॻ ΫΤϦʮژʯ ݕࡧ݁Ռɿจॻ จॻ
ݕࡧΤϯδϯJODPPLQBE
ࣗಈ༁ ίϯϐϡʔλʹΑΔผͷݴޠͷՁͳจষͷஔ ɿଠژʹߦͬͨ ӳɿ5BSPXFOUUP,ZPUP ܗଶૉղੳɺߏจղੳɺ ݴޠ୯Ґ͝ͱʹ༁ ߦͬͨ ଠ ژʹ 5BSP
UP,ZPUP XFOU MFBWF ࣗવจΛੜ ೖྗจΛಛఆͷݴޠ୯ҐʢFH୯ޠɺ୯ޠྻʣ Ͱදݱ ୯Ґ͝ͱͷީิΛΈ߹ΘͤͯෳͷจΛੜ ͦͷத͔ΒͬͱࣗવͳͷΛग़ྗ ର༁σʔλΛࢀߟʹ༁ީิΛੜʢσʔλ ༧Ίߏங͓ͯ͘͠ʣ
ࣗಈ༁JODPPLQBE 8FBSFIJSJOH
࣮शɿܗଶૉղੳثΛͬͯΈΑ͏
ܗଶૉղੳث +6."/ $IB4FO .F$BC ,Z5FB ػցֶशʢੜϞσϧʣʹΑΔίετௐ
ػցֶशʢࣝผϞσϧʣʹΑΔίετௐ ֶशσʔλͷߏஙΛ༰қʹ ਓखʹΑΔίετௐ
.F$BC ɾݱࡏͷσϑΝΫτ ɹɾߴਫ਼Ͱ͍͍͢ ɾ͍ํ ɹɾ45%*/ʹͭͬ͜Ή͚ͩ NFDBC ଠژʹߦͬͨ&OUFS ଠɹ໊ࢺ ݻ༗໊ࢺ ਓ໊
໊ ଠ λϩ λϩʔ ɹɹॿࢺ ॿࢺ ϋ ϫ ژɹ໊ࢺ ݻ༗໊ࢺ Ҭ Ұൠ ژ Ωϣτ Ωϣʔτ ʹɹɹॿࢺ ֨ॿࢺ Ұൠ ʹ χ χ ߦͬɹಈࢺ ཱࣗ ޒஈɾΧߦଅԻศ ࿈༻λଓ ߦ͘ Πο Πο ͨɹɹॿಈࢺ ಛघɾλ جຊܗ ͨ λ λ &04 ୯ޠͷ۠Γͱࢺɺݪܗ͕͔Δ ؆୯ͳͷͰ͋Εɺݻ༗දݱ͔Δ
࣮शϨγϐΛղੳ͠Α͏ Ϩγϐσʔλʢ ϨγϐͷλΠτϧʣΛऔಘ ɹɾDVSMPSFDJQFUYUlIUUQTYYYzʢ63-4MBDLࢀরʣ ܗଶૉղੳΛ࣮ߦ ɹɾNFDBCSFDJQFUYUʁ
࣮श୯ޠͷΛௐࠪ͠Α͏ ग़ݱසΛܭ ɹɾࢥ͍ࢥ͍ͷํ๏Ͱʂ ॱҐ ୯ޠ ग़ݱස ʁ
ʁ ؆୯ ̇ ࣽ Ϩγϐʹ ճҎ্ ग़ݱ͢Δ୯ޠͱʁ
࣮शδοϓͷ๏ଇΛ؍ଌ͠Α͏ ॱҐͱग़ݱ֬ΛάϥϑԽ ɹɾࢥ͍ࢥ͍ͷํ๏Ͱʂ શମͰL൪ͷग़ݱසΛ࣋ͭཁૉ͕શମʹ ΊΔׂ߹ʢJFग़ݱ֬ʣLʹൺྫ ग़ ݱ ֬ ॱҐ
ʁ
࣮श୯ޠΛొ͠Α͏ ܗଶૉղੳΛ࣮ߦ ɹɾFDIPlΫοΫύουzcNFDBCʁ ࣗ༻ͷࣙॻΛ࡞ ɹɾ୯ޠͷใΛΧϯϚ۠ΓͰొ ࣙॻΛίϯύΠϧ ɹɾVTSMPDBM$FMMBSNFDBCMJCFYFDNFDBCNFDBCEJDUJOEFYE ɹɹVTSMPDBM$FMMBSNFDBCMJCNFDBCEJDJQBEJDVVTFSEJDVTFSDTWGVUGUVUG ܗଶૉղੳΛ࣮ߦ ɹɾFDIPlΫοΫύουzcNFDBCVVTFSEJDʁ
දܗ ݪܗ ಡΈ ൃԻ ίετ ࢺ ΫοΫύου ໊ࢺ ݻ༗໊ࢺ ৫ ΫοΫύου ΫοΫύου ΫοΫύου VTFSDTW
ಠशɿࣗવݴޠॲཧͱྑ͘ͳΖ͏
ؔ࿈ਤॻˍؔ࿈ֶձ ɾؔ࿈ਤॻ ɹɾࣗવݴޠॲཧʢ์ૹେֶڭҭৼڵձʣ ɹɾࣗવݴޠॲཧͷجૅʢίϩφࣾʣ ɹɾݴޠॲཧͷͨΊͷػցֶशೖʢίϩφࣾʣ ɾؔ࿈ֶձ ɹɾݴޠॲཧֶձ ɹɾࣗવݴޠॲཧݚڀձ ɹɾ/-1एखͷձ