Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
cookpad で学ぶ自然言語処理/internship2015
Search
j.harashima
August 26, 2015
4
36k
cookpad で学ぶ自然言語処理/internship2015
Summer Internship 2015 で使用した資料です。
https://recruit.cookpad.com/internship/summer2015-engineer/
j.harashima
August 26, 2015
Tweet
Share
More Decks by j.harashima
See All by j.harashima
日本語レシピデータセットの継続的な構築と複合的な利用/JED2022
junharashima
0
11k
自然言語処理の基礎と応用 〜 料理と医療を題材として 〜 /JADI2021
junharashima
0
4.5k
企業での研究開発の楽しさと苦労/WAP-Tech-Talk
junharashima
1
10k
クックパッドにおける研究開発/HCG2020
junharashima
0
3.8k
Calorie Estimation in a Real-World Recipe Service/iaai-20
junharashima
0
14k
クックパッドと機械学習(短縮版)/MLTBP
junharashima
0
8.5k
クックパッドと NLP/CV/nlpaper-challenge
junharashima
0
94
AI 部門の実戦投入/repro-tech-meetup
junharashima
0
3.8k
クックパッドと機械学習/uec-aix-seminar
junharashima
0
11k
Featured
See All Featured
Templates, Plugins, & Blocks: Oh My! Creating the theme that thinks of everything
marktimemedia
30
2.3k
Practical Tips for Bootstrapping Information Extraction Pipelines
honnibal
PRO
19
1.2k
Done Done
chrislema
184
16k
Testing 201, or: Great Expectations
jmmastey
42
7.5k
Optimising Largest Contentful Paint
csswizardry
37
3.2k
The Straight Up "How To Draw Better" Workshop
denniskardys
233
140k
Evolution of real-time – Irina Nazarova, EuRuKo, 2024
irinanazarova
8
680
4 Signs Your Business is Dying
shpigford
183
22k
Building an army of robots
kneath
305
45k
[RailsConf 2023] Rails as a piece of cake
palkan
54
5.5k
Scaling GitHub
holman
459
140k
Dealing with People You Can't Stand - Big Design 2015
cassininazir
367
26k
Transcript
DPPLQBEͰֶͿࣗવݴޠॲཧ ݪౡ७
ࣗݾհ ɾݪౡ७ ɹɾॴଐɿݕࡧฤ෦ɺݚڀ։ൃνʔϜ ɹɾݞॻɿΤϯδχΞɺใֶത࢜ ɹɾઐɿࣗવݴޠॲཧ
ߨٛɿࣗવݴޠॲཧΛͬ͘͟Γֶ΅͏
ࣗવݴޠॲཧ ࣗવݴޠΛίϯϐϡʔλͰॲཧ͢ΔͨΊͷֶ ࣗવݴޠࣗવൃੜతʹੜ·ΕͨݴޠʢFHຊޠʣ ਓݴޠਓతʹ࡞ΒΕͨݴޠʢFH$ݴޠʣ
ࣗવݴޠॲཧʹجͮ͘ΞϓϦέʔγϣϯ ɾݕࡧΤϯδϯ ɹɾ(PPHMFɺ:BIPPɺ ɾࣗಈ༁ ɹɾ(PPHMF༁ɺΤΩαΠτ༁ɺ ɾ࣭Ԡ ɹɾ8BUTPOɺ4JSJɺ ɾԾ໊ࣈม ɹɾ(PPHMF*.&ɺ"50,ɺ
جૅղੳ ܗଶૉղੳ ߏจղੳ ݻ༗දݱೝࣝ ֨ղੳ লུরԠղੳ ಉٛදݱೝࣝ ޠٛᐆດੑղফ ஊߏղੳ ୯ޠϨϕϧ
ߏจϨϕϧ จ຺Ϩϕϧ ҙຯϨϕϧ ΞϓϦέʔγϣϯ
ࠓͷτϐοΫ ɾجૅղੳ ɹɾܗଶૉղੳ ɹɾݻ༗දݱೝࣝ ɹɾߏจղੳ ɹɾলུরԠղੳ ɹɾஊߏղੳ ɹɾ֨ղੳ ɹɾಉٛදݱೝࣝ ɹɾޠٛᐆດੑղফ
ɾΞϓϦέʔγϣϯ ɹɾݕࡧΤϯδϯ ɹɾࣗಈ༁ ɹɾ࣭Ԡ ɹɾ͔ͳࣈม
ܗଶૉղੳ ୯ޠͷ۠ΓͱࢺɺݪܗΛࣝผ͢Δॲཧ ଠ ژ ʹ ߦͬͨ ଠژʹߦͬͨ ໊ࢺ ໊ࢺ
ಈࢺ ॿࢺ ॿࢺ c c c c ߦ͘ ղੳ༻ͷࣙॻΛࢀরͯ͠ɺҰ൪ͬͱΒ͍͠ ʢҰ൪ίετͷ૯͕͍ʣ୯ޠྻΛબ͢Δ ଠ ໊ࢺ ژ ໊ࢺ ژ ໊ࢺ ໊ࢺ ࣙॻ ੜىίετ ੜىίετͷ΄͔ʹ୯ޠؒͷ࿈ίετߟྀ
ܗଶૉղੳJODPPLQBE ಲͷʹΜʹ͘ে༉ম͖ ͷ ʹΜʹ͘ ে༉ ໊ࢺ ໊ࢺ ॿࢺ ໊ࢺ c
c c c ম͘ ಲ ম͖ ಈࢺ
ݻ༗දݱೝࣝ จதͷݻ༗දݱʢFHਓ໊ɺ໊ʣΛೝࣝ͢Δॲཧ ଠ ژ ʹ ߦͬͨ ໊ࢺ ໊ࢺ ಈࢺ
ॿࢺ ॿࢺ c c c c ߦ͘ ଠ ژ ʹ ߦͬͨ ਓ໊ ໊ ܇࿅σʔλΛ༻ҙͯ͠ɺͲͷΑ͏ͳ୯ޠྻ͕ ͲͷΑ͏ͳݻ༗දݱʹͳΓ͏Δ͔Λֶश ࣍ژʹߦͬͨɻ Ֆࢠେࡕʹߦͬͨɻ ܇࿅σʔλ ਓ໊ ਓ໊ ໊ ໊ ݻ༗දݱೝࣝث
ಛചใʢళฮ͔Βߘʣ ݻ༗දݱೝࣝ ͨ·Ͷ͗ݸ ԁ ͨ·Ͷ͗υϨογϯά ԁ ͨ·Ͷ͗ɹݸ ໊
ͨ·Ͷ͗ɹυϨογϯά ໊ ʮͨ·Ͷ͗ʯͰొ ʮͨ·Ͷ͗υϨογϯάʯͰొ 0OMJOF Ϣʔβͷۙลͷళฮ͔Β ໊ʮͨ·Ͷ͗ʯΛݕࡧ ݻ༗දݱೝࣝJODPPLQBE
ߏจղੳ จͷߏʢຊޠͰจઅͷ۠ΓͱΓઌʣΛ໌Β͔ʹ͢Δॲཧ ҎԼͷใ͔Βࣝผ ɾจઅલ͔ΒޙΖʹΔ ɾจઅͨͩҰͭͷจઅʹΔ ɾΓड͚ޓ͍ʹަࠩ͠ͳ͍ ɾ࠷͍ۙจઅʹΓ͍͢ ɾ ଠ
ژ ʹ ߦͬͨ ໊ࢺ ໊ࢺ ಈࢺ ॿࢺ ॿࢺ c c c c ߦ͘ ଠ ژʹ ߦͬͨ c c จઅͷ۠ΓΛࣝผ ߦͬͨ ଠ ژʹ จઅͷΓઌΛࣝผ จઅݸҎ্ͷ༰ޠʢFH໊ࢺʣͱݸ Ҏ্ͷଐޠʢFHॿࢺʣ͔ΒͳΔ
লུরԠղੳ রԠࢺ จষதͷಉҰදݱΛಉఆ͢Δॲཧ ઌߦࢺ রԠղੳ লུղੳʢθϩরԠղੳʣ ͔ͬͨ ൴ ਗ਼ਫࣉʹ ·ͣ
ଠ ژʹ ߦͬͨ θϩ໊ࢺ ઌߦࢺ ͔ͬͨ ൴ ਗ਼ਫࣉʹ ·ͣ ଠ ژʹ ߦͬͨ θϩ໊ࢺʢলུ͞ΕͨরԠࢺʣʹؾ͘ͱ͜Ζ͔Β ελʔτ ҎԼͷใ͔Βಉఆ ɾরԠࢺͱઌߦࢺͷੑผಉ͡ ɾઌߦࢺʮʯΛ͍͍͢ ɾরԠࢺͱઌߦࢺͦΕ΄ͲΕͳ͍ ɾ
ߏจղੳBOEলུরԠղੳJODPPLQBE ɾࠓͷͱ͜Ζɺ͍Ͳ͜Ζͳ͠ ɹɾࣗಈ༁ʢޙͰհʣͰ༻͢Δ͔ʁ
୯ޠϨϕϧ ߏจϨϕϧ ίϯϐϡʔλɹʹɹܭࢉػ ίϯϐϡʔλɹʹɹίϯϐϡʔλʔ ܠؾ͕ྫྷ͑Δɹʹɹܠؾ͕Լ͕Δ ಉٛදݱೝࣝ ಉ͡ҙຯΛ࣋ͭදݱΛೝࣝ͢Δॲཧ ্ҟදهಉٛʢಉ͡୯ޠͷදه༳Εʣ ԼҟܗಉٛʢҟͳΔ୯ޠ͕ಉ͡ҙຯʣ ୯ޠϨϕϧͰʮྫྷ͑Δʯ㱠ʮԼ͕Δʯ͕ͩ
ʮܠؾ͕ʯ͕͘ͱಉٛ
ಉٛදݱೝࣝJODPPLQBE
ݕࡧΤϯδϯ ΫΤϦʹؔ࿈͢ΔϦιʔεʢFHจॻʣΛऔಘ͢Δॲཧ ΠϯσΩγϯά సஔΠϯσοΫε ୯ޠ͔ΒจॻͷϚοϐϯά 0⒐JOF 0OMJOF จॻଠژʹߦͬͨ จॻ࣍ژʹߦͬͨ ܗଶૉղੳ
จॻଠccژcʹcߦͬͨ จॻ࣍ccژcʹcߦͬͨ ଠ\^ ࣍\^ ژ\ ^ ΫΤϦʮଠʯ ݕࡧ݁Ռɿจॻ ΫΤϦʮژʯ ݕࡧ݁Ռɿจॻ จॻ
ݕࡧΤϯδϯJODPPLQBE
ࣗಈ༁ ίϯϐϡʔλʹΑΔผͷݴޠͷՁͳจষͷஔ ɿଠژʹߦͬͨ ӳɿ5BSPXFOUUP,ZPUP ܗଶૉղੳɺߏจղੳɺ ݴޠ୯Ґ͝ͱʹ༁ ߦͬͨ ଠ ژʹ 5BSP
UP,ZPUP XFOU MFBWF ࣗવจΛੜ ೖྗจΛಛఆͷݴޠ୯ҐʢFH୯ޠɺ୯ޠྻʣ Ͱදݱ ୯Ґ͝ͱͷީิΛΈ߹ΘͤͯෳͷจΛੜ ͦͷத͔ΒͬͱࣗવͳͷΛग़ྗ ର༁σʔλΛࢀߟʹ༁ީิΛੜʢσʔλ ༧Ίߏங͓ͯ͘͠ʣ
ࣗಈ༁JODPPLQBE 8FBSFIJSJOH
࣮शɿܗଶૉղੳثΛͬͯΈΑ͏
ܗଶૉղੳث +6."/ $IB4FO .F$BC ,Z5FB ػցֶशʢੜϞσϧʣʹΑΔίετௐ
ػցֶशʢࣝผϞσϧʣʹΑΔίετௐ ֶशσʔλͷߏஙΛ༰қʹ ਓखʹΑΔίετௐ
.F$BC ɾݱࡏͷσϑΝΫτ ɹɾߴਫ਼Ͱ͍͍͢ ɾ͍ํ ɹɾ45%*/ʹͭͬ͜Ή͚ͩ NFDBC ଠژʹߦͬͨ&OUFS ଠɹ໊ࢺ ݻ༗໊ࢺ ਓ໊
໊ ଠ λϩ λϩʔ ɹɹॿࢺ ॿࢺ ϋ ϫ ژɹ໊ࢺ ݻ༗໊ࢺ Ҭ Ұൠ ژ Ωϣτ Ωϣʔτ ʹɹɹॿࢺ ֨ॿࢺ Ұൠ ʹ χ χ ߦͬɹಈࢺ ཱࣗ ޒஈɾΧߦଅԻศ ࿈༻λଓ ߦ͘ Πο Πο ͨɹɹॿಈࢺ ಛघɾλ جຊܗ ͨ λ λ &04 ୯ޠͷ۠Γͱࢺɺݪܗ͕͔Δ ؆୯ͳͷͰ͋Εɺݻ༗දݱ͔Δ
࣮शϨγϐΛղੳ͠Α͏ Ϩγϐσʔλʢ ϨγϐͷλΠτϧʣΛऔಘ ɹɾDVSMPSFDJQFUYUlIUUQTYYYzʢ63-4MBDLࢀরʣ ܗଶૉղੳΛ࣮ߦ ɹɾNFDBCSFDJQFUYUʁ
࣮श୯ޠͷΛௐࠪ͠Α͏ ग़ݱසΛܭ ɹɾࢥ͍ࢥ͍ͷํ๏Ͱʂ ॱҐ ୯ޠ ग़ݱස ʁ
ʁ ؆୯ ̇ ࣽ Ϩγϐʹ ճҎ্ ग़ݱ͢Δ୯ޠͱʁ
࣮शδοϓͷ๏ଇΛ؍ଌ͠Α͏ ॱҐͱग़ݱ֬ΛάϥϑԽ ɹɾࢥ͍ࢥ͍ͷํ๏Ͱʂ શମͰL൪ͷग़ݱසΛ࣋ͭཁૉ͕શମʹ ΊΔׂ߹ʢJFग़ݱ֬ʣLʹൺྫ ग़ ݱ ֬ ॱҐ
ʁ
࣮श୯ޠΛొ͠Α͏ ܗଶૉղੳΛ࣮ߦ ɹɾFDIPlΫοΫύουzcNFDBCʁ ࣗ༻ͷࣙॻΛ࡞ ɹɾ୯ޠͷใΛΧϯϚ۠ΓͰొ ࣙॻΛίϯύΠϧ ɹɾVTSMPDBM$FMMBSNFDBCMJCFYFDNFDBCNFDBCEJDUJOEFYE ɹɹVTSMPDBM$FMMBSNFDBCMJCNFDBCEJDJQBEJDVVTFSEJDVTFSDTWGVUGUVUG ܗଶૉղੳΛ࣮ߦ ɹɾFDIPlΫοΫύουzcNFDBCVVTFSEJDʁ
දܗ ݪܗ ಡΈ ൃԻ ίετ ࢺ ΫοΫύου ໊ࢺ ݻ༗໊ࢺ ৫ ΫοΫύου ΫοΫύου ΫοΫύου VTFSDTW
ಠशɿࣗવݴޠॲཧͱྑ͘ͳΖ͏
ؔ࿈ਤॻˍؔ࿈ֶձ ɾؔ࿈ਤॻ ɹɾࣗવݴޠॲཧʢ์ૹେֶڭҭৼڵձʣ ɹɾࣗવݴޠॲཧͷجૅʢίϩφࣾʣ ɹɾݴޠॲཧͷͨΊͷػցֶशೖʢίϩφࣾʣ ɾؔ࿈ֶձ ɹɾݴޠॲཧֶձ ɹɾࣗવݴޠॲཧݚڀձ ɹɾ/-1एखͷձ