Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
日本語の形態素解析
Search
Yumeto Inaoka
January 26, 2017
Technology
500
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
日本語の形態素解析
2017/01/26のB3ゼミで発表
Yumeto Inaoka
January 26, 2017
More Decks by Yumeto Inaoka
See All by Yumeto Inaoka
文献紹介: Quantity doesn’t buy quality syntax with neural language models
yumeto
1
220
文献紹介: Open Domain Web Keyphrase Extraction Beyond Language Modeling
yumeto
0
290
文献紹介: Self-Supervised_Neural_Machine_Translation
yumeto
0
200
文献紹介: Comparing and Developing Tools to Measure the Readability of Domain-Specific Texts
yumeto
0
210
文献紹介: PAWS: Paraphrase Adversaries from Word Scrambling
yumeto
0
220
文献紹介: Beyond BLEU: Training Neural Machine Translation with Semantic Similarity
yumeto
0
330
文献紹介: EditNTS: An Neural Programmer-Interpreter Model for Sentence Simplification through Explicit Editing
yumeto
0
440
文献紹介: Decomposable Neural Paraphrase Generation
yumeto
0
260
文献紹介: Analyzing the Limitations of Cross-lingual Word Embedding Mappings
yumeto
0
290
Other Decks in Technology
See All in Technology
国家プロジェクトを支える「さくらONE」 大規模LLM開発におけるGPU障害を乗り越えるクラスター運用戦略
gpuunite_official
0
170
関東Kaggler会発表資料
takoi
1
270
도구에서 동료까지: 10년차 AI 스타트업의 AI 적응기
inureyes
PRO
1
300
LLM・AIエージェントシステムベストプラクティス
shibuiwilliam
6
1.6k
会社紹介資料 / Sansan Company Profile
sansan33
PRO
24
430k
ホームラボ紹介
y_sera15
0
220
AI開発に用いられるHPC技術について
gpuunite_official
0
180
社内の7割が使うデータ基盤を、 データチーム2人で回すためにやったこと
koh_yoshi
4
1.5k
What's new in Go 1.27?
ciarana
0
280
Software Supply Chain Attackからクラウド環境を守るためにできること
lhazy
2
290
カートの信頼性を担保するWireMockを使ったe2eテスト
ykagano
0
620
AI時代に、人は何を、どう学ぶのか #pbl_pub / What and How Do We Learn in the AI Era?
takaking22
1
180
Featured
See All Featured
Highjacked: Video Game Concept Design
rkendrick25
PRO
1
440
First, design no harm
axbom
PRO
2
1.3k
The Language of Interfaces
destraynor
162
27k
Mind Mapping
helmedeiros
PRO
1
320
SEO Brein meetup: CTRL+C is not how to scale international SEO
lindahogenes
1
2.8k
Exploring anti-patterns in Rails
aemeredith
3
470
Navigating the moral maze — ethical principles for Al-driven product design
skipperchong
2
490
Intergalactic Javascript Robots from Outer Space
tanoku
273
27k
WENDY [Excerpt]
tessaabrams
11
39k
Optimising Largest Contentful Paint
csswizardry
37
3.9k
Max Prin - Stacking Signals: How International SEO Comes Together (And Falls Apart)
techseoconnect
PRO
0
420
Discover your Explorer Soul
emna__ayadi
2
1.3k
Transcript
ຊޠͷܗଶૉղੳ #θϛ ࣗવݴޠॲཧݚڀࣨɹֶ෦ɹҴԬເਓ
ࢀߟʹͨ͠ॻ੶
ൃද༰ ˗ ܗଶૉղੳͰߦ͏͜ͱ ˗ ୯ޠࣙॻɾ࿈Մೳੑߦྻ ˗ ܗଶૉղੳީิͷྻڍ ˗ ղੳީิ͔Βղͷܾఆ ˗
ະޠͷॲཧ
ܗଶૉղੳ ˗ จΛ୯ޠຖʹ۠Δ ˗ ࢺΛೝࣝ͢Δ ˗ ׆༻Λೝࣝ͢Δ
ܗଶૉղੳ ˗ จΛ୯ޠຖʹ۠Δ ˗ ࢺΛೝࣝ͢Δ ˗ ׆༻Λೝࣝ͢Δ ͓ۚͰങ͑ͳ͍Ձ͕͋Δɻ
ܗଶૉղੳ ˗ จΛ୯ޠຖʹ۠Δ ˗ ࢺΛೝࣝ͢Δ ˗ ׆༻Λೝࣝ͢Δ ͓ ۚ
Ͱ ങ͑ ͳ͍ Ձ ͕ ͋Δ ɻ
ܗଶૉղੳ ˗ จΛ୯ޠຖʹ۠Δ ˗ ࢺΛೝࣝ͢Δ ˗ ׆༻Λೝࣝ͢Δ ͓ ಄ࣙ
ۚ ໊ࢺ Ͱ ॿࢺ ങ͑ ಈࢺ ͳ͍ ॿಈࢺ Ձ ໊ࢺ ͕ ॿࢺ ͋Δ ಈࢺ ɻ ۟
ܗଶૉղੳ ˗ จΛ୯ޠຖʹ۠Δ ˗ ࢺΛೝࣝ͢Δ ˗ ׆༻Λೝࣝ͢Δ ͓ ಄ࣙ
ۚ ໊ࢺ Ͱ ॿࢺ ങ͑ ಈࢺ ԼҰஈະવܗ ͳ͍ ॿಈࢺ ࿈ମܗ Ձ ໊ࢺ ͕ ॿࢺ ͋Δ ಈࢺ ޒஈऴࢭܗ ɻ ۟
୯ޠࣙॻ ୯ޠͷදهɺࢺɺ׆༻ͳͲΛ هड़ͨࣙ͠ॻ දه ࢺ ׆༻ ݩؾ ໊ࢺ ʔ
୫ ໊ࢺ ʔ ͳΔ ಈࢺ ޒஈ ʹ ॿࢺ ʔ ୲͏ ಈࢺ ޒஈ ࠜ ໊ࢺ ʔ ৸Δ ಈࢺ ԼҰஈ Β ඌࣙ ʔ
࿈Մೳੑߦྻ ͲͷΑ͏ͳࢺͷ୯ޠ͕จதͰ࿈ଓ͠ಘΔ͔Λද͢ จ ໊ࢺ ಈࢺ ॿࢺ ඌࣙ จ಄
໊ࢺ ಈࢺ ॿࢺ ඌࣙ
࿈Մೳੑߦྻ ͲͷΑ͏ͳࢺͷ୯ޠ͕จதͰ࿈ଓ͠ಘΔ͔Λද͢ จ ໊ࢺ ಈࢺ ॿࢺ ඌࣙ จ಄
໊ࢺ ಈࢺ ॿࢺ ඌࣙ
࿈Մೳੑߦྻ ͲͷΑ͏ͳࢺͷ୯ޠ͕จதͰ࿈ଓ͠ಘΔ͔Λද͢ จ ໊ࢺ ಈࢺ ॿࢺ ඌࣙ จ಄
໊ࢺ ಈࢺ ॿࢺ ඌࣙ
ܗଶૉղੳީิͷྻڍ จ಄ ͶͨΒݩؾʹͳͬͨ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ Ͷͨ ৸Δ
ಈࢺ ͶͨΒ ৸Δ ಈࢺ ͶͨΒݩؾʹͳͬͨ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ Ͷͨ ৸Δ ಈࢺ ͶͨΒ ৸Δ ಈࢺ ͶͨΒݩؾʹͳͬͨ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ͶͨΒݩؾʹͳͬͨ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ͶͨΒݩؾʹͳͬͨ º จ ໊ࢺ ಈࢺ ॿࢺ ඌࣙ จ಄ ໊ࢺ ಈࢺ ॿࢺ ඌࣙ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ͶͨΒݩؾʹͳͬͨ º
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ͶͨΒݩؾʹͳͬͨ º
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º ͶͨΒݩؾʹͳͬͨ ϥςΟεදݱ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º ͶͨΒݩؾʹͳͬͨ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º ͶͨΒݩؾʹͳͬͨ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º ͶͨΒݩؾʹͳͬͨ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º ͶͨΒݩؾʹͳͬͨ
ղੳީิ͔Βղͷܾఆ ˗ ୯ޠࣙॻɺ࿈Մೳߦྻ͚ͩͰղΛܾఆͰ͖ͳ͍ ˗ ϥςΟεߏίετΛ༩ ˗ ίετͷ࠷͍ީิΛղͱ͢Δʢίετ࠷খ๏ʣ
ϥςΟεߏͷίετͷ༩ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º
ϥςΟεߏͷίετͷ༩ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º
ϥςΟεߏͷίετͷ༩ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º
֤ީิͷίετͷࢉग़ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º
֤ީิͷίετͷࢉग़ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º
֤ީิͷίετͷࢉग़ ˗ ࠜɹ୫ɹݩؾɹʹɹͳͬͨ ˗ ࠜɹ୫ɹݩؾɹ୲ͬͨ ˗ ৸ͨΒɹݩؾɹʹɹͳͬͨ ˗ ৸ͨΒɹݩؾɹ୲ͬͨ
ˠ ˠ ˠ ࠷খ ˠ
࠷খίετͷީิͷ୳ࡧ ˗ ޠኮͷ૿ՃɺೖྗจͷจԽͰީิരൃతʹ૿Ճ ˠશީิͷίετࢉग़࣮࣭ෆՄೳ ˗ ೖྗจΛׂ͠ɺͦΕͧΕͷ݁ՌΛ౷߹ ˠೖྗจͷจԽʹΑΔީิͷ૿ՃΛ͑ΒΕΔ
ϏλϏΞϧΰϦζϜ ˗ ಈతܭը๏ %ZOBNJD1SPHSBNNJOH%1 ͷͻͱͭ ˗ .F$BCɺ$IBTFOͰ࠾༻͞Ε͍ͯΔ ˗ ӳจͷࢺղੳͳͲʹ༻͞Ε͍ͯΔ
ϏλϏΞϧΰϦζϜ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º
ϏλϏΞϧΰϦζϜ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º
ϏλϏΞϧΰϦζϜ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º
ະޠͷॲཧ ˗ จதʹະޠ͕ग़ΔͱϥςΟεߏ͕࡞ΒΕͳ͍ ˠղੳΛߦ͏͜ͱ͕Ͱ͖ͳ͍ ˗ ࣈɾΧλΧφͷ࿈ଓΛҰޠͱ͠ɺߴ͍ίετΛ༩ ˠࣙॻͷޠͷΈͰղऍͰ͖ΔͳΒͦͪΒΛ༻ ˠແཧ͕͋ΔͳΒٖࣅతͳޠΛ༻
ൃදͨ͠༰ ˗ ܗଶૉղੳͰߦ͏͜ͱ ˗ ୯ޠࣙॻɾ࿈Մೳੑߦྻ ˗ ܗଶૉղੳީิͷྻڍ ˗ ղੳީิ͔Βղͷܾఆ ˗
ະޠͷॲཧ