Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
日本語の形態素解析
Search
Yumeto Inaoka
January 26, 2017
Technology
510
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
日本語の形態素解析
2017/01/26のB3ゼミで発表
Yumeto Inaoka
January 26, 2017
Transcript
38 slides
ຊޠͷܗଶૉղੳ #θϛ ࣗવݴޠॲཧݚڀࣨɹֶ෦ɹҴԬເਓ
ࢀߟʹͨ͠ॻ੶
ൃද༰ ˗ ܗଶૉղੳͰߦ͏͜ͱ ˗ ୯ޠࣙॻɾ࿈Մೳੑߦྻ ˗ ܗଶૉղੳީิͷྻڍ ˗ ղੳީิ͔Βղͷܾఆ ˗
ະޠͷॲཧ
ܗଶૉղੳ ˗ จΛ୯ޠຖʹ۠Δ ˗ ࢺΛೝࣝ͢Δ ˗ ׆༻Λೝࣝ͢Δ
ܗଶૉղੳ ˗ จΛ୯ޠຖʹ۠Δ ˗ ࢺΛೝࣝ͢Δ ˗ ׆༻Λೝࣝ͢Δ ͓ۚͰങ͑ͳ͍Ձ͕͋Δɻ
ܗଶૉղੳ ˗ จΛ୯ޠຖʹ۠Δ ˗ ࢺΛೝࣝ͢Δ ˗ ׆༻Λೝࣝ͢Δ ͓ ۚ
Ͱ ങ͑ ͳ͍ Ձ ͕ ͋Δ ɻ
ܗଶૉղੳ ˗ จΛ୯ޠຖʹ۠Δ ˗ ࢺΛೝࣝ͢Δ ˗ ׆༻Λೝࣝ͢Δ ͓ ಄ࣙ
ۚ ໊ࢺ Ͱ ॿࢺ ങ͑ ಈࢺ ͳ͍ ॿಈࢺ Ձ ໊ࢺ ͕ ॿࢺ ͋Δ ಈࢺ ɻ ۟
ܗଶૉղੳ ˗ จΛ୯ޠຖʹ۠Δ ˗ ࢺΛೝࣝ͢Δ ˗ ׆༻Λೝࣝ͢Δ ͓ ಄ࣙ
ۚ ໊ࢺ Ͱ ॿࢺ ങ͑ ಈࢺ ԼҰஈະવܗ ͳ͍ ॿಈࢺ ࿈ମܗ Ձ ໊ࢺ ͕ ॿࢺ ͋Δ ಈࢺ ޒஈऴࢭܗ ɻ ۟
୯ޠࣙॻ ୯ޠͷදهɺࢺɺ׆༻ͳͲΛ هड़ͨࣙ͠ॻ දه ࢺ ׆༻ ݩؾ ໊ࢺ ʔ
୫ ໊ࢺ ʔ ͳΔ ಈࢺ ޒஈ ʹ ॿࢺ ʔ ୲͏ ಈࢺ ޒஈ ࠜ ໊ࢺ ʔ ৸Δ ಈࢺ ԼҰஈ Β ඌࣙ ʔ
࿈Մೳੑߦྻ ͲͷΑ͏ͳࢺͷ୯ޠ͕จதͰ࿈ଓ͠ಘΔ͔Λද͢ จ ໊ࢺ ಈࢺ ॿࢺ ඌࣙ จ಄
໊ࢺ ಈࢺ ॿࢺ ඌࣙ
࿈Մೳੑߦྻ ͲͷΑ͏ͳࢺͷ୯ޠ͕จதͰ࿈ଓ͠ಘΔ͔Λද͢ จ ໊ࢺ ಈࢺ ॿࢺ ඌࣙ จ಄
໊ࢺ ಈࢺ ॿࢺ ඌࣙ
࿈Մೳੑߦྻ ͲͷΑ͏ͳࢺͷ୯ޠ͕จதͰ࿈ଓ͠ಘΔ͔Λද͢ จ ໊ࢺ ಈࢺ ॿࢺ ඌࣙ จ಄
໊ࢺ ಈࢺ ॿࢺ ඌࣙ
ܗଶૉղੳީิͷྻڍ จ಄ ͶͨΒݩؾʹͳͬͨ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ Ͷͨ ৸Δ
ಈࢺ ͶͨΒ ৸Δ ಈࢺ ͶͨΒݩؾʹͳͬͨ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ Ͷͨ ৸Δ ಈࢺ ͶͨΒ ৸Δ ಈࢺ ͶͨΒݩؾʹͳͬͨ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ͶͨΒݩؾʹͳͬͨ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ͶͨΒݩؾʹͳͬͨ º จ ໊ࢺ ಈࢺ ॿࢺ ඌࣙ จ಄ ໊ࢺ ಈࢺ ॿࢺ ඌࣙ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ͶͨΒݩؾʹͳͬͨ º
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ͶͨΒݩؾʹͳͬͨ º
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º ͶͨΒݩؾʹͳͬͨ ϥςΟεදݱ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º ͶͨΒݩؾʹͳͬͨ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º ͶͨΒݩؾʹͳͬͨ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º ͶͨΒݩؾʹͳͬͨ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º ͶͨΒݩؾʹͳͬͨ
ղੳީิ͔Βղͷܾఆ ˗ ୯ޠࣙॻɺ࿈Մೳߦྻ͚ͩͰղΛܾఆͰ͖ͳ͍ ˗ ϥςΟεߏίετΛ༩ ˗ ίετͷ࠷͍ީิΛղͱ͢Δʢίετ࠷খ๏ʣ
ϥςΟεߏͷίετͷ༩ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º
ϥςΟεߏͷίετͷ༩ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º
ϥςΟεߏͷίετͷ༩ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º
֤ީิͷίετͷࢉग़ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º
֤ީิͷίετͷࢉग़ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º
֤ީิͷίετͷࢉग़ ˗ ࠜɹ୫ɹݩؾɹʹɹͳͬͨ ˗ ࠜɹ୫ɹݩؾɹ୲ͬͨ ˗ ৸ͨΒɹݩؾɹʹɹͳͬͨ ˗ ৸ͨΒɹݩؾɹ୲ͬͨ
ˠ ˠ ˠ ࠷খ ˠ
࠷খίετͷީิͷ୳ࡧ ˗ ޠኮͷ૿ՃɺೖྗจͷจԽͰީิരൃతʹ૿Ճ ˠશީิͷίετࢉग़࣮࣭ෆՄೳ ˗ ೖྗจΛׂ͠ɺͦΕͧΕͷ݁ՌΛ౷߹ ˠೖྗจͷจԽʹΑΔީิͷ૿ՃΛ͑ΒΕΔ
ϏλϏΞϧΰϦζϜ ˗ ಈతܭը๏ %ZOBNJD1SPHSBNNJOH%1 ͷͻͱͭ ˗ .F$BCɺ$IBTFOͰ࠾༻͞Ε͍ͯΔ ˗ ӳจͷࢺղੳͳͲʹ༻͞Ε͍ͯΔ
ϏλϏΞϧΰϦζϜ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º
ϏλϏΞϧΰϦζϜ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º
ϏλϏΞϧΰϦζϜ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º
ະޠͷॲཧ ˗ จதʹະޠ͕ग़ΔͱϥςΟεߏ͕࡞ΒΕͳ͍ ˠղੳΛߦ͏͜ͱ͕Ͱ͖ͳ͍ ˗ ࣈɾΧλΧφͷ࿈ଓΛҰޠͱ͠ɺߴ͍ίετΛ༩ ˠࣙॻͷޠͷΈͰղऍͰ͖ΔͳΒͦͪΒΛ༻ ˠແཧ͕͋ΔͳΒٖࣅతͳޠΛ༻
ൃදͨ͠༰ ˗ ܗଶૉղੳͰߦ͏͜ͱ ˗ ୯ޠࣙॻɾ࿈Մೳੑߦྻ ˗ ܗଶૉղੳީิͷྻڍ ˗ ղੳީิ͔Βղͷܾఆ ˗
ະޠͷॲཧ
More Decks by Yumeto Inaoka
See All by Yumeto Inaoka
文献紹介: Quantity doesn’t buy quality syntax with neural language models
yumeto
1
230
文献紹介: Open Domain Web Keyphrase Extraction Beyond Language Modeling
yumeto
0
300
文献紹介: Self-Supervised_Neural_Machine_Translation
yumeto
0
200
文献紹介: Comparing and Developing Tools to Measure the Readability of Domain-Specific Texts
yumeto
0
220
文献紹介: PAWS: Paraphrase Adversaries from Word Scrambling
yumeto
0
250
文献紹介: Beyond BLEU: Training Neural Machine Translation with Semantic Similarity
yumeto
0
340
文献紹介: EditNTS: An Neural Programmer-Interpreter Model for Sentence Simplification through Explicit Editing
yumeto
0
440
文献紹介: Decomposable Neural Paraphrase Generation
yumeto
0
260
文献紹介: Analyzing the Limitations of Cross-lingual Word Embedding Mappings
yumeto
0
310
Other Decks in Technology
See All in Technology
エンタープライズIAMについて - ID・権限をどう統制するか
oidfj
1
290
攻撃と守りは何が変わり、何が変わらないのか~最近の不正アクセスから考える、リスク評価と標準の使いどころ
oidfj
2
300
MCPでネットワーク障害調査を自動化する前に直すべき3つのこと
yama3133
1
650
OWASP AI Agentic Top10に準拠するクラウドネイティブなガードレールの実践(CNDW 2026)
keitah
1
420
メール到達性を支える、リンク先URLのドメイン評価の扱い方
wind111
0
190
おうち環境でも「なるべく止めたくない!」 ― おうち環境の機器冗長化の理想と現実
yuutosi
1
640
パスワードのない鍵で、 データを手元に置く
ginjihayashi
0
390
農家は秘伝のタレを知らない - NOBODY KNOWS THE HIDDEN SOURCE - Kaggriculture 3rd Place Solution
masspeaks
3
670
認知の質も文化醸成も。数年取り組んで見えてきた技術広報のKPI設計 / Tech PR KPIs: Lessons on Awareness Quality and Culture After Several Years
bitkey
PRO
0
180
認知負荷の減らし方 ~開発にも日常業務にも活かせるノウハウ~
minorun365
PRO
15
9.6k
NutanixへのSSHアクセスの今後について
shadowhat
0
140
AIエージェントのアーキテクチャ設計
nsatoh
0
450
Featured
See All Featured
Navigating Team Friction
lara
192
16k
The Invisible Side of Design
smashingmag
301
52k
Dealing with People You Can't Stand - Big Design 2015
cassininazir
367
27k
SEOcharity - Dark patterns in SEO and UX: How to avoid them and build a more ethical web
sarafernandez
0
340
実際に使うSQLの書き方 徹底解説 / pgcon21j-tutorial
soudai
PRO
203
77k
How To Speak Unicorn (iThemes Webinar)
marktimemedia
1
640
YesSQL, Process and Tooling at Scale
rocio
174
15k
The Curious Case for Waylosing
cassininazir
1
620
Building an army of robots
kneath
307
47k
SEO in 2025: How to Prepare for the Future of Search
ipullrank
3
3.9k
B2B Lead Gen: Tactics, Traps & Triumph
marketingsoph
1
310
WENDY [Excerpt]
tessaabrams
15
41k