Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
日本語の形態素解析
Search
Yumeto Inaoka
January 26, 2017
Technology
490
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
日本語の形態素解析
2017/01/26のB3ゼミで発表
Yumeto Inaoka
January 26, 2017
More Decks by Yumeto Inaoka
See All by Yumeto Inaoka
文献紹介: Quantity doesn’t buy quality syntax with neural language models
yumeto
1
220
文献紹介: Open Domain Web Keyphrase Extraction Beyond Language Modeling
yumeto
0
290
文献紹介: Self-Supervised_Neural_Machine_Translation
yumeto
0
190
文献紹介: Comparing and Developing Tools to Measure the Readability of Domain-Specific Texts
yumeto
0
210
文献紹介: PAWS: Paraphrase Adversaries from Word Scrambling
yumeto
0
210
文献紹介: Beyond BLEU: Training Neural Machine Translation with Semantic Similarity
yumeto
0
320
文献紹介: EditNTS: An Neural Programmer-Interpreter Model for Sentence Simplification through Explicit Editing
yumeto
0
430
文献紹介: Decomposable Neural Paraphrase Generation
yumeto
0
250
文献紹介: Analyzing the Limitations of Cross-lingual Word Embedding Mappings
yumeto
0
280
Other Decks in Technology
See All in Technology
複数プロダクト組織のAIネイティブ化における戦略 / AICon2026_kude
rakus_dev
0
260
AIと1000本ノックしてたどり着いた、最速のプロダクト開発 ~toC向けAIエージェントUXを、動く選択肢とAIキャパシティで設計する~
lycorptech_jp
PRO
1
100
インシデント事例と パッケージの全量解析に学ぶ ソフトウェアサプライチェーンの守り方 / supply-chain-attack-defense
flatt_security
0
560
SoccerMaster: A Vision Foundation Model for Soccer Understanding
kzykmyzw
0
150
ボーイスカウトルールでメモリやスキルを改善しよう
azukiazusa1
4
1.5k
タスクの複雑さでモデルを選ぶ ── Thompson Samplingで動かす“トークン/コスト最適化
satohy0323
0
600
SREとQA 二人三脚で進めるSLO運用/sre-qa-slo
sugitak
0
1.1k
「最後に責任を取るのはチーム」— 人間のPRレビューを最小化してアップデートしたメンタルモデル
jnishime_dresscode
0
970
Type-safe IaC for Dart
coborinai
0
170
AIが当たり前の組織で エンジニアはどう育つか
nishihira
1
560
キャリアLT会#3
beli68
0
170
誤解だらけの開発生産性 / Myths and Misconceptions about Developer Productivity
i35_267
2
930
Featured
See All Featured
The Anti-SEO Checklist Checklist. Pubcon Cyber Week
ryanjones
0
190
Stop Working from a Prison Cell
hatefulcrawdad
274
21k
Visual Storytelling: How to be a Superhuman Communicator
reverentgeek
2
590
Put a Button on it: Removing Barriers to Going Fast.
kastner
60
4.4k
Designing for humans not robots
tammielis
254
26k
No one is an island. Learnings from fostering a developers community.
thoeni
21
3.8k
GraphQLの誤解/rethinking-graphql
sonatard
75
12k
SEO in 2025: How to Prepare for the Future of Search
ipullrank
3
3.6k
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
kevinliebholz
37
6.5k
How to Grow Your eCommerce with AI & Automation
katarinadahlin
PRO
1
230
Darren the Foodie - Storyboard
khoart
PRO
3
3.4k
The Curious Case for Waylosing
cassininazir
1
430
Transcript
ຊޠͷܗଶૉղੳ #θϛ ࣗવݴޠॲཧݚڀࣨɹֶ෦ɹҴԬເਓ
ࢀߟʹͨ͠ॻ੶
ൃද༰ ˗ ܗଶૉղੳͰߦ͏͜ͱ ˗ ୯ޠࣙॻɾ࿈Մೳੑߦྻ ˗ ܗଶૉղੳީิͷྻڍ ˗ ղੳީิ͔Βղͷܾఆ ˗
ະޠͷॲཧ
ܗଶૉղੳ ˗ จΛ୯ޠຖʹ۠Δ ˗ ࢺΛೝࣝ͢Δ ˗ ׆༻Λೝࣝ͢Δ
ܗଶૉղੳ ˗ จΛ୯ޠຖʹ۠Δ ˗ ࢺΛೝࣝ͢Δ ˗ ׆༻Λೝࣝ͢Δ ͓ۚͰങ͑ͳ͍Ձ͕͋Δɻ
ܗଶૉղੳ ˗ จΛ୯ޠຖʹ۠Δ ˗ ࢺΛೝࣝ͢Δ ˗ ׆༻Λೝࣝ͢Δ ͓ ۚ
Ͱ ങ͑ ͳ͍ Ձ ͕ ͋Δ ɻ
ܗଶૉղੳ ˗ จΛ୯ޠຖʹ۠Δ ˗ ࢺΛೝࣝ͢Δ ˗ ׆༻Λೝࣝ͢Δ ͓ ಄ࣙ
ۚ ໊ࢺ Ͱ ॿࢺ ങ͑ ಈࢺ ͳ͍ ॿಈࢺ Ձ ໊ࢺ ͕ ॿࢺ ͋Δ ಈࢺ ɻ ۟
ܗଶૉղੳ ˗ จΛ୯ޠຖʹ۠Δ ˗ ࢺΛೝࣝ͢Δ ˗ ׆༻Λೝࣝ͢Δ ͓ ಄ࣙ
ۚ ໊ࢺ Ͱ ॿࢺ ങ͑ ಈࢺ ԼҰஈະવܗ ͳ͍ ॿಈࢺ ࿈ମܗ Ձ ໊ࢺ ͕ ॿࢺ ͋Δ ಈࢺ ޒஈऴࢭܗ ɻ ۟
୯ޠࣙॻ ୯ޠͷදهɺࢺɺ׆༻ͳͲΛ هड़ͨࣙ͠ॻ දه ࢺ ׆༻ ݩؾ ໊ࢺ ʔ
୫ ໊ࢺ ʔ ͳΔ ಈࢺ ޒஈ ʹ ॿࢺ ʔ ୲͏ ಈࢺ ޒஈ ࠜ ໊ࢺ ʔ ৸Δ ಈࢺ ԼҰஈ Β ඌࣙ ʔ
࿈Մೳੑߦྻ ͲͷΑ͏ͳࢺͷ୯ޠ͕จதͰ࿈ଓ͠ಘΔ͔Λද͢ จ ໊ࢺ ಈࢺ ॿࢺ ඌࣙ จ಄
໊ࢺ ಈࢺ ॿࢺ ඌࣙ
࿈Մೳੑߦྻ ͲͷΑ͏ͳࢺͷ୯ޠ͕จதͰ࿈ଓ͠ಘΔ͔Λද͢ จ ໊ࢺ ಈࢺ ॿࢺ ඌࣙ จ಄
໊ࢺ ಈࢺ ॿࢺ ඌࣙ
࿈Մೳੑߦྻ ͲͷΑ͏ͳࢺͷ୯ޠ͕จதͰ࿈ଓ͠ಘΔ͔Λද͢ จ ໊ࢺ ಈࢺ ॿࢺ ඌࣙ จ಄
໊ࢺ ಈࢺ ॿࢺ ඌࣙ
ܗଶૉղੳީิͷྻڍ จ಄ ͶͨΒݩؾʹͳͬͨ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ Ͷͨ ৸Δ
ಈࢺ ͶͨΒ ৸Δ ಈࢺ ͶͨΒݩؾʹͳͬͨ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ Ͷͨ ৸Δ ಈࢺ ͶͨΒ ৸Δ ಈࢺ ͶͨΒݩؾʹͳͬͨ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ͶͨΒݩؾʹͳͬͨ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ͶͨΒݩؾʹͳͬͨ º จ ໊ࢺ ಈࢺ ॿࢺ ඌࣙ จ಄ ໊ࢺ ಈࢺ ॿࢺ ඌࣙ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ͶͨΒݩؾʹͳͬͨ º
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ͶͨΒݩؾʹͳͬͨ º
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º ͶͨΒݩؾʹͳͬͨ ϥςΟεදݱ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º ͶͨΒݩؾʹͳͬͨ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º ͶͨΒݩؾʹͳͬͨ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º ͶͨΒݩؾʹͳͬͨ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º ͶͨΒݩؾʹͳͬͨ
ղੳީิ͔Βղͷܾఆ ˗ ୯ޠࣙॻɺ࿈Մೳߦྻ͚ͩͰղΛܾఆͰ͖ͳ͍ ˗ ϥςΟεߏίετΛ༩ ˗ ίετͷ࠷͍ީิΛղͱ͢Δʢίετ࠷খ๏ʣ
ϥςΟεߏͷίετͷ༩ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º
ϥςΟεߏͷίετͷ༩ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º
ϥςΟεߏͷίετͷ༩ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º
֤ީิͷίετͷࢉग़ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º
֤ީิͷίετͷࢉग़ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º
֤ީิͷίετͷࢉग़ ˗ ࠜɹ୫ɹݩؾɹʹɹͳͬͨ ˗ ࠜɹ୫ɹݩؾɹ୲ͬͨ ˗ ৸ͨΒɹݩؾɹʹɹͳͬͨ ˗ ৸ͨΒɹݩؾɹ୲ͬͨ
ˠ ˠ ˠ ࠷খ ˠ
࠷খίετͷީิͷ୳ࡧ ˗ ޠኮͷ૿ՃɺೖྗจͷจԽͰީิരൃతʹ૿Ճ ˠશީิͷίετࢉग़࣮࣭ෆՄೳ ˗ ೖྗจΛׂ͠ɺͦΕͧΕͷ݁ՌΛ౷߹ ˠೖྗจͷจԽʹΑΔީิͷ૿ՃΛ͑ΒΕΔ
ϏλϏΞϧΰϦζϜ ˗ ಈతܭը๏ %ZOBNJD1SPHSBNNJOH%1 ͷͻͱͭ ˗ .F$BCɺ$IBTFOͰ࠾༻͞Ε͍ͯΔ ˗ ӳจͷࢺղੳͳͲʹ༻͞Ε͍ͯΔ
ϏλϏΞϧΰϦζϜ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º
ϏλϏΞϧΰϦζϜ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º
ϏλϏΞϧΰϦζϜ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º
ະޠͷॲཧ ˗ จதʹະޠ͕ग़ΔͱϥςΟεߏ͕࡞ΒΕͳ͍ ˠղੳΛߦ͏͜ͱ͕Ͱ͖ͳ͍ ˗ ࣈɾΧλΧφͷ࿈ଓΛҰޠͱ͠ɺߴ͍ίετΛ༩ ˠࣙॻͷޠͷΈͰղऍͰ͖ΔͳΒͦͪΒΛ༻ ˠແཧ͕͋ΔͳΒٖࣅతͳޠΛ༻
ൃදͨ͠༰ ˗ ܗଶૉղੳͰߦ͏͜ͱ ˗ ୯ޠࣙॻɾ࿈Մೳੑߦྻ ˗ ܗଶૉղੳީิͷྻڍ ˗ ղੳީิ͔Βղͷܾఆ ˗
ະޠͷॲཧ