Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
日本語の形態素解析
Search
Yumeto Inaoka
January 26, 2017
Technology
0
430
日本語の形態素解析
2017/01/26のB3ゼミで発表
Yumeto Inaoka
January 26, 2017
Tweet
Share
More Decks by Yumeto Inaoka
See All by Yumeto Inaoka
文献紹介: Quantity doesn’t buy quality syntax with neural language models
yumeto
1
130
文献紹介: Open Domain Web Keyphrase Extraction Beyond Language Modeling
yumeto
0
170
文献紹介: Self-Supervised_Neural_Machine_Translation
yumeto
0
120
文献紹介: Comparing and Developing Tools to Measure the Readability of Domain-Specific Texts
yumeto
0
120
文献紹介: PAWS: Paraphrase Adversaries from Word Scrambling
yumeto
0
93
文献紹介: Beyond BLEU: Training Neural Machine Translation with Semantic Similarity
yumeto
0
210
文献紹介: EditNTS: An Neural Programmer-Interpreter Model for Sentence Simplification through Explicit Editing
yumeto
0
270
文献紹介: Decomposable Neural Paraphrase Generation
yumeto
0
180
文献紹介: Analyzing the Limitations of Cross-lingual Word Embedding Mappings
yumeto
0
180
Other Decks in Technology
See All in Technology
The Rise of LLMOps
asei
7
1.6k
AIチャットボット開発への生成AI活用
ryomrt
0
170
【Pycon mini 東海 2024】Google Colaboratoryで試すVLM
kazuhitotakahashi
2
510
CysharpのOSS群から見るModern C#の現在地
neuecc
2
3.4k
Terraform CI/CD パイプラインにおける AWS CodeCommit の代替手段
hiyanger
1
240
SSMRunbook作成の勘所_20241120
koichiotomo
2
150
信頼性に挑む中で拡張できる・得られる1人のスキルセットとは?
ken5scal
2
530
マルチモーダル / AI Agent / LLMOps 3つの技術トレンドで理解するLLMの今後の展望
hirosatogamo
37
12k
Lexical Analysis
shigashiyama
1
150
SREによる隣接領域への越境とその先の信頼性
shonansurvivors
2
520
Engineer Career Talk
lycorp_recruit_jp
0
170
EventHub Startup CTO of the year 2024 ピッチ資料
eventhub
0
120
Featured
See All Featured
The Cost Of JavaScript in 2023
addyosmani
45
6.8k
Large-scale JavaScript Application Architecture
addyosmani
510
110k
Building Better People: How to give real-time feedback that sticks.
wjessup
364
19k
For a Future-Friendly Web
brad_frost
175
9.4k
How to train your dragon (web standard)
notwaldorf
88
5.7k
What's new in Ruby 2.0
geeforr
343
31k
Designing Experiences People Love
moore
138
23k
Navigating Team Friction
lara
183
14k
A Philosophy of Restraint
colly
203
16k
Testing 201, or: Great Expectations
jmmastey
38
7.1k
Adopting Sorbet at Scale
ufuk
73
9.1k
Gamification - CAS2011
davidbonilla
80
5k
Transcript
ຊޠͷܗଶૉղੳ #θϛ ࣗવݴޠॲཧݚڀࣨɹֶ෦ɹҴԬເਓ
ࢀߟʹͨ͠ॻ੶
ൃද༰ ˗ ܗଶૉղੳͰߦ͏͜ͱ ˗ ୯ޠࣙॻɾ࿈Մೳੑߦྻ ˗ ܗଶૉղੳީิͷྻڍ ˗ ղੳީิ͔Βղͷܾఆ ˗
ະޠͷॲཧ
ܗଶૉղੳ ˗ จΛ୯ޠຖʹ۠Δ ˗ ࢺΛೝࣝ͢Δ ˗ ׆༻Λೝࣝ͢Δ
ܗଶૉղੳ ˗ จΛ୯ޠຖʹ۠Δ ˗ ࢺΛೝࣝ͢Δ ˗ ׆༻Λೝࣝ͢Δ ͓ۚͰങ͑ͳ͍Ձ͕͋Δɻ
ܗଶૉղੳ ˗ จΛ୯ޠຖʹ۠Δ ˗ ࢺΛೝࣝ͢Δ ˗ ׆༻Λೝࣝ͢Δ ͓ ۚ
Ͱ ങ͑ ͳ͍ Ձ ͕ ͋Δ ɻ
ܗଶૉղੳ ˗ จΛ୯ޠຖʹ۠Δ ˗ ࢺΛೝࣝ͢Δ ˗ ׆༻Λೝࣝ͢Δ ͓ ಄ࣙ
ۚ ໊ࢺ Ͱ ॿࢺ ങ͑ ಈࢺ ͳ͍ ॿಈࢺ Ձ ໊ࢺ ͕ ॿࢺ ͋Δ ಈࢺ ɻ ۟
ܗଶૉղੳ ˗ จΛ୯ޠຖʹ۠Δ ˗ ࢺΛೝࣝ͢Δ ˗ ׆༻Λೝࣝ͢Δ ͓ ಄ࣙ
ۚ ໊ࢺ Ͱ ॿࢺ ങ͑ ಈࢺ ԼҰஈະવܗ ͳ͍ ॿಈࢺ ࿈ମܗ Ձ ໊ࢺ ͕ ॿࢺ ͋Δ ಈࢺ ޒஈऴࢭܗ ɻ ۟
୯ޠࣙॻ ୯ޠͷදهɺࢺɺ׆༻ͳͲΛ هड़ͨࣙ͠ॻ දه ࢺ ׆༻ ݩؾ ໊ࢺ ʔ
୫ ໊ࢺ ʔ ͳΔ ಈࢺ ޒஈ ʹ ॿࢺ ʔ ୲͏ ಈࢺ ޒஈ ࠜ ໊ࢺ ʔ ৸Δ ಈࢺ ԼҰஈ Β ඌࣙ ʔ
࿈Մೳੑߦྻ ͲͷΑ͏ͳࢺͷ୯ޠ͕จதͰ࿈ଓ͠ಘΔ͔Λද͢ จ ໊ࢺ ಈࢺ ॿࢺ ඌࣙ จ಄
໊ࢺ ಈࢺ ॿࢺ ඌࣙ
࿈Մೳੑߦྻ ͲͷΑ͏ͳࢺͷ୯ޠ͕จதͰ࿈ଓ͠ಘΔ͔Λද͢ จ ໊ࢺ ಈࢺ ॿࢺ ඌࣙ จ಄
໊ࢺ ಈࢺ ॿࢺ ඌࣙ
࿈Մೳੑߦྻ ͲͷΑ͏ͳࢺͷ୯ޠ͕จதͰ࿈ଓ͠ಘΔ͔Λද͢ จ ໊ࢺ ಈࢺ ॿࢺ ඌࣙ จ಄
໊ࢺ ಈࢺ ॿࢺ ඌࣙ
ܗଶૉղੳީิͷྻڍ จ಄ ͶͨΒݩؾʹͳͬͨ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ Ͷͨ ৸Δ
ಈࢺ ͶͨΒ ৸Δ ಈࢺ ͶͨΒݩؾʹͳͬͨ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ Ͷͨ ৸Δ ಈࢺ ͶͨΒ ৸Δ ಈࢺ ͶͨΒݩؾʹͳͬͨ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ͶͨΒݩؾʹͳͬͨ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ͶͨΒݩؾʹͳͬͨ º จ ໊ࢺ ಈࢺ ॿࢺ ඌࣙ จ಄ ໊ࢺ ಈࢺ ॿࢺ ඌࣙ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ͶͨΒݩؾʹͳͬͨ º
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ͶͨΒݩؾʹͳͬͨ º
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º ͶͨΒݩؾʹͳͬͨ ϥςΟεදݱ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º ͶͨΒݩؾʹͳͬͨ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º ͶͨΒݩؾʹͳͬͨ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º ͶͨΒݩؾʹͳͬͨ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º ͶͨΒݩؾʹͳͬͨ
ղੳީิ͔Βղͷܾఆ ˗ ୯ޠࣙॻɺ࿈Մೳߦྻ͚ͩͰղΛܾఆͰ͖ͳ͍ ˗ ϥςΟεߏίετΛ༩ ˗ ίετͷ࠷͍ީิΛղͱ͢Δʢίετ࠷খ๏ʣ
ϥςΟεߏͷίετͷ༩ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º
ϥςΟεߏͷίετͷ༩ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º
ϥςΟεߏͷίετͷ༩ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º
֤ީิͷίετͷࢉग़ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º
֤ީิͷίετͷࢉग़ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º
֤ީิͷίετͷࢉग़ ˗ ࠜɹ୫ɹݩؾɹʹɹͳͬͨ ˗ ࠜɹ୫ɹݩؾɹ୲ͬͨ ˗ ৸ͨΒɹݩؾɹʹɹͳͬͨ ˗ ৸ͨΒɹݩؾɹ୲ͬͨ
ˠ ˠ ˠ ࠷খ ˠ
࠷খίετͷީิͷ୳ࡧ ˗ ޠኮͷ૿ՃɺೖྗจͷจԽͰީิരൃతʹ૿Ճ ˠશީิͷίετࢉग़࣮࣭ෆՄೳ ˗ ೖྗจΛׂ͠ɺͦΕͧΕͷ݁ՌΛ౷߹ ˠೖྗจͷจԽʹΑΔީิͷ૿ՃΛ͑ΒΕΔ
ϏλϏΞϧΰϦζϜ ˗ ಈతܭը๏ %ZOBNJD1SPHSBNNJOH%1 ͷͻͱͭ ˗ .F$BCɺ$IBTFOͰ࠾༻͞Ε͍ͯΔ ˗ ӳจͷࢺղੳͳͲʹ༻͞Ε͍ͯΔ
ϏλϏΞϧΰϦζϜ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º
ϏλϏΞϧΰϦζϜ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º
ϏλϏΞϧΰϦζϜ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º
ະޠͷॲཧ ˗ จதʹະޠ͕ग़ΔͱϥςΟεߏ͕࡞ΒΕͳ͍ ˠղੳΛߦ͏͜ͱ͕Ͱ͖ͳ͍ ˗ ࣈɾΧλΧφͷ࿈ଓΛҰޠͱ͠ɺߴ͍ίετΛ༩ ˠࣙॻͷޠͷΈͰղऍͰ͖ΔͳΒͦͪΒΛ༻ ˠແཧ͕͋ΔͳΒٖࣅతͳޠΛ༻
ൃදͨ͠༰ ˗ ܗଶૉղੳͰߦ͏͜ͱ ˗ ୯ޠࣙॻɾ࿈Մೳੑߦྻ ˗ ܗଶૉղੳީิͷྻڍ ˗ ղੳީิ͔Βղͷܾఆ ˗
ະޠͷॲཧ