Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
日本語の形態素解析
Search
Yumeto Inaoka
January 26, 2017
Technology
0
420
日本語の形態素解析
2017/01/26のB3ゼミで発表
Yumeto Inaoka
January 26, 2017
Tweet
Share
More Decks by Yumeto Inaoka
See All by Yumeto Inaoka
文献紹介: Quantity doesn’t buy quality syntax with neural language models
yumeto
1
120
文献紹介: Open Domain Web Keyphrase Extraction Beyond Language Modeling
yumeto
0
160
文献紹介: Self-Supervised_Neural_Machine_Translation
yumeto
0
120
文献紹介: Comparing and Developing Tools to Measure the Readability of Domain-Specific Texts
yumeto
0
120
文献紹介: PAWS: Paraphrase Adversaries from Word Scrambling
yumeto
0
88
文献紹介: Beyond BLEU: Training Neural Machine Translation with Semantic Similarity
yumeto
0
210
文献紹介: EditNTS: An Neural Programmer-Interpreter Model for Sentence Simplification through Explicit Editing
yumeto
0
260
文献紹介: Decomposable Neural Paraphrase Generation
yumeto
0
180
文献紹介: Analyzing the Limitations of Cross-lingual Word Embedding Mappings
yumeto
0
170
Other Decks in Technology
See All in Technology
RAGHack: Building RAG apps in Python
pamelafox
0
130
マーケットプレイス版Oracle WebCenter Content For OCI
oracle4engineer
PRO
2
170
デジタル化・DX推進あるある
y150saya
0
230
Functional TypeScript
naoya
8
3.5k
CRTO/CRTL/OSEPの比較・勉強法とAV/EDRの検知実験
chayakonanaika
1
940
Autonomous Database Cloud 技術詳細 / adb-s_technical_detail_jp
oracle4engineer
PRO
15
39k
20分で分かるIAM全機能 (拡大版) / 20240903-jawsug-yokohama-iam
opelab
3
130
中規模・ミドルTier開発組織におけるDevRelの戦略と実行と成果 - DevRel Guild Conference Mini -
leveragestech
2
280
LandingZoneAccelerator と学ぶ 「スケーラブルで安全なマルチアカウントAWS環境」と 私たちにもできるベストプラクティス
maimyyym
1
110
[RSJ24] Object Retrieval in Large-Scale Indoor Environments Using Dense Text with a Multi-Modal Large Language Model
keio_smilab
PRO
0
230
四国のあのイベントの〇〇システムを45日間で構築した話 / cloudohenro2024_tachibana
biatunky
0
260
脆弱星に導かれて
nishimunea
1
1.6k
Featured
See All Featured
Git: the NoSQL Database
bkeepers
PRO
425
64k
Thoughts on Productivity
jonyablonski
66
4.2k
Reflections from 52 weeks, 52 projects
jeffersonlam
346
20k
Agile that works and the tools we love
rasmusluckow
327
20k
Rebuilding a faster, lazier Slack
samanthasiow
78
8.5k
Bash Introduction
62gerente
608
210k
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
eileencodes
131
32k
Building an army of robots
kneath
302
42k
Ruby is Unlike a Banana
tanoku
96
10k
A designer walks into a library…
pauljervisheath
201
24k
Producing Creativity
orderedlist
PRO
340
39k
How to name files
jennybc
75
98k
Transcript
ຊޠͷܗଶૉղੳ #θϛ ࣗવݴޠॲཧݚڀࣨɹֶ෦ɹҴԬເਓ
ࢀߟʹͨ͠ॻ੶
ൃද༰ ˗ ܗଶૉղੳͰߦ͏͜ͱ ˗ ୯ޠࣙॻɾ࿈Մೳੑߦྻ ˗ ܗଶૉղੳީิͷྻڍ ˗ ղੳީิ͔Βղͷܾఆ ˗
ະޠͷॲཧ
ܗଶૉղੳ ˗ จΛ୯ޠຖʹ۠Δ ˗ ࢺΛೝࣝ͢Δ ˗ ׆༻Λೝࣝ͢Δ
ܗଶૉղੳ ˗ จΛ୯ޠຖʹ۠Δ ˗ ࢺΛೝࣝ͢Δ ˗ ׆༻Λೝࣝ͢Δ ͓ۚͰങ͑ͳ͍Ձ͕͋Δɻ
ܗଶૉղੳ ˗ จΛ୯ޠຖʹ۠Δ ˗ ࢺΛೝࣝ͢Δ ˗ ׆༻Λೝࣝ͢Δ ͓ ۚ
Ͱ ങ͑ ͳ͍ Ձ ͕ ͋Δ ɻ
ܗଶૉղੳ ˗ จΛ୯ޠຖʹ۠Δ ˗ ࢺΛೝࣝ͢Δ ˗ ׆༻Λೝࣝ͢Δ ͓ ಄ࣙ
ۚ ໊ࢺ Ͱ ॿࢺ ങ͑ ಈࢺ ͳ͍ ॿಈࢺ Ձ ໊ࢺ ͕ ॿࢺ ͋Δ ಈࢺ ɻ ۟
ܗଶૉղੳ ˗ จΛ୯ޠຖʹ۠Δ ˗ ࢺΛೝࣝ͢Δ ˗ ׆༻Λೝࣝ͢Δ ͓ ಄ࣙ
ۚ ໊ࢺ Ͱ ॿࢺ ങ͑ ಈࢺ ԼҰஈະવܗ ͳ͍ ॿಈࢺ ࿈ମܗ Ձ ໊ࢺ ͕ ॿࢺ ͋Δ ಈࢺ ޒஈऴࢭܗ ɻ ۟
୯ޠࣙॻ ୯ޠͷදهɺࢺɺ׆༻ͳͲΛ هड़ͨࣙ͠ॻ දه ࢺ ׆༻ ݩؾ ໊ࢺ ʔ
୫ ໊ࢺ ʔ ͳΔ ಈࢺ ޒஈ ʹ ॿࢺ ʔ ୲͏ ಈࢺ ޒஈ ࠜ ໊ࢺ ʔ ৸Δ ಈࢺ ԼҰஈ Β ඌࣙ ʔ
࿈Մೳੑߦྻ ͲͷΑ͏ͳࢺͷ୯ޠ͕จதͰ࿈ଓ͠ಘΔ͔Λද͢ จ ໊ࢺ ಈࢺ ॿࢺ ඌࣙ จ಄
໊ࢺ ಈࢺ ॿࢺ ඌࣙ
࿈Մೳੑߦྻ ͲͷΑ͏ͳࢺͷ୯ޠ͕จதͰ࿈ଓ͠ಘΔ͔Λද͢ จ ໊ࢺ ಈࢺ ॿࢺ ඌࣙ จ಄
໊ࢺ ಈࢺ ॿࢺ ඌࣙ
࿈Մೳੑߦྻ ͲͷΑ͏ͳࢺͷ୯ޠ͕จதͰ࿈ଓ͠ಘΔ͔Λද͢ จ ໊ࢺ ಈࢺ ॿࢺ ඌࣙ จ಄
໊ࢺ ಈࢺ ॿࢺ ඌࣙ
ܗଶૉղੳީิͷྻڍ จ಄ ͶͨΒݩؾʹͳͬͨ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ Ͷͨ ৸Δ
ಈࢺ ͶͨΒ ৸Δ ಈࢺ ͶͨΒݩؾʹͳͬͨ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ Ͷͨ ৸Δ ಈࢺ ͶͨΒ ৸Δ ಈࢺ ͶͨΒݩؾʹͳͬͨ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ͶͨΒݩؾʹͳͬͨ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ͶͨΒݩؾʹͳͬͨ º จ ໊ࢺ ಈࢺ ॿࢺ ඌࣙ จ಄ ໊ࢺ ಈࢺ ॿࢺ ඌࣙ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ͶͨΒݩؾʹͳͬͨ º
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ͶͨΒݩؾʹͳͬͨ º
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º ͶͨΒݩؾʹͳͬͨ ϥςΟεදݱ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º ͶͨΒݩؾʹͳͬͨ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º ͶͨΒݩؾʹͳͬͨ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º ͶͨΒݩؾʹͳͬͨ
ܗଶૉղੳީิͷྻڍ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º ͶͨΒݩؾʹͳͬͨ
ղੳީิ͔Βղͷܾఆ ˗ ୯ޠࣙॻɺ࿈Մೳߦྻ͚ͩͰղΛܾఆͰ͖ͳ͍ ˗ ϥςΟεߏίετΛ༩ ˗ ίετͷ࠷͍ީิΛղͱ͢Δʢίετ࠷খ๏ʣ
ϥςΟεߏͷίετͷ༩ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º
ϥςΟεߏͷίετͷ༩ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º
ϥςΟεߏͷίετͷ༩ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º
֤ީิͷίετͷࢉग़ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º
֤ީิͷίετͷࢉग़ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º
֤ީิͷίετͷࢉग़ ˗ ࠜɹ୫ɹݩؾɹʹɹͳͬͨ ˗ ࠜɹ୫ɹݩؾɹ୲ͬͨ ˗ ৸ͨΒɹݩؾɹʹɹͳͬͨ ˗ ৸ͨΒɹݩؾɹ୲ͬͨ
ˠ ˠ ˠ ࠷খ ˠ
࠷খίετͷީิͷ୳ࡧ ˗ ޠኮͷ૿ՃɺೖྗจͷจԽͰީิരൃతʹ૿Ճ ˠશީิͷίετࢉग़࣮࣭ෆՄೳ ˗ ೖྗจΛׂ͠ɺͦΕͧΕͷ݁ՌΛ౷߹ ˠೖྗจͷจԽʹΑΔީิͷ૿ՃΛ͑ΒΕΔ
ϏλϏΞϧΰϦζϜ ˗ ಈతܭը๏ %ZOBNJD1SPHSBNNJOH%1 ͷͻͱͭ ˗ .F$BCɺ$IBTFOͰ࠾༻͞Ε͍ͯΔ ˗ ӳจͷࢺղੳͳͲʹ༻͞Ε͍ͯΔ
ϏλϏΞϧΰϦζϜ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º
ϏλϏΞϧΰϦζϜ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º
ϏλϏΞϧΰϦζϜ จ಄ Ͷ ࠜ ໊ࢺ ͨΒ ୫
໊ࢺ ݩؾ ໊ࢺ Ͷͨ ৸Δ ಈࢺ Β ඌࣙ ͶͨΒ ৸Δ ಈࢺ ʹ ॿࢺ ͳͬͨ ͳΔ ಈࢺ ʹͳͬͨ ୲͏ ಈࢺ จ º
ະޠͷॲཧ ˗ จதʹະޠ͕ग़ΔͱϥςΟεߏ͕࡞ΒΕͳ͍ ˠղੳΛߦ͏͜ͱ͕Ͱ͖ͳ͍ ˗ ࣈɾΧλΧφͷ࿈ଓΛҰޠͱ͠ɺߴ͍ίετΛ༩ ˠࣙॻͷޠͷΈͰղऍͰ͖ΔͳΒͦͪΒΛ༻ ˠແཧ͕͋ΔͳΒٖࣅతͳޠΛ༻
ൃදͨ͠༰ ˗ ܗଶૉղੳͰߦ͏͜ͱ ˗ ୯ޠࣙॻɾ࿈Մೳੑߦྻ ˗ ܗଶૉղੳީิͷྻڍ ˗ ղੳީิ͔Βղͷܾఆ ˗
ະޠͷॲཧ