Upgrade to Pro — share decks privately, control downloads, hide ads and more …

word2vecで女性向けQ＆Aサイトを解析してみた

Sponsored · Your Podcast. Everywhere. Effortlessly. Share. Educate. Inspire. Entertain. You do you. We'll handle the rest. →
Avatar for tatsushim tatsushim
June 17, 2015
Research
6.4k
0

 word2vecで女性向けQ＆Aサイトを解析してみた

2015/06/10
IVS CTO NightのLTで発表したプレゼン資料です。
word2vecにmamariQ内のテキストを使用してみました。

Avatar for tatsushim

tatsushim

June 17, 2015

More Decks by tatsushim

See All by tatsushim
DockerとAmazon SageMakerで実現した機械学習システムのプロダクション移行
Avatar for tatsushim tatsushim
0
27k
コミュニティサービスにおける機械学習のためのアノテーション
Avatar for tatsushim tatsushim
0
2.2k
日本のママをコンテナで支える
Avatar for tatsushim tatsushim
1
3.2k
コネヒトが考える技術選択の仕方について
Avatar for tatsushim tatsushim
0
22k
コネヒトが考えるサービスづくりに必要な技術とその考え方について
Avatar for tatsushim tatsushim
2
3.3k
独身男性のためのデータドリブン講座
Avatar for tatsushim tatsushim
0
6.9k

Other Decks in Research

See All in Research
「車1割削減、渋滞半減、公共交通2倍」を 熊本から岡山へ＠RACDA設立30周年記念都市交通フォーラム2026
Avatar for Traffic Brain trafficbrain
1
1.2k
The Landscape of Agentic Reinforcement Learning for LLMs: A Survey
Avatar for Shunsuke KITADA shunk031
4
1k
YOLO26_ Key Architectural Enhancements and Performance Benchmarking for Real-Time Object Detection
Avatar for SatAI.challenge satai
3
810
多様なデータを許容し学習し続ける模倣学習 / Advanced Imitation Learning for VLA
Avatar for PRIN Lab prinlab
0
220
AY 2026 Guide to Academic Writing Using Generative AI - Workshop
Avatar for Kenji Saito ks91
PRO
0
120
The mathematics of transformers
Avatar for Gabriel Peyré gpeyre
0
330
AGI4OPT:自然言語から数理最適化を導くエ ージェントスキル Translating Human Intent into Mathematical Optimization
Avatar for MIKIO KUBO mickey_kubo
0
140
Φ-Sat-2のAutoEncoderによる情報圧縮系論文
Avatar for SatAI.challenge satai
4
780
Ankylosing Spondylitis
Avatar for Charles Holtzkampf ankh2054
0
170
定数整数除算・剰余算最適化再考
Avatar for herumi herumi
1
130
衛星×エッジAI勉強会 衛星上におけるAI処理制約とそ取組について
Avatar for SatAI.challenge satai
4
560
Using our influence and power for patient safety
Avatar for Helen Bevan helenbevan
0
360

Featured

See All Featured
Making Projects Easy
Avatar for Brett Harned brettharned
120
6.7k
Conquering PDFs: document understanding beyond plain text
Avatar for Ines Montani inesmontani
PRO
4
2.8k
ピンチをチャンスに：未来をつくるプロダクトロードマップ #pmconf2020
Avatar for Aki / @LoveIdahoBurger aki_iinuma
128
56k
RailsConf 2023
Avatar for Aaron Patterson tenderlove
30
1.5k
Claude Code どこまでも/ Claude Code Everywhere
Avatar for nwiizo nwiizo
65
56k
Believing is Seeing
Avatar for Spiro Bolos oripsolob
1
150
GitHub's CSS Performance
Avatar for Jon Rohan jonrohan
1033
470k
10 Git Anti Patterns You Should be Aware of
Avatar for Lemi Orhan Ergin lemiorhan
PRO
659
62k
Ten Tips & Tricks for a 🌱 transition
Avatar for Manu Carrasco Molina stuffmc
0
140
What Being in a Rock Band Can Teach Us About Real World SEO
Avatar for Ade Holder 427marketing
0
250
GraphQLとの向き合い方2022年版
Avatar for Yosuke Kurami quramy
50
15k
Test your architecture with Archunit
Avatar for Yoan thirion
1
2.3k

Transcript

  1. word2vecͰঁੑ޲͚QˍA αΠτΛղੳͯ͠Έͨ Tatsuro Shimada <[email protected]> tatsushim @ Connehito, Inc

  2. Connehito Inc. ౡాୡ࿕ʢ͠·ͩͨͭΖ͏ʣ • Connehito, Inc CTO • Πϯϑϥ͔Βϑϩϯτ·Ͱ •

    ͋ͱ͓՛ࢠͷങ͍ग़͠ PROFILE @tatsushim 2

  3. ϚϚϦͱ͸ʁ Connehito Inc. 3

  4. Connehito Inc. ϚϚϦjp (❨web)❩ ϚϚϦ2 (❨ΞϓϦ)❩ ϚϚϦKQ / ϚϚϦ2 ϝσΟΞ

    ίϛϡχςΟ 4

  5. Connehito Inc. ࣭໰΁ͷճ౴ ˋ௒ ճ౴͕ͭ͘·Ͱ ෼ҎԼ ΞϓϦͷ଺ࡏ࣌ؒ ෼Ҏ্ ѹ౗తͳαʔϏεͷ੒௕ 

        +VO +VM "VH 4FQ 0DU /PW %FD +BO 'FC લ݄ൺˋ੒௕ ྦྷܭ౤ߘ਺ ೛৷ɾग़࢈Ͱ೰Ήਓͷ ਓʹਓ͕݄̍ΞΫηε 5

  6. Connehito Inc. ϚϚϦKQ / ϚϚϦ2 6 λʔήοτ ࢲ

  7. Connehito Inc. ϚϚϦKQ / ϚϚϦ2 7 ঁੑ λʔήοτ ࢲ

  8. Connehito Inc. ϚϚϦKQ / ϚϚϦ2 8 ঁੑ ϚϚ λʔήοτ ࢲ

  9. Connehito Inc. ϚϚϦKQ / ϚϚϦ2 9 ঁੑ ϚϚ λʔήοτ ࢲ

    ೛৷ ग़࢈

  10. Connehito Inc. ϚϚϦKQ / ϚϚϦ2 10 ঁੑ ϚϚ λʔήοτ ࢲ

    உੑ ೛৷ ग़࢈

  11. Connehito Inc. ϚϚϦKQ / ϚϚϦ2 11 ঁੑ ϚϚ λʔήοτ ࢲ

    உੑ ೛৷ ग़࢈ ಠΓ਎

  12. Connehito Inc. ϚϚϦKQ / ϚϚϦ2 12 ঁੑ ϚϚ λʔήοτ ࢲ

    உੑ ಠΓ਎ ೛৷ ग़࢈ Ͱ͖ͳ͍

  13. ʘ(^o^)ʗ

  14. ʘ(^o^)ʗ Ϣʔβʔͷ͜ͱཧղ͍ͨ͠ʂ

  15. 15

  16. 16 word2vec

  17. None

  18. Connehito Inc. • Tomas Mikolovࢯ
 (౰࣌Google, ݱFacebook)͕ఏҊ • ୯ޠಉ࢜ͷؔ܎ੑΛϕΫτϧͱͯ͠දݱ •

    ୯ޠͷྨࣅ౓ͷܭࢉ΍଍͠Ҿ͖͕Մೳ word2vecͱ͸ʁ 18

  19. 19

  20. 20 ۩ମྫΛݟͯΈΑ͏

  21. word2vecͷ୅දతͳ2ͭͷ࢖͍ํ Connehito Inc. 21

  22. Display similar words Connehito Inc. 22

  23. None

  24. ྨٛޠ

  25. Interesting properties of the word vectors Connehito Inc. 25

  26. Connehito Inc. 26 word2vecͷྫ vector(‘France')

  27. Connehito Inc. 27 word2vecͷྫ - vector(‘Paris') vector(‘France')

  28. Connehito Inc. 28 word2vecͷྫ - vector(‘Paris') + vector(‘Tokyo’) vector(‘France')

  29. Connehito Inc. 29 word2vecͷྫ - vector(‘Paris') + vector(‘Tokyo’) = vector('Japan')

    vector(‘France')

  30. Connehito Inc. 30 word2vecͷྫ vector(‘Paris')

  31. Connehito Inc. 31 word2vecͷྫ - vector(‘France') vector(‘Paris')

  32. Connehito Inc. 32 word2vecͷྫ - vector(‘France') + vector(‘Italy’) vector(‘Paris')

  33. Connehito Inc. 33 word2vecͷྫ - vector(‘France') + vector(‘Italy’) = vector('Rome')

    vector(‘Paris')

  34. Connehito Inc. 34 word2vecͷྫ vector(‘king')

  35. Connehito Inc. 35 word2vecͷྫ - vector(‘man') vector(‘king')

  36. Connehito Inc. 36 word2vecͷྫ - vector(‘man') + vector(‘woman’) vector(‘king')

  37. Connehito Inc. 37 word2vecͷྫ - vector(‘man') + vector(‘woman’) = vector('queen')

    vector(‘king')

  38. ੔ཧͯ͠ΈΔ Connehito Inc. 38

  39. Connehito Inc. 39 word2vecͷྫ - vector(‘Paris') vector(‘France')

  40. Connehito Inc. 40 word2vecͷྫ - vector(‘Paris') + vector(‘Tokyo’) vector(‘France')

  41. Connehito Inc. 41 word2vecͷྫ - vector(‘Paris') + vector(‘Tokyo’) = vector('Japan')

    vector(‘France')

  42. Connehito Inc. 42 word2vecͷྫ - vector(‘Paris') + vector(‘Tokyo’) = vector('Japan')

    vector(‘France')}

  43. Connehito Inc. 43 word2vecͷྫ - vector(‘Paris') + vector(‘Tokyo’) = vector('Japan')

    vector(‘France') ͋Δ౎ࢢΛट౎ͱ͢Δࠃ }

  44. Connehito Inc. 44 word2vecͷྫ - vector(‘Paris') + vector(‘Tokyo’) = vector('Japan')

    vector(‘France') ͋Δ౎ࢢΛट౎ͱ͢Δࠃ } +

  45. Connehito Inc. 45 word2vecͷྫ - vector(‘Paris') + vector(‘Tokyo’) = vector('Japan')

    vector(‘France') ͋Δ౎ࢢΛट౎ͱ͢Δࠃ } } +

  46. Connehito Inc. 46 word2vecͷྫ - vector(‘Paris') + vector(‘Tokyo’) = vector('Japan')

    vector(‘France') ͋Δ౎ࢢΛट౎ͱ͢Δࠃ } } ౦ژ +

  47. Connehito Inc. 47 word2vecͷྫ - vector(‘Paris') + vector(‘Tokyo’) = vector('Japan')

    vector(‘France') ͋Δ౎ࢢΛट౎ͱ͢Δࠃ } } ౦ژ + =

  48. Connehito Inc. 48 word2vecͷྫ - vector(‘Paris') + vector(‘Tokyo’) = vector('Japan')

    vector(‘France') ͋Δ౎ࢢΛट౎ͱ͢Δࠃ } } ౦ژ + = }

  49. Connehito Inc. 49 word2vecͷྫ - vector(‘Paris') + vector(‘Tokyo’) = vector('Japan')

    vector(‘France') ͋Δ౎ࢢΛट౎ͱ͢Δࠃ } } ౦ژ + = }౦ژΛट౎ͱ͢Δࠃ

  50. 50

  51. 51 mamariQͰword2vecͯ͠ΈΔ

  52. None

  53. ୯ޠͷҙຯΛද͢୯ޠ Connehito Inc. 53

  54. Connehito Inc. 54 ʮ଻ಈʯin mamariQ Word: ଻ಈ Word Cosine distance

    ------------------------------------------------------------------------ ೘ҙ 0.527825 ϙίϙί 0.516658 ҧ࿨ײ 0.432082 ಈ͖ 0.430563 ͠Όͬ͘Γ 0.406297 ͙͍ͬͨ͘͢ 0.386457 ಈ͍ 0.383030 ى෬ 0.381906 ϙίο 0.377959

  55. Connehito Inc. 55 ʮυΫϯυΫϯʯin mamariQ Word: υΫϯυΫϯ Word Cosine distance

    ------------------------------------------------------------------------ ຺ଧͭ 0.454460 ϙίο 0.425674 Ͳ͘Ͳ͘ 0.425287 ϐΫο 0.418931 ಥͬுΔ 0.417948 ϐΫϐΫ 0.415464 લଆ 0.413287 ͭͬͺΔ 0.412516

  56. Connehito Inc. 56 ʮ཭ೕ৯ʯin mamariQ Word: ཭ೕ৯ Word Cosine distance

    ------------------------------------------------------------------------ ख͔ͮΈ 0.472250 ͔ͭΈ 0.445568 ॏ౬ 0.432616 ͓͔Ώ 0.425068 τΠτϨ 0.415463 ͨΜͺ࣭͘ 0.412253 ϕϏʔμϊϯ 0.393488 λϯύΫ࣭ 0.392157 ৯ࡐ 0.390477

  57. ୯ޠͱ୯ޠͷؔ܎ੑ Connehito Inc. 57

  58. Connehito Inc. 58 vector(‘ެཱ') ୯ޠͷ໘ന͍ؔ܎ੑ in mamariQ

  59. Connehito Inc. 59 - vector(‘ଉࢠ') vector(‘ެཱ') ୯ޠͷ໘ന͍ؔ܎ੑ in mamariQ

  60. Connehito Inc. 60 - vector(‘ଉࢠ') + vector(‘່’) vector(‘ެཱ') ୯ޠͷ໘ന͍ؔ܎ੑ in

    mamariQ

  61. Connehito Inc. 61 - vector(‘ଉࢠ') + vector(‘່’) = vector('ࢲཱ') vector(‘ެཱ')

    ୯ޠͷ໘ന͍ؔ܎ੑ in mamariQ

  62. 62

  63. 63 ঁͷࢠͷํ͕ࢲཱΛݕ౼͢Δʁ

  64. Connehito Inc. 64 vector(‘νϡʔϋΠ') ୯ޠͷ໘ന͍ؔ܎ੑ in mamariQ

  65. Connehito Inc. 65 - vector(‘͓฼͞Μ') vector(‘νϡʔϋΠ') ୯ޠͷ໘ന͍ؔ܎ੑ in mamariQ

  66. Connehito Inc. 66 - vector(‘͓฼͞Μ') + vector(‘͓෕͞Μ’) vector(‘νϡʔϋΠ') ୯ޠͷ໘ന͍ؔ܎ੑ in

    mamariQ

  67. Connehito Inc. 67 - vector(‘͓฼͞Μ') + vector(‘͓෕͞Μ’) = vector('Ϗʔϧ') vector(‘νϡʔϋΠ')

    ୯ޠͷ໘ന͍ؔ܎ੑ in mamariQ

  68. 68

  69. 69 உੑͷํ͕Ϗʔϧ޷͖ʁ

  70. Connehito Inc. 70 vector(‘ՄѪ͍') ୯ޠͷ໘ന͍ؔ܎ੑ in mamariQ

  71. Connehito Inc. 71 - vector(‘ଉࢠ') vector(‘ՄѪ͍') ୯ޠͷ໘ന͍ؔ܎ੑ in mamariQ

  72. Connehito Inc. 72 - vector(‘ଉࢠ') + vector(‘່’) vector(‘ՄѪ͍') ୯ޠͷ໘ന͍ؔ܎ੑ in

    mamariQ

  73. Connehito Inc. 73 - vector(‘ଉࢠ') + vector(‘່’) = vector('ՄѪ͍') vector(‘ՄѪ͍')

    ୯ޠͷ໘ന͍ؔ܎ੑ in mamariQ

  74. Connehito Inc. 74 - vector(‘ଉࢠ') + vector(‘່’) = vector('ՄѪ͍') vector(‘ՄѪ͍')

    ୯ޠͷ໘ന͍ؔ܎ੑ in mamariQ ʊਓਓਓਓਓʊ ʼɹՄѪ͍ɹʻ ʉY^Y^Y^Y
  75. None

  76. ͨͩͷ਌όΧ

  77. ೔ຊޠʹword2vecదԠ͢ΔࡍͷTips Connehito Inc. 77

  78. Connehito Inc. 78 ೔ຊޠʹword2vecదԠ͢ΔࡍͷTips

  79. Connehito Inc. • ࣙॻʹmecab-ipadic-neologdΛ࢖͏
 - Web্ͷݴޠࢿݯ͔Βಘͨ৽ޠʹରԠ 79 ೔ຊޠʹword2vecదԠ͢ΔࡍͷTips

  80. Connehito Inc. • ࣙॻʹmecab-ipadic-neologdΛ࢖͏
 - Web্ͷݴޠࢿݯ͔Βಘͨ৽ޠʹରԠ 80 ೔ຊޠʹword2vecదԠ͢ΔࡍͷTips • ۀքݻ༗ͷϫʔυ͸ͪΌΜͱొ࿥͢Δ


    - Ex. 24w3d = ೛৷͔Β24िͱ3೔໨

  81. Connehito Inc. • ࣙॻʹmecab-ipadic-neologdΛ࢖͏
 - Web্ͷݴޠࢿݯ͔Βಘͨ৽ޠʹରԠ 81 ೔ຊޠʹword2vecదԠ͢ΔࡍͷTips • ύϥϝʔλௐ੔


    - Ex. αʔϏεʹ߹Θͤͨwindow sizeΛ • ۀքݻ༗ͷϫʔυ͸ͪΌΜͱొ࿥͢Δ
 - Ex. 24w3d = ೛৷͔Β24िͱ3೔໨

  82. 82

  83. 83 ݁ہԿʹ࢖͑Δͷ͔ʁ

  84. Connehito Inc. 84 Ԡ༻ઌ

  85. Connehito Inc. • ྨٛޠݕग़ 85 Ԡ༻ઌ

  86. Connehito Inc. • ྨٛޠݕग़ 86 • QˍAίϛχϡχςΟͰ͸Qʹରͯ͠࠷΋ྑ ͍ճ౴ΛܾΊΔͱ͖ͷfeatureʹ࢖͏ͱ͔(࣮ ࡍԠ༻ͨ͠࿦จ͕͋Δ) Ԡ༻ઌ

  87. Connehito Inc. • ྨٛޠݕग़ 87 • QˍAίϛχϡχςΟͰ͸Qʹରͯ͠࠷΋ྑ ͍ճ౴ΛܾΊΔͱ͖ͷfeatureʹ࢖͏ͱ͔(࣮ ࡍԠ༻ͨ͠࿦จ͕͋Δ) •

    ͍͔ͭ͘Ծઆ͕͋ΔͷͰɺ্ख͘ߦͬͨΒ ࿦จʹͯ͠ൃ৴͍͖ͯ͠·͢ Ԡ༻ઌ

  88. ͜͜·Ͱ͕word2vecͷ͓࿩ Connehito Inc. 88

  89. Connehito Inc. • Ҏ্͕ɺword2vecΛ࢖ͬͯΈ͓ͨ࿩Ͱ͢ 89 • IVS CTO NightॳࢀՃͰϫΫϫΫͯ͠·͢ •

    ͜͏͍͏RˍDΛΈΜͳ͍ͭ΍ͬͯɺͲ͏ औΓೖΕͯΔͷ͔஌Γ͍ͨ • ͜ͷޙྑ͔ͬͨΒ͓࿩͍ͤͯͩ͘͞͞ վΊ͓ͯٓ͘͠ئ͍͠·͢ʂ

  90. Connehito Inc. • Ҏ্͕ɺword2vecΛ࢖ͬͯΈ͓ͨ࿩Ͱ͢ 90 • IVS CTO NightॳࢀՃͰϫΫϫΫͯ͠·͢ •

    ͜͏͍͏RˍDΛΈΜͳ͍ͭ΍ͬͯɺͲ͏ औΓೖΕͯΔͷ͔஌Γ͍ͨ • ͜ͷޙྑ͔ͬͨΒ͓࿩͍ͤͯͩ͘͞͞ վΊ͓ͯٓ͘͠ئ͍͠·͢ʂ ͝ਗ਼ௌ༗೉͏͍͟͝·ͨ͠ʂ