Upgrade to PRO for Only $50/Year—Limited-Time Offer! 🔥

word2vecで女性向けQ＆Aサイトを解析してみた

Avatar for tatsushim tatsushim
June 17, 2015
Research
0
6.3k

 word2vecで女性向けQ＆Aサイトを解析してみた

2015/06/10
IVS CTO NightのLTで発表したプレゼン資料です。
word2vecにmamariQ内のテキストを使用してみました。

Avatar for tatsushim

tatsushim

June 17, 2015
Tweet

More Decks by tatsushim

See All by tatsushim
DockerとAmazon SageMakerで実現した機械学習システムのプロダクション移行
Avatar for tatsushim tatsushim
0
27k
コミュニティサービスにおける機械学習のためのアノテーション
Avatar for tatsushim tatsushim
0
2.2k
日本のママをコンテナで支える
Avatar for tatsushim tatsushim
1
3.1k
コネヒトが考える技術選択の仕方について
Avatar for tatsushim tatsushim
0
22k
コネヒトが考えるサービスづくりに必要な技術とその考え方について
Avatar for tatsushim tatsushim
2
3.2k
独身男性のためのデータドリブン講座
Avatar for tatsushim tatsushim
0
6.9k

Other Decks in Research

See All in Research
SNLP2025:Can Language Models Reason about Individualistic Human Values and Preferences?
Avatar for Yuki Zenimoto yukizenimoto
0
220
Thirty Years of Progress in Speech Synthesis: A Personal Perspective on the Past, Present, and Future
Avatar for Keiichi Tokuda ktokuda
0
140
機械学習と数理最適化の融合 (MOAI) による革新
Avatar for MIKIO KUBO mickey_kubo
1
440
湯村研究室の紹介2025 / yumulab2025
Avatar for yumulab yumulab
0
270
CoRL2025速報
Avatar for robotpaper.challenge rpc
3
3.6k
財務諸表監査のための逐次検定
Avatar for MasaKat0 masakat0
0
210
LLM-Assisted Semantic Guidance for Sparsely Annotated Remote Sensing Object Detection
Avatar for SatAI.challenge satai
3
180
言語モデルの地図：確率分布と 情報幾何による類似性の可視化
Avatar for Hidetoshi Shimodaira shimosan
8
2.3k
思いつきが武器になる：研究というゲームを始めよう / Ideas Are Your Equipments : Let the Game of Research Begin!
Avatar for Kenji Saito ks91
PRO
0
110
さまざまなAgent FrameworkとAIエージェントの評価
Avatar for Kento.Yamada ymd65536
1
360
学習型データ構造：機械学習を内包する新しいデータ構造の設計と解析
Avatar for Yusuke Matsui matsui_528
4
2.2k
Pythonでジオを使い倒そう！ 〜それとFOSS4G Hiroshima 2026のご紹介を少し〜
Avatar for wata909 wata909
0
1.2k

Featured

See All Featured
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
Avatar for Rebecca Miller-Webster rmw
35
3.3k
GitHub's CSS Performance
Avatar for Jon Rohan jonrohan
1032
470k
Fight the Zombie Pattern Library - RWD Summit 2016
Avatar for Marcelo Somers marcelosomers
234
17k
Site-Speed That Sticks
Avatar for Harry Roberts csswizardry
13
1k
The Organizational Zoo: Understanding Human Behavior Agility Through Metaphoric Constructive Conversations (based on the works of Arthur Shelley, Ph.D)
Avatar for Dr. Kim W Petersen kimpetersen
PRO
0
200
How to Think Like a Performance Engineer
Avatar for Harry Roberts csswizardry
28
2.4k
YesSQL, Process and Tooling at Scale
Avatar for Rocio Delgado rocio
174
15k
New Earth Scene 8
Avatar for Sydney Stone popppiees
0
1.2k
Redefining SEO in the New Era of Traffic Generation
Avatar for Szymon szymonslowik
1
160
Agile Actions for Facilitating Distributed Teams - ADO2019
Avatar for Mark Kilby mkilby
0
88
Ecommerce SEO: The Keys for Success Now & Beyond - #SERPConf2024
Avatar for Aleyda Solis aleyda
1
1.7k
CSS Pre-Processors: Stylus, Less & Sass
Avatar for Bermon Painter bermonpainter
359
30k

Transcript

  1. word2vecͰঁੑ޲͚QˍA αΠτΛղੳͯ͠Έͨ Tatsuro Shimada <[email protected]> tatsushim @ Connehito, Inc

  2. Connehito Inc. ౡాୡ࿕ʢ͠·ͩͨͭΖ͏ʣ • Connehito, Inc CTO • Πϯϑϥ͔Βϑϩϯτ·Ͱ •

    ͋ͱ͓՛ࢠͷങ͍ग़͠ PROFILE @tatsushim 2

  3. ϚϚϦͱ͸ʁ Connehito Inc. 3

  4. Connehito Inc. ϚϚϦjp (❨web)❩ ϚϚϦ2 (❨ΞϓϦ)❩ ϚϚϦKQ / ϚϚϦ2 ϝσΟΞ

    ίϛϡχςΟ 4

  5. Connehito Inc. ࣭໰΁ͷճ౴ ˋ௒ ճ౴͕ͭ͘·Ͱ ෼ҎԼ ΞϓϦͷ଺ࡏ࣌ؒ ෼Ҏ্ ѹ౗తͳαʔϏεͷ੒௕ 

        +VO +VM "VH 4FQ 0DU /PW %FD +BO 'FC લ݄ൺˋ੒௕ ྦྷܭ౤ߘ਺ ೛৷ɾग़࢈Ͱ೰Ήਓͷ ਓʹਓ͕݄̍ΞΫηε 5

  6. Connehito Inc. ϚϚϦKQ / ϚϚϦ2 6 λʔήοτ ࢲ

  7. Connehito Inc. ϚϚϦKQ / ϚϚϦ2 7 ঁੑ λʔήοτ ࢲ

  8. Connehito Inc. ϚϚϦKQ / ϚϚϦ2 8 ঁੑ ϚϚ λʔήοτ ࢲ

  9. Connehito Inc. ϚϚϦKQ / ϚϚϦ2 9 ঁੑ ϚϚ λʔήοτ ࢲ

    ೛৷ ग़࢈

  10. Connehito Inc. ϚϚϦKQ / ϚϚϦ2 10 ঁੑ ϚϚ λʔήοτ ࢲ

    உੑ ೛৷ ग़࢈

  11. Connehito Inc. ϚϚϦKQ / ϚϚϦ2 11 ঁੑ ϚϚ λʔήοτ ࢲ

    உੑ ೛৷ ग़࢈ ಠΓ਎

  12. Connehito Inc. ϚϚϦKQ / ϚϚϦ2 12 ঁੑ ϚϚ λʔήοτ ࢲ

    உੑ ಠΓ਎ ೛৷ ग़࢈ Ͱ͖ͳ͍

  13. ʘ(^o^)ʗ

  14. ʘ(^o^)ʗ Ϣʔβʔͷ͜ͱཧղ͍ͨ͠ʂ

  15. 15

  16. 16 word2vec

  17. None

  18. Connehito Inc. • Tomas Mikolovࢯ
 (౰࣌Google, ݱFacebook)͕ఏҊ • ୯ޠಉ࢜ͷؔ܎ੑΛϕΫτϧͱͯ͠දݱ •

    ୯ޠͷྨࣅ౓ͷܭࢉ΍଍͠Ҿ͖͕Մೳ word2vecͱ͸ʁ 18

  19. 19

  20. 20 ۩ମྫΛݟͯΈΑ͏

  21. word2vecͷ୅දతͳ2ͭͷ࢖͍ํ Connehito Inc. 21

  22. Display similar words Connehito Inc. 22

  23. None

  24. ྨٛޠ

  25. Interesting properties of the word vectors Connehito Inc. 25

  26. Connehito Inc. 26 word2vecͷྫ vector(‘France')

  27. Connehito Inc. 27 word2vecͷྫ - vector(‘Paris') vector(‘France')

  28. Connehito Inc. 28 word2vecͷྫ - vector(‘Paris') + vector(‘Tokyo’) vector(‘France')

  29. Connehito Inc. 29 word2vecͷྫ - vector(‘Paris') + vector(‘Tokyo’) = vector('Japan')

    vector(‘France')

  30. Connehito Inc. 30 word2vecͷྫ vector(‘Paris')

  31. Connehito Inc. 31 word2vecͷྫ - vector(‘France') vector(‘Paris')

  32. Connehito Inc. 32 word2vecͷྫ - vector(‘France') + vector(‘Italy’) vector(‘Paris')

  33. Connehito Inc. 33 word2vecͷྫ - vector(‘France') + vector(‘Italy’) = vector('Rome')

    vector(‘Paris')

  34. Connehito Inc. 34 word2vecͷྫ vector(‘king')

  35. Connehito Inc. 35 word2vecͷྫ - vector(‘man') vector(‘king')

  36. Connehito Inc. 36 word2vecͷྫ - vector(‘man') + vector(‘woman’) vector(‘king')

  37. Connehito Inc. 37 word2vecͷྫ - vector(‘man') + vector(‘woman’) = vector('queen')

    vector(‘king')

  38. ੔ཧͯ͠ΈΔ Connehito Inc. 38

  39. Connehito Inc. 39 word2vecͷྫ - vector(‘Paris') vector(‘France')

  40. Connehito Inc. 40 word2vecͷྫ - vector(‘Paris') + vector(‘Tokyo’) vector(‘France')

  41. Connehito Inc. 41 word2vecͷྫ - vector(‘Paris') + vector(‘Tokyo’) = vector('Japan')

    vector(‘France')

  42. Connehito Inc. 42 word2vecͷྫ - vector(‘Paris') + vector(‘Tokyo’) = vector('Japan')

    vector(‘France')}

  43. Connehito Inc. 43 word2vecͷྫ - vector(‘Paris') + vector(‘Tokyo’) = vector('Japan')

    vector(‘France') ͋Δ౎ࢢΛट౎ͱ͢Δࠃ }

  44. Connehito Inc. 44 word2vecͷྫ - vector(‘Paris') + vector(‘Tokyo’) = vector('Japan')

    vector(‘France') ͋Δ౎ࢢΛट౎ͱ͢Δࠃ } +

  45. Connehito Inc. 45 word2vecͷྫ - vector(‘Paris') + vector(‘Tokyo’) = vector('Japan')

    vector(‘France') ͋Δ౎ࢢΛट౎ͱ͢Δࠃ } } +

  46. Connehito Inc. 46 word2vecͷྫ - vector(‘Paris') + vector(‘Tokyo’) = vector('Japan')

    vector(‘France') ͋Δ౎ࢢΛट౎ͱ͢Δࠃ } } ౦ژ +

  47. Connehito Inc. 47 word2vecͷྫ - vector(‘Paris') + vector(‘Tokyo’) = vector('Japan')

    vector(‘France') ͋Δ౎ࢢΛट౎ͱ͢Δࠃ } } ౦ژ + =

  48. Connehito Inc. 48 word2vecͷྫ - vector(‘Paris') + vector(‘Tokyo’) = vector('Japan')

    vector(‘France') ͋Δ౎ࢢΛट౎ͱ͢Δࠃ } } ౦ژ + = }

  49. Connehito Inc. 49 word2vecͷྫ - vector(‘Paris') + vector(‘Tokyo’) = vector('Japan')

    vector(‘France') ͋Δ౎ࢢΛट౎ͱ͢Δࠃ } } ౦ژ + = }౦ژΛट౎ͱ͢Δࠃ

  50. 50

  51. 51 mamariQͰword2vecͯ͠ΈΔ

  52. None

  53. ୯ޠͷҙຯΛද͢୯ޠ Connehito Inc. 53

  54. Connehito Inc. 54 ʮ଻ಈʯin mamariQ Word: ଻ಈ Word Cosine distance

    ------------------------------------------------------------------------ ೘ҙ 0.527825 ϙίϙί 0.516658 ҧ࿨ײ 0.432082 ಈ͖ 0.430563 ͠Όͬ͘Γ 0.406297 ͙͍ͬͨ͘͢ 0.386457 ಈ͍ 0.383030 ى෬ 0.381906 ϙίο 0.377959

  55. Connehito Inc. 55 ʮυΫϯυΫϯʯin mamariQ Word: υΫϯυΫϯ Word Cosine distance

    ------------------------------------------------------------------------ ຺ଧͭ 0.454460 ϙίο 0.425674 Ͳ͘Ͳ͘ 0.425287 ϐΫο 0.418931 ಥͬுΔ 0.417948 ϐΫϐΫ 0.415464 લଆ 0.413287 ͭͬͺΔ 0.412516

  56. Connehito Inc. 56 ʮ཭ೕ৯ʯin mamariQ Word: ཭ೕ৯ Word Cosine distance

    ------------------------------------------------------------------------ ख͔ͮΈ 0.472250 ͔ͭΈ 0.445568 ॏ౬ 0.432616 ͓͔Ώ 0.425068 τΠτϨ 0.415463 ͨΜͺ࣭͘ 0.412253 ϕϏʔμϊϯ 0.393488 λϯύΫ࣭ 0.392157 ৯ࡐ 0.390477

  57. ୯ޠͱ୯ޠͷؔ܎ੑ Connehito Inc. 57

  58. Connehito Inc. 58 vector(‘ެཱ') ୯ޠͷ໘ന͍ؔ܎ੑ in mamariQ

  59. Connehito Inc. 59 - vector(‘ଉࢠ') vector(‘ެཱ') ୯ޠͷ໘ന͍ؔ܎ੑ in mamariQ

  60. Connehito Inc. 60 - vector(‘ଉࢠ') + vector(‘່’) vector(‘ެཱ') ୯ޠͷ໘ന͍ؔ܎ੑ in

    mamariQ

  61. Connehito Inc. 61 - vector(‘ଉࢠ') + vector(‘່’) = vector('ࢲཱ') vector(‘ެཱ')

    ୯ޠͷ໘ന͍ؔ܎ੑ in mamariQ

  62. 62

  63. 63 ঁͷࢠͷํ͕ࢲཱΛݕ౼͢Δʁ

  64. Connehito Inc. 64 vector(‘νϡʔϋΠ') ୯ޠͷ໘ന͍ؔ܎ੑ in mamariQ

  65. Connehito Inc. 65 - vector(‘͓฼͞Μ') vector(‘νϡʔϋΠ') ୯ޠͷ໘ന͍ؔ܎ੑ in mamariQ

  66. Connehito Inc. 66 - vector(‘͓฼͞Μ') + vector(‘͓෕͞Μ’) vector(‘νϡʔϋΠ') ୯ޠͷ໘ന͍ؔ܎ੑ in

    mamariQ

  67. Connehito Inc. 67 - vector(‘͓฼͞Μ') + vector(‘͓෕͞Μ’) = vector('Ϗʔϧ') vector(‘νϡʔϋΠ')

    ୯ޠͷ໘ന͍ؔ܎ੑ in mamariQ

  68. 68

  69. 69 உੑͷํ͕Ϗʔϧ޷͖ʁ

  70. Connehito Inc. 70 vector(‘ՄѪ͍') ୯ޠͷ໘ന͍ؔ܎ੑ in mamariQ

  71. Connehito Inc. 71 - vector(‘ଉࢠ') vector(‘ՄѪ͍') ୯ޠͷ໘ന͍ؔ܎ੑ in mamariQ

  72. Connehito Inc. 72 - vector(‘ଉࢠ') + vector(‘່’) vector(‘ՄѪ͍') ୯ޠͷ໘ന͍ؔ܎ੑ in

    mamariQ

  73. Connehito Inc. 73 - vector(‘ଉࢠ') + vector(‘່’) = vector('ՄѪ͍') vector(‘ՄѪ͍')

    ୯ޠͷ໘ന͍ؔ܎ੑ in mamariQ

  74. Connehito Inc. 74 - vector(‘ଉࢠ') + vector(‘່’) = vector('ՄѪ͍') vector(‘ՄѪ͍')

    ୯ޠͷ໘ന͍ؔ܎ੑ in mamariQ ʊਓਓਓਓਓʊ ʼɹՄѪ͍ɹʻ ʉY^Y^Y^Y
  75. None

  76. ͨͩͷ਌όΧ

  77. ೔ຊޠʹword2vecదԠ͢ΔࡍͷTips Connehito Inc. 77

  78. Connehito Inc. 78 ೔ຊޠʹword2vecదԠ͢ΔࡍͷTips

  79. Connehito Inc. • ࣙॻʹmecab-ipadic-neologdΛ࢖͏
 - Web্ͷݴޠࢿݯ͔Βಘͨ৽ޠʹରԠ 79 ೔ຊޠʹword2vecదԠ͢ΔࡍͷTips

  80. Connehito Inc. • ࣙॻʹmecab-ipadic-neologdΛ࢖͏
 - Web্ͷݴޠࢿݯ͔Βಘͨ৽ޠʹରԠ 80 ೔ຊޠʹword2vecదԠ͢ΔࡍͷTips • ۀքݻ༗ͷϫʔυ͸ͪΌΜͱొ࿥͢Δ


    - Ex. 24w3d = ೛৷͔Β24िͱ3೔໨

  81. Connehito Inc. • ࣙॻʹmecab-ipadic-neologdΛ࢖͏
 - Web্ͷݴޠࢿݯ͔Βಘͨ৽ޠʹରԠ 81 ೔ຊޠʹword2vecదԠ͢ΔࡍͷTips • ύϥϝʔλௐ੔


    - Ex. αʔϏεʹ߹Θͤͨwindow sizeΛ • ۀքݻ༗ͷϫʔυ͸ͪΌΜͱొ࿥͢Δ
 - Ex. 24w3d = ೛৷͔Β24िͱ3೔໨

  82. 82

  83. 83 ݁ہԿʹ࢖͑Δͷ͔ʁ

  84. Connehito Inc. 84 Ԡ༻ઌ

  85. Connehito Inc. • ྨٛޠݕग़ 85 Ԡ༻ઌ

  86. Connehito Inc. • ྨٛޠݕग़ 86 • QˍAίϛχϡχςΟͰ͸Qʹରͯ͠࠷΋ྑ ͍ճ౴ΛܾΊΔͱ͖ͷfeatureʹ࢖͏ͱ͔(࣮ ࡍԠ༻ͨ͠࿦จ͕͋Δ) Ԡ༻ઌ

  87. Connehito Inc. • ྨٛޠݕग़ 87 • QˍAίϛχϡχςΟͰ͸Qʹରͯ͠࠷΋ྑ ͍ճ౴ΛܾΊΔͱ͖ͷfeatureʹ࢖͏ͱ͔(࣮ ࡍԠ༻ͨ͠࿦จ͕͋Δ) •

    ͍͔ͭ͘Ծઆ͕͋ΔͷͰɺ্ख͘ߦͬͨΒ ࿦จʹͯ͠ൃ৴͍͖ͯ͠·͢ Ԡ༻ઌ

  88. ͜͜·Ͱ͕word2vecͷ͓࿩ Connehito Inc. 88

  89. Connehito Inc. • Ҏ্͕ɺword2vecΛ࢖ͬͯΈ͓ͨ࿩Ͱ͢ 89 • IVS CTO NightॳࢀՃͰϫΫϫΫͯ͠·͢ •

    ͜͏͍͏RˍDΛΈΜͳ͍ͭ΍ͬͯɺͲ͏ औΓೖΕͯΔͷ͔஌Γ͍ͨ • ͜ͷޙྑ͔ͬͨΒ͓࿩͍ͤͯͩ͘͞͞ վΊ͓ͯٓ͘͠ئ͍͠·͢ʂ

  90. Connehito Inc. • Ҏ্͕ɺword2vecΛ࢖ͬͯΈ͓ͨ࿩Ͱ͢ 90 • IVS CTO NightॳࢀՃͰϫΫϫΫͯ͠·͢ •

    ͜͏͍͏RˍDΛΈΜͳ͍ͭ΍ͬͯɺͲ͏ औΓೖΕͯΔͷ͔஌Γ͍ͨ • ͜ͷޙྑ͔ͬͨΒ͓࿩͍ͤͯͩ͘͞͞ վΊ͓ͯٓ͘͠ئ͍͠·͢ʂ ͝ਗ਼ௌ༗೉͏͍͟͝·ͨ͠ʂ