“Satisfaction with Failure” or “Unsatisfied Success” - “検索の成功”と“ユーザの満足”の関係 -

WEBエンジニア勉強会 #10 (https://web-engineer-meetup.connpass.com/event/104523/) での登壇資料です．

The Web Conference 2018 の
“Satisfaction with Failure” or “Unsatisfied Success”: Investigating the Relationship between Search Success and User Satisfaction
という論文について簡単に紹介しました．

こういう身近なテーマのものもあるので，これを機に是非論文などにも興味を持っていただければと思い発表しました．

Transcript

1. “Satisfaction with Failure”
   or
   “Unsatisfied Success”
   - “ݕࡧͷ੒ޭ”ͱ“Ϣʔβͷຬ଍”ͷؔ܎ -
   WEBΤϯδχΞษڧձ #10
   Yuya Matsumura (@yu-ya4)
   9 November 2018
   

   View Slide

2. ✓ Yuya Matsumura
   ✓ Software Engineer
   ✓ Wantedly, Inc. Recommendation Team
   ✓ Interested in Information Retrieval, Machine Learning
   Self-Introduction
   @yu-ya4
   @yu__ya4
   

   View Slide

3. ✓ Webٕज़શൠʹؔ͢Δ࠷΋ݖҖͷ͋Δࠃࡍձٞ
   ✓ Google, Baidu, Amazon, facebook…. ͳͲͷ໊ͩͨΔεϙϯαʔ
   ✓࠾୒཰͸ WWW 2018 Ͱ 14.8% (171/1155)
   ✓ 2018 ೥͸ϑϥϯεͷϦϤϯ (Lyon) Ͱ։࠵ (࣍ճ͸αϯϑϥϯγεί)
   ✓ ݕࡧ΍ηΩϡϦςΟɼػցֶश͔Βࣾձ໰୊·Ͱ༷ʑͳτϐοΫ
   What is The Web Conference (WWW) ?
   5IF8FC$POGFSFODFIUUQTXXXUIFXFCDPOGPSH
   
   

   View Slide

4. ✓ The Effect of Ad Blocking on User Engagement with the Web
   ✓ Robust Factorization Machines for User Response Prediction
   ✓ Did You Really Just Have a Heart Attack?: Towards Robust
   Detection of Personal Health Mentions in Social Media
   ✓ “Satisfaction with Failure” or “Unsatisfied Success”: Investigating
   the Relationship between Search Success and User Satisfaction
   Examples of sessions
   IUUQTXXXUIFXFCDPOGPSHSFTFBSDITFTTJPOTEFUBJMT
   
   

   View Slide

5. ✓ The Effect of Ad Blocking on User Engagement with the Web
   ✓ Robust Factorization Machines for User Response Prediction
   ✓ Did You Really Just Have a Heart Attack?: Towards Robust Detection of
   Personal Health Mentions in Social Media
   ✓ “Satisfaction with Failure” or “Unsatisfied Success”: Investigating the
   Relationship between Search Success and User Satisfaction
   ࠓ೔࿩͢͜ͱ
   IUUQTXXXUIFXFCDPOGPSHSFTFBSDITFTTJPOTEFUBJMT
   
   ˠ͜ͷ࿦จͷ಺༰ʹ͍ͭͯ؆୯ʹ͝঺հ
   

   View Slide

6. ✓ ֓ཁΛ͞Βͬͱ঺հ͠·͢ (ৄࡉͳ࣮ݧઃఆ౳ʹ͸ݴٴ͠·ͤΜ)
   ✓ ͋͘·Ͱɼࢲ͕࿦จΛಡΜ্ͩͰͷࢲͷղऍͰ͢
   ✓ ؒҧͬͨ͜ͱݴͬͯͨΒ͝ΊΜͳ͍͞
   ✓ ൃද಺༰ͱॴଐ૊৫ͱ͸ؔ܎͍͟͝·ͤΜ (ΦωΦ)
   Excuse
   

   View Slide

7. “Satisfaction with Failure” or “Unsatisfied Success”:
   Investigating the Relationship
   between Search Success and User Satisfaction
   IUUQTEMBDNPSHBVUIPSJ[FDGN LFZ/
   
   "VUIPST.FOHZBOH-JV :JRVO-JV +JBYJO.BP $IFOH-VP .JO;IBOHBOE4IBPQJOH.B
   1SPDFFEJOH
   8881SPDFFEJOHTPGUIF8PSME8JEF8FC$POGFSFODF
   1BHFT
   

   View Slide

8. എܠ
   Ϣʔβ͕ݕࡧΛߦͬͨࡍʹ ݕࡧߦҝʹ“ຬ଍”͔ͨ͠Ͳ͏͔
   ͱ͍͏ͷ͸ͱͯ΋ॏཁͳࢦඪʂ
   Ϣʔβ͕“ຬ଍”͢ΔݕࡧΛ࣮ݱ͢Δͷ͕Ϣʔβʹͱ͍ͬͯ
   ͍͜ͱͷ͸ͣʂʂ
   Ͱ΋ɼϢʔβ͕“ຬ଍”͔ͨ͠Βͱ͍ͬͯ
   ݕࡧʹ“੒ޭ”͍ͯ͠Δͱ͸ݶΒͳ͍ʁ
   

   View Slide

9. ͨͱ͑͹
   தࠃਓͷֶੜ͕͋Δҩྍ৘ใΛݕࡧͨ͠ࡍʹɼ
   ޡͬͨةݥͳ৘ใؚ͕·ΕΔݕࡧ݁Ռʹຬ଍ͯ͠͠·͍ɼ
   ͦͷ݁Ռɼ๢͘ͳΔͱ͍͏ࣄނ͕ى͖ͨ
   தࠃਓͷֶੜ͸ɼݕࡧ݁Ռʹ“ຬ଍”͍͕ͯͨ͠
   ݕࡧʹ͸“੒ޭ”͍ͯ͠ͳ͔ͬͨ
   

   View Slide

10. Ϣʔβͷݕࡧ׆ಈʹ͓͚Δ
    “ݕࡧͷ੒ޭ”ͱ“Ϣʔβͷຬ଍౓”
    ͷؔ܎Λௐ΂ͯΈΑ͏ʂ
    ͜ͷ࿦จͰ΍͍ͬͯΔ͜ͱΛҰݴͰʂʂ
    

    View Slide

11. ✓ ݕࡧ׆ಈΛ௨ͯ͠ͷϢʔβͷओ؍తͳײ৘ʹΑͬ
    ͯଌΒΕΔ
    ✓ Ϣʔβʹͱͬͯͷಛఆͷ৘ใཁ͕݅ຬͨ͞Ε͍ͯ
    Δ͜ͱ
    “Ϣʔβͷຬ଍”ͱ͸
    

    View Slide

12. ✓ ݕࡧ׆ಈΛ௨ͯ͠ಘΒΕΔ٬؍తͳ݁ՌʹΑͬͯ
    ଌΒΕΔ
    ✓ ͋Β͔͡Ίఆٛ͞Εͨج४ʹΑͬͯଌఆ͞ΕΔ
    ͔ɺ֘౰υϝΠϯͷઐ໳ՈʹΑͬͯධՁ͞ΕΔ
    “ݕࡧͷ੒ޭ”ͱ͸
    

    View Slide

13. ✓ ඃݧऀΛूΊͯࢦఆͨ͠ݕࡧλεΫΛ͜ͳͯ͠΋Β͏
    ✓ Ϣʔβ͕ݕࡧʹຬ଍͔ͨ͠ΛώΞϦϯά
    ✓ λεΫ͝ͱʹઐ໳ՈʹΑΔਖ਼ղΛ༻ҙɽϢʔβͷݕࡧ
    ͕੒ޭ͍ͯͨ͠ͷ͔Λݕূ
    ࣮ݧͯ͠ΈΑ͏ʂ
    

    View Slide

14. Ϣʔβ͸ຬ଍͕ͨ͠ݕࡧʹ͸੒ޭ͍ͯ͠ͳ͍ྫ
    

    View Slide

15. ✓ શମͷ 28.3 % ͕ɼ“ຬ଍͍ͯ͠Δ͕ࣦഊ”
    ✓ શମͷ 12.0 % ͕ɼ“ຬ଍͍ͯ͠ͳ͍͕੒ޭ”
    ݁Ռ
    શମͷ 40.3 % ΋ͷׂ߹ʹ͓͍ͯɼ
    “Ϣʔβͷຬ଍”ͱ“ݕࡧͷ੒ޭ”͕Ұக͍ͯ͠ͳ͍
    “Satisfaction with Failure”
    “Unsatisfied Success”
    

    View Slide

16. ✓ Readability: จॻͷಡΈ΍͢͞
    ✓ Credibility: จॻͷ৴པੑ
    ผͷ؍఺͔Β“Ϣʔβͷຬ଍”ʹؔ܎͢ΔཁૉΛ෼ੳ
    ✓ Difficulty: λεΫͷ೉қ౓
    ✓ Interest: λεΫͷ಺༰΁ͷڵຯ
    ✓ Knowledge: λεΫͷ಺༰΁ͷࣄલ஌ࣝ
    Subjective factors (Ϣʔβ͔ΒώΞϦϯά)
    Objective factors (ઐ໳ՈʹΑͬͯ൑ఆ)
    

    View Slide

17. Objective factors
    ͱ
    Ϣʔβͷײ͡Δ༗༻౓
    

    View Slide

18. ಡΈ΍͚͢Ε͹ίϯςϯπͷ٬؍తͳ৘ใྔʹؔΘΒͣɼ
    ༗༻Ͱ͋ΔͱϢʔβ͸൑அ͢Δ
    

    View Slide

19. ίϯςϯπͷ৴པੑ͕ߴͯ͘΋௿ͯ͘΋ɼ
    ϢʔβʹΑΔ༗༻ੑͷ൑அʹ΄΅Өڹ͕ͳ͍
    

    View Slide

20. Subjective factors
    ͱ
    Ϣʔβͷײ͡Δ༗༻౓
    

    View Slide

21. ࣄલʹݕࡧλεΫ͕೉͍͠ͱײ͍ͯͨ͡Β
    ίϯςϯπ͕ྑͯ͘΋༗༻ੑ͕͋Δͱײ͡ʹ͍͘
    

    View Slide

22. ݕࡧλεΫ΁ͷڵຯ͕େ͖͚Ε͹
    ίϯςϯπ͕ྑ͍ͱ༗༻ੑ͕͋Δͱײ͡΍͍͢
    

    View Slide

23. ݕࡧλεΫ΁ͷࣄલ஌͕ࣝେ͖͚Ε͹
    ίϯςϯπ͕ѱ͍ͱ༗༻ੑ͕ͳ͍ͱײ͡΍͍͢
    

    View Slide

24. ✓ Ϣʔβͷݕࡧ׆ಈʹ͓͚Δ“ݕࡧͷ੒ޭ”ͱ“Ϣʔβͷຬ଍౓”ͷؔ܎ੑʹ
    ͍ͭͯௐࠪ͢Δ࿦จ
    ✓ ࣮ݧͰ͸શମͷ 40.3 % ΋͕ “Satisfaction with Failure” or
    “Unsatisfied Success”
    ✓ จॻͷಡΈ΍͢͞΍৴པੑͳͲͱɼϢʔβͷײ͡Δ༗༻౓ͷؔ܎΋෼ੳ
    ·ͱΊ
    

    View Slide

25. ✓ The Web Conference ͍ͬͯ͏ Web ܥͷΧϯϑΝϨϯε͕͋ΔΑʂ
    ✓ ঺հͨ͠Α͏ͳׂͱಡΈ΍͍͢࿦จ΋౤ߘ͞ΕͯΔΑʂ
    ✓ ීஈͷۀ຿ʹ׆͔ͤΔ͔΋ʂʁ
    ✓ Έͳ͞Μ΋ੋඇڵຯΛ͍͚࣋ͬͯͨͩΕ͹ʂ
    ✓ ๻΋࠷ۙ͋·ΓಡΊͯͳ͍ͷͰਫ਼ਐ͠·͢
    ఻͔͑ͨͬͨ͜ͱ
    

    View Slide