会社訪問アプリ「Wantedly Visit」 における募集画像がユーザーに与える影響

2022年3月1日 DEIM2022 (https://event.dbsj.org/deim2022/) における技術報告の資料です。

[C34]感情・評判・公平性　3月1日 15:15 ～ 17:45
https://cms.dbsj.org/deim2022/program/?oral#/C34

会社訪問アプリ「Wantedly Visit」において募集の画像がユーザの行動に与える影響を調査するために行った検証実験について紹介します。

Transcript

1. ©2022 Wantedly, Inc.
   ձࣾ๚໰ΞϓϦʮWantedly Visitʯ

   ʹ͓͚Δืूը૾͕Ϣʔβʔʹ༩͑ΔӨڹ
   C[34-6]
   DEIM2022 [C34]ײ৘ɾධ൑ɾެฏੑʲٕज़ใࠂʳ
   1.March.2022 - ߹ాपฏʢ΢ΥϯςουϦʔגࣜձࣾʣ
   

   View Slide

2. ©2022 Wantedly, Inc.
   1. ͸͡Ίʹ
   • ࣗݾ঺հɺձࣾͱϓϩμΫτͷ঺հ
   • ϓϩμΫτʹ͓͚ΔσʔλαΠΤϯεͷऔΓ૊Έࣄྫ
   • ΞΧσϛΞʹ͓͚Δ׆ಈ
   2. ձࣾ๚໰ΞϓϦʮWantedly Visitʯʹ͓͚Δืूը૾͕Ϣʔβʔʹ༩͑ΔӨڹ
   • Ϟνϕʔγϣϯ
   • ݕূํ๏
   • ࣮ݧ݁Ռɾߟ࡯
   ໨࣍
   

   View Slide

3. ©2022 Wantedly, Inc.
   1. ͸͡Ίʹ
   • ࣗݾ঺հɺձࣾͱϓϩμΫτͷ঺հ
   • ϓϩμΫτʹ͓͚ΔσʔλαΠΤϯεͷऔΓ૊Έࣄྫ
   • ΞΧσϛΞʹ͓͚Δ׆ಈ
   2. ձࣾ๚໰ΞϓϦʮWantedly Visitʯʹ͓͚Δืूը૾͕Ϣʔβʔʹ༩͑ΔӨڹ
   • Ϟνϕʔγϣϯ
   • ࣮ݧઃఆ
   • ࣮ݧ݁Ռ
   • ߟ࡯ɾԾઆ
   ໨࣍
   

   View Slide

4. ©2022 Wantedly, Inc.
   ࣗݾ঺հ
   ߹ా पฏ (Shuhei Goda)
   ✓ ΢ΥϯςουϦʔגࣜձࣾ σʔλαΠΤϯςΟετ
   ✓ Kaggle Master
   @hakubishin3
   @jy_msc
   

   View Slide

5. ©2022 Wantedly, Inc.
   ձࣾ঺հ
   "γΰτͰίίϩΦυϧͻͱΛ;΍͢"
   "CREATE A WORLD WHERE WORK DRIVES PASSION"
   

   View Slide

6. ©2022 Wantedly, Inc.
   ձࣾ๚໰ΞϓϦ Wantedly Visit
   

   View Slide

7. ©2022 Wantedly, Inc.
   ϓϩμΫτʹ͓͚ΔσʔλαΠΤϯεͷऔΓ૊Έࣄྫ
   

   View Slide

8. ©2022 Wantedly, Inc.
   Ϣʔβ͝ͱʹ࠷దԽ͞Εͨίϯςϯπͷਪન
   Ϣʔβʹద੾ͳίϯςϯπΛఏڙͯ͠
   ཧ૝ͷϚονϯάΛ࣮ݱ͢ΔͨΊͷ༷ʑͳਪનγεςϜ
   ࣗવݴޠॲཧ΍ػցֶशͳͲ༷ʑͳٕज़Λ׆༻
   

   View Slide

9. ©2022 Wantedly, Inc.
   ϢʔβͷʮڵຯʯʹΑΔϚονϯά
   Ϣʔβ͕બ୒ͨ͠ʮڵຯʯʹجͮ͘ืूͱͷϚονϯά
   ʮ৬छʯͳͲʹΑΔϑΟϧλϦϯάͷΈͰ͸ݟ͚ͭΒΕͳ
   ͍ΑΓϢʔβͷᅂ޷ʹ߹ͬͨืूΛਪન͢Δ
   

   View Slide

10. ©2022 Wantedly, Inc.
    ΞΧσϛΞʹ͓͚Δ׆ಈ
    

    View Slide

11. ©2022 Wantedly, Inc.
    ࠃࡍֶձ΁ͷௌߨࢀՃ / ࿦จಡΈձΠϕϯτͷاըӡӦ
    

    View Slide

12. ©2022 Wantedly, Inc.
    ֶձซઃίϯϖςΟγϣϯͰͷೖ৆ɾ࿦จ౤ߘɾൃද
    RecSys’20 WSDM’21 SIGIR’21
    

    View Slide

13. ©2022 Wantedly, Inc.
    DEIM ΁ͷڠࢍ / ٕज़ใࠂ
    https://event.dbsj.org/deim2022/
    

    View Slide

14. ©2022 Wantedly, Inc.
    ձࣾ๚໰ΞϓϦʮWantedly Visitʯ
    ʹ͓͚Δืूը૾͕Ϣʔβʔʹ༩͑ΔӨڹ
    

    View Slide

15. ©2022 Wantedly, Inc.
    ձࣾ๚໰ΞϓϦʮWantedly Visitʯʹ͓͍ͯืूը૾͕Ϣʔβʔͷߦಈʹ
    ༩͑ΔӨڹΛௐࠪ͢ΔͨΊʹݕূ࣮ݧΛ࣮ࢪ
    ձࣾ๚໰ΞϓϦʮWantedly Visitʯʹ͓͚Δืूը૾͕Ϣʔβʔʹ༩͑ΔӨڹ
    

    View Slide

16. ©2022 Wantedly, Inc.
    WhyɿϞνϕʔγϣϯ
    

    View Slide

17. ©2022 Wantedly, Inc.
    • ืूʹఴ෇͢Δը૾΁ͷͩ͜ΘΓ
    ➡ اۀͷΧϧνϟʔ΍ͦ͜Ͱಇ͘ਓͷงғؾͳͲɺݴޠԽ͕೉͍͠৘ใ͕൓ө͞Ε͍ͯΔ
    ➡ ͦͷͨΊϢʔβʔ͕ࣗ෼ʹ߹ͬͨڞײͰ͖ΔձࣾΛ୳͢ͷʹ༗༻ͩͱߟ͍͑ͯΔ
    Ϟνϕʔγϣϯ
    

    View Slide

18. ©2022 Wantedly, Inc.
    ◦
    Ϟνϕʔγϣϯ
    • ืूը૾ͷΫΦϦςΟͷ୲อ
    ➡ ίϯςϯπɾΫΦϦςΟɾΨΠυϥΠϯΛઃ͚ɺืूܝࡌ࣌ʹ͸ਓྗͰͷνΣοΫΛ࣮ࢪ
    https://www.wantedly.com/about/guideline#members_guideline_cover_image
    

    View Slide

19. ©2022 Wantedly, Inc.
    Ϟνϕʔγϣϯ
    • ืूը૾͕໨ཱͭ UI ͷఏڙ
    ืूͷτοϓϖʔδ ืूͷৄࡉϖʔδ
    ը૾̍
    

    View Slide

20. ©2022 Wantedly, Inc.
    Ϟνϕʔγϣϯ
    • Ϣʔβʔ͕ࣗ਎ʹ͋ͬͨืूΛ୳͢͜ͱʹରͯ͠ը૾͕ߩݙ͍ͯ͠Δ͔Λ

    ఆྔతʹݕূ͍ͨ͠
    ➡ ը૾͸ϢʔβͷߦಈʹӨڹΛ༩͍͑ͯΔͷ͔
    - ը૾͸Ͳͷߦಈʹରͯ͠ӨڹΛ༩͍͑ͯΔͷ͔
    - ը૾͸Ͳͷఔ౓ӨڹΛ༩͍͑ͯΔͷ͔ɺಛʹը૾Ҏ֎ͷ৘ใͱൺֱͯ͠Ͳ͏͔
    ➡ Ͳ͏ͯͦ͠͏ͳͬͨͷ͔
    ➡ Ͳ͏͍͏ը૾ͳΒӨڹ͕େ͖͍͔
    

    View Slide

21. ©2022 Wantedly, Inc.
    Howɿݕূํ๏
    

    View Slide

22. ©2022 Wantedly, Inc.
    ݕূํ๏
    • Ϣʔβʔ͕ืू΁ͷԠืʹࢸΔϑΝωϧʢΫϦοΫ → Ԡืʣʹ͓͍ͯɺ

    ֤εςοϓͷߦಈΛը૾Λ༻͍Δ͜ͱͰ༧ଌͰ͖Δͷ͔ݕূ͢Δ
    ืूͷτοϓϖʔδ ืूͷৄࡉϖʔδ
    ΫϦοΫ
    Ԡื
    

    View Slide

23. ©2022 Wantedly, Inc.
    ݕূํ๏
    • Ϣʔβʔ͕ืू΁ͷԠืʹࢸΔϑΝωϧʢΫϦοΫ → Ԡืʣʹ͓͍ͯɺ

    ֤εςοϓͷߦಈΛը૾Λ༻͍Δ͜ͱͰ༧ଌͰ͖Δͷ͔ݕূ͢Δ
    ➡ ༧ଌର৅ͱͳΔ 2 छྨͷߦಈ
    - ΫϦοΫ: ืूͷτοϓϖʔδ͔ΒืूͷৄࡉϖʔδʹભҠ͢Δߦಈ
    - Ԡื: ืूͷৄࡉϖʔδ͔Βʮ࿩Λฉ͖ʹߦ͖͍ͨʯϘλϯΛԡ͢ߦಈ
    

    View Slide

24. ©2022 Wantedly, Inc.
    ݕূํ๏
    • Ϣʔβʔ͕ืू΁ͷԠืʹࢸΔϑΝωϧʢΫϦοΫ → Ԡืʣʹ͓͍ͯɺ

    ֤εςοϓͷߦಈΛը૾Λ༻͍Δ͜ͱͰ༧ଌͰ͖Δͷ͔ݕূ͢Δ
    ➡ ༧ଌର৅ͱͳΔ 2 छྨͷߦಈ
    - ΫϦοΫ: ืूͷτοϓϖʔδ͔ΒืूͷৄࡉϖʔδʹભҠ͢Δߦಈ
    - Ԡื: ืूͷৄࡉϖʔδ͔Βʮ࿩Λฉ͖ʹߦ͖͍ͨʯϘλϯΛԡ͢ߦಈ
    ➡ ࠓճ͸ɺϢʔβͷ୹ظతͳߦಈʹର͢ΔӨڹ͔͠ݕূ͠ͳ͍
    

    View Slide

25. ©2022 Wantedly, Inc.
    ݕূํ๏
    • Ϣʔβʔ͕ืू΁ͷԠืʹࢸΔϑΝωϧʢΫϦοΫ → Ԡืʣʹ͓͍ͯɺ

    ֤εςοϓͷߦಈΛը૾Λ༻͍Δ͜ͱͰ༧ଌͰ͖Δͷ͔ݕূ͢Δ
    ➡ ༧ଌର৅ͱͳΔ 2 छྨͷߦಈ
    - ΫϦοΫ: ืूͷτοϓϖʔδ͔ΒืूͷৄࡉϖʔδʹભҠ͢Δߦಈ
    - Ԡื: ืूͷৄࡉϖʔδ͔Βʮ࿩Λฉ͖ʹߦ͖͍ͨʯϘλϯΛԡ͢ߦಈ
    ➡ ࠓճ͸ɺϢʔβͷ୹ظతͳߦಈʹର͢ΔӨڹ͔͠ݕূ͠ͳ͍
    ➡ ؆୯ԽͷͨΊɺϢʔβҰਓҰਓͷӨڹΛݸผʹݟΔͷͰ͸ͳ͘Ϣʔβશମͷ܏޲Λݕূ͢Δ
    - ͦͷืू͕ΫϦοΫ͞Ε΍͍͔͢Ͳ͏͔Λ༧ଌ
    - ͦͷืू͕Ԡื͞Ε΍͍͔͢Ͳ͏͔Λ༧ଌ
    

    View Slide

26. ©2022 Wantedly, Inc.
    ࣮ݧ֓ཁ
    • ༧ଌର৅
    - ΫϦοΫλεΫ: ืूͷΫϦοΫϢʔβ཰ (= ืूΛΫϦοΫͨ͠Ϣʔβ਺ / ืूΛimpͨ͠Ϣʔβ਺
    )
    
    - ԠืλεΫ: ืूͷԠืϢʔβ཰ (= ืूʹԠืͨ͠Ϣʔβ਺ / ืूΛΫϦοΫͨ͠Ϣʔβ਺
    )
    
    • ༧ଌϞσϧͷೖྗύλʔϯ
    - ืूը૾ͷΈ
    - ืूςΩετͷΈ
    - ืूը૾ͱืूςΩετͷ྆ํ
    • ਖ਼ղɾෆਖ਼ղͷఆٛ
    - ධՁ΍ղऍ͕͠΍͍͢ͷͰೋ஋෼ྨʹམͱ͠ࠐΉ
    - ༧ଌର৅ͷ෼෍ͷ 60 percentile ͔Β্Λਖ਼ྫɺ40 percentile ͔ΒԼΛෛྫ [1]
    [1]: Azimi, Javad and Zhang, Ruofei and Zhou, Yang and Navalpakkam, Vidhya and Mao, Jianchang and Fern, Xiaoli. 2012.
    
    
    Visual Appearance of Display Ads and Its Effect on Click through Rate. Proceedings of the 21st ACM international conference on Information and knowledge management P. 495-504.
    

    View Slide

27. ©2022 Wantedly, Inc.
    ࣮ݧσʔλ
    • Wantedly Visit ʹ͓͚Δ 2018/01 - 2022/01 ͷ 3 ೥෼ͷߦಈϩά
    • ʮத్ʯ΋͘͠͸ʮ෭ۀʯͷืू
    • ໌Β͔ʹը૾Ҏ֎ͷཁҼͰΫϦοΫ͞Εա͗ΔɾԠื͞Εա͗ΔืूΛআ֎
    - όζͬͨืूɺ࣌੎ͷӨڹ͕ڧ͍ืूɺet
    c
    
    • ਖ਼ྫͱෛྫͰ෼͚ͨͱ͖ʹը૾Ҏ֎ͷଐੑͰภΓ͕ੜ͡ͳ͍Α͏૚ผαϯϓϦϯά
    

    View Slide

28. ©2022 Wantedly, Inc.
    ධՁ
    • ςετσʔλͷ෼ׂ
    - σʔληοτͷ 20 % Λςετσʔλͱͯ͠ར༻
    • ධՁࢦඪ
    - ROC-AUC Scor
    e
    
    - F1 Score
    

    View Slide

29. ©2022 Wantedly, Inc.
    ݕূ༻ϞσϧͷΞʔΩςΫνϟ
    3FT/FU
    ը૾
    '$MBZFS
    5'*%'
    47%/.'
    ςΩετ
    '$MBZFS
    ը૾ͷΈ࢖͏ύλʔϯ ςΩετͷΈ࢖͏ύλʔϯ
    3FT/FU
    ը૾
    '$MBZFS
    5'*%'
    47%/.'
    ςΩετ
    '$MBZFS
    $PODBU
    '$MBZFS
    ը૾ͱςΩετͷ྆ํΛ࢖͏ύλʔϯ
    

    View Slide

30. ©2022 Wantedly, Inc.
    Resultsɿ࣮ݧ݁Ռɾߟ࡯
    

    View Slide

31. ©2022 Wantedly, Inc.
    ࣮ݧ݁Ռᶃ
    ΫϦοΫλεΫ ԠืλεΫ
    ςετσʔλΛ࣮ࡍͷΫϦοΫϢʔβ཰ / ԠืϢʔβ཰Ͱιʔτ͠ɺ྆୺ͷσʔλΛk = δn ͚ͩநग़
    • ը૾ͱςΩετ͸ࠨࣼΊ্ํ޲ʹਪҠ͓ͯ͠ΓΫϦοΫ܏޲Λ༧ଌͰ͖͍ͯΔ
    • ςΩετ͸Ԡื܏޲Λ༧ଌͰ͖͍ͯΔ͕ɺը૾͸΄΅ԣ͹͍ʹਪҠ͓ͯ͠Γ༧ଌ͕౰͍ͨͬͯͳ͍
    

    View Slide

32. ©2022 Wantedly, Inc.
    ࣮ݧ݁Ռᶄ
    શςετσʔλΛ࢖ͬͯΫϦοΫλεΫΛධՁͨ݁͠Ռ
    • ը૾ΑΓ΋ςΩετͷํ͕είΞ͕ߴ͍
    • ςΩετ୯ମΑΓ΋ɺը૾ͱςΩετΛซ༻ͨ͠΄͏͕είΞ͕޲্
    

    View Slide

33. ©2022 Wantedly, Inc.
    ࣮ݧ݁Ռᶅ
    ΫϦοΫλεΫʹ͓͚Δ༧ଌ܏޲Λൺֱ
    • ςΩετ͚ͩͰ౰ͯΒΕΔέʔεͱը૾͚ͩͰ౰ͯΒΕΔέʔεʹҧ͍͕͋Δ
    ը૾ͷΈɺςΩετͷΈ ը૾ͱςΩετɺςΩετͷΈ
    

    View Slide

34. ©2022 Wantedly, Inc.
    ఆੑධՁ
    • ΫϦοΫ܏޲͕ߴ͍ͱ༧ଌ͞Εͨը૾ಛ௃ͷҰྫ
    - σβΠϯʹͩ͜Θ͍ͬͯΔ
    - ը࣭͕ߴ͍
    - എܠ৭͕๛͔
    - νʔϜن໛Ͱਓ͕͍ࣸͬͯΔ
    (஫ҙॻ͖
    )
    
    ͋͘·Ͱશମ܏޲Λݟͨͱ͖ͷ݁ՌͰ͋Γɺຊདྷ͸ϢʔβݸʑਓʹΑͬͯ܏޲͸େ͖͘มΘΔɻ
    ͜ΕΒͷಛ௃͕ͳ͍͔ΒҰ֓ʹѱ͍ͱ͍͏Θ͚Ͱ͸ͳ͍ɻ
    

    View Slide

35. ©2022 Wantedly, Inc.
    ߟ࡯
    • ԠืλεΫͰը૾͚ͩͩͱશ͘౰ͯΒΕͳ͍ͷ͸ͳ͔ͥ
    ➡ืूͷৄࡉϖʔδ͔ΒԠืߦಈΛऔΔࡍɺϢʔβ͸ը૾ʹେ͖͘ࠨӈ͞ΕͣืूͷςΩετΛ
    ͔ͬ͠ΓಡΜͰ͔ΒԠื͢Δ͔൱͔Λҙࢥܾఆ͍ͯ͠Δ
    • ΫϦοΫλεΫͰςΩετͱը૾Ͱ౰ͯΒΕΔέʔεʹҧ͍͕ग़Δͷ͸ͳ͔ͥ
    ➡ഔମΛ௨ͯ͠఻͑ΒΕΔ৘ใͷछྨ͕ҟͳΔ
    - ςΩετ͚ͩͰ͸఻͑ΒΕͳ͍৘ใΛը૾Ͱ͸఻͑ΒΕ͍ͯΔ͔΋͠Εͳ͍
    ➡৘ใͷशಘʹཁ͢Δίετ(ޮ཰ੑ)͕ҟͳΔ
    - ը૾͸ίετ͕௿͘ɺςΩετ͸௕͍΄Ͳ৘ใΛर͏ͷʹඞཁͳίετ͕ߴ͘ͳΔ
    

    View Slide

36. ©2022 Wantedly, Inc.
    Future work
    Ϣʔβ୯ҐͰͷը૾ͷӨڹ
    ➡Ϣʔβʔͷੑ࣭΍ᅂ޷ੑ͸େ͖͘ҟͳΔ
    - ը૾ͷࢹ֮తಛ௃͕Ͳ͏ߦಈʹ࡞༻͢Δ͔͸ϢʔβʹΑͬͯେ͖͘ҟͳΔ͸ͣ
    - Ϣʔβͷߦಈ܏޲ʹΑͬͯϢʔβ͕ը૾Λॏࢹ͢Δ͔ςΩετΛॏࢹ͢Δ͔͸ҟͳΔ͸ͣ
    UIͷҧ͍ʹΑΔը૾ͷӨڹ
    ➡ը૾͕Ͳͷ͙Β͍ޮ͔͘͸UIʹґଘ͢Δ
    - ܦ࿏΍ഔମ(PC WebɺMobile WebɺMobile App)Ͱ UI ͕ҟͳΔ
    ਪનͰͷը૾ͷ׆༻
    ➡ը૾Ͱ͔͠આ໌͕͔ͭͳ͍܏޲͕ϓϩμΫτʹଘࡏ͢Δ
    

    View Slide

37. ©2022 Wantedly, Inc.
    ·ͱΊ
    • Wantedly Visit ʹ͓͍ͯը૾͕Ϣʔβʔͷߦಈʹ༩͑ΔӨڹΛௐࠪͨ͠
    ➡Ϣʔβʔ͕Ԡื͢Δ͜ͱʹରͯ͠ืूͷը૾͸د༩͍ͯ͠Δ
    - ืूৄࡉ͔ΒͷԠืͱ͍͏εςοϓͰ͸Өڹ͕খ͍͕͞
    - ืूτοϓϖʔδ͔Βืूৄࡉ΁ͷભҠ͢ΔεςοϓʹӨڹ͍ͯ͠Δ
    ➡ΫϦοΫλεΫʹ͓͍ͯςΩετ୯ମΑΓ΋ը૾୯ମͷ༧ଌਫ਼౓͸௿͍͕ɺ

    ςΩετͰ౰ͯΒΕ͍ͯͳ͍͕ը૾Ͱ͸౰ͯΒΕ͍ͯΔέʔε͕ଟ͍(ٯ΋͔͠Γ)ɹ
    - (Ծઆ1)৘ใͷछྨͷҧ͍: ը૾͸ςΩετͱҟͳΔ৘ใΛఏڙ͍ͯ͠Δ
    - (Ծઆ2)ޮ཰ੑͷҧ͍: ը૾͚ͩΛݟͯҰ࣍൑அ(ͳ͍͠͸ը૾͚ͩͰ൑அ)͍ͯ͠Δ
    

    View Slide