会社訪問アプリ「Wantedly Visit」での シゴトに関する興味選択機能と推薦改善

5回 Data-Centric AI勉強会の登壇資料です
https://dcai-jp.connpass.com/event/303111/

Transcript

1. © 2023 Wantedly, Inc. ձࣾ๚໰ΞϓϦʮWantedly VisitʯͰͷ γΰτʹؔ͢Δڵຯબ୒ػೳͱਪનվળ ୈ5ճ Data-Centric AIษڧձ Dec. 20 2023 - Shuhei Goda
2. © 2023 Wantedly, Inc. ͸͡Ίʹ
3. ©2023 Wantedly, Inc. ໊લɿ 
 ߹ా पฏ(Shuhei Goda) ॴଐͱ໾ׂɿ 
 ɾ΢ΥϯςουϦʔגࣜձࣾ(2019~) 
 ɾਪનνʔϜϦʔμʔ 
 ɾML Tech Lead & Product Manager 
 
 Kaggle Tierɿ 
 Kaggle Competitions Grandmaster @hakubishin3 @jy_msc ࣗݾ঺հ
4. © 2023 Wantedly, Inc. Ϣʔβʔ͕ڵຯΛબ୒Ͱ͖ΔػೳΛ։ൃ͠ɺ৽نొ࿥௚ޙͷମݧΛվળ • ձࣾ๚໰ΞϓϦʮWantedly Visitʯͷ৽نొ࿥ͷϑϩʔͰ͸ɺϢʔβʔͷᅂ޷ Λද͢৘ใΛे෼ʹऔಘͰ͖͓ͯΒͣɺίʔϧυελʔτ໰୊͕ੜ͍ͯͨ͡ • Ϣʔβʔ͕γΰτʹؔ͢ΔʮڵຯʯΛબ୒Ͱ͖Δػೳ։ൃͷաఔ΍ɺ
 Ϣʔβʔ͕બ୒ͨ͠ʮڵຯʯʹج͍ͮͨਪનվળʹ͍ͭͯ঺հ͢Δ ຊൃදͰ࿩͍ͨ͜͠ͱ
5. © 2023 Wantedly, Inc. ձࣾɾαʔϏεͷ঺հ
6. ©2023 Wantedly, Inc. ڀۃͷదࡐదॴʹΑΓɺ 
 γΰτͰίίϩΦυϧͻͱΛ;΍͢ ࢲͨͪͷϛογϣϯ ©2023 Wantedly, Inc.
7. © 2023 Wantedly, Inc. iOS, Android and Web ؾܰʹձࣾ๚໰ ϛογϣϯ΍Ձ஋؍΁ͷڞײͰϚονϯά • څ༩΍෱རްੜͳͲͷ৚݅Ͱ͸ͳ͘ɺ૝͍͕͋Ε͹ձࣾͷ ن໛ʹͱΒΘΕͳ͍ ·ͣʮ࿩Λฉ͖ʹߦ͘ʯͱ͍͏৽͍͠ମݧ • ݸਓͱاۀ͕ϑϥοτͳ໨ઢͰग़ձ͑Δ͜ͱͰɺΑΓັྗ తͳ৔ॴΛݟ͚ͭΔ͜ͱ͕Մೳʹ ձࣾ๚໰ΞϓϦʮWantedly Visitʯ
8. © 2023 Wantedly, Inc. ՝୊
9. © 2023 Wantedly, Inc. ৽نొ࿥ϢʔβʔͷԠื͕৳ͼ೰ΜͰ͍Δͱ͍͏໰୊͕͋ͬͨ • ཧ૝తʹ͸ɺ৽نొ࿥ޙ͙͢ʹڵຯͷҾ͘ืूͱग़ձͬͯཉ͍͠ • ৭ʑཁҼ͸͋Δ͕ɺͦͷ͏ͪͷ1ͭʹʮ৽نొ࿥ޙʹਪન͞ΕΔืू͕Ϣʔ βʔʹϚον͍ͯ͠ͳ͍ʯ ϓϩμΫτͷ՝୊
10. © 2023 Wantedly, Inc. ৽نొ࿥Ϣʔβʔͷᅂ޷Λද͢৘ใ͕গͳ͍ • ৽نొ࿥࣌ʹऔಘ͍ͯͨ͠ᅂ޷৘ใ͸ʮ৬छʯͷΈ • Wantedly Visit ͸ଟछଟ༷ͳۀքɾ෯޿͍೥ྸ૚ͷϢʔβʔ͕ར༻͓ͯ͠Γɺ ʮ৬छʯ͚ͩΛ؍఺ʹͨ͠γΰτ୳ͩ͠ͱରԠ͖͠Εͳ͍ - બ୒ࢶதͷ৬छʹબ΂Δ΋ͷ͕ͳ͍ - ৬छͷΈͰγΰτΛܾΊΒΕͳ͍ ৽نొ࿥௚ޙͷਪનͷ࣭͕͋·Γߴ͘ͳ͍ͷ͸ͳ͔ͥ
11. © 2023 Wantedly, Inc. Ͳ͏ղܾ͢Δ͔
12. © 2023 Wantedly, Inc. ໨తɿΑΓଟ͘ͷਓ͕ɺొ࿥ޙ͙͢ʹڵຯΛҾ͘ืूͱग़ձ͑ΔΑ͏ʹ͢Δ ղܾ΁ͷํ਑ɿ୭΋͕৬छҎ֎ͷγΰτʹؔ͢ΔʮڵຯʯΛબ΂ΔΑ͏ʹ ͠ɺબ୒ͨ͠ʮڵຯʯʹԠͯ͡ద੾ͳืू͕ਪન͞ΕΔΑ͏ʹ͢Δ ղܾ΁ͷํ਑ Step1 ڵຯΛબͿ Step2 ਪન͞ΕΔ
13. © 2023 Wantedly, Inc. Step1. ڵຯΛબͿ - Ͳ͏બΜͰ΋Β͏͔
14. © 2023 Wantedly, Inc. ҎԼΛ౿·্͑ͨͰɺ୭Ͱ΋ڵຯΛબ΂ΔΑ͏ʹ͢Δඞཁ͕͋Δ • ଟछଟ༷ͳϢʔβʔ͸ڵຯؔ৺ͷ෯͕޿͘ɺ͔ͭਂ͞Λ͍࣋ͬͯΔ • ෳ਺ͷ؍఺Ͱγΰτ୳͕͠ߦΘΕ͍ͯΔ ʮStep1. ڵຯΛબͿʯͷ࣮ݱʹ͋ͨͬͯؾΛ͚ͭΔ͜ͱ γΰτ୳͢͠Δ্Ͱͷ؍఺ͱͦͷཁૉͱͳΔʮڵຯʯͷҰྫ
15. © 2023 Wantedly, Inc. ಉ͡؍఺Ͱਖ਼൓ରͷબ୒ࢶΛൺֱ͢Δ͜ͱͰબͼ΍͘͢͢Δ • ͜ΕΛେ͖ͳཻ౓͔Β࢝ΊͯɺԿ౓͔બΜͰ͍Δͱ࠷ऴతʹਂ͍ڵຯؔ৺ʹ ͨͲΓண͚ΔΑ͏ʹ͢Δ ʮStep1. ڵຯΛબͿʯͷΞϓϩʔν Ξϓϩʔνͷྫʢ෼͔Γ΍͢͞ॏࢹͰγΰτΛ୊ࡐʹ͍ͯ͠ͳ͍Ͱ͢ʣ ֎Ͱ༡Ϳ ՈͰ༡Ϳ ήʔϜ͢Δ ษڧ͢Δ μʔΫι΢ϧΛ͢Δ ΅͘ͷͳͭ΍͢ΈΛ΍Δ
16. © 2023 Wantedly, Inc. UIͰͷදݱ ෳ਺ͷ؍఺Λಉ࣌ʹฒ΂Δ ಉ͡؍఺ͷڵຯΛฒ΂Δ
17. © 2023 Wantedly, Inc. ϫʔυΫϥ΢υ ʮڵຯʯΛબ୒͢ΔͱɺͦΕͷҰஈਂ͍֊૚
 ʹଘࡏ͢Δʮڵຯʯ͕৽͘͠௥Ճ͞ΕΔ
18. © 2023 Wantedly, Inc. Step1. ڵຯΛબͿ - ԿΛબΜͰ΋Β͏͔
19. © 2023 Wantedly, Inc. ଟ͘ͷϢʔβʔ͕બ୒Ͱ͖Δʮڵຯʯͷ 
 ୯ޠΛநग़ɺߏ଄Խ͢Δ ΫϥελϦϯάͷ݁Ռʹج͍ͮͯ Ϣʔβʔ͕ڵຯΛબΜͩޙʹ Ͳ͏͍͏ڵຯΛग़ݱͤ͞Δ͔ΛܾΊΔ UI/UX ʹ߹Θͤͯʮڵຯʯͷߏ଄Λ࡞Δ اۀͷืूͷৄࡉςΩετ ᶃڵຯͷநग़ ʮMLOpsʯ ʮ౷ܭతݕఆʯ ʮΠϯλʔϯʯ ʮඒ༰ʯ ʮDeep Learningʯ ʮVRσβΠϯʯ ʮσʔλαΠΤϯςΟετʯ … ᶄڵຯͷΫϥελϦϯά Ϋϥελͷ࡞੒ͱ୅ද఺ͷܾఆΛ࠶ؼతʹߦ͍ɺ
 ֊૚ߏ଄Λߏங ※Χοί಺ͷ਺ࣈ͸Document Frequencyʹ૬౰͢Δ΋ͷ
20. © 2023 Wantedly, Inc. σʔλ෼ੳख๏ʹج͍ͮͨ݁ՌΛૉҊͱͯ͠ɺਓखͰબఆɾߏ଄Խ • ҙຯͷ͋Δܗʹ·ͱ·͍ͬͯΔ͜ͱ΋͋Δ͠ɺͦ͏ͳΒͳ͍͜ͱ΋͋Δ • ߏ଄ͷ׬શͳࣗಈԽ͸ظ଴Ͱ͖ͳ͍͕ɺϓϥοτϑΥʔϜʹ͓͚Δʮڵຯʯ ͷधཁͱڙڅʹجͮ͘ߏ଄͸͓͓Αͦ͸Θ͔ΔͷͰҙຯ͸͋Δ • ͋Δ΂͖؍఺ͷఆٛ΍ΫϥελϦϯάͷ݁Ռͷղऍ͔Βߏ଄ΛݻΊ͍͖ͯɺ ͋Δఔ౓ࣗ༝౓͕ݮͬͨΒ·ͨΫϥελϦϯά͢ΔɺΛ܁Γฦ͢ Ͱ΋݁ہ͸ਓखͰ͢
21. © 2023 Wantedly, Inc. Step1. ڵຯΛબͿ - ԿݸબΜͰ΋Β͏͔
22. © 2023 Wantedly, Inc. ࠷௿ 3 ݸɺ ࠷େ 10 ݸʹઃఆͨ͠ • Ϣʔβʔͷ໌ࣔతͳᅂ޷৘ใ͸ଟ͘ཉ͍͠ • ೖྗͯ͠΋Β͏ྔͱ཭୤཰͕τϨʔυΦϑͷؔ܎ʹ͋Δ͕ɺ
 ཭୤͕૿Ճ͢ΔҎ্ͷޮՌ͕͋Δͱظ଴ͯ͠ઃఆ ԿݸબͿͱྑͦ͞͏ʁ
23. © 2023 Wantedly, Inc. Step2. ਪન͢Δ
24. © 2023 Wantedly, Inc. ಺༰ϕʔεϑΟϧλϦϯάΛ࠾༻ • ༧Ίʮڵຯʯ͝ͱʹϥϯΩϯάΛੜ੒͓͖ͯ͠ɺϦΫΤετ࣌ʹϢʔβͷબ ୒ͨ͠ʮڵຯʯʹ֘౰͢ΔϥϯΩϯάΛऔಘ͠ɺϥϯΩϯάείΞΛՙॏฏ ۉ͢Δ બ୒ͨ͠ڵຯʹج͍ͮͨਪન
25. © 2023 Wantedly, Inc. ݁Ռ͸Ͳ͏ͳ͔ͬͨ
26. © 2023 Wantedly, Inc. վળͤͣɺΉ͠ΖѱԽͯͦ͠͏ͳؾ഑͋Γ ϕʔεϥΠϯɿʮ৬छʯʹج͍ͮͨਪનΞϧΰϦζϜ A/B ςετͰݕূ
27. © 2023 Wantedly, Inc. ཁҼ͸ڵຯͷબ୒਺ͷ্ݶ͕ଟ͗ͨ͢͜ͱʢ࠷େ 10 ݸʣ • ࠓճ࡞੒ͨ͠ UI ʹΑͬͯɺڵຯΛ্ݶ͍ͬͺ͍·Ͱબ୒͢ΔϢʔβʔ͕ଟ͍ ͜ͱ͕Θ͔ͬͨ • ڵຯ͕ଟ͘બ୒͞ΕΔ͜ͱ͸خ͍͜͠ͱ͕ͩɺϢʔβʔʹͱͬͯॏཁͰͳ͍ ڵຯ΋ؚ·Εͯ͠·͏ˍͦͷॏཁ౓Λ൑அͰ͖ͳ͍͜ͱͰɺਪનਫ਼౓͕ѱԽ • શ͘աڈͷ৘ใͷͳ͍ঢ়گͩͱγϯϓϧͳऔΓ૊ΈʹͳΒ͟ΔΛಘͳ͍ • ͔ͩΒͦ͜ɺڵຯͷબ୒্ݶΛ͋͑ͯ཈͑Δબ୒ΛऔΔ ͳͥվળͰ͖͍ͯͳ͍ͷ͔
28. © 2023 Wantedly, Inc. ओཁͳϝτϦΫε͕ +30% ͱେ͖͘վળ 🎉 બ୒্ݶΛ10→6ʹมߋͯ͠ɺA/B ςετͰ࠶ݕূ
29. © 2023 Wantedly, Inc. Ϣʔβʔ͕ڵຯΛબ୒Ͱ͖ΔػೳΛ։ൃ͠ɺ৽نొ࿥௚ޙͷମݧΛվળ • Ϣʔβʔͷਖ਼֬ͳᅂ޷Λଟ͘औಘ͢Δ͜ͱ͕ɺΑΓྑ͍ମݧ޲্ʹͭͳ͕Δ • ڵຯબ୒ػೳͰ͸ҎԼΛຬͨ͢ UI Λ࡞Δ͜ͱͰબ୒཰ͷߴ͞Λ࣮ݱ • ந৅ˠ۩ମͱਂ΅ΕΔΑ͏ʹ͢Δ • ෳ਺ͷ؍఺͔Βબ΂ΔΑ͏ʹ͢Δ • ͋͑ͯબ୒্ݶΛ཈͑Δ͜ͱͰɺΑΓਖ਼֬ͳᅂ޷Λબ୒ͯ͠΋Β͑ΔΑ͏ʹ ຊൃදͷαϚϦʔ