Share
Embed
Slide 1
Slide 1 text
©2019 Wantedly, Inc.
σʔλ׆༻ͷࡍʹϋϚͬͯ͠·ͬͯ
ਏ͔ͬͨ͜ͱ
σʔλͱMLपลΤϯδχΞϦϯάΛߟ͑Δձ #2
19.July.2019 - Yuya Matsumura @yu-ya4
Slide 2
Slide 2 text
©2019 Wantedly, Inc.
✓ Yuya Matsumura (দଜ ༏)
✓ Software Engineer (ݕࡧɾਪનΤϯδχΞ)
✓ Wantedly, Inc. Recommendation Team (since April 2018)
✓ Interested in Information Retrieval, Machine Learning
Self-Introduction
@yu-ya4
@yu__ya4
Slide 3
Slide 3 text
©2018 Wantedly, Inc.
Slide 4
Slide 4 text
©2019 Wantedly, Inc.
Wantedly ʹ͓͚Δੵۃతͳσʔλ׆༻
㾎උ͞Εͨσʔλج൫
w ͋ΒΏΔϩάσʔλ#JH2VFSZʹอଘ
w ओཁͳػೳ͝ͱͷϩάʢMPHVTFS@TFBSDI@MPH::::..%%ʣ
w EBJMZͰͷ3%#ͷεφοϓγϣοτʢSECVTFST::::..%%ʣ
w EBJMZͰͷਪન݁ՌʢSFDPNNOFESBOLJOH::::..%%ʣ
w ੳ͍͢͠Α͏ʹɼલॲཧΛߦ͍ϩάσʔλΛܗͨ͠தؒςʔϒϧͷ
࡞ɾڞ༗
Slide 5
Slide 5 text
©2019 Wantedly, Inc.
Wantedly ʹ͓͚Δੵۃతͳσʔλ׆༻
㾎σʔλ׆༻ͷຽओԽ
w ϏδωεαΠυؚΊɼࣾһશһ͕#JH2VFSZͰσʔλʹΞΫηεͰ͖Δڥ
w #JH2VFSZͷ͍ํͱυϝΠϯࣝ֫ಘ͢ΔͨΊͷ৽ਓݚमͷ࣮ࢪ
w ΞϓϦέʔγϣϯΤϯδχΞ͕ࣗͨͪͰσʔλੳΛߦͬͯ՝ΛѲͯ͠
ࢪࡦΛ࣮ࢪ͠ɼͦͷ݁ՌͷධՁ·ͰΛߦ͏ମ੍
IUUQTTQFBLFSEFDLDPNZVZBXBOUFEMZOFXDPNFSUSBJOJOHCJHRVFSZUSBJOJOH
Slide 6
Slide 6 text
©2019 Wantedly, Inc.
σʔλ׆༻ͷࡍʹϋϚͬͯ͠·ͬͯ
ਏ͔ͬͨࣄྫΛ͍͔ͭ͘͝հ(´ʀТʀʆ)
Slide 7
Slide 7 text
©2019 Wantedly, Inc.
ਏ͔ͬͨ͜ͱᶃ
Λද͢ςʔϒϧsuffix
ᶃ log.user_search_log20190718
→ 20197݄18ͷ1ͷϩά͕ೖͬͨςʔϒϧ
ᶄ rdb.users20190718
→
ᶅ recommend.ranking20190718
→ɹ
Slide 8
Slide 8 text
©2019 Wantedly, Inc.
ਏ͔ͬͨ͜ͱᶃ
Λද͢ςʔϒϧsuffix
ᶃ log.user_search_log20190718
→ 20197݄18ͷ1ͷϩά͕ೖͬͨςʔϒϧ
ᶄ rdb.users20190718
→ 20197݄1824:00࣌ͰͷRDBͷεφοϓγϣοτ
ᶅ recommend.ranking20190718
→ 20197݄18ʹ༻͍ͨϥϯΩϯά
Slide 9
Slide 9 text
©2019 Wantedly, Inc.
ਏ͔ͬͨ͜ͱᶃ
ҙຯͷҟͳΔΛද͢ςʔϒϧsuffix
ᶃ log.user_search_log20190718
→ 20197݄18ͷ1ͷϩά͕ೖͬͨςʔϒϧ
ᶄ rdb.users20190718
→ 20197݄1824:00࣌ͰͷRDBͷεφοϓγϣοτ
→ 20197݄18ʹ࡞͞Εͨ20197݄1724:00࣌ͰͷRDBͷεφοϓγϣοτ
ᶅ recommend.ranking20190718
→ 20197݄18ʹ༻͍ͨϥϯΩϯά
→ 20197݄18·ͰͷσʔλΛݩʹ࡞͞Εͨ20197݄19ʹ༻͍ͨϥϯΩϯά
Slide 10
Slide 10 text
©2019 Wantedly, Inc.
ਏ͔ͬͨ͜ͱᶃ
ҙຯͷҟͳΔΛද͢ςʔϒϧsuffix
ᶃ log.user_search_log20190718
→ 20197݄18ͷ1ͷϩά͕ೖͬͨςʔϒϧ
ᶄ rdb.users20190718
→ 20197݄1824:00࣌ͰͷRDBͷεφοϓγϣοτ
→ 20197݄18ʹ࡞͞Εͨ20197݄1724:00࣌ͰͷRDBͷεφοϓγϣοτ
ᶅ recommend.ranking20190718
→ 20197݄18ʹ༻͍ͨϥϯΩϯά
→ 20197݄18·ͰͷσʔλΛݩʹ࡞͞Εͨ20197݄19ʹ༻͍ͨϥϯΩϯά
←͔͠ͷʹΑͬͯ
ɹ20197݄18ʹ༻͍ͨϥϯΩϯάΛද͢
ʢೖࣾؒͳ͍΅͕͘࡞ͬͨɻɻɻʣ
Slide 11
Slide 11 text
©2019 Wantedly, Inc.
ਏ͔ͬͨ͜ͱᶃ
ҙຯͷҟͳΔΛද͢ςʔϒϧsuffix
ᶃ log.user_search_log20190718
→ 20197݄18ͷ1ͷϩά͕ೖͬͨςʔϒϧ
ᶄ rdb.users20190718
→ 20197݄1824:00࣌ͰͷRDBͷεφοϓγϣοτ
→ 20197݄18ʹ࡞͞Εͨ20197݄1724:00࣌ͰͷRDBͷεφοϓγϣοτ
ᶅ recommend.ranking20190718
→ 20197݄18ʹ༻͍ͨϥϯΩϯά
→ 20197݄18·ͰͷσʔλΛݩʹ࡞͞Εͨ20197݄19ʹ༻͍ͨϥϯΩϯά
͜ͷ͋ͱ໓ۤυΩϡϝϯτ࡞ͬͨɻ
Slide 12
Slide 12 text
©2019 Wantedly, Inc.
ਏ͔ͬͨ͜ͱᶄ
json ܗࣜͰهड़͞Εͨ STRING ͷΧϥϜ
ϦΫΤετύϥϝλΈ͍ͨͳͷΛ json ܗࣜͷ STRING Ͱอଘ͍ͯ͠Δ
ύϥϝλ͕૿͑ͨΓݮͬͨΓ͢Δɼςʔϒϧͷ Schema Λมߋ͢Δ
ඞཁ͕ͳ͍ͷͰϕϯϦ
→
Slide 13
Slide 13 text
©2019 Wantedly, Inc.
ਏ͔ͬͨ͜ͱᶄ
json ܗࣜͰهड़͞Εͨ STRING ͷΧϥϜ
• ಛఆͷ filter ͕ΘΕͨͱ͖ͷ log ͚ͩूΊͯੳ͍ͨ͠ʂ
• ͍ΖΜͳάϥϑΛ࡞ͬͯ BI πʔϧʹొͩʂ
• ͜ͷσʔλΛͬͯ model Λ࡞ʂ
Slide 14
Slide 14 text
©2019 Wantedly, Inc.
ਏ͔ͬͨ͜ͱᶄ
json ܗࣜͰهड़͞Εͨ STRING ͷΧϥϜʹ࿔͞ΕΔDS
• ಛఆͷ filter ͕ΘΕͨͱ͖ͷ log ͚ͩूΊͯੳ͍ͨ͠ʂ
• ͍ΖΜͳάϥϑΛ࡞ͬͯ BI πʔϧʹొͩʂ
• ͜ͷσʔλΛͬͯ model Λ࡞ʂ
ύϥϝλ͕૿͑ͨΓݮͬͨΓ͢Δɼੳ༻ͷΫΤϦBIπʔϧͷ
άϥϑ model ೦ͳ͜ͱʹ…
→
Slide 15
Slide 15 text
©2019 Wantedly, Inc.
ਏ͔ͬͨ͜ͱᶅ null
Slide 16
Slide 16 text
©2019 Wantedly, Inc.
ਏ͔ͬͨ͜ͱᶅ "null"
Slide 17
Slide 17 text
©2019 Wantedly, Inc.
ਏ͔ͬͨ͜ͱᶅ
json ܗࣜͷ STRING ͷΧϥϜΛॲཧͯ͠ੳ༻ͷதؒςʔϒϧΛ࡞ͨ͠ࡍ
ʹ͜͏ͳͬͯ͠·͍ͬͯͨɻ
"null"
Slide 18
Slide 18 text
©2019 Wantedly, Inc.
ਏ͔ͬͨ͜ͱᶅ
null Λআ͍ͨ ARRAY Λ࡞͍ͬͯΖ͍Ζॲཧͨ͠ޙʹɼͦͷ ARRAY ͷཁૉ
ͷΛ͑ΔʢARRAY_LENGTH() ʣͬͯॲཧΛͨ͠ͱ͖ʹ௧͍ʹ…
"null"
Slide 19
Slide 19 text
©2019 Wantedly, Inc.
ਏ͔ͬͨ͜ͱᶅ
json ܗࣜͰ݁ՌΛݟΕؾ͚ͮͨɻʢແཧͰʁʣ
"null"
Slide 20
Slide 20 text
©2019 Wantedly, Inc.
ਏ͔ͬͨ͜ͱᶅ
৽UIͰվળ͞Εͨ
"null"
Slide 21
Slide 21 text
©2019 Wantedly, Inc.
͓ΘΓ
㾎ਏ͔ͬͨ͜ͱʢࣗۀࣗಘʣ
w ҙຯͷҟͳΔΛද͢ςʔϒϧTV⒏Y
w KTPOܗࣜͰهड़͞Εͨ453*/(ͷΧϥϜʹ࿔͞ΕΔ%4
w OVMM