データドリブンな組織の不正検知

1. σʔλυϦϒϯͳ૊৫ͷ ෆਖ਼ݕ஌ Fumihiro Kubota MoT/ίωώτ/Kanmu ͕ޠΔ ϓϩμΫτ։ൃxσʔλ෼ੳ
2. Copyright Kanmu, Inc. All right reserved. 2 ٱอా ࢙༸ ML Engineer at Kanmu, Inc. @fkubota @fkubota_ ࣗݾ঺հ
3. Copyright Kanmu, Inc. All right reserved. ػցֶशΤϯδχΞ fkubotaͷۀ຿಺༰ • ࣄۀΛ੒௕ͤ͞ΔखஈͷதͰσʔλͰͰ͖Δ͜ͱશൠ • ͦͷதͷҰ෦ʹML͕͋Δ • ϓϩμΫτ๊͕͍͑ͯΔ໰୊΍ղܾ͍ͨ͠Ϣʔβͷ௧ΈΛσ ʔλͰ໰୊ղܾͰ͖Δܗʹͯ͠ղ͘ͱ͍͏ͷ͕ͬ͘͟Γͱ ͨ͠ۀ຿ൣғ ࣄۀΛ੒௕ͤ͞Δखஈ σʔλͰͰ͖Δ͜ͱશൠ ML
4. Copyright Kanmu, Inc. All right reserved. 4 ϓϩμΫτʹ͍ͭͯ ෆਖ਼ͱରࡦ ϧʔϧϕʔεͷܾఆ 1 2 3 ΞδΣϯμ
5. ϓϩμΫτʹ͍ͭͯ 1
6. Copyright Kanmu, Inc. All right reserved. ΧϯϜ͕ఏڙ͍ͯ͠ΔϓϩμΫτ ୭Ͱ΋࡞ΕΔVisaϓϦϖΠυΧʔυ खݩͷࢿ࢈ܗ੒ʹ׆༻Ͱ͖ΔΫϨδοτΧʔυ ࠓ೔͸ͬͪ͜ͷ࿩
7. Copyright Kanmu, Inc. All right reserved. ʹ͍ͭͯ • ಛ௃Λ؆୯ʹ ◦ 1෼Ͱ࡞ΕΔVisaϓϦϖΠυΧʔυ ◦ 600ສμ΢ϯϩʔυಥഁ ◦ ޙ෷͍ػೳ͕͋Δ
8. Copyright Kanmu, Inc. All right reserved. ϙνͬͱνϟʔδ • ϙνͬͱνϟʔδʹ͍ͭͯ ◦ ޙ෷͍αʔϏε ◦ ਖ਼֬ʹ͸ɺηϒϯͷޙ෷͍αʔϏεΛόϯυϧΧʔυͷ ΞϓϦ಺Ͱ࢖༻Ͱ͖Δ
9. Copyright Kanmu, Inc. All right reserved. ޙ෷͍αʔϏεͱ͸ • ࠓ͙͢ങ͍͍ͨͷʹ࢒ߴ͕଍Γͳ͍Αʙͱ͍͏ͱ͖ʹ࢖͑Δ • গֹ(3000ԁʙ50000ԁ)νϟʔδ͢Δ͜ͱ͕Ͱ͖Δ • ͦͷޙظݶ೔·ͰʹίϯϏχͳͲͰࢧ෷͍ • େ͖ͳಛ௃ͱͯ͠਎෼ূఏग़ΛߦΘͳͯ͘΋ར༻͢Δ͜ͱ͕ Ͱ͖Δ ◦ ※ ޙ෷͍αʔϏεΛఏڙ͢Δηϒϯ౳ͷ৹ࠪʹΑͬͯར༻Ͱ͖ͳ͍Ϣʔβʔ ͸ଘࡏ͢Δ
10. Copyright Kanmu, Inc. All right reserved. ޙ෷͍αʔϏεͷෆਖ਼ • νϟʔδޙʹҙਤతʹࢧ෷͍Λ͠ͳ͍ • ૊৫తͳ൜ߦͳͲ΋͋Δ ࠓ೔͸ɺෆਖ਼νϟʔδͷ૿Ճ͕֬ೝ͞Εͨͱ͖ ʹɺνʔϜͰߦͬͨରࡦʹ͍͓ͭͯ࿩͠͠·͢ ϙνͬͱ νϟʔδ ܾࡁ ࢧ෷͍ ϙνͬͱ νϟʔδ ܾࡁ
11. ෆਖ਼ͱରࡦ 2 ෆਖ਼ͱ͍͏σϦέʔτͳ࿩୊ͳͷͰɺৄࡉʹ৮ΕΒΕͳ͍෦෼͕ଟ͋͘Γ·͕ྃ͢͝ঝ͍ͩ͘͞ɻ
12. Copyright Kanmu, Inc. All right reserved. ෆਖ਼݅਺ͷ૿Ճ • ૊৫తͱݟΒΕΔෆਖ਼ͷ૿Ճ͕؍ଌ͞Εͨ • طଘͷෆਖ਼Λ๷͙ϧʔϧ͕ಥഁ͞Εͨͱ͍͏͜ͱ ◦ ๷͙ʹ͸Ͳ͏͢Δʁ
13. Copyright Kanmu, Inc. All right reserved. ಛ௃Λݟ͚͍ͭͨ • ૊৫తͳͷͰɺͳʹ͔ڞ௨఺͕͋Δ͸ͣ • ྫ͑͹ɺશͯಉ͡υϝΠϯͷϝʔϧΞυϨεͷϢʔβ܈ͳΒ ؆୯ʹಛఆ͠ରࡦ͢Δ͜ͱ͕Ͱ͖Δ • ݱ࣮ʹ͸΋ͪΖΜͦ͜·Ͱ୯७Ͱ͸ͳ͍
14. Copyright Kanmu, Inc. All right reserved. ͱʹ͔͘Ұ࣍৘ใΛݟΔ • Ճ޻͞Ε͍ͯͳ͍σʔλΛͱʹ͔͘ݟ·͢ɻ(టष͘) • ͳʹ͔ͱ͔͔ͬΓ͕௫ΊΕ͹ɺԾઆΛཱͯͯΫϩεूܭͳͲͰ σʔλΛ෼ੳ͠·͢ ◦ ͜ͷಛ௃ྔA ͷ a1~a5 ʹଐ͢ΔϢʔβ܈͕ո͍͠ͷͰ͸ʁʁ • ಘΒΕͨ৘ใ͔ΒԾઆΛΞοϓσʔτͯ͠·ͨσʔλΛݟΔ ֶͼ ͱ ڞ༗ ෼ੳ ੜσʔλ Ծઆ ͙Δ͙Δճ͢
15. Copyright Kanmu, Inc. All right reserved. σʔλυϦϒϯͳνʔϜͰઓ͏ • ෼ੳΛ͍ͯ͠Δؒʹ΋ͲΜͲΜ࢖͑ͦ͏ͳσʔλީิ͕νʔ Ϝϝϯόʔ͔Βू·͖ͬͯ·͢ • ΧϯϜ͸ࣾһͷ΄΅શһ͕SQLΛॻ͚ΔͷͰඞཁͳ৘ใ͸ ֤ࣗͰऔΓߦ͘ͱ͍͏จԽ͕͋Γ·͢ • ৬छʹΑͬͯීஈ࢖͏σʔλ(ςʔϒϧ)͕ҟͳΔͷͰɺ஌Β ͳ͔ͬͨ৘ใ͕ͨ͘͞Μू·Δ ΄΅શһ͕ɺ ϛχσʔλΞφϦετʁ ͜ͷϩάݟΕ͹ ͳʹ͔Θ͔ΔΜ͡Όͳ͍͔ͳ ͜ͷςʔϒϧͷ ͜ͷσʔλ࢖͑Δ͔΋ ໾һ Ϛʔέλʔ Πϯϑϥ σβΠφʔ PdM ϑϩϯτΤϯυ Biz/Dev
16. Copyright Kanmu, Inc. All right reserved. ϝϯόʔ͔Βͷ৘ใఏڙͰѻ͏σʔλ͕ਂ͘޿͘ͳΔ • ෼ੳ݁Ռ͔Β৘ใΛڞ༗ͯ͠ • ͦΕΛݟͨඇ෼ੳઐ໳ͷϝϯόʔ͔Βίϝϯτ͕ଓʑͱ • ͦΕͰѻ͏σʔλͷ্࣭͕͕ͬͨΓ৽ͨͳԾઆཱ͕ͬͨΓ ֶͼ ͱ ڞ༗ ෼ੳ ੜσʔλ Ծઆ σʔλ΍஌ݟ ৘ใ
17. Copyright Kanmu, Inc. All right reserved. ࢖͑ͦ͏ͳσʔλ͕Ұ௨ΓἧͬͨΒ • Ͳ͏͍͏໰୊Λղ͘΂͖͔ߟ͑Δ a. Ͳͷ࣌఺Ͱݕ஌͍ͨ͠ͷ͔ʁ(ෆਖ਼લʁɺෆਖ਼ޙʁ) b. ྑ͍ݕ஌ͱ͸ͳʹ͔ʁ(ධՁࢦඪ) c. ӡ༻໘
18. Copyright Kanmu, Inc. All right reserved. a. Ͳͷ࣌఺Ͱݕ஌͍ͨ͠ͷ͔ʁ • ୔ࢁσʔλ͕͋ͬͯ΋ෆਖ਼ݕ஌λΠϛϯάʹΑͬͯ࢖͑ͳ ͍Մೳੑ΋͋ΔͷͰ৻ॏʹ(ϦʔΫ) • ͕࣌ؒܦա͢Δ΄Ͳ࢖͑Δ৘ใ͸ଟ͍ • ૣ͍λΠϛϯάͩͱෆਖ਼༧ଌͱͯ͠ػೳͯ͠ෆਖ਼͕ى͜Δ લʹࢭΊΒΕΔ • ଎౓ͱ৘ใྔͷτϨʔυΦϑ ొ࿥ ෆਖ਼ νϟʔδ ܾࡁ ? ? ? ? ? ৘ใྔ
19. Copyright Kanmu, Inc. All right reserved. b. ྑ͍ݕ஌ͱ͸ͳʹ͔ • ෆਖ਼ͷΈΛશ݅ݟ͚ͭΔͷ͸ͱͯ΋Ή͔͍ͣ͠ • શ݅ݟ͚ͭΑ͏ͱ͢Δͱ ◦ →ר͖ࠐΜͰ͠·͏Ϣʔβ͕૿͑Δ • ר͖ࠐ·ͳ͍Α͏ʹ͢Δͱ ◦ →ෆਖ਼Λಀͯ͠͠·͏ • Α͋͘Δ Precision vs Recall ໰୊ • ͋Δ1ͭͷධՁࢦඪͷ࠷େԽͰ୯७ʹܾΊΒΕͳ͍͜ͱ΋͋Δ • ͜͜͸టष͘
20. Copyright Kanmu, Inc. All right reserved. c. ӡ༻໘ • ৽͘͠MLϞσϧΛ࡞ͬͯӡ༻͢Δʁ ◦ ݱঢ়͸ɺML͕࢖ΘΕ͍ͯΔͱ͜Ζ΋͋Δ͕࢖ΘΕ͍ͯͳ ͍ͱ͜Ζ΋͋Δ • ෆਖ਼͕૿͍͑ͯΔঢ়گͰ͸ɺૣ͘ରॲ͍ͨ͠ ◦ MLΛγεςϜʹ૊ΈࠐΉ࣌ؒ͸ͳ͍ʁ
21. Copyright Kanmu, Inc. All right reserved. ࠓճͷղ͖͍ͨ໰୊͸ • 3ཁૉ ◦ Ͳͷ࣌఺Ͱݕ஌͍ͨ͠ͷ͔ ▪ ͋Δఔ౓৘ใ͕ू·Δ࣌఺͔ͭɺΦϖϨʔγϣϯͷ؍఺͔Βܾఆ ◦ ྑ͍ݕ஌ͱ͸ͳʹ͔ ▪ ෆਖ਼Λݕ஌ͭͭ͠ɺଞͷϢʔβΛͰ͖Δ͚ͩר͖ࠐ·ͳ͍Α͏ʹ͢Δ ▪ ݶքརӹ΍աڈͷӡ༻͖ͯͨ͠ϧʔϧϕʔεͷܦݧ͔ΒɺνʔϜͰ૯߹త ʹ൑அˡ͋ΔҰͭͷࢦඪͷ࠷େԽͱ͍͏୯७ͳ໰୊Ͱ͸ͳ͍ ◦ ӡ༻໘ ▪ ࣮૷·Ͱͷ଎౓ɺ͜Ε·Ͱͷӡ༻ͱͷ਌࿨ੑɺਫ਼౓͔ΒMLϞσϧͰ͸ͳ ͘ɺϧʔϧϕʔεͰे෼ͩͱ൑அ • Next Action ◦ ݕ஌ͷλΠϛϯά͔Β࢖͑Δσʔλ͕ܾ·ͬͨɻ ◦ ͜ΕΒΛ࢖ͬͯɺଞͷϢʔβΛͰ͖Δ͚ͩר͖ࠐ·ͳ͍ܗͰෆਖ਼Λݕ஌Ͱ͖ ΔϧʔϧϕʔεΛܾఆ͢Δɻ
22. ϧʔϧϕʔεͷܾఆ 3
23. Copyright Kanmu, Inc. All right reserved. ϧʔϧϕʔεͷܾఆ • ࢖͑ͦ͏ͳσʔλ(ಛ௃ྔ)͸ͨ͘͞Μ͋Δ • ͲΕΛϧʔϧͱͯ͠࢖͏͔ܾΊͳ͚Ε͹ͳΒͳ͍ ◦ ྫ: ಛ௃ྔA͕aҎ্Λෆਖ਼ͱ͢Δ • ͔͋͠͠Δಛ௃ྔ1ͭͰෆਖ਼ͩͱ൑அ͢Δ͚ͩͷܾఆతͳಛ ௃ྔ͸ݟ͔͍ͭͬͯͳ͍ • ෳ਺ͷಛ௃ྔΛ࢖ͬͨଟ࣍ݩతͳϧʔϧʹ͢Δඞཁ͕͋Δ ◦ ྫ: ಛ௃ྔA͕aҎ্ ͔ͭ ಛ௃ྔB͕bҎԼ ͔ͭ...
24. Copyright Kanmu, Inc. All right reserved. ܾఆ໦Λ༻͍Δ • େྔͷ࢖͑ͦ͏ͳಛ௃ྔΛܾఆ໦ʹೖྗɺڭࢣσʔλ͸ 1(ෆਖ਼) / 0(notෆਖ਼) ͷೋ஋෼ྨ • ෆਖ਼͕ͨ͘͞Μؚ·ΕΔ͔ͭר͖ࠐΈ͕গͳ͍ऴ୺ϊʔυ͕͋Ε͹ͦͷϊ ʔυʹͨͲΓண͘·ͰͷϧʔϧΛͦͷ··ϧʔϧϕʔεʹ͢ΔΞϓϩʔν • ֤ϊʔυ͕ͦΕͧΕఏҊ͞Εͨϧʔϧͱߟ͑Δ͜ͱ͕Ͱ͖Δ featA > a ? featB > b ? featC > c ? not ෆਖ਼ ෆਖ਼ yes no ѱ͍ϧʔϧ ྑ͍ϧʔϧ ϧʔϧʹ͢Δͱ • featA <= a ͔ͭ featC <= c Λෆਖ਼ͱ͢Δ
25. Copyright Kanmu, Inc. All right reserved. ϧʔϧͷܾఆ • ӡ༻໘΍ղऍͷ͠΍͢͞ͳͲ͔ΒϧʔϧΛܾఆ • ࠷ޙ͸ᮢ஋ͳͲΛաڈͷσʔλͰݟͳ͕ΒϩόετੑͳͲ΋ ߟྀ͠ඍௐ੔ • ͜Ε΋νʔϜ(ෆਖ਼؂ࢹઐ໳ϝϯόʔͳͲ)Ͱ૬ஊܾͯ͠ఆ featA > a ? featB > b ? featC > c ? not ෆਖ਼ ෆਖ਼ yes no ྑ͍ϧʔϧ ϧʔϧʹ͢Δͱ • featA <= a ͔ͭ featC <= c Λෆਖ਼ͱ͢Δ
26. Copyright Kanmu, Inc. All right reserved. ܾఆ໦ͷ஫ҙ఺ • ໦͕ਂ͘ͳΔͱϧʔϧ͕ෳࡶʹͳΓ͗͢Δ • ໦͕ਂ͍ͱɺͦͷϊʔυͷෆ७౓͕Լ͕Δ͕ɺऴ୺ϊʔυʹؚ· ΕΔσʔλ਺͕গͳ͍ͷͰෆਖ਼Λଟ͘औΓಀ͕͢͜ͱʹ ◦ ܾఆ໦ͷਂ͞͸ɺ਺ύλʔϯࢼͤ͹͋ͨΓ͸͙͢ʹ෇͚ΒΕͨ • ӡ༻໘ɺղऍੑɺਫ਼౓ͳͲటष͘σʔλΛݟͳ͕ΒܾΊ͍ͯ͘ඞ ཁ͕͋Δ featA > a ? featZ > z ? not ෆਖ਼ ෆਖ਼ yes no ෆ७౓͸খ͍͕͞ɺ ଟ͘ͷෆਖ਼Λಀͯ͠ ͍Δྫ . . .
27. Copyright Kanmu, Inc. All right reserved. ܾఆ໦͕ϕετ͔ʁ • ࠓճ͸ɺ༗ޮͳಛ௃ྔީิͱͦͷᮢ஋ͷ͋ͨΓ͕͚ͭΒΕ Ε͹Α͔ͬͨ • ݫີʹ΍ΔͳΒɺ੍໿෇͖ͷ࠷దԽ໰୊ͱͯ͠ղ͘ͷ͕ྑ ͍ͱࢥ͏͕͕͔͔࣌ؒΔ ◦ ࠓճ͸ɺௐ͔ࠪΒϧʔϧܾఆɺಋೖ·ͰӦۀ೔10೔ؒఔ ౓Ͱऩ·ͬͨ • ࠓճ͸ɺܾఆ໦Ͱे෼ͩͬͨ
28. Copyright Kanmu, Inc. All right reserved. ·ͱΊ • σʔλυϦϒϯͳ૊৫ ◦ ೔ʑͷҙࢥܾఆʹ͸جຊతʹσʔλ͋Γ͖ɻࢿྉʹ͸SQLͷΫ ΤϦ΋Ұॹʹ෇͍ͯ͘Δɻ(ඇΤϯδχΞͰ΋) ◦ ͜Ε͕పఈ͞Ε͍ͯΔͷͰɺଟํ໘͔Β࢖͑ͦ͏ͳσʔλ͕ू ·Δɻ • ෆਖ਼ݕ஌ͱ͍ͬͯ΋ɺͲ͏͍͏໰୊Λղ͖͍͔ͨʹΑͬͯΞϓϩ ʔν͕ҟͳΔ ◦ ղ͍ͯخ͍͠໰୊Λৗʹߟ͑Δ ◦ ਫ਼౓ͷߴ͍MLϞσϧ࡞ͬͯ΋࢖Θͳ͚Ε͹ҙຯ͕ͳ͍ • ϧʔϧϕʔεͷܾఆͷ͓ख఻͍ͱͯ͠MLϞσϧ(ܾఆ໦)Λ࢖༻ͨ͠
29. Copyright Kanmu, Inc. All right reserved. σʔλυϦϒϯͳ૊৫ͰҰॹʹྑ͍ϓϩμΫτ࡞Γ·ͤΜ͔ʁ https://kanmu.co.jp/jobs/
30. Thank you !