データドリブンな組織の不正検知

Transcript

1. σʔλυϦϒϯͳ૊৫ͷ
   ෆਖ਼ݕ஌
   Fumihiro Kubota
   MoT/ίωώτ/Kanmu ͕ޠΔ
   ϓϩμΫτ։ൃxσʔλ෼ੳ
   

   View Slide

2. Copyright Kanmu, Inc. All right reserved. 2
   ٱอా ࢙༸
   ML Engineer at Kanmu, Inc.
   @fkubota
   @fkubota_
   ࣗݾ঺հ
   

   View Slide

3. Copyright Kanmu, Inc. All right reserved.
   ػցֶशΤϯδχΞ fkubotaͷۀ຿಺༰
   ● ࣄۀΛ੒௕ͤ͞ΔखஈͷதͰσʔλͰͰ͖Δ͜ͱશൠ
   ● ͦͷதͷҰ෦ʹML͕͋Δ
   
   ● ϓϩμΫτ๊͕͍͑ͯΔ໰୊΍ղܾ͍ͨ͠Ϣʔβͷ௧ΈΛσ
   ʔλͰ໰୊ղܾͰ͖Δܗʹͯ͠ղ͘ͱ͍͏ͷ͕ͬ͘͟Γͱ
   ͨ͠ۀ຿ൣғ
   ࣄۀΛ੒௕ͤ͞Δखஈ
   σʔλͰͰ͖Δ͜ͱશൠ
   ML
   

   View Slide

4. Copyright Kanmu, Inc. All right reserved. 4
   ϓϩμΫτʹ͍ͭͯ
   ෆਖ਼ͱରࡦ
   ϧʔϧϕʔεͷܾఆ
   1
   2
   3
   ΞδΣϯμ
   

   View Slide

5. ϓϩμΫτʹ͍ͭͯ
   1
   

   View Slide

6. Copyright Kanmu, Inc. All right reserved.
   ΧϯϜ͕ఏڙ͍ͯ͠ΔϓϩμΫτ
   ୭Ͱ΋࡞ΕΔVisaϓϦϖΠυΧʔυ खݩͷࢿ࢈ܗ੒ʹ׆༻Ͱ͖ΔΫϨδοτΧʔυ
   ࠓ೔͸ͬͪ͜ͷ࿩
   

   View Slide

7. Copyright Kanmu, Inc. All right reserved.
   ʹ͍ͭͯ
   ● ಛ௃Λ؆୯ʹ
   
   ○ 1෼Ͱ࡞ΕΔVisaϓϦϖΠυΧʔυ
   
   ○ 600ສμ΢ϯϩʔυಥഁ
   
   ○ ޙ෷͍ػೳ͕͋Δ
   

   View Slide

8. Copyright Kanmu, Inc. All right reserved.
   ϙνͬͱνϟʔδ
   ● ϙνͬͱνϟʔδʹ͍ͭͯ
   ○ ޙ෷͍αʔϏε
   
   ○ ਖ਼֬ʹ͸ɺηϒϯͷޙ෷͍αʔϏεΛόϯυϧΧʔυͷ
   ΞϓϦ಺Ͱ࢖༻Ͱ͖Δ
   

   View Slide

9. Copyright Kanmu, Inc. All right reserved.
   ޙ෷͍αʔϏεͱ͸
   ● ࠓ͙͢ങ͍͍ͨͷʹ࢒ߴ͕଍Γͳ͍Αʙͱ͍͏ͱ͖ʹ࢖͑Δ
   
   ● গֹ(3000ԁʙ50000ԁ)νϟʔδ͢Δ͜ͱ͕Ͱ͖Δ
   
   ● ͦͷޙظݶ೔·ͰʹίϯϏχͳͲͰࢧ෷͍
   
   ● େ͖ͳಛ௃ͱͯ͠਎෼ূఏग़ΛߦΘͳͯ͘΋ར༻͢Δ͜ͱ͕
   Ͱ͖Δ
   
   ○ ※ ޙ෷͍αʔϏεΛఏڙ͢Δηϒϯ౳ͷ৹ࠪʹΑͬͯར༻Ͱ͖ͳ͍Ϣʔβʔ
   ͸ଘࡏ͢Δ
   
   

   View Slide

10. Copyright Kanmu, Inc. All right reserved.
    ޙ෷͍αʔϏεͷෆਖ਼
    ● νϟʔδޙʹҙਤతʹࢧ෷͍Λ͠ͳ͍
    
    ● ૊৫తͳ൜ߦͳͲ΋͋Δ
    ࠓ೔͸ɺෆਖ਼νϟʔδͷ૿Ճ͕֬ೝ͞Εͨͱ͖
    ʹɺνʔϜͰߦͬͨରࡦʹ͍͓ͭͯ࿩͠͠·͢
    ϙνͬͱ
    νϟʔδ
    ܾࡁ ࢧ෷͍
    ϙνͬͱ
    νϟʔδ
    ܾࡁ
    

    View Slide

11. ෆਖ਼ͱରࡦ
    2
    ෆਖ਼ͱ͍͏σϦέʔτͳ࿩୊ͳͷͰɺৄࡉʹ৮ΕΒΕͳ͍෦෼͕ଟ͋͘Γ·͕ྃ͢͝ঝ͍ͩ͘͞ɻ
    

    View Slide

12. Copyright Kanmu, Inc. All right reserved.
    ෆਖ਼݅਺ͷ૿Ճ
    ● ૊৫తͱݟΒΕΔෆਖ਼ͷ૿Ճ͕؍ଌ͞Εͨ
    
    ● طଘͷෆਖ਼Λ๷͙ϧʔϧ͕ಥഁ͞Εͨͱ͍͏͜ͱ
    
    ○ ๷͙ʹ͸Ͳ͏͢Δʁ
    

    View Slide

13. Copyright Kanmu, Inc. All right reserved.
    ಛ௃Λݟ͚͍ͭͨ
    ● ૊৫తͳͷͰɺͳʹ͔ڞ௨఺͕͋Δ͸ͣ
    
    ● ྫ͑͹ɺશͯಉ͡υϝΠϯͷϝʔϧΞυϨεͷϢʔβ܈ͳΒ
    ؆୯ʹಛఆ͠ରࡦ͢Δ͜ͱ͕Ͱ͖Δ
    
    ● ݱ࣮ʹ͸΋ͪΖΜͦ͜·Ͱ୯७Ͱ͸ͳ͍
    

    View Slide

14. Copyright Kanmu, Inc. All right reserved.
    ͱʹ͔͘Ұ࣍৘ใΛݟΔ
    ● Ճ޻͞Ε͍ͯͳ͍σʔλΛͱʹ͔͘ݟ·͢ɻ(టष͘)
    
    ● ͳʹ͔ͱ͔͔ͬΓ͕௫ΊΕ͹ɺԾઆΛཱͯͯΫϩεूܭͳͲͰ
    σʔλΛ෼ੳ͠·͢
    
    ○ ͜ͷಛ௃ྔA ͷ a1~a5 ʹଐ͢ΔϢʔβ܈͕ո͍͠ͷͰ͸ʁʁ
    
    ● ಘΒΕͨ৘ใ͔ΒԾઆΛΞοϓσʔτͯ͠·ͨσʔλΛݟΔ
    ֶͼ
    ͱ
    ڞ༗
    ෼ੳ
    ੜσʔλ
    Ծઆ
    ͙Δ͙Δճ͢
    

    View Slide

15. Copyright Kanmu, Inc. All right reserved.
    σʔλυϦϒϯͳνʔϜͰઓ͏
    ● ෼ੳΛ͍ͯ͠Δؒʹ΋ͲΜͲΜ࢖͑ͦ͏ͳσʔλީิ͕νʔ
    Ϝϝϯόʔ͔Βू·͖ͬͯ·͢
    
    ● ΧϯϜ͸ࣾһͷ΄΅શһ͕SQLΛॻ͚ΔͷͰඞཁͳ৘ใ͸
    ֤ࣗͰऔΓߦ͘ͱ͍͏จԽ͕͋Γ·͢
    ● ৬छʹΑͬͯීஈ࢖͏σʔλ(ςʔϒϧ)͕ҟͳΔͷͰɺ஌Β
    ͳ͔ͬͨ৘ใ͕ͨ͘͞Μू·Δ ΄΅શһ͕ɺ
    ϛχσʔλΞφϦετʁ
    ͜ͷϩάݟΕ͹
    ͳʹ͔Θ͔ΔΜ͡Όͳ͍͔ͳ
    ͜ͷςʔϒϧͷ
    ͜ͷσʔλ࢖͑Δ͔΋
    ໾һ
    Ϛʔέλʔ Πϯϑϥ
    σβΠφʔ
    PdM
    ϑϩϯτΤϯυ
    Biz/Dev
    

    View Slide

16. Copyright Kanmu, Inc. All right reserved.
    ϝϯόʔ͔Βͷ৘ใఏڙͰѻ͏σʔλ͕ਂ͘޿͘ͳΔ
    ● ෼ੳ݁Ռ͔Β৘ใΛڞ༗ͯ͠
    
    ● ͦΕΛݟͨඇ෼ੳઐ໳ͷϝϯόʔ͔Βίϝϯτ͕ଓʑͱ
    
    ● ͦΕͰѻ͏σʔλͷ্࣭͕͕ͬͨΓ৽ͨͳԾઆཱ͕ͬͨΓ
    ֶͼ
    ͱ
    ڞ༗
    ෼ੳ
    ੜσʔλ
    Ծઆ
    σʔλ΍஌ݟ
    ৘ใ
    

    View Slide

17. Copyright Kanmu, Inc. All right reserved.
    ࢖͑ͦ͏ͳσʔλ͕Ұ௨ΓἧͬͨΒ
    ● Ͳ͏͍͏໰୊Λղ͘΂͖͔ߟ͑Δ
    a. Ͳͷ࣌఺Ͱݕ஌͍ͨ͠ͷ͔ʁ(ෆਖ਼લʁɺෆਖ਼ޙʁ)
    
    b. ྑ͍ݕ஌ͱ͸ͳʹ͔ʁ(ධՁࢦඪ)
    
    c. ӡ༻໘
    
    

    View Slide

18. Copyright Kanmu, Inc. All right reserved.
    a. Ͳͷ࣌఺Ͱݕ஌͍ͨ͠ͷ͔ʁ
    ● ୔ࢁσʔλ͕͋ͬͯ΋ෆਖ਼ݕ஌λΠϛϯάʹΑͬͯ࢖͑ͳ
    ͍Մೳੑ΋͋ΔͷͰ৻ॏʹ(ϦʔΫ)
    
    ● ͕࣌ؒܦա͢Δ΄Ͳ࢖͑Δ৘ใ͸ଟ͍
    ● ૣ͍λΠϛϯάͩͱෆਖ਼༧ଌͱͯ͠ػೳͯ͠ෆਖ਼͕ى͜Δ
    લʹࢭΊΒΕΔ
    
    ● ଎౓ͱ৘ใྔͷτϨʔυΦϑ
    ొ࿥
    ෆਖ਼
    
    νϟʔδ
    ܾࡁ
    ? ? ? ? ?
    ৘ใྔ
    

    View Slide

19. Copyright Kanmu, Inc. All right reserved.
    b. ྑ͍ݕ஌ͱ͸ͳʹ͔
    ● ෆਖ਼ͷΈΛશ݅ݟ͚ͭΔͷ͸ͱͯ΋Ή͔͍ͣ͠
    
    ● શ݅ݟ͚ͭΑ͏ͱ͢Δͱ
    
    ○ →ר͖ࠐΜͰ͠·͏Ϣʔβ͕૿͑Δ
    
    ● ר͖ࠐ·ͳ͍Α͏ʹ͢Δͱ
    
    ○ →ෆਖ਼Λಀͯ͠͠·͏
    
    ● Α͋͘Δ Precision vs Recall ໰୊
    ● ͋Δ1ͭͷධՁࢦඪͷ࠷େԽͰ୯७ʹܾΊΒΕͳ͍͜ͱ΋͋Δ
    
    ● ͜͜͸టष͘
    

    View Slide

20. Copyright Kanmu, Inc. All right reserved.
    c. ӡ༻໘
    ● ৽͘͠MLϞσϧΛ࡞ͬͯӡ༻͢Δʁ
    
    ○ ݱঢ়͸ɺML͕࢖ΘΕ͍ͯΔͱ͜Ζ΋͋Δ͕࢖ΘΕ͍ͯͳ
    ͍ͱ͜Ζ΋͋Δ
    
    ● ෆਖ਼͕૿͍͑ͯΔঢ়گͰ͸ɺૣ͘ରॲ͍ͨ͠
    ○ MLΛγεςϜʹ૊ΈࠐΉ࣌ؒ͸ͳ͍ʁ
    

    View Slide

21. Copyright Kanmu, Inc. All right reserved.
    ࠓճͷղ͖͍ͨ໰୊͸
    ● 3ཁૉ
    
    ○ Ͳͷ࣌఺Ͱݕ஌͍ͨ͠ͷ͔
    
    ■ ͋Δఔ౓৘ใ͕ू·Δ࣌఺͔ͭɺΦϖϨʔγϣϯͷ؍఺͔Βܾఆ
    
    ○ ྑ͍ݕ஌ͱ͸ͳʹ͔
    
    ■ ෆਖ਼Λݕ஌ͭͭ͠ɺଞͷϢʔβΛͰ͖Δ͚ͩר͖ࠐ·ͳ͍Α͏ʹ͢Δ
    
    ■ ݶքརӹ΍աڈͷӡ༻͖ͯͨ͠ϧʔϧϕʔεͷܦݧ͔ΒɺνʔϜͰ૯߹త
    ʹ൑அˡ͋ΔҰͭͷࢦඪͷ࠷େԽͱ͍͏୯७ͳ໰୊Ͱ͸ͳ͍
    
    ○ ӡ༻໘
    
    ■ ࣮૷·Ͱͷ଎౓ɺ͜Ε·Ͱͷӡ༻ͱͷ਌࿨ੑɺਫ਼౓͔ΒMLϞσϧͰ͸ͳ
    ͘ɺϧʔϧϕʔεͰे෼ͩͱ൑அ
    
    ● Next Action
    ○ ݕ஌ͷλΠϛϯά͔Β࢖͑Δσʔλ͕ܾ·ͬͨɻ
    
    ○ ͜ΕΒΛ࢖ͬͯɺଞͷϢʔβΛͰ͖Δ͚ͩר͖ࠐ·ͳ͍ܗͰෆਖ਼Λݕ஌Ͱ͖
    ΔϧʔϧϕʔεΛܾఆ͢Δɻ
    

    View Slide

22. ϧʔϧϕʔεͷܾఆ
    3
    

    View Slide

23. Copyright Kanmu, Inc. All right reserved.
    ϧʔϧϕʔεͷܾఆ
    ● ࢖͑ͦ͏ͳσʔλ(ಛ௃ྔ)͸ͨ͘͞Μ͋Δ
    
    ● ͲΕΛϧʔϧͱͯ͠࢖͏͔ܾΊͳ͚Ε͹ͳΒͳ͍
    
    ○ ྫ: ಛ௃ྔA͕aҎ্Λෆਖ਼ͱ͢Δ
    
    ● ͔͋͠͠Δಛ௃ྔ1ͭͰෆਖ਼ͩͱ൑அ͢Δ͚ͩͷܾఆతͳಛ
    ௃ྔ͸ݟ͔͍ͭͬͯͳ͍
    
    ● ෳ਺ͷಛ௃ྔΛ࢖ͬͨଟ࣍ݩతͳϧʔϧʹ͢Δඞཁ͕͋Δ
    
    ○ ྫ: ಛ௃ྔA͕aҎ্ ͔ͭ ಛ௃ྔB͕bҎԼ ͔ͭ...
    
    

    View Slide

24. Copyright Kanmu, Inc. All right reserved.
    ܾఆ໦Λ༻͍Δ
    ● େྔͷ࢖͑ͦ͏ͳಛ௃ྔΛܾఆ໦ʹೖྗɺڭࢣσʔλ͸ 1(ෆਖ਼) / 0(notෆਖ਼)
    ͷೋ஋෼ྨ
    
    ● ෆਖ਼͕ͨ͘͞Μؚ·ΕΔ͔ͭר͖ࠐΈ͕গͳ͍ऴ୺ϊʔυ͕͋Ε͹ͦͷϊ
    ʔυʹͨͲΓண͘·ͰͷϧʔϧΛͦͷ··ϧʔϧϕʔεʹ͢ΔΞϓϩʔν
    
    ● ֤ϊʔυ͕ͦΕͧΕఏҊ͞Εͨϧʔϧͱߟ͑Δ͜ͱ͕Ͱ͖Δ
    featA > a ?
    featB > b ? featC > c ?
    not ෆਖ਼
    ෆਖ਼ yes no
    ѱ͍ϧʔϧ ྑ͍ϧʔϧ
    ϧʔϧʹ͢Δͱ
    
    ● featA <= a ͔ͭ featC <= c
    Λෆਖ਼ͱ͢Δ
    

    View Slide

25. Copyright Kanmu, Inc. All right reserved.
    ϧʔϧͷܾఆ
    ● ӡ༻໘΍ղऍͷ͠΍͢͞ͳͲ͔ΒϧʔϧΛܾఆ
    
    ● ࠷ޙ͸ᮢ஋ͳͲΛաڈͷσʔλͰݟͳ͕ΒϩόετੑͳͲ΋
    ߟྀ͠ඍௐ੔
    
    ● ͜Ε΋νʔϜ(ෆਖ਼؂ࢹઐ໳ϝϯόʔͳͲ)Ͱ૬ஊܾͯ͠ఆ
    featA > a ?
    featB > b ? featC > c ?
    not ෆਖ਼
    ෆਖ਼ yes no
    ྑ͍ϧʔϧ
    ϧʔϧʹ͢Δͱ
    ● featA <= a ͔ͭ featC <= c
    Λෆਖ਼ͱ͢Δ
    

    View Slide

26. Copyright Kanmu, Inc. All right reserved.
    ܾఆ໦ͷ஫ҙ఺
    ● ໦͕ਂ͘ͳΔͱϧʔϧ͕ෳࡶʹͳΓ͗͢Δ
    ● ໦͕ਂ͍ͱɺͦͷϊʔυͷෆ७౓͕Լ͕Δ͕ɺऴ୺ϊʔυʹؚ·
    ΕΔσʔλ਺͕গͳ͍ͷͰෆਖ਼Λଟ͘औΓಀ͕͢͜ͱʹ
    
    ○ ܾఆ໦ͷਂ͞͸ɺ਺ύλʔϯࢼͤ͹͋ͨΓ͸͙͢ʹ෇͚ΒΕͨ
    
    ● ӡ༻໘ɺղऍੑɺਫ਼౓ͳͲటष͘σʔλΛݟͳ͕ΒܾΊ͍ͯ͘ඞ
    ཁ͕͋Δ
    featA > a ?
    featZ > z ?
    not ෆਖ਼
    ෆਖ਼ yes no
    ෆ७౓͸খ͍͕͞ɺ
    ଟ͘ͷෆਖ਼Λಀͯ͠
    ͍Δྫ
    .
    .
    .
    

    View Slide

27. Copyright Kanmu, Inc. All right reserved.
    ܾఆ໦͕ϕετ͔ʁ
    ● ࠓճ͸ɺ༗ޮͳಛ௃ྔީิͱͦͷᮢ஋ͷ͋ͨΓ͕͚ͭΒΕ
    Ε͹Α͔ͬͨ
    
    ● ݫີʹ΍ΔͳΒɺ੍໿෇͖ͷ࠷దԽ໰୊ͱͯ͠ղ͘ͷ͕ྑ
    ͍ͱࢥ͏͕͕͔͔࣌ؒΔ
    
    ○ ࠓճ͸ɺௐ͔ࠪΒϧʔϧܾఆɺಋೖ·ͰӦۀ೔10೔ؒఔ
    ౓Ͱऩ·ͬͨ
    
    ● ࠓճ͸ɺܾఆ໦Ͱे෼ͩͬͨ
    

    View Slide

28. Copyright Kanmu, Inc. All right reserved.
    ·ͱΊ
    ● σʔλυϦϒϯͳ૊৫
    
    ○ ೔ʑͷҙࢥܾఆʹ͸جຊతʹσʔλ͋Γ͖ɻࢿྉʹ͸SQLͷΫ
    ΤϦ΋Ұॹʹ෇͍ͯ͘Δɻ(ඇΤϯδχΞͰ΋)
    
    ○ ͜Ε͕పఈ͞Ε͍ͯΔͷͰɺଟํ໘͔Β࢖͑ͦ͏ͳσʔλ͕ू
    ·Δɻ
    
    ● ෆਖ਼ݕ஌ͱ͍ͬͯ΋ɺͲ͏͍͏໰୊Λղ͖͍͔ͨʹΑͬͯΞϓϩ
    ʔν͕ҟͳΔ
    
    ○ ղ͍ͯخ͍͠໰୊Λৗʹߟ͑Δ
    
    ○ ਫ਼౓ͷߴ͍MLϞσϧ࡞ͬͯ΋࢖Θͳ͚Ε͹ҙຯ͕ͳ͍
    
    ● ϧʔϧϕʔεͷܾఆͷ͓ख఻͍ͱͯ͠MLϞσϧ(ܾఆ໦)Λ࢖༻ͨ͠
    

    View Slide

29. Copyright Kanmu, Inc. All right reserved.
    σʔλυϦϒϯͳ૊৫ͰҰॹʹྑ͍ϓϩμΫτ࡞Γ·ͤΜ͔ʁ
    https://kanmu.co.jp/jobs/
    

    View Slide

30. Thank you !
    

    View Slide