Federated Learning 連合学習

Regonn @関西Kaggler交流会 2023/03/24

Transcript

1. Regonn @ؔ੢Kagglerަྲྀձ 2023/03/24
   Federated Learning
   ࿈߹ֶश
   

   View Slide

2. Regonn (@regonn_haizine)
   • Kaggle Competition Expert
   • Kaggle ؔ࿈ Podcast (with ΧϨʔͪΌΜ)
   • ౡࠜͷϑϦʔϥϯε
   • ϒϩοΫνΣʔϯɾϝλόʔεɾػցֶश(Ӵ੕σʔλɾ೴೾)ͷ࢓ࣄҊ݅
   • Solana Japan ΍ Orca(DEX: ෼ࢄऔҾॴ) ͷ CM
   • ڈ೥͔Β೶ۀ΋࢝Ίͯ·͢
   

   View Slide

3. ࠷ۙ AI ͷਐา΋໨֮·͍͠
   • ChatGPT-4
   • Hugging Face ౳ͷ͓͔͛Ͱɺ໨త(Task)ʹ߹ͬͨɺֶशࡁΈϞσϧΛར༻͠
   ΍͘͢ͳ͖͍ͬͯͯΔ
   

   View Slide

4. औಘ͕೉͍͠σʔλᶃ
   • ΤοδσόΠεσʔλ
   • ௨৴ଳҬͳͲͷ੍ݶ
   • શͯͷηϯαʔσʔλऔಘ͸೉͍͠
   

   View Slide

5. औಘ͕೉͍͠σʔλᶄ
   • ҩྍσʔλɾސ٬σʔλ
   • ϓϥΠόγʔ໰୊
   • ଞࣾؒͰͷڞ༗
   

   View Slide

6. Federated Learning(FL)
   ෼ࢄͯ͠อ࣋͞ΕͨσʔλΛऩूɾू໿͢Δ͜ͱͳ͘ػցֶशϞσϧͷ܇࿅ʹ
   ༻͍Δํ๏
   

   View Slide

7. Federated Learning(FL)ͷछྨ
   • ਫฏ࿈߹ֶश
   • ਨ௚࿈߹ֶश
   • ࿈߹సҠֶश
   

   View Slide

8. ਫฏ࿈߹ֶश
   • ͦΕͧΕ͕ɺಉ͡ಛ௃ྔͰɺҟͳΔσʔληοτΛ͍࣋ͬͯͨ৔߹
   • ΤοδσόΠε౳Ͱ΋͜ͷλΠϓ
   

   View Slide

9. ਫฏ࿈߹ֶश
   ᶃ
   ᶄ
   ᶅ
   ᶃϩʔΧϧͰֶश
   ᶄதԝαʔόʔʹଛࣦ΍ޯ഑৘ใΛૹΔ
   ᶅதԝαʔόʔͰΞϯαϯϒϧతॲཧ(ޯ഑ฏۉԽ)
   ᶆߋ৽͞ΕͨϞσϧΛશͯ΁ฦ͢
   ᶆ
   

   View Slide

10. ਨ௚࿈߹ֶश
    • ͦΕͧΕಛ௃ྔ͸ҟͳΔ͕ɺಉ͡λʔήοτͷσʔλΠϯσοΫε͕ଘࡏ͢
    Δ৔߹
    ࢒ߴ ϩʔϯ
    ސ٬A xx yy
    ௨৴ྔ ՝ֹۚ
    ސ٬A xx yy
    ΫϨδοτΧʔυͷσϑΥϧτ༧ଌ
    σϑΥϧτ
    ސ٬A 1
    

    View Slide

11. ਨ௚࿈߹ֶश
    ࢒ߴ ϩʔϯ
    ސ٬A xx yy
    ސ٬C zz ww
    ௨৴ྔ ՝ֹۚ
    ސ٬A kk mm
    ސ٬B aa bb
    σϑΥϧτ
    ސ٬A 1
    ސ٬D 0
    ※ݫີͰ͸ͳ͍
    தԝαʔόʔͰ҉߸伴Λ࡞Γެ։伴Λ഑෍ɺ
    ͦΕͧΕͷϩʔΧϧͰ҉߸Խ͠ɺ
    ΞϊχϚΠζ͞ΕͨσʔλͰֶश
    ࢒ߴ ϩʔϯ ௨৴ྔ աֹۚ σϑΥϧτ
    ސ٬A xx yy kk mm 1
    

    View Slide

12. ࿈߹సҠֶश
    • ಛ௃ྔ΋λʔήοτ΋ҟͳΔ৔߹
    • ࣅ͍ͯΔυϝΠϯྖҬ
    • ෼෍΍αΠζ͕େ෯ʹҟͳΔ৔߹
    

    View Slide

13. Federated Learningͷใु
    • ͦΕͧΕͷɺϞσϧߩݙ౓ʹԠͯ͡ใुΛܭࢉ͢ΔϩδοΫ౳΋ݚڀ͞Εͯ
    ͍Δ
    

    View Slide

14. Numerai
    • ۚ༥σʔλͷਨ௚࿈߹ֶशతͳ΋ͷ͕Ͱ͖͍ͯΔ
    • શੈքגࣜࢢ৔ͷגՁͷಈ͖ΛNumeraiଆ͕࡞੒ͨ͠Target 0~1Ͱ༧ଌ͢Δ
    • Numerai Signals Ͱ͸ɺಛ௃ྔ͸ࣗ෼Ͱ༻ҙͯ͘͠Δ
    • ࣮ࡍʹσʔλͰϑΝ΢ϯυ͕ӡ༻͞ΕͯɺརӹͷҰ෦ΛϞσϧͷߩݙ౓ʹԠ͡
    ͯ෼഑͞ΕΔ
    

    View Slide

15. Federated Learning ϥΠϒϥϦؔ࿈
    • େ͖Ίͷ΋ͷͩͱ
    • https://github.com/tensorflow/federated
    • TensorflowFederated: Tensorflow ͷެࣜ Federated ϥΠϒϥϦ
    • https://github.com/OpenMined/PySyft
    • PySyft: PyTorch Λ࢖͏৔߹ͩͬͨΒɺͪ͜ΒΛ࢖͏
    • ͓ͦΒ͘ɺϥΠϒϥϦ͚ͩͰͳ͘αʔϏε΋ࠓޙ૿͖͑ͯͦ͏
    

    View Slide

16. ࢀߟਤॻ
    Federated Learning:
    ϓϥΠόγʔอޢԼʹ͓͚Δػցֶश
    

    View Slide

17. ऴΘΓ
    

    View Slide