Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Federated Learning 連合学習

regonn
March 24, 2023

Federated Learning 連合学習

Regonn @関西Kaggler交流会 2023/03/24

regonn

March 24, 2023
Tweet

More Decks by regonn

Other Decks in Technology

Transcript

  1. Regonn @ؔ੢Kagglerަྲྀձ 2023/03/24
    Federated Learning
    ࿈߹ֶश

    View full-size slide

  2. Regonn (@regonn_haizine)
    • Kaggle Competition Expert
    • Kaggle ؔ࿈ Podcast (with ΧϨʔͪΌΜ)
    • ౡࠜͷϑϦʔϥϯε
    • ϒϩοΫνΣʔϯɾϝλόʔεɾػցֶश(Ӵ੕σʔλɾ೴೾)ͷ࢓ࣄҊ݅
    • Solana Japan ΍ Orca(DEX: ෼ࢄऔҾॴ) ͷ CM
    • ڈ೥͔Β೶ۀ΋࢝Ίͯ·͢

    View full-size slide

  3. ࠷ۙ AI ͷਐา΋໨֮·͍͠
    • ChatGPT-4
    • Hugging Face ౳ͷ͓͔͛Ͱɺ໨త(Task)ʹ߹ͬͨɺֶशࡁΈϞσϧΛར༻͠
    ΍͘͢ͳ͖͍ͬͯͯΔ

    View full-size slide

  4. औಘ͕೉͍͠σʔλᶃ
    • ΤοδσόΠεσʔλ
    • ௨৴ଳҬͳͲͷ੍ݶ
    • શͯͷηϯαʔσʔλऔಘ͸೉͍͠

    View full-size slide

  5. औಘ͕೉͍͠σʔλᶄ
    • ҩྍσʔλɾސ٬σʔλ
    • ϓϥΠόγʔ໰୊
    • ଞࣾؒͰͷڞ༗

    View full-size slide

  6. Federated Learning(FL)
    ෼ࢄͯ͠อ࣋͞ΕͨσʔλΛऩूɾू໿͢Δ͜ͱͳ͘ػցֶशϞσϧͷ܇࿅ʹ
    ༻͍Δํ๏

    View full-size slide

  7. Federated Learning(FL)ͷछྨ
    • ਫฏ࿈߹ֶश
    • ਨ௚࿈߹ֶश
    • ࿈߹సҠֶश

    View full-size slide

  8. ਫฏ࿈߹ֶश
    • ͦΕͧΕ͕ɺಉ͡ಛ௃ྔͰɺҟͳΔσʔληοτΛ͍࣋ͬͯͨ৔߹
    • ΤοδσόΠε౳Ͱ΋͜ͷλΠϓ

    View full-size slide

  9. ਫฏ࿈߹ֶश



    ᶃϩʔΧϧͰֶश
    ᶄதԝαʔόʔʹଛࣦ΍ޯ഑৘ใΛૹΔ
    ᶅதԝαʔόʔͰΞϯαϯϒϧతॲཧ(ޯ഑ฏۉԽ)
    ᶆߋ৽͞ΕͨϞσϧΛશͯ΁ฦ͢

    View full-size slide

  10. ਨ௚࿈߹ֶश
    • ͦΕͧΕಛ௃ྔ͸ҟͳΔ͕ɺಉ͡λʔήοτͷσʔλΠϯσοΫε͕ଘࡏ͢
    Δ৔߹
    ࢒ߴ ϩʔϯ
    ސ٬A xx yy
    ௨৴ྔ ՝ֹۚ
    ސ٬A xx yy
    ΫϨδοτΧʔυͷσϑΥϧτ༧ଌ
    σϑΥϧτ
    ސ٬A 1

    View full-size slide

  11. ਨ௚࿈߹ֶश
    ࢒ߴ ϩʔϯ
    ސ٬A xx yy
    ސ٬C zz ww
    ௨৴ྔ ՝ֹۚ
    ސ٬A kk mm
    ސ٬B aa bb
    σϑΥϧτ
    ސ٬A 1
    ސ٬D 0
    ※ݫີͰ͸ͳ͍
    தԝαʔόʔͰ҉߸伴Λ࡞Γެ։伴Λ഑෍ɺ
    ͦΕͧΕͷϩʔΧϧͰ҉߸Խ͠ɺ
    ΞϊχϚΠζ͞ΕͨσʔλͰֶश
    ࢒ߴ ϩʔϯ ௨৴ྔ աֹۚ σϑΥϧτ
    ސ٬A xx yy kk mm 1

    View full-size slide

  12. ࿈߹సҠֶश
    • ಛ௃ྔ΋λʔήοτ΋ҟͳΔ৔߹
    • ࣅ͍ͯΔυϝΠϯྖҬ
    • ෼෍΍αΠζ͕େ෯ʹҟͳΔ৔߹

    View full-size slide

  13. Federated Learningͷใु
    • ͦΕͧΕͷɺϞσϧߩݙ౓ʹԠͯ͡ใुΛܭࢉ͢ΔϩδοΫ౳΋ݚڀ͞Εͯ
    ͍Δ

    View full-size slide

  14. Numerai
    • ۚ༥σʔλͷਨ௚࿈߹ֶशతͳ΋ͷ͕Ͱ͖͍ͯΔ
    • શੈքגࣜࢢ৔ͷגՁͷಈ͖ΛNumeraiଆ͕࡞੒ͨ͠Target 0~1Ͱ༧ଌ͢Δ
    • Numerai Signals Ͱ͸ɺಛ௃ྔ͸ࣗ෼Ͱ༻ҙͯ͘͠Δ
    • ࣮ࡍʹσʔλͰϑΝ΢ϯυ͕ӡ༻͞ΕͯɺརӹͷҰ෦ΛϞσϧͷߩݙ౓ʹԠ͡
    ͯ෼഑͞ΕΔ

    View full-size slide

  15. Federated Learning ϥΠϒϥϦؔ࿈
    • େ͖Ίͷ΋ͷͩͱ
    • https://github.com/tensorflow/federated
    • TensorflowFederated: Tensorflow ͷެࣜ Federated ϥΠϒϥϦ
    • https://github.com/OpenMined/PySyft
    • PySyft: PyTorch Λ࢖͏৔߹ͩͬͨΒɺͪ͜ΒΛ࢖͏
    • ͓ͦΒ͘ɺϥΠϒϥϦ͚ͩͰͳ͘αʔϏε΋ࠓޙ૿͖͑ͯͦ͏

    View full-size slide

  16. ࢀߟਤॻ
    Federated Learning:
    ϓϥΠόγʔอޢԼʹ͓͚Δػցֶश

    View full-size slide