Federated Learning 連合学習

Slide 1

Slide 1 text

Regonn @ؔ੢Kagglerަྲྀձ 2023/03/24 Federated Learning ࿈߹ֶश

Slide 2

Slide 2 text

Regonn (@regonn_haizine) • Kaggle Competition Expert • Kaggle ؔ࿈ Podcast (with ΧϨʔͪΌΜ) • ౡࠜͷϑϦʔϥϯε • ϒϩοΫνΣʔϯɾϝλόʔεɾػցֶश(Ӵ੕σʔλɾ೴೾)ͷ࢓ࣄҊ݅ • Solana Japan ΍ Orca(DEX: ෼ࢄऔҾॴ) ͷ CM • ڈ೥͔Β೶ۀ΋࢝Ίͯ·͢

Slide 3

Slide 3 text

࠷ۙ AI ͷਐา΋໨֮·͍͠ • ChatGPT-4 • Hugging Face ౳ͷ͓͔͛Ͱɺ໨త(Task)ʹ߹ͬͨɺֶशࡁΈϞσϧΛར༻͠ ΍͘͢ͳ͖͍ͬͯͯΔ

Slide 4

Slide 4 text

औಘ͕೉͍͠σʔλᶃ • ΤοδσόΠεσʔλ • ௨৴ଳҬͳͲͷ੍ݶ • શͯͷηϯαʔσʔλऔಘ͸೉͍͠

Slide 5

Slide 5 text

औಘ͕೉͍͠σʔλᶄ • ҩྍσʔλɾސ٬σʔλ • ϓϥΠόγʔ໰୊ • ଞࣾؒͰͷڞ༗

Slide 6

Slide 6 text

Federated Learning(FL) ෼ࢄͯ͠อ࣋͞ΕͨσʔλΛऩूɾू໿͢Δ͜ͱͳ͘ػցֶशϞσϧͷ܇࿅ʹ ༻͍Δํ๏

Slide 7

Slide 7 text

Federated Learning(FL)ͷछྨ • ਫฏ࿈߹ֶश • ਨ௚࿈߹ֶश • ࿈߹సҠֶश

Slide 8

Slide 8 text

ਫฏ࿈߹ֶश • ͦΕͧΕ͕ɺಉ͡ಛ௃ྔͰɺҟͳΔσʔληοτΛ͍࣋ͬͯͨ৔߹ • ΤοδσόΠε౳Ͱ΋͜ͷλΠϓ

Slide 9

Slide 9 text

ਫฏ࿈߹ֶश ᶃ ᶄ ᶅ ᶃϩʔΧϧͰֶश ᶄதԝαʔόʔʹଛࣦ΍ޯ഑৘ใΛૹΔ ᶅதԝαʔόʔͰΞϯαϯϒϧతॲཧ(ޯ഑ฏۉԽ) ᶆߋ৽͞ΕͨϞσϧΛશͯ΁ฦ͢ ᶆ

Slide 10

Slide 10 text

ਨ௚࿈߹ֶश • ͦΕͧΕಛ௃ྔ͸ҟͳΔ͕ɺಉ͡λʔήοτͷσʔλΠϯσοΫε͕ଘࡏ͢ Δ৔߹ ࢒ߴ ϩʔϯ ސ٬A xx yy ௨৴ྔ ՝ֹۚ ސ٬A xx yy ΫϨδοτΧʔυͷσϑΥϧτ༧ଌ σϑΥϧτ ސ٬A 1

Slide 11

Slide 11 text

ਨ௚࿈߹ֶश ࢒ߴ ϩʔϯ ސ٬A xx yy ސ٬C zz ww ௨৴ྔ ՝ֹۚ ސ٬A kk mm ސ٬B aa bb σϑΥϧτ ސ٬A 1 ސ٬D 0 ※ݫີͰ͸ͳ͍ தԝαʔόʔͰ҉߸伴Λ࡞Γެ։伴Λ഑෍ɺ ͦΕͧΕͷϩʔΧϧͰ҉߸Խ͠ɺ ΞϊχϚΠζ͞ΕͨσʔλͰֶश ࢒ߴ ϩʔϯ ௨৴ྔ աֹۚ σϑΥϧτ ސ٬A xx yy kk mm 1

Slide 12

Slide 12 text

࿈߹సҠֶश • ಛ௃ྔ΋λʔήοτ΋ҟͳΔ৔߹ • ࣅ͍ͯΔυϝΠϯྖҬ • ෼෍΍αΠζ͕େ෯ʹҟͳΔ৔߹

Slide 13

Slide 13 text

Federated Learningͷใु • ͦΕͧΕͷɺϞσϧߩݙ౓ʹԠͯ͡ใुΛܭࢉ͢ΔϩδοΫ౳΋ݚڀ͞Εͯ ͍Δ

Slide 14

Slide 14 text

Numerai • ۚ༥σʔλͷਨ௚࿈߹ֶशతͳ΋ͷ͕Ͱ͖͍ͯΔ • શੈքגࣜࢢ৔ͷגՁͷಈ͖ΛNumeraiଆ͕࡞੒ͨ͠Target 0~1Ͱ༧ଌ͢Δ • Numerai Signals Ͱ͸ɺಛ௃ྔ͸ࣗ෼Ͱ༻ҙͯ͘͠Δ • ࣮ࡍʹσʔλͰϑΝ΢ϯυ͕ӡ༻͞ΕͯɺརӹͷҰ෦ΛϞσϧͷߩݙ౓ʹԠ͡ ͯ෼഑͞ΕΔ

Slide 15

Slide 15 text

Federated Learning ϥΠϒϥϦؔ࿈ • େ͖Ίͷ΋ͷͩͱ • https://github.com/tensorflow/federated • TensorflowFederated: Tensorflow ͷެࣜ Federated ϥΠϒϥϦ • https://github.com/OpenMined/PySyft • PySyft: PyTorch Λ࢖͏৔߹ͩͬͨΒɺͪ͜ΒΛ࢖͏ • ͓ͦΒ͘ɺϥΠϒϥϦ͚ͩͰͳ͘αʔϏε΋ࠓޙ૿͖͑ͯͦ͏