Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Federated Learning 連合学習
Search
regonn
March 24, 2023
Technology
4
1.5k
Federated Learning 連合学習
Regonn @関西Kaggler交流会 2023/03/24
regonn
March 24, 2023
Tweet
Share
More Decks by regonn
See All by regonn
Submission with Numerai Compute using GCP Batch
regonn
0
290
HelloMoon x Orca=HelloOrca
regonn
0
90
The Challenge of Automatically Configuring Numerai Compute Environment
regonn
0
57
PLATEAUをデータベースに取り込んでみた
regonn
0
1.7k
古参Numerai参加者の戯言
regonn
1
2.3k
Nim + Cloud Run + TerraformでGCPにNimのサーバーレス環境を作る
regonn
1
590
S+ Camera Basicと似た環境をラズパイから構築してみる
regonn
0
450
衛星画像のゴルフ場写り込み判定AIモデルを作る
regonn
0
650
データラーニングギルド での活動と今後
regonn
0
120
Other Decks in Technology
See All in Technology
O'Reilly Superstream: Building a RAG App to Chat with Your Data
pamelafox
0
120
Qdrant を用いた検索改善施策の紹介 / Search Engineering Tech Talk 2024 Summer
visional_engineering_and_design
1
210
【インフラエンジニアbooks】30分でわかる「AWS継続的セキュリティ実践ガイド」
hssh2_bin
5
1.7k
kube-vipとkube-proxy置き換えCiliumを積んだ究極のK3sクラスタを建てる
logica0419
4
220
「ばん・さく・つき・たー!」にならないためにSHIROBAKOから 学んだこと
ysknsid25
3
690
Binary Hacks Rebooted 私選ハック集
nullpo_head
1
280
Databricks Appのご紹介
databricksjapan
0
350
プロダクト開発の貢献をアピールするための目標設計や認知活動 / Goal design and recognition activities to promote product development contributions.
oomatomo
5
910
Amazon ECS & AWS Fargate 今昔物語 / past and present stories of Amazon ECS and AWS Fargate
iselegant
12
2.2k
Castor - Le Task Runner PHP qui simplifie votre Workflow
lyrixx
1
290
New Relicを活用したシステム監視の強化とオブザーバビリティ向上
sugoto911
1
110
クレジットカードを製造する技術
yutadayo
81
48k
Featured
See All Featured
The Mythical Team-Month
searls
218
43k
Practical Tips for Bootstrapping Information Extraction Pipelines
honnibal
PRO
7
580
Debugging Ruby Performance
tmm1
73
12k
Understanding Cognitive Biases in Performance Measurement
bluesmoon
26
1.4k
Adopting Sorbet at Scale
ufuk
73
9k
Raft: Consensus for Rubyists
vanstee
136
6.6k
The Pragmatic Product Professional
lauravandoore
31
6.2k
KATA
mclloyd
27
13k
Git: the NoSQL Database
bkeepers
PRO
425
64k
Infographics Made Easy
chrislema
239
18k
Helping Users Find Their Own Way: Creating Modern Search Experiences
danielanewman
29
2.2k
Dealing with People You Can't Stand - Big Design 2015
cassininazir
364
22k
Transcript
Regonn @ؔKagglerަྲྀձ 2023/03/24 Federated Learning ࿈߹ֶश
Regonn (@regonn_haizine) • Kaggle Competition Expert • Kaggle ؔ࿈ Podcast
(with ΧϨʔͪΌΜ) • ౡࠜͷϑϦʔϥϯε • ϒϩοΫνΣʔϯɾϝλόʔεɾػցֶश(Ӵσʔλɾ)ͷࣄҊ݅ • Solana Japan Orca(DEX: ࢄऔҾॴ) ͷ CM • ڈ͔Βۀ࢝Ίͯ·͢
࠷ۙ AI ͷਐา֮·͍͠ • ChatGPT-4 • Hugging Face ͷ͓͔͛Ͱɺత(Task)ʹ߹ͬͨɺֶशࡁΈϞσϧΛར༻͠ ͘͢ͳ͖͍ͬͯͯΔ
औಘ͕͍͠σʔλᶃ • ΤοδσόΠεσʔλ • ௨৴ଳҬͳͲͷ੍ݶ • શͯͷηϯαʔσʔλऔಘ͍͠
औಘ͕͍͠σʔλᶄ • ҩྍσʔλɾސ٬σʔλ • ϓϥΠόγʔ • ଞࣾؒͰͷڞ༗
Federated Learning(FL) ࢄͯ͠อ࣋͞ΕͨσʔλΛऩूɾू͢Δ͜ͱͳ͘ػցֶशϞσϧͷ܇࿅ʹ ༻͍Δํ๏
Federated Learning(FL)ͷछྨ • ਫฏ࿈߹ֶश • ਨ࿈߹ֶश • ࿈߹సҠֶश
ਫฏ࿈߹ֶश • ͦΕͧΕ͕ɺಉ͡ಛྔͰɺҟͳΔσʔληοτΛ͍࣋ͬͯͨ߹ • ΤοδσόΠεͰ͜ͷλΠϓ
ਫฏ࿈߹ֶश ᶃ ᶄ ᶅ ᶃϩʔΧϧͰֶश ᶄதԝαʔόʔʹଛࣦޯใΛૹΔ ᶅதԝαʔόʔͰΞϯαϯϒϧతॲཧ(ޯฏۉԽ) ᶆߋ৽͞ΕͨϞσϧΛશͯฦ͢ ᶆ
ਨ࿈߹ֶश • ͦΕͧΕಛྔҟͳΔ͕ɺಉ͡λʔήοτͷσʔλΠϯσοΫε͕ଘࡏ͢ Δ߹ ߴ ϩʔϯ ސ٬A xx yy ௨৴ྔ
՝ֹۚ ސ٬A xx yy ΫϨδοτΧʔυͷσϑΥϧτ༧ଌ σϑΥϧτ ސ٬A 1
ਨ࿈߹ֶश ߴ ϩʔϯ ސ٬A xx yy ސ٬C zz ww ௨৴ྔ
՝ֹۚ ސ٬A kk mm ސ٬B aa bb σϑΥϧτ ސ٬A 1 ސ٬D 0 ※ݫີͰͳ͍ தԝαʔόʔͰ҉߸伴Λ࡞Γެ։伴Λɺ ͦΕͧΕͷϩʔΧϧͰ҉߸Խ͠ɺ ΞϊχϚΠζ͞ΕͨσʔλͰֶश ߴ ϩʔϯ ௨৴ྔ աֹۚ σϑΥϧτ ސ٬A xx yy kk mm 1
࿈߹సҠֶश • ಛྔλʔήοτҟͳΔ߹ • ࣅ͍ͯΔυϝΠϯྖҬ • αΠζ͕େ෯ʹҟͳΔ߹
Federated Learningͷใु • ͦΕͧΕͷɺϞσϧߩݙʹԠͯ͡ใुΛܭࢉ͢ΔϩδοΫݚڀ͞Εͯ ͍Δ
Numerai • ۚ༥σʔλͷਨ࿈߹ֶशతͳͷ͕Ͱ͖͍ͯΔ • શੈքגࣜࢢͷגՁͷಈ͖ΛNumeraiଆ͕࡞ͨ͠Target 0~1Ͱ༧ଌ͢Δ • Numerai Signals ͰɺಛྔࣗͰ༻ҙͯ͘͠Δ
• ࣮ࡍʹσʔλͰϑΝϯυ͕ӡ༻͞ΕͯɺརӹͷҰ෦ΛϞσϧͷߩݙʹԠ͡ ͯ͞ΕΔ
Federated Learning ϥΠϒϥϦؔ࿈ • େ͖Ίͷͷͩͱ • https://github.com/tensorflow/federated • TensorflowFederated: Tensorflow
ͷެࣜ Federated ϥΠϒϥϦ • https://github.com/OpenMined/PySyft • PySyft: PyTorch Λ͏߹ͩͬͨΒɺͪ͜ΒΛ͏ • ͓ͦΒ͘ɺϥΠϒϥϦ͚ͩͰͳ͘αʔϏεࠓޙ૿͖͑ͯͦ͏
ࢀߟਤॻ Federated Learning: ϓϥΠόγʔอޢԼʹ͓͚Δػցֶश
ऴΘΓ