Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Federated Learning 連合学習
Search
regonn
March 24, 2023
Technology
4
1.6k
Federated Learning 連合学習
Regonn @関西Kaggler交流会 2023/03/24
regonn
March 24, 2023
Tweet
Share
More Decks by regonn
See All by regonn
Submission with Numerai Compute using GCP Batch
regonn
0
430
HelloMoon x Orca=HelloOrca
regonn
0
99
The Challenge of Automatically Configuring Numerai Compute Environment
regonn
0
69
PLATEAUをデータベースに取り込んでみた
regonn
0
1.7k
古参Numerai参加者の戯言
regonn
1
2.3k
Nim + Cloud Run + TerraformでGCPにNimのサーバーレス環境を作る
regonn
1
610
S+ Camera Basicと似た環境をラズパイから構築してみる
regonn
0
480
衛星画像のゴルフ場写り込み判定AIモデルを作る
regonn
0
700
データラーニングギルド での活動と今後
regonn
0
140
Other Decks in Technology
See All in Technology
20250129 Findy_テスト高活用化
dshirae
0
240
ココナラのセキュリティ組織の体制・役割・今後目指す世界
coconala_engineer
0
230
High Performance PHP
cmuench
0
110
Enhancing SRE Using AI
yoshiiryo1
1
400
Grid表示のレイアウトで Flow layoutsを使う
cffyoha
1
160
[JAWS-UG栃木]地方だからできたクラウドネイティブ事例大公開! / jawsug_tochigi_tachibana
biatunky
0
160
プロダクト観点で考えるデータ基盤の育成戦略 / Growth Strategy of Data Analytics Platforms from a Product Perspective
yamamotoyuta
0
390
A Hidden Pitfall of K8s DNS with Spring Webflux
musaprg
0
200
Active Directory の保護
eurekaberry
6
2.9k
アーキテクチャわからん、の話
shirayanagiryuji
0
220
AWSエンジニアに捧ぐLangChainの歩き方
tsukuboshi
0
250
[2025クラウドガバナンスはこう変わる!マルチアカウント運用のre:Invent最新情報と活用例] re:Invent 2024 から見る AWS マルチアカウントガバナンスのこれまでとこれから
0nihajim
0
110
Featured
See All Featured
Agile that works and the tools we love
rasmusluckow
328
21k
The World Runs on Bad Software
bkeepers
PRO
67
11k
Learning to Love Humans: Emotional Interface Design
aarron
274
40k
A Philosophy of Restraint
colly
203
16k
Performance Is Good for Brains [We Love Speed 2024]
tammyeverts
7
620
Responsive Adventures: Dirty Tricks From The Dark Corners of Front-End
smashingmag
251
21k
Java REST API Framework Comparison - PWX 2021
mraible
28
8.4k
GraphQLとの向き合い方2022年版
quramy
44
13k
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
addyosmani
3
280
Building Better People: How to give real-time feedback that sticks.
wjessup
366
19k
Designing Experiences People Love
moore
139
23k
The Cult of Friendly URLs
andyhume
78
6.2k
Transcript
Regonn @ؔKagglerަྲྀձ 2023/03/24 Federated Learning ࿈߹ֶश
Regonn (@regonn_haizine) • Kaggle Competition Expert • Kaggle ؔ࿈ Podcast
(with ΧϨʔͪΌΜ) • ౡࠜͷϑϦʔϥϯε • ϒϩοΫνΣʔϯɾϝλόʔεɾػցֶश(Ӵσʔλɾ)ͷࣄҊ݅ • Solana Japan Orca(DEX: ࢄऔҾॴ) ͷ CM • ڈ͔Βۀ࢝Ίͯ·͢
࠷ۙ AI ͷਐา֮·͍͠ • ChatGPT-4 • Hugging Face ͷ͓͔͛Ͱɺత(Task)ʹ߹ͬͨɺֶशࡁΈϞσϧΛར༻͠ ͘͢ͳ͖͍ͬͯͯΔ
औಘ͕͍͠σʔλᶃ • ΤοδσόΠεσʔλ • ௨৴ଳҬͳͲͷ੍ݶ • શͯͷηϯαʔσʔλऔಘ͍͠
औಘ͕͍͠σʔλᶄ • ҩྍσʔλɾސ٬σʔλ • ϓϥΠόγʔ • ଞࣾؒͰͷڞ༗
Federated Learning(FL) ࢄͯ͠อ࣋͞ΕͨσʔλΛऩूɾू͢Δ͜ͱͳ͘ػցֶशϞσϧͷ܇࿅ʹ ༻͍Δํ๏
Federated Learning(FL)ͷछྨ • ਫฏ࿈߹ֶश • ਨ࿈߹ֶश • ࿈߹సҠֶश
ਫฏ࿈߹ֶश • ͦΕͧΕ͕ɺಉ͡ಛྔͰɺҟͳΔσʔληοτΛ͍࣋ͬͯͨ߹ • ΤοδσόΠεͰ͜ͷλΠϓ
ਫฏ࿈߹ֶश ᶃ ᶄ ᶅ ᶃϩʔΧϧͰֶश ᶄதԝαʔόʔʹଛࣦޯใΛૹΔ ᶅதԝαʔόʔͰΞϯαϯϒϧతॲཧ(ޯฏۉԽ) ᶆߋ৽͞ΕͨϞσϧΛશͯฦ͢ ᶆ
ਨ࿈߹ֶश • ͦΕͧΕಛྔҟͳΔ͕ɺಉ͡λʔήοτͷσʔλΠϯσοΫε͕ଘࡏ͢ Δ߹ ߴ ϩʔϯ ސ٬A xx yy ௨৴ྔ
՝ֹۚ ސ٬A xx yy ΫϨδοτΧʔυͷσϑΥϧτ༧ଌ σϑΥϧτ ސ٬A 1
ਨ࿈߹ֶश ߴ ϩʔϯ ސ٬A xx yy ސ٬C zz ww ௨৴ྔ
՝ֹۚ ސ٬A kk mm ސ٬B aa bb σϑΥϧτ ސ٬A 1 ސ٬D 0 ※ݫີͰͳ͍ தԝαʔόʔͰ҉߸伴Λ࡞Γެ։伴Λɺ ͦΕͧΕͷϩʔΧϧͰ҉߸Խ͠ɺ ΞϊχϚΠζ͞ΕͨσʔλͰֶश ߴ ϩʔϯ ௨৴ྔ աֹۚ σϑΥϧτ ސ٬A xx yy kk mm 1
࿈߹సҠֶश • ಛྔλʔήοτҟͳΔ߹ • ࣅ͍ͯΔυϝΠϯྖҬ • αΠζ͕େ෯ʹҟͳΔ߹
Federated Learningͷใु • ͦΕͧΕͷɺϞσϧߩݙʹԠͯ͡ใुΛܭࢉ͢ΔϩδοΫݚڀ͞Εͯ ͍Δ
Numerai • ۚ༥σʔλͷਨ࿈߹ֶशతͳͷ͕Ͱ͖͍ͯΔ • શੈքגࣜࢢͷגՁͷಈ͖ΛNumeraiଆ͕࡞ͨ͠Target 0~1Ͱ༧ଌ͢Δ • Numerai Signals ͰɺಛྔࣗͰ༻ҙͯ͘͠Δ
• ࣮ࡍʹσʔλͰϑΝϯυ͕ӡ༻͞ΕͯɺརӹͷҰ෦ΛϞσϧͷߩݙʹԠ͡ ͯ͞ΕΔ
Federated Learning ϥΠϒϥϦؔ࿈ • େ͖Ίͷͷͩͱ • https://github.com/tensorflow/federated • TensorflowFederated: Tensorflow
ͷެࣜ Federated ϥΠϒϥϦ • https://github.com/OpenMined/PySyft • PySyft: PyTorch Λ͏߹ͩͬͨΒɺͪ͜ΒΛ͏ • ͓ͦΒ͘ɺϥΠϒϥϦ͚ͩͰͳ͘αʔϏεࠓޙ૿͖͑ͯͦ͏
ࢀߟਤॻ Federated Learning: ϓϥΠόγʔอޢԼʹ͓͚Δػցֶश
ऴΘΓ