Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Federated Learning 連合学習
Search
regonn
March 24, 2023
Technology
4
1.5k
Federated Learning 連合学習
Regonn @関西Kaggler交流会 2023/03/24
regonn
March 24, 2023
Tweet
Share
More Decks by regonn
See All by regonn
Submission with Numerai Compute using GCP Batch
regonn
0
320
HelloMoon x Orca=HelloOrca
regonn
0
90
The Challenge of Automatically Configuring Numerai Compute Environment
regonn
0
57
PLATEAUをデータベースに取り込んでみた
regonn
0
1.7k
古参Numerai参加者の戯言
regonn
1
2.3k
Nim + Cloud Run + TerraformでGCPにNimのサーバーレス環境を作る
regonn
1
590
S+ Camera Basicと似た環境をラズパイから構築してみる
regonn
0
450
衛星画像のゴルフ場写り込み判定AIモデルを作る
regonn
0
660
データラーニングギルド での活動と今後
regonn
0
120
Other Decks in Technology
See All in Technology
v-modelの歩みを振り返る
bengo4com
5
2.6k
AWS CDKで大量のパラメータストアを作りたい
haku__hime
1
120
さくっと実践!Postmanを活用した高品質で持続可能なAPI管理
yokawasa
5
370
GPSデバイスを使った簡易位置案内システムの構築をしてみた話。/jawsfesta2024
kwada
0
240
JPOUG_10_20241018_OracleDB_AWS_v1.3.pdf
asahihidehiko
1
200
Overview of file type identifiers
ange
0
150
Julia 新 LTS v1.10 解説 for JuliaTokai #20
antimon2
1
100
MOSH_companydeck_202410
mosh_inc
0
120
Rist_Meetup_Kaggleは業務の役にたつ - ビジネスコンテンツ情報を活用する BtoB 事業編 - / rist-meetup-20241012
taro_masuda
1
370
Trusted Types API と Vue.js
lycorptech_jp
PRO
1
120
Introduction to Indistinguishability/Ideal Obfuscation (iO)
sorasuegami
0
110
Brakeman を欺く - Kashiwa.rb #4
kozy4324
1
110
Featured
See All Featured
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
rmw
31
2.6k
Building Your Own Lightsaber
phodgson
102
6k
Java REST API Framework Comparison - PWX 2021
mraible
PRO
28
7.7k
What's new in Ruby 2.0
geeforr
342
31k
Responsive Adventures: Dirty Tricks From The Dark Corners of Front-End
smashingmag
250
21k
Designing Experiences People Love
moore
138
23k
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
jcasabona
27
1.9k
Fantastic passwords and where to find them - at NoRuKo
philnash
50
2.8k
jQuery: Nuts, Bolts and Bling
dougneiner
61
7.5k
Sharpening the Axe: The Primacy of Toolmaking
bcantrill
37
1.8k
Stop Working from a Prison Cell
hatefulcrawdad
267
20k
10 Git Anti Patterns You Should be Aware of
lemiorhan
653
59k
Transcript
Regonn @ؔKagglerަྲྀձ 2023/03/24 Federated Learning ࿈߹ֶश
Regonn (@regonn_haizine) • Kaggle Competition Expert • Kaggle ؔ࿈ Podcast
(with ΧϨʔͪΌΜ) • ౡࠜͷϑϦʔϥϯε • ϒϩοΫνΣʔϯɾϝλόʔεɾػցֶश(Ӵσʔλɾ)ͷࣄҊ݅ • Solana Japan Orca(DEX: ࢄऔҾॴ) ͷ CM • ڈ͔Βۀ࢝Ίͯ·͢
࠷ۙ AI ͷਐา֮·͍͠ • ChatGPT-4 • Hugging Face ͷ͓͔͛Ͱɺత(Task)ʹ߹ͬͨɺֶशࡁΈϞσϧΛར༻͠ ͘͢ͳ͖͍ͬͯͯΔ
औಘ͕͍͠σʔλᶃ • ΤοδσόΠεσʔλ • ௨৴ଳҬͳͲͷ੍ݶ • શͯͷηϯαʔσʔλऔಘ͍͠
औಘ͕͍͠σʔλᶄ • ҩྍσʔλɾސ٬σʔλ • ϓϥΠόγʔ • ଞࣾؒͰͷڞ༗
Federated Learning(FL) ࢄͯ͠อ࣋͞ΕͨσʔλΛऩूɾू͢Δ͜ͱͳ͘ػցֶशϞσϧͷ܇࿅ʹ ༻͍Δํ๏
Federated Learning(FL)ͷछྨ • ਫฏ࿈߹ֶश • ਨ࿈߹ֶश • ࿈߹సҠֶश
ਫฏ࿈߹ֶश • ͦΕͧΕ͕ɺಉ͡ಛྔͰɺҟͳΔσʔληοτΛ͍࣋ͬͯͨ߹ • ΤοδσόΠεͰ͜ͷλΠϓ
ਫฏ࿈߹ֶश ᶃ ᶄ ᶅ ᶃϩʔΧϧͰֶश ᶄதԝαʔόʔʹଛࣦޯใΛૹΔ ᶅதԝαʔόʔͰΞϯαϯϒϧతॲཧ(ޯฏۉԽ) ᶆߋ৽͞ΕͨϞσϧΛશͯฦ͢ ᶆ
ਨ࿈߹ֶश • ͦΕͧΕಛྔҟͳΔ͕ɺಉ͡λʔήοτͷσʔλΠϯσοΫε͕ଘࡏ͢ Δ߹ ߴ ϩʔϯ ސ٬A xx yy ௨৴ྔ
՝ֹۚ ސ٬A xx yy ΫϨδοτΧʔυͷσϑΥϧτ༧ଌ σϑΥϧτ ސ٬A 1
ਨ࿈߹ֶश ߴ ϩʔϯ ސ٬A xx yy ސ٬C zz ww ௨৴ྔ
՝ֹۚ ސ٬A kk mm ސ٬B aa bb σϑΥϧτ ސ٬A 1 ސ٬D 0 ※ݫີͰͳ͍ தԝαʔόʔͰ҉߸伴Λ࡞Γެ։伴Λɺ ͦΕͧΕͷϩʔΧϧͰ҉߸Խ͠ɺ ΞϊχϚΠζ͞ΕͨσʔλͰֶश ߴ ϩʔϯ ௨৴ྔ աֹۚ σϑΥϧτ ސ٬A xx yy kk mm 1
࿈߹సҠֶश • ಛྔλʔήοτҟͳΔ߹ • ࣅ͍ͯΔυϝΠϯྖҬ • αΠζ͕େ෯ʹҟͳΔ߹
Federated Learningͷใु • ͦΕͧΕͷɺϞσϧߩݙʹԠͯ͡ใुΛܭࢉ͢ΔϩδοΫݚڀ͞Εͯ ͍Δ
Numerai • ۚ༥σʔλͷਨ࿈߹ֶशతͳͷ͕Ͱ͖͍ͯΔ • શੈքגࣜࢢͷגՁͷಈ͖ΛNumeraiଆ͕࡞ͨ͠Target 0~1Ͱ༧ଌ͢Δ • Numerai Signals ͰɺಛྔࣗͰ༻ҙͯ͘͠Δ
• ࣮ࡍʹσʔλͰϑΝϯυ͕ӡ༻͞ΕͯɺརӹͷҰ෦ΛϞσϧͷߩݙʹԠ͡ ͯ͞ΕΔ
Federated Learning ϥΠϒϥϦؔ࿈ • େ͖Ίͷͷͩͱ • https://github.com/tensorflow/federated • TensorflowFederated: Tensorflow
ͷެࣜ Federated ϥΠϒϥϦ • https://github.com/OpenMined/PySyft • PySyft: PyTorch Λ͏߹ͩͬͨΒɺͪ͜ΒΛ͏ • ͓ͦΒ͘ɺϥΠϒϥϦ͚ͩͰͳ͘αʔϏεࠓޙ૿͖͑ͯͦ͏
ࢀߟਤॻ Federated Learning: ϓϥΠόγʔอޢԼʹ͓͚Δػցֶश
ऴΘΓ