Slide 1
Slide 1 text
PyTorch Lightningʹ
ೖͯ͠Έͨ
@yustoris
2020/10/25
Slide 2
Slide 2 text
PyTorch Lightning ͱ
• PyTorch͚ศརWrapper
• Մಡੑͱอकੑ্
+ PyTochͰͷݚڀ։ൃ͚Ճػೳ
• ࠷ۙv1.0ʹͳΓ·ͨ͠
https://pytorchlightning.ai
Slide 3
Slide 3 text
͜͏͍͏
ίʔυ͕
Slide 4
Slide 4 text
͜͏͍͏
ίʔυ͕
େମ͜͏͍͏ॳظԽίʔυ͕
μϥͬͱ͘ͳΓ͕ͪ
Slide 5
Slide 5 text
͜͏͍͏
ίʔυ͕
େମ͜͏͍͏5SBJOJOHϧʔϓ͕
ͨΒ͍ίʔυʹͳͬͯՄಡੑ͕͓ͪΔ
Slide 6
Slide 6 text
͜͏ͳΔ
Training Code
Training CodeΛϞσϧΫϥεʹ TrainerΫϥεͰTraining࣮ߦ
Model Class
Slide 7
Slide 7 text
PyTorch Lightning ͷओཁͳػೳ
• Performance & bottleneck profiler
• Model checkpointing
• 16-bit precision
• Run distributed training
• Logging
• … etc.
جຊ5SBJOFSʹΦϓγϣϯͰઃఆ
Slide 8
Slide 8 text
Hydra ͱซ༻͕͓͢͢Ί
• YAMLͰΦϓγϣϯΛܕ/֊͝ͱͰఆٛՄೳ
• ϋΠύʔύϥϝʔλʔ͕ଟ͘ͳΓ͕ͪͳ
ػցֶशίʔυͰ༗༻
• ެࣜαϯϓϧ༗Γ
https://github.com/PyTorchLightning/wheat
https://hydra.cc