Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Introduction to PyTorch Lightning

Sponsored · SiteGround - Reliable hosting with speed, security, and support you can count on. →
Avatar for Yustoris Yustoris
October 25, 2020
Technology
0
500

Introduction to PyTorch Lightning

Avatar for Yustoris

Yustoris

October 25, 2020
Tweet

More Decks by Yustoris

See All by Yustoris
Scene Text Detection and Recognition: The Deep Learning Era
Avatar for Yustoris yustoris
0
1.1k
Introduction to Cuneiform Texts
Avatar for Yustoris yustoris
0
250

Other Decks in Technology

See All in Technology
Cosmos World Foundation Model Platform for Physical AI
Avatar for Takuya MINAGAWA takmin
0
880
フルカイテン株式会社 エンジニア向け採用資料
Avatar for FULL KAITEN fullkaiten
0
10k
Digitization部 紹介資料
Avatar for Sansan, Inc. sansan33
PRO
1
6.8k
CDK対応したAWS DevOps Agentを試そう_20260201
Avatar for モブエンジニア（Masaki Okuda） masakiokuda
1
270
SREチームをどう作り、どう育てるか ― Findy横断SREのマネジメント
Avatar for adachi.ryo rvirus0817
0
240
プロダクト成長を支える開発基盤とスケールに伴う課題
Avatar for yuu26 yuu26
4
1.3k
What happened to RubyGems and what can we learn?
Avatar for Mike McQuaid mikemcquaid
0
300
顧客の言葉を、そのまま信じない勇気
Avatar for yamatai12 yamatai1212
1
350
量子クラウドサービスの裏側　〜Deep Dive into OQTOPUS〜
Avatar for OQTOPUS oqtopus
0
110
30万人の同時アクセスに耐えたい！新サービスの盤石なリリースを支える負荷試験 / SRE Kaigi 2026
Avatar for GENDA genda
4
1.3k
学生・新卒・ジュニアから目指すSRE
Avatar for Hiroya Onoe hiroyaonoe
2
600
Bedrock PolicyでAmazon Bedrock Guardrails利用を強制してみた
Avatar for Yudai Jinno yuu551
0
230

Featured

See All Featured
Marketing to machines
Avatar for Jono Alderson jonoalderson
1
4.6k
Building Better People: How to give real-time feedback that sticks.
Avatar for Will Jessup wjessup
370
20k
Speed Design
Avatar for Sergey Chernyshev sergeychernyshev
33
1.5k
"I'm Feeling Lucky" - Building Great Search Experiences for Today's Users (#IAC19)
Avatar for Dan Newman danielanewman
231
22k
We Analyzed 250 Million AI Search Results: Here's What I Found
Avatar for Josh Blyskal joshbly
1
710
Color Theory Basics | Prateek | Gurzu
Avatar for Gurzu gurzu
0
200
Everyday Curiosity
Avatar for Cassini Nazir cassininazir
0
130
Agile Actions for Facilitating Distributed Teams - ADO2019
Avatar for Mark Kilby mkilby
0
110
Build The Right Thing And Hit Your Dates
Avatar for Maggie C. maggiecrowley
38
3k
KATA
Avatar for Megan Lloyd mclloyd
PRO
34
15k
エンジニアに許された特別な時間の終わり
Avatar for watany watany
106
230k
Fight the Zombie Pattern Library - RWD Summit 2016
Avatar for Marcelo Somers marcelosomers
234
17k

Transcript

  1. PyTorch Lightningʹ ೖ໳ͯ͠Έͨ @yustoris 2020/10/25

  2. PyTorch Lightning ͱ͸ • PyTorch޲͚ศརWrapper • Մಡੑͱอकੑ޲্ + PyTochͰͷݚڀ։ൃ޲͚௥Ճػೳ •

    ࠷ۙv1.0ʹͳΓ·ͨ͠ https://pytorchlightning.ai

  3. ͜͏͍͏ ίʔυ͕

  4. ͜͏͍͏ ίʔυ͕ େମ͜͏͍͏ॳظԽίʔυ͕ μϥͬͱ௕͘ͳΓ͕ͪ

  5. ͜͏͍͏ ίʔυ͕ େମ͜͏͍͏5SBJOJOHϧʔϓ͕ ΍ͨΒ௕͍ίʔυʹͳͬͯՄಡੑ͕͓ͪΔ

  6. ͜͏ͳΔ Training Code Training CodeΛϞσϧΫϥεʹ TrainerΫϥεͰTraining࣮ߦ Model Class

  7. PyTorch Lightning ͷओཁͳػೳ • Performance & bottleneck profiler • Model

    checkpointing • 16-bit precision • Run distributed training • Logging • … etc. جຊ5SBJOFSʹΦϓγϣϯͰઃఆ

  8. Hydra ͱซ༻͕͓͢͢Ί • YAMLͰΦϓγϣϯΛܕ/֊૚͝ͱͰఆٛՄೳ • ϋΠύʔύϥϝʔλʔ͕ଟ͘ͳΓ͕ͪͳ ػցֶशίʔυͰ༗༻ • ެࣜαϯϓϧ΋༗Γ https://github.com/PyTorchLightning/wheat

    https://hydra.cc