Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Introduction to PyTorch Lightning

Avatar for Yustoris Yustoris
October 25, 2020
Technology
0
500

Introduction to PyTorch Lightning

Avatar for Yustoris

Yustoris

October 25, 2020
Tweet

More Decks by Yustoris

See All by Yustoris
Scene Text Detection and Recognition: The Deep Learning Era
Avatar for Yustoris yustoris
0
1.1k
Introduction to Cuneiform Texts
Avatar for Yustoris yustoris
0
250

Other Decks in Technology

See All in Technology
フルカイテン株式会社 エンジニア向け採用資料
Avatar for FULL KAITEN fullkaiten
0
10k
SREのプラクティスを用いた3領域同時 マネジメントへの挑戦 〜SRE・情シス・セキュリティを統合した チーム運営術〜
Avatar for coconala_engineer coconala_engineer
2
640
顧客との商談議事録をみんなで読んで顧客解像度を上げよう
Avatar for shibayu36 shibayu36
0
230
コスト削減から「セキュリティと利便性」を担うプラットフォームへ
Avatar for SansanTech sansantech
PRO
3
1.5k
Oracle Cloud Observability and Management Platform - OCI 運用監視サービス概要 -
Avatar for oracle4engineer oracle4engineer
PRO
2
14k
予期せぬコストの急増を障害のように扱う――「コスト版ポストモーテム」の導入とその後の改善
Avatar for Masahiro Yoshizawa muziyoshiz
1
1.9k
AIエージェントを開発しよう！-AgentCore活用の勘所-
Avatar for YukiOgawa yukiogawa
0
170
Introduction to Sansan for Engineers / エンジニア向け会社紹介
Avatar for Sansan, Inc. sansan33
PRO
6
68k
Codex 5.3 と Opus 4.6 にコーポレートサイトを作らせてみた / Codex 5.3 vs Opus 4.6
Avatar for ama-ch ama_ch
0
150
広告の効果検証を題材にした因果推論の精度検証について
Avatar for ZOZO Developers zozotech
PRO
0
170
プロダクト成長を支える開発基盤とスケールに伴う課題
Avatar for yuu26 yuu26
4
1.3k
データの整合性を保ちたいだけなんだ
Avatar for ShoheiMitani shoheimitani
8
3.1k

Featured

See All Featured
Side Projects
Avatar for Sacha Greif sachag
455
43k
Breaking role norms: Why Content Design is so much more than writing copy - Taylor Woolridge
Avatar for UX Y'all uxyall
0
170
Unlocking the hidden potential of vector embeddings in international SEO
Avatar for Frank van Dijk frankvandijk
0
170
AI in Enterprises - Java and Open Source to the Rescue
Avatar for ivargrimstad ivargrimstad
0
1.1k
How to Get Subject Matter Experts Bought In and Actively Contributing to SEO & PR Initiatives.
Avatar for Liv Day livdayseo
0
66
Raft: Consensus for Rubyists
Avatar for Patrick Van Stee vanstee
141
7.3k
A Modern Web Designer's Workflow
Avatar for Chris Coyier chriscoyier
698
190k
Being A Developer After 40
Avatar for Adrian Kosmaczewski akosma
91
590k
The Anti-SEO Checklist Checklist. Pubcon Cyber Week
Avatar for Ryan Jones ryanjones
0
65
How to Ace a Technical Interview
Avatar for Jacob Kaplan-Moss jacobian
281
24k
Utilizing Notion as your number one productivity tool
Avatar for Mfonobong Umondia mfonobong
3
220
Building Adaptive Systems
Avatar for Chris Keathley keathley
44
2.9k

Transcript

  1. PyTorch Lightningʹ ೖ໳ͯ͠Έͨ @yustoris 2020/10/25

  2. PyTorch Lightning ͱ͸ • PyTorch޲͚ศརWrapper • Մಡੑͱอकੑ޲্ + PyTochͰͷݚڀ։ൃ޲͚௥Ճػೳ •

    ࠷ۙv1.0ʹͳΓ·ͨ͠ https://pytorchlightning.ai

  3. ͜͏͍͏ ίʔυ͕

  4. ͜͏͍͏ ίʔυ͕ େମ͜͏͍͏ॳظԽίʔυ͕ μϥͬͱ௕͘ͳΓ͕ͪ

  5. ͜͏͍͏ ίʔυ͕ େମ͜͏͍͏5SBJOJOHϧʔϓ͕ ΍ͨΒ௕͍ίʔυʹͳͬͯՄಡੑ͕͓ͪΔ

  6. ͜͏ͳΔ Training Code Training CodeΛϞσϧΫϥεʹ TrainerΫϥεͰTraining࣮ߦ Model Class

  7. PyTorch Lightning ͷओཁͳػೳ • Performance & bottleneck profiler • Model

    checkpointing • 16-bit precision • Run distributed training • Logging • … etc. جຊ5SBJOFSʹΦϓγϣϯͰઃఆ

  8. Hydra ͱซ༻͕͓͢͢Ί • YAMLͰΦϓγϣϯΛܕ/֊૚͝ͱͰఆٛՄೳ • ϋΠύʔύϥϝʔλʔ͕ଟ͘ͳΓ͕ͪͳ ػցֶशίʔυͰ༗༻ • ެࣜαϯϓϧ΋༗Γ https://github.com/PyTorchLightning/wheat

    https://hydra.cc