Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Introduction to PyTorch Lightning

Avatar for Yustoris Yustoris
October 25, 2020
Technology
0
480

Introduction to PyTorch Lightning

Avatar for Yustoris

Yustoris

October 25, 2020
Tweet

More Decks by Yustoris

See All by Yustoris
Scene Text Detection and Recognition: The Deep Learning Era
Avatar for Yustoris yustoris
0
1.1k
Introduction to Cuneiform Texts
Avatar for Yustoris yustoris
0
250

Other Decks in Technology

See All in Technology
我々は雰囲気で仕事をしている / How can we do vibe coding as well
Avatar for Naomi Yamasaki naospon
2
200
Oracle Base Database Service：サービス概要のご紹介
Avatar for oracle4engineer oracle4engineer
PRO
2
20k
LLMエージェント時代に適応した開発フロー
Avatar for Yuya Hirayama hiragram
1
350
いま、あらためて考えてみるアカウント管理 with IaC / Account management with IaC
Avatar for kohbis kohbis
2
590
人を動かすことについて考える
Avatar for nakamichi ichimichi
2
300
PFEM Online Feature Flag @ newmo
Avatar for tobi shinyaishitobi
2
270
RAID6 を楔形文字で組んで現代人を怖がらせましょう（実装編）
Avatar for mimifuwacc mimifuwa
0
280
歴代のWeb Speed Hackathonの出題から考えるデグレしないパフォーマンス改善
Avatar for did0es shuta13
6
580
[CVPR2025論文読み会] Linguistics-aware Masked Image Modeling for Self-supervised Scene Text Recognition
Avatar for So Uchida s_aiueo32
0
210
サービスロボット最前線：ugoが挑むPhysical AI活用
Avatar for Ken Matsui kmatsuiugo
0
180
モノレポにおけるエラー管理 ~Runbook自動生成とチームメンションの最適化
Avatar for Shota Iwami biwashi
0
500
Exadata Database Service on Dedicated Infrastructure セキュリティ、ネットワーク、および管理について
Avatar for oracle4engineer oracle4engineer
PRO
1
350

Featured

See All Featured
The Art of Programming - Codeland 2020
Avatar for Erika Heidi erikaheidi
55
13k
StorybookのUI Testing Handbookを読んだ
Avatar for Shingo Yamazaki zakiyama
30
6k
Imperfection Machines: The Place of Print at Facebook
Avatar for Scott Boms scottboms
268
13k
Performance Is Good for Brains [We Love Speed 2024]
Avatar for Tammy Everts tammyeverts
10
1k
The World Runs on Bad Software
Avatar for Brandon Keepers bkeepers
PRO
70
11k
XXLCSS - How to scale CSS and keep your sanity
Avatar for Zaharenia Atzitzikaki sugarenia
248
1.3M
Art, The Web, and Tiny UX
Avatar for Lynn Fisher lynnandtonic
302
21k
Designing for Performance
Avatar for Lara Hogan lara
610
69k
Balancing Empowerment & Direction
Avatar for Lara Hogan lara
2
580
Learning to Love Humans: Emotional Interface Design
Avatar for Aarron Walter aarron
273
40k
Done Done
Avatar for chrislema chrislema
185
16k
Faster Mobile Websites
Avatar for Dean Hume deanohume
309
31k

Transcript

  1. PyTorch Lightningʹ ೖ໳ͯ͠Έͨ @yustoris 2020/10/25

  2. PyTorch Lightning ͱ͸ • PyTorch޲͚ศརWrapper • Մಡੑͱอकੑ޲্ + PyTochͰͷݚڀ։ൃ޲͚௥Ճػೳ •

    ࠷ۙv1.0ʹͳΓ·ͨ͠ https://pytorchlightning.ai

  3. ͜͏͍͏ ίʔυ͕

  4. ͜͏͍͏ ίʔυ͕ େମ͜͏͍͏ॳظԽίʔυ͕ μϥͬͱ௕͘ͳΓ͕ͪ

  5. ͜͏͍͏ ίʔυ͕ େମ͜͏͍͏5SBJOJOHϧʔϓ͕ ΍ͨΒ௕͍ίʔυʹͳͬͯՄಡੑ͕͓ͪΔ

  6. ͜͏ͳΔ Training Code Training CodeΛϞσϧΫϥεʹ TrainerΫϥεͰTraining࣮ߦ Model Class

  7. PyTorch Lightning ͷओཁͳػೳ • Performance & bottleneck profiler • Model

    checkpointing • 16-bit precision • Run distributed training • Logging • … etc. جຊ5SBJOFSʹΦϓγϣϯͰઃఆ

  8. Hydra ͱซ༻͕͓͢͢Ί • YAMLͰΦϓγϣϯΛܕ/֊૚͝ͱͰఆٛՄೳ • ϋΠύʔύϥϝʔλʔ͕ଟ͘ͳΓ͕ͪͳ ػցֶशίʔυͰ༗༻ • ެࣜαϯϓϧ΋༗Γ https://github.com/PyTorchLightning/wheat

    https://hydra.cc