Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Introduction to PyTorch Lightning

Avatar for Yustoris Yustoris
October 25, 2020
Technology
0
500

Introduction to PyTorch Lightning

Avatar for Yustoris

Yustoris

October 25, 2020
Tweet

More Decks by Yustoris

See All by Yustoris
Scene Text Detection and Recognition: The Deep Learning Era
Avatar for Yustoris yustoris
0
1.1k
Introduction to Cuneiform Texts
Avatar for Yustoris yustoris
0
250

Other Decks in Technology

See All in Technology
【Oracle Cloud ウェビナー】[Oracle AI Database + AWS] Oracle Database@AWSで広がるクラウドの新たな選択肢とAI時代のデータ戦略
Avatar for oracle4engineer oracle4engineer
PRO
2
140
ClickHouseはどのように大規模データを活用したAIエージェントを全社展開しているのか
Avatar for Miki Matsumoto mikimatsumoto
0
230
AIエージェントを開発しよう！-AgentCore活用の勘所-
Avatar for YukiOgawa yukiogawa
0
160
Amazon S3 Vectorsを使って資格勉強用AIエージェントを構築してみた
Avatar for usanchuu usanchuu
3
450
配列に見る bash と zsh の違い
Avatar for kazzpapa3 kazzpapa3
1
140
Data Hubグループ 紹介資料
Avatar for Sansan, Inc. sansan33
PRO
0
2.7k
Codex 5.3 と Opus 4.6 にコーポレートサイトを作らせてみた / Codex 5.3 vs Opus 4.6
Avatar for ama-ch ama_ch
0
150
Context Engineeringが企業で不可欠になる理由
Avatar for Hirosato Gamo hirosatogamo
PRO
3
570
Introduction to Bill One Development Engineer
Avatar for Sansan, Inc. sansan33
PRO
0
360
CDK対応したAWS DevOps Agentを試そう_20260201
Avatar for モブエンジニア（Masaki Okuda） masakiokuda
1
270
Webhook best practices for rock solid and resilient deployments
Avatar for Guillaume Laforge glaforge
1
290
顧客との商談議事録をみんなで読んで顧客解像度を上げよう
Avatar for shibayu36 shibayu36
0
230

Featured

See All Featured
Lessons Learnt from Crawling 1000+ Websites
Avatar for Charles Meaden charlesmeaden
PRO
1
1.1k
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
Avatar for Eileen M. Uchitelle eileencodes
141
34k
Max Prin - Stacking Signals: How International SEO Comes Together (And Falls Apart)
Avatar for Tech SEO Connect techseoconnect
PRO
0
84
Fireside Chat
Avatar for paigeccino paigeccino
41
3.8k
ピンチをチャンスに：未来をつくるプロダクトロードマップ #pmconf2020
Avatar for Aki / @LoveIdahoBurger aki_iinuma
128
55k
Effective software design: The role of men in debugging patriarchy in IT @ Voxxed Days AMS
Avatar for Kenny Baas-Schwegler baasie
0
220
DevOps and Value Stream Thinking: Enabling flow, efficiency and business value
Avatar for Helen Beal helenjbeal
1
94
svc-hook: hooking system calls on ARM64 by binary rewriting
Avatar for Akira Moroo retrage
1
99
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
Avatar for Sam Stephenson sstephenson
162
16k
GraphQLとの向き合い方2022年版
Avatar for Yosuke Kurami quramy
50
14k
Build The Right Thing And Hit Your Dates
Avatar for Maggie C. maggiecrowley
38
3k
The MySQL Ecosystem @ GitHub 2015
Avatar for Sam Lambert samlambert
251
13k

Transcript

  1. PyTorch Lightningʹ ೖ໳ͯ͠Έͨ @yustoris 2020/10/25

  2. PyTorch Lightning ͱ͸ • PyTorch޲͚ศརWrapper • Մಡੑͱอकੑ޲্ + PyTochͰͷݚڀ։ൃ޲͚௥Ճػೳ •

    ࠷ۙv1.0ʹͳΓ·ͨ͠ https://pytorchlightning.ai

  3. ͜͏͍͏ ίʔυ͕

  4. ͜͏͍͏ ίʔυ͕ େମ͜͏͍͏ॳظԽίʔυ͕ μϥͬͱ௕͘ͳΓ͕ͪ

  5. ͜͏͍͏ ίʔυ͕ େମ͜͏͍͏5SBJOJOHϧʔϓ͕ ΍ͨΒ௕͍ίʔυʹͳͬͯՄಡੑ͕͓ͪΔ

  6. ͜͏ͳΔ Training Code Training CodeΛϞσϧΫϥεʹ TrainerΫϥεͰTraining࣮ߦ Model Class

  7. PyTorch Lightning ͷओཁͳػೳ • Performance & bottleneck profiler • Model

    checkpointing • 16-bit precision • Run distributed training • Logging • … etc. جຊ5SBJOFSʹΦϓγϣϯͰઃఆ

  8. Hydra ͱซ༻͕͓͢͢Ί • YAMLͰΦϓγϣϯΛܕ/֊૚͝ͱͰఆٛՄೳ • ϋΠύʔύϥϝʔλʔ͕ଟ͘ͳΓ͕ͪͳ ػցֶशίʔυͰ༗༻ • ެࣜαϯϓϧ΋༗Γ https://github.com/PyTorchLightning/wheat

    https://hydra.cc