Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Introduction to PyTorch Lightning

Avatar for Yustoris Yustoris
October 25, 2020
Technology
0
480

Introduction to PyTorch Lightning

Avatar for Yustoris

Yustoris

October 25, 2020
Tweet

More Decks by Yustoris

See All by Yustoris
Scene Text Detection and Recognition: The Deep Learning Era
Avatar for Yustoris yustoris
0
1.1k
Introduction to Cuneiform Texts
Avatar for Yustoris yustoris
0
250

Other Decks in Technology

See All in Technology
Zero Trust DNS でより安全なインターネット アクセス
Avatar for Murachi Akira murachiakira
0
110
Amazon Athena で JSON・Parquet・Iceberg のデータを検索し、性能を比較してみた
Avatar for ShigeruOda shigeruoda
1
140
スタートアップの現場で実践しているテストマネジメント #jasst_kyushu
Avatar for Makky makky_tyuyan
0
140
会社を支える Pythonという言語戦略 ~なぜPythonを主要言語にしているのか？~
Avatar for curekoshimizu curekoshimizu
3
860
SRE × マネジメントレイヤーが挑戦した組織・会社のオブザーバビリティ改革 ― ビジネス価値と信頼性を両立するリアルな挑戦
Avatar for coconala_engineer coconala_engineer
0
280
OCIjp_Oracle AI World_Recap
Avatar for Shinya Omori shinpy
1
180
.NET 10のBlazorの期待の新機能
Avatar for tkym htkym
0
110
re:Inventに行くまでにやっておきたいこと
Avatar for nagisa_53 nagisa53
0
500
プレイドのユニークな技術とインターンのリアル
Avatar for PLAID Tech plaidtech
PRO
1
420
AI時代におけるデータの重要性 ~データマネジメントの第一歩~
Avatar for 太田 涼一 ryoichi_ota
0
720
AI AgentをLangflowでサクッと作って、1日働かせてみた！
Avatar for Yano-13 yano13
1
160
Okta Identity Governanceで実現する最小権限の原則
Avatar for 株式会社出前館 demaecan
0
100

Featured

See All Featured
Art, The Web, and Tiny UX
Avatar for Lynn Fisher lynnandtonic
303
21k
A Tale of Four Properties
Avatar for Chris Coyier chriscoyier
161
23k
Build your cross-platform service in a week with App Engine
Avatar for Jose L jlugia
233
18k
The MySQL Ecosystem @ GitHub 2015
Avatar for Sam Lambert samlambert
251
13k
No one is an island. Learnings from fostering a developers community.
Avatar for Antonio thoeni
21
3.5k
Let's Do A Bunch of Simple Stuff to Make Websites Faster
Avatar for Chris Coyier chriscoyier
508
140k
The Illustrated Children's Guide to Kubernetes
Avatar for Chris Short chrisshort
49
51k
"I'm Feeling Lucky" - Building Great Search Experiences for Today's Users (#IAC19)
Avatar for Dan Newman danielanewman
230
22k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
Avatar for mongodb mongodb
48
9.7k
Building Flexible Design Systems
Avatar for Yesenia Perez-Cruz yeseniaperezcruz
329
39k
Rebuilding a faster, lazier Slack
Avatar for samanthasiow samanthasiow
84
9.2k
RailsConf 2023
Avatar for Aaron Patterson tenderlove
30
1.3k

Transcript

  1. PyTorch Lightningʹ ೖ໳ͯ͠Έͨ @yustoris 2020/10/25

  2. PyTorch Lightning ͱ͸ • PyTorch޲͚ศརWrapper • Մಡੑͱอकੑ޲্ + PyTochͰͷݚڀ։ൃ޲͚௥Ճػೳ •

    ࠷ۙv1.0ʹͳΓ·ͨ͠ https://pytorchlightning.ai

  3. ͜͏͍͏ ίʔυ͕

  4. ͜͏͍͏ ίʔυ͕ େମ͜͏͍͏ॳظԽίʔυ͕ μϥͬͱ௕͘ͳΓ͕ͪ

  5. ͜͏͍͏ ίʔυ͕ େମ͜͏͍͏5SBJOJOHϧʔϓ͕ ΍ͨΒ௕͍ίʔυʹͳͬͯՄಡੑ͕͓ͪΔ

  6. ͜͏ͳΔ Training Code Training CodeΛϞσϧΫϥεʹ TrainerΫϥεͰTraining࣮ߦ Model Class

  7. PyTorch Lightning ͷओཁͳػೳ • Performance & bottleneck profiler • Model

    checkpointing • 16-bit precision • Run distributed training • Logging • … etc. جຊ5SBJOFSʹΦϓγϣϯͰઃఆ

  8. Hydra ͱซ༻͕͓͢͢Ί • YAMLͰΦϓγϣϯΛܕ/֊૚͝ͱͰఆٛՄೳ • ϋΠύʔύϥϝʔλʔ͕ଟ͘ͳΓ͕ͪͳ ػցֶशίʔυͰ༗༻ • ެࣜαϯϓϧ΋༗Γ https://github.com/PyTorchLightning/wheat

    https://hydra.cc