PyTorch Lightningのススメ

by Yongtae723

Slide 1

Slide 1 text

1Z5PSDI-JHIUOJOHͷεεϝ )XBOH:POHUBF ୈճ.-0QTษڧձ 0OMJOF dਝ଎ͳχϡʔε଎ใൃ৴Λࢧ͑Δ.-0QTd

Slide 2

Slide 2 text

2,ݱঢ়෼ੳͱ໰୊఺ Who I am ԫ༐ଠ ϑΝϯϤϯς w ౦ژେֶɹཧֶത࢜ ෺ཧ w +9௨৴ࣾɹػցֶशΤϯδχΞ w 1Z5PSDI-JHIUOJOHͷϔϏʔϢʔβʔ w 4MBDLͷίϛϡχςΟʹೖͬͯ·͢ !:PPPPOHUBF

Slide 3

Slide 3 text

2,ݱঢ়෼ੳͱ໰୊఺ ຊൃදͷ໨త w 1Z5PSDI-JHIUOJOHΛ஌ͬͯ΋Β͍ɺར༻ͷ͖͔͚ͬʹͳͬͯ΄͍͠ w ຊ೔ͷ಺༰͸ɺϒϩάʹ·ͱΊ͍ͯ·͢ɻ w $PMBCͰಈ͘αϯϓϧίʔυ΋ϒϩά͔ΒΞΫηεͰ͖·͢ɻ

Slide 4

Slide 4 text

Agenda 1Z5PSDI-JHIUOJOHΛར༻ͨ͠എܠ 1Z5PSDI-JHIUOJOHͱ͸ʁ 1, 2, ຊൃදͷ໨త 0,

Slide 5

Slide 5 text

2,ݱঢ়෼ੳͱ໰୊఺ MLΤϯδχΞʹٻΊΒΕΔۀ຿ αΠΤϯε ίʔσΟϯά ɾϞσϧਫ਼౓Λ্͛Δ ɾσʔλͷਫ਼ࠪ ɾ՝୊ղܾʹ௚݁͢Δํ๏Λ୳Δ ɾ࿦จௐࠪ ɾBOETPPO ɾֶश͢ΔσόΠεͷ੾Γସ͑ ɾֶशه࿥ɾϞσϧͷอଘ ɾֶशͷߴ଎Խ ɾֶश࣌ͷਐḿͷදࣔ ɾBOETPPO Λ࢖͍ͬͯΔͱɻɻɻ

Slide 6

Slide 6 text

2,ݱঢ়෼ੳͱ໰୊఺ ΠϊϕʔςΟϒͳMLνʔϜʹͳΔͨΊʹ͸ Λ࢖͏ͱ

Slide 7

Slide 7 text

2,ݱঢ়෼ੳͱ໰୊఺ PyTorch LightningΛར༻ͨ͠എܠ +9௨৴ࣾͷ.-νʔϜͰେࣄʹͯ͠Δཧ೦ ྗΛ࢖͏΂͖ॴʹͷΈ஫ྗ͠Α͏ʂ ϒϩάॻ͍ͯ·͢ ଐਓԽ͕ͪ͠ͳR&DΛνʔϜ։ൃ͢ΔͨΊͷJX௨৴ࣾͰͷ޻෉ IUUQTUFDIKYQSFTTOFUFOUSZ +9௨৴ࣾͰ͸ Λ༻͍Δ͜ͱͰɺ ྗΛ࢖͏΂͖ॴʹͷΈ஫ྗ͠Α͏ʂ Ͱ͖ΔΑ͏ʹ͍ͯ͠·͢

Slide 8

Slide 8 text

1Z5PSDI-JHIUOJOHͱ͸ʁ 02

Slide 9

Slide 9 text

2,ݱঢ়෼ੳͱ໰୊఺ PyTorch Lightningͱ͸ 1ZUPSDI-*HIUOJOHͷ)1ΑΓҾ༻ IUUQTXXXQZUPSDIMJHIUOJOHBJ

Slide 10

Slide 10 text

2,ݱঢ়෼ੳͱ໰୊఺ PyTorch ͱԿ͕ҧ͏ͷʁ 1Z5PSDI-JHIUOJOH͸ ɾαΠΤϯεͷίʔυ͕ϝΠϯɺଞͷॲཧ͸਺ߦͷ௥ՃͰ׬݁ ɾίʔυͷॻ͖ํʹϑϨʔϜϫʔΫ͕͋ΓɺͦΕΛຒΊΔΑ͏ʹॻ͘ ɾ1Z5PSDI͕Ͱ͖Δ͜ͱ͸΄ͱΜͲͰ͖Δ

Slide 11

Slide 11 text

1Z5PSDI-JHIUOJOHͷॻ͖ํ dೖ໳d αΠΤϯεʹؔΘΔ෦෼ 02-1

Slide 12

Slide 12 text

2,ݱঢ়෼ੳͱ໰୊఺ σʔλͷॲཧ(LightningDataModule) 1Z5PSDIͷ%BUB-PBEFSΛ·ͱΊΔϞδϡʔϧ ؔ਺ͷ໊લΛউखʹฤूͯ͠͸ͳΒͳ͍

Slide 13

Slide 13 text

2,ݱঢ়෼ੳͱ໰୊఺ ֶशʹؔΘΔॲཧ(LightningModule) Ϟσϧͷ ΞʔΩςΫνϟΛ ఆٛ 1ZUPSDIͱಉ͡ ͜ͷMPTTΛجʹϞ σϧ͕ߋ৽͞ΕΔ UP EFWJDF ͸ඞཁͳ͠ʂ ֶश࣌ͷ֤εςοϓ Ͱͷಈ࡞Λهड़ ଞͷྫWBMJE@FQPDI@FOE PO@ fi U@TUBSU 0QUJNJ[FSͷఆٛ

Slide 14

Slide 14 text

2,ݱঢ়෼ੳͱ໰୊఺ Trainer ɾ5SBJOFSͰֶश͕։࢝ ਺ߦͷ௥ՃͰՄೳ

Slide 15

Slide 15 text

2,ݱঢ়෼ੳͱ໰୊఺ Trainer ɾ5SBJOFSͰֶश͕։࢝ ɾؔΘͬͨίʔυ͸ ⾣σʔλͷॲཧ๏ ⾣NPEFMͷΞʔΩςΫνϟ ⾣USBJO WBMJE UFTU MPPQ಺ͷॲཧ ɾ݁Ռͷݟ͔ͨɺอଘ͸ʁ ɾϞσϧͷอଘ͸ʁ ɾ(16516Ͱಈ͔ͨ͢Ίʹ͸ʁ ਺ߦͷ௥ՃͰՄೳ

Slide 16

Slide 16 text

1Z5PSDI-JHIUOJOHͷॻ͖ํ dԠ༻d ίʔσΟϯάʹؔΘΔ෦෼ 02-2

Slide 17

Slide 17 text

݁Ռͷݟ͔ͨɾอଘํ๏ 02-2

Slide 18

Slide 18 text

2,ݱঢ়෼ੳͱ໰୊఺ ݁Ռͷݟ͔ͨɾอଘํ๏ʹ͍ͭͯ TFMGMPHͰNFUSJDT͕ه࿥͞ΕΔ

Slide 19

Slide 19 text

2,ݱঢ়෼ੳͱ໰୊఺ ݁Ռͷݟ͔ͨɾอଘํ๏ʹ͍ͭͯ UPSDINFUSJDTͷϥΠϒϥϦͰ؆୯ʹ݁ՌΛ هड़Ͱ͖Δʂ

Slide 20

Slide 20 text

2,ݱঢ়෼ੳͱ໰୊఺ ݁Ռͷݟ͔ͨɾอଘํ๏ʹ͍ͭͯ

Slide 21

Slide 21 text

2,ݱঢ়෼ੳͱ໰୊఺ ݁Ռͷݟ͔ͨɾอଘํ๏ʹ͍ͭͯ ༷ʑͳ࣮ݧ؅ཧϥΠϒϥϦʹରԠʂ w 5FOTPS#PBSE w .-'MPX w $PNFU w 8BOE# w /FQUVOF w BOETPPO

Slide 22

Slide 22 text

ϞσϧͷอଘͱFBSMZ TUPQQJOH 02-2

Slide 23

Slide 23 text

2,ݱঢ়෼ੳͱ໰୊఺ Callbacks $BMMCBDLTˠֶशϧʔϓʹίʔυΛ௥ՃͰ͖Δ

Slide 24

Slide 24 text

2,ݱঢ়෼ੳͱ໰୊఺ Ϟσϧͷอଘͱearly stopping -JHIUOJOH͔Βఏڙ͞ΕΔDBMMCBDL w .PEFM$IFDLQPJOU w Ϟσϧͷอଘ w &BSMZ4UPQQJOH w ֶश͕ਐ·ͳ͍ͳΒࢭΊΔ

Slide 25

Slide 25 text

(16516*16Ͱͷֶश 02-2

Slide 26

Slide 26 text

2,ݱঢ়෼ੳͱ໰୊఺ GPU/ TPU/ IPUͰͷֶश ֶश͢ΔσόΠεͰ଎౓͕มΘΔ IUUQTDMPVEHPPHMFDPNCMPHKBQSPEVDUTHDQBOJOEFQUIMPPLBUHPPHMFT fi STUUFOTPSQSPDFTTJOHVOJUUQVΑΓҾ༻ 1Z5PSDIͰ͸UP EFWJDF ΛࢸΔॴʹॻ͘ඞཁ͋Γ

Slide 27

Slide 27 text

2,ݱঢ়෼ੳͱ໰୊఺ GPU/ TPU/ IPUͰͷֶश 5SBJOFSͷҾ਺Λมߋ͢Δ͚ͩʂ .VMUJQMF(16ͷฒྻܭࢉʹ΋ରԠ

Slide 28

Slide 28 text

2,ݱঢ়෼ੳͱ໰୊఺ ·ͱΊ ྗΛ๋͛Δ΂͖৔ॴʹ஫ྗ͠Α͏ʂΛୡ੒͢ΔͨΊʹ+9௨৴ࣾͰ͸1Z5PSDI -JHIUOJOHΛར༻ 1Z5PSDI-JHIUOJOHͰ͸αΠΤϯεʹؔΘΔίʔυͷ஫ྗͰ͖ɺଞͷίʔσΟϯά͸ ਺ߦͰऴΘΕΔΑ͏ʹͳΔ

Slide 29

Slide 29 text

ʲ"EEJUJPOBMʳ 1Z5PSDI-JHIUOJOH'MBTI ʹ͍ͭͯ 02-3

Slide 30

Slide 30 text

2,ݱঢ়෼ੳͱ໰୊఺ PyTorch Lightning Flashʹ͍ͭͯ -JHIUOJOHΑΓߴҐͷϥούʔ యܕతͳλεΫ͸਺ߦͰऴΘΔ ϕʔεϥΠϯͷϞσϧΛ࡞੒ʹద͍ͯ͠Δ͕ ॊೈੑʹ๡͘͠޻෉͕ࠔ೉ IUUQTMJHIUOJOH fl BTISFBEUIFEPDTJPFOTUBCMF CBEHFTUBCMFΑΓҾ༻

Slide 31

Slide 31 text

2,ݱঢ়෼ੳͱ໰୊఺ PyTorch Lightning Flashʹ͍ͭͯ ࣮૷ͷָ͞ ॊೈੑ ݸਓతͳ࢖͍ํ ࠷ઌ୺Ϩϕϧͷ޻෉Λ͠ ͍ͨͱ͖ λεΫ໨తʹ͋ͬͨ޻෉ Λ͍ͨ͠ͱ͖ ϕʔεϥΠϯ

Slide 32

Slide 32 text

+9௨৴ࣾɹ࠾༻ɹ 2,ݱঢ়෼ੳͱ໰୊఺ WE ARE HIRING !!! զʑͱͱ΋ʹ νϟϨϯδ͍ͨ͠஥ؒΛ ืूதʂ ϒϩά΋ݟͯͶʂ

Slide 33

Slide 33 text

Thank you!