実践 PyTorch Lightning (2019/11/30 分析コンペLT会 #1)

by fam_taro

Slide 1

Slide 1 text

࣮ફ 1Z5PSDI-JHIUOJOH !GBN@UBSP ෼ੳίϯϖ-5ձ !͔͙ΔʔͲ

Slide 2

Slide 2 text

ࣗݾ঺հ ໊લ౻ຊ༟հ 5XJUUFS!GBN@UBSP ུྺ ૣҴాେֶେֶӃम࢜՝ఔमྃ ࣗવݴޠॲཧ 4*FS ۚ༥ܥ ೿ݣձࣾ 42- /PX-1*9&- ۦ͚ग़͠ ,BHHMF.BTUFS ઌʑि ͳΓ·ͨ͠ʂ

Slide 3

Slide 3 text

࠷ۙͷίϯϖྺ ࣌ظ ,BHHMFίϯϖ ੒੷ ίϝϯτ ݄ 4**."$31OFVNPUIPSBY 4FHNFOUBUJPO ؾڳίϯϖ 5PQ ॳ(PME ɻͨͩ͠ 1Z5PSDIʹΑΔେ͖ͳෛͷҨ࢈Λ ࡞ͬͯ͠·ͬͨ ݄ 4FWFSTUBM4UFFM%FGFDU %FUFDUJPO మίϯϖ 5PQ 1Z5PSDI-JHIUOJOHσϏϡʔ രࢮ ݄ 34/"*OUSBDSBOJBM )FNPSSIBHF%FUFDUJPO ೴ίϯϖ 5PQ Θʔ͍ʂʢ!"QQJBO͞ΜͷίʔυΛؙύΫϦͯࣗ͠ ෼Ͱॻ͜͏ͱ͠ͳ͔ͬͨʣ ݄ 6OEFSTUBOEJOH$MPVETGSPN 4BUFMMJUF*NBHFT Ӣίϯϖ 5PQ 1Z5PSDI-JHIUOJOHϦϕϯδ ͳΜͱ͔ 4PMP4JMWFS

Slide 4

Slide 4 text

໨࣍ എܠ 1Z5PSDI-JHIUOJOHͱ͸ 4UBSU1Z5PSDI-JHIUOJOH 1Z5PSDI-JHIUOJOHͷ஫ҙ఺ ײ૝ͱ݁࿦ ͓·͚ɿίϯϖʹ଱͑͏Δ 1Z5PSDI-JHIUOJOH

Slide 5

Slide 5 text

஫ҙࣄ߲ • 1Z5PSDIͷ࢖༻͕લఏͱͳ͍ͬͯ·͢ • ࢖͍ͬͯͳ͍ਓ͝ΊΜͳ͍͞ʢศར͔ͩΒ͓͢͢ΊͰ͢Αʣ • ͔ͭ͋Δఔ౓࢖ͬͨਓ͕ϝΠϯλʔήοτͰ͢ • ͱ͜ΖͲ͜ΖςΫχΧϧͳ୯ޠ͕͋Δ͔΋͠Ε·ͤΜ • ύοτݟΑ͘෼͔Βͳ͔ͬͨΒ͍ͭͰ΋ฉ͍͍ͯͩ͘͞ • ࠓճͷίʔυ Ӣίϯϖ༻ ͸Լهʹஔ͍ͯ͋Γ·͢ • IUUQTHJUIVCDPNZVLLZP,BHHMF6OEFSTUBOEJOH$MPVETUITPMVUJPO • ͜ͷ -5Ͱ͸ QZUPSDIMJHIUOJOHΛ૝ఆ͍ͯ͠·͢ • ͢Ͱʹ࠷৽൛͸ Ͱ͢͝ΊΜͳ͍͞

Slide 6

Slide 6 text

എܠ • 1Z5PSDIͨͷ͍͠ʂ • ωοτϫʔΫߏ଄ม͑Δͷָ • -PTTपΓ΋͍͡Δͷָ • ࣗ෼Ͱ৭ʑ͍͡ΕΔͷͰཧղ͠΍͍͢ • ͳΜ͔ͨͷ͍͠ʂ • 1Z5PSDIͰίϯϖࢀՃ͢Δͷ΄Μͱͨͷ͠ʔʂ

Slide 7

Slide 7 text

ؾڳίϯϖΛऴ͑ͨ͋Δ೔ͷ͜ͱʜ ͞ʔͯ๻ͷ ̈(PME4PMVUJPÖ ࢖͍·Θͪ͠Ό͏ͧʔʂ

Slide 8

Slide 8 text

͕͔ͩ͠͠ʜ

Slide 9

Slide 9 text

• ίʔυԚ͗͢ • ϝιου௕͗͢ • ৭Μͳͱ͜Ζʹ৭Μͳ΋ͷ͕͋Δ • ୭ͩΑ͜ͷίʔυॻ͍ͨͷ • ΋ͪΖΜࣗ෼Ͱ͋Δ • ίϯϖத͸ແզເத͚ͩͬͨͲʜ • ΋͏࢖͍ͨ͘ͳ͍

Slide 10

Slide 10 text

Ԛ͘ͳͬͨཁҼ • ࣗ෼Ͱॻ͘ USBJO@B@FQPDI • ແݶʹਂ͘ͳΔ GPSϧʔϓʢFQPDI CBUDI FUDʜ • ແݶʹ૿͑ΔҾ਺ • ࣗ෼Ͱ΍Δ MFBSOJOH@SBUF@TDIFEVMFSTUFQ • ࣗ෼Ͱΰχϣΰχϣͯ͠͠·͏ (SBEJFOU"DDVNVMBUJPO • (SBEJFOU"DDVNVMBUJPO ޯ഑ྦྷੵ ɿύϥϝʔλߋ৽ PQUJNJ[FSTUFQ Λ਺όονʹճʹ͢Δ͜ͱͰ #4Λ૿΍͢͜ͱʹ͍ۙॲཧΛ͢Δ • #4େ͖͘͢Δ͜ͱͱ׬શʹ౳ՁͰ͸ͳ͍ͷͰ஫ҙ • ࣗ෼Ͱΰχϣΰχϣ͢Δ UREN • FUDʜ

Slide 11

Slide 11 text

Slide 12

Slide 12 text

ΦϨΦϨ 5SBJOFSΫϥε΋ॻ͚Δ͚Ͳʜ • ઈରԚ͘ͳΔ • 8JOOFSTPMVUJPODPEFͰΑ͘ݟ͔͚Δ͚ͲେମԚ͍ • Ճ͑ͯඍົʹͦΕͧΕݸੑग़͖ͯͯ͠ਏ͍ • ͦͷ͏ͪؾ͔ͮͣʹόάຒΊࠐΈͦ͏ • Ͱ͖Ε͹ͪΌΜͱͨ͠ઃܭʹԊ͍͍ͨ • ଞਓ ະདྷͷࣗ෼ؚΊ ͕Ҡ২͢Δͱ͖ʹָʹҠ২Ͱ͖ͯ΄͍͠ • ࣗ෼Ͱϝϯς͢ΔؾʹͳΕͳ͍ • ઈରਏ͍ • ͋ʔͲ͔͜ʹ๻ΑΓڧͦ͏ͳͻͱ͕ϝϯςͯ͘͠ΕΔ 5SBJOFS Ͷʔ͔ͳʔʁʁʁ

Slide 13

Slide 13 text

ͦΜͳ͋ͳͨʹ

Slide 14

Slide 14 text

1Z5PSDI-JHIUOJOHͱ͸ • ԼهΛαϙʔτͯ͘͠ΕΔ 1Z5PSDIXSBQQFS • 4DBMFZPVSNPEFMT • .VMUJ(16ɾ.VMUJ/PEF5SBJOJOHɾOWJEJBBQFY .JYFE 1SFDJTJPO5SBJOJOH • ઃఆ΍ධՁࢦඪɾֶशࡁXFJHIUͷอଘͳͲ • 8SJUFMFTTCPJMFSQMBUF ఆܕจͷলུ

Slide 15

Slide 15 text

• ӈਤ͸ެࣜϖʔδΑΓ • IUUQTHJUIVCDPNX JMMJBN'BMDPOQZUPSDI MJHIUOJOH • 1-͸ӈͷփ৭ͷ෦෼ ΛΧόʔͯ͘͠ΕΔ • ࢲୡ͸੨͍෦෼͚ͩू த͢Ε͹ྑ͍ʂʂ • ఔΑཻ͍౓ʂ

Slide 16

Slide 16 text

1Z5PSDI-JHIUOJOHͱ͸ େ͖͘ҎԼ ͭͷཁૉ͕͋Δ • -JHIUOJOH.PEVMF • 㲈 .PEFM%BUBTFU-PTT0QUJNJ[FS • USBJOJOH΍ WBMJEBUJPOͷ֤ TUFQͷಈ࡞ͳͲΛఆٛ • WBMJEBUJPOFOE࣌ʹ݁ՌΛͲ͏ू໿͢Δ͔ͱ͔΋ఆٛՄ • 5SBJOFS • %FWJDF (16PS$16 ΍ .JYFE1SFDJTJPO • .VMUJ(165ZQF %1PS%%1 • 8FJHIU΍ MPHͷอଘ৔ॴ • $BMMCBDL FBSMZTUPQQJOHͱ͔ • (SBEJFOU"DDVNVMBUJPO

Slide 17

Slide 17 text

4UBSU1Z5PSDI-JHIUOJOH • 4UFQQJQJOTUBMMQZUPSDIMJHIUOJOH • 4UFQ ඞཁͳਓ͸ OWJEJBBQFYΛผ్Πϯετʔϧ • 1Z5PSDI-JHIUOJOHΛ࢖͏͚ͩͳΒඞਢͰ͸ͳ͍ • Ͱ΋ศརͳͷͰݸਓతʹ͸ਪ঑ • 4UFQ-JHIUOJOH.PEVMFͷ࡞੒ • 4UFQ5SBJOFSͷ࡞੒ • 4UFQUSBJOFSGJU NZ@MJHIUOJOH@NPEVMF

Slide 18

Slide 18 text

4UFQ-JHIUOJOH.PEVMFͷ࡞੒ • -JHIUOJOH.PEVMF Λܧঝ • ҎԼͷؔ਺Λఆٛ • ඞਢ 3FRVJSFE • USBJOJOH@TUFQ • DPOGJHVSF@PQUJNJ[FST • 999@EBUBMPBEFS • ࣗ༝ 0QUJPOBM • WBMJEBUJPO@TUFQ • WBMJEBUJPO@FOE

Slide 19

Slide 19 text

4UFQ-JHIUOJOH.PEVMFͷ࡞੒ ೖྗ͔Β -PTTΛܭࢉͯ͠ฦ͢ ೖྗ͔Β -PTTΛܭࢉͯ͠ฦ͢ -PTT͚ͩ͡Όͳ֤͘ධՁࢦඪ΋Մೳ

Slide 20

Slide 20 text

4UFQ-JHIUOJOH.PEVMFͷ࡞੒ -PTTͷ߹ܭ஋ͱ͔৭ʑฦ͢ ίϯιʔϧදࣔ༻ QSPHSFTT@CBS ΍MPH༻ MPH ɺ DBMMCBDL༻ WBM@MPTT ͱ͔ࣗ෼Ͱ໊෇͚Δ ͳͲΛฦͤΔ PQUJNJ[FSΛฦ͢ TDIFEVMFS͸͋ͬͯ΋ͳͯ͘΋Մ

Slide 21

Slide 21 text

4UFQ5SBJOFSͷ࡞੒ -PHͷอଘํ๏΍ ԿΛอଘ͢Δ͔ 8FJHIUͷอଘํ਑ MBUFTUPS CFTUMPTT ΍ &BSMZ4UPQQJOH౳ .VMUJ(16ͷΦϓγϣϯ΋બ΂Δʂ ஍ຯʹ͏Ε͍͠ HSBE@BDD Φϓγϣϯ

Slide 22

Slide 22 text

4UFQ5SBJOFSGJU QM@NPEVMF ˠ࣮ߦ ,FSBT -JLF

Slide 23

Slide 23 text

1Z5PSDI-JHIUOJOHͷ஫ҙ఺ • ·ͩ 4UBCMFͳόʔδϣϯͰ͸ͳ͍ • ޙํޓ׵ੑͳΜͯ؁͑͸ͳ͍ όʔδϣϯΞοϓ ॻ͖௚͠ඞਢ • 1Z$IBSNͱ͔ͷؔ਺δϟϯϓػೳ͸ඞਢʢ1Z5PSDIॳͷਓʹ͸ඇਪ঑ʣ • .VMUJ(16º .JYFE1SFDJTJPO5SBJOJOH ͷબ୒ࢶ͕ %%1ͷΈ • 1Z5PSDIͰ .VMUJ(16Λ࢖͏ͨΊͷબ୒ࢶ͸ %1ͱ %%1 • %1 %BUB1BSBMMFM • Πϝʔδ֤(16Λ߹ମͯ͠େ͖͍(16Λ࡞Δ • %%1 %JTUSJCVUFE%BUB1BSBMMFM • Πϝʔδ֤(16Ͱಠཱͯ͠ॲཧΛਐΊΔײ͡ • %BUBTFUΛ(16ຖʹ෼ׂ͢Δ • %1ͱ %%1ͷࠩ͸Լه͕Ұ൪෼͔Γ΍͍͢ • IUUQXXXUFMFTFOTDPEJTUSJCVUFEEBUBQBSBMMFMUSBJOJOH VTJOHQZUPSDIPOBXT

Slide 24

Slide 24 text

1Z5PSDI-JHIUOJOHͷ஫ҙ఺ • %%1࣌ʹ 7BMJE%BUB-PBEFSΛ෼ׂ͢Δͱ 7BMJE4DPSF͕ਖ਼ ͘͠ܭࢉͰ͖ͳ͍ Ұ෦͔͠࢖ΘΕͳ͍ • ݱঢ়෼ׂ͢Δͱ (16ͷ 7BMJE4DPSF͔͠อଘ͞Εͳ͍ • ֤ (16Ͱܭࢉͨ͠ 7BMJE4DPSFΛू໿ SFEVDF Ͱ͖ͳ͍ • IUUQTHJUIVCDPNXJMMJBN'BMDPOQZUPSDIMJHIUOJOHJTTVFT • ͪΌΜͱ 7BMJE4DPSFΛܭࢉ͢ΔͨΊʹ͸ 7BMJE%BUB-PBEFSΛ෼ ׂͤͣʹ֤ (16Ͱܭࢉͤ͞Δ ༨෼ͳܭࢉΛ͠ͳ͍ͱ͍͚ͳ͍ • গ͚͕͔͔ͩ࣌ؒ͠Δ • ͋͘·Ͱ 7BMJEͳͷͰ 5SBJO࣌ؒʹൺ΂Ε͹ڐͤΔ͕

Slide 25

Slide 25 text

1Z5PSDI-JHIUOJOHͷ஫ҙ఺ • ॻ͘ίʔυྔ͕ΊͪΌͪ͘ΌݮΔΘ͚Ͱ͸ͳ͍ • ͦΕͳΓʹॻ͘ • ୹͍͚ͨͩ͘͠ͳΒ GBTUBJ ʹߦ͘΂͖ • ʮ1Z5PSDI-JHIUOJOHʯ ˠ ʮΦϨΦϨϧʔϓʯ΁ͷҠߦ͸ָ

Slide 26

Slide 26 text

࢖ͬͯΈͨײ૝ • ·ͩ·ͩൃల్্͚ͩͲظ଴େ • ݸਓతʹ͸ 1Z5PSDI*HOJUFΑΓ͸޷͖ • ΄ͲΑࣗ͘༝౓ͷ࢒ͬͨςϯϓϨʔτͰ͋Γɺڧ੍తʹ৑௕ͳ ϧʔϓΛ෼ׂ͢ΔΑ͏ʹͳΔͷͰݸਓతʹ͸خ͍͠ • ඞͣॻؔ͘਺͕ܾ·͍ͬͯΔͷͰɺଞλεΫ࢝ΊΔͱ͖΋࢝Ί΍͍͢ • ࠓ࢖͍࢝ΊΔͱ౓ʑؔ਺δϟϯϓΛ࢖Θ͟ΔΛ͑ͳ͍͚Ͳɺ ιʔείʔυΛಡΉ͜ͱͰ৭ʑษڧʹͳͬͨ • %JTUSJCVUFE%BUB4BNQMFSͱ͔

Slide 27

Slide 27 text

݁࿦ • .VMUJ(16पΓͷڍಈΛআ͚͹͍͍ͩͨຬ଍ʂ • 4JOHMF(16ͳΒؾʹͳΔͱ͜Ζ͸ͳ͍ • ,BHHMFͰ͸ 1Z5PSDI$BUBMZTU΋ྲྀߦͦ͠͏ͳͷͰཁνΣοΫ • $BUBMZTU͸ 4FHNFOUBUJPOUVUPSJBM͕ΫΦϦςΟߴ͔ͬͨͰ͢ • ྆ํ࢖ͬͯࣗ෼ʹ߹ͬͨ΄͏Λ࢖͏ͷ͕ྑ͍ͱࢥ͍·͢ • ࢼ͢ʹ΋͕͔͔࣌ؒΔ͚Ͳʜ • ͍ͣΕ΋ૉͷ 1Z5PSDIΑΓ͸டংΛײ͡ΒΕΔ • ؾʹͳΔਓ͸ԼهͰݕࡧͯ͠Έ·͠ΐ͏ • lQZUPSDI JHOJUFz lQZUPSDI DBUBMZTUz lQZUPSDI MJHIUOJOHz • ্ه͸͍ͣΕ΋ެࣜ IUUQTQZUPSDIPSHFDPTZTUFN Ͱ঺հ͞ΕͯΔ

Slide 28

Slide 28 text

͝ਗ਼ௌ͋Γ͕ͱ͏͍͟͝·ͨ͠

Slide 29

Slide 29 text

͓·͚ɿ෼ੳίϯϖ-5ձͷ࢝·Γ

Slide 30

Slide 30 text

͓·͚ɿ෼ੳίϯϖ-5ձͷ࢝·Γ

Slide 31

Slide 31 text

͓·͚ɿ෼ੳίϯϖ-5ձͷ࢝·Γ

Slide 32

Slide 32 text

͓·͚ɿίϯϖʹ଱͑͏Δ 1Z5PSDI-JHIUOJOH • ͔͜͜Β͸ ,BHHMFͷ l6OEFSTUBOEJOH$MPVETGSPN 4BUFMMJUF*NBHFT Ӣίϯϖ z༻ʹ޻෉ͨ͠෦෼Λ঺հ͠·͢ • IUUQTHJUIVCDPNZVLLZP,BHHMF6OEFSTUBOEJOH$MPVETUITPMVUJPO • ΦϨΦϨ 1Z5PSDI-JHIUOJOHʹͳͬͯ͠·ͬͯΔͷͰ஫ҙ • ࣗ͝਎Ͱ֦ு͢ΔώϯτʹͳΕ͹ͱࢥ͍·͢ • FY͜͜Β΁ΜΛม͍͑ͨͱ͖͸͜͜Λมߋͪ͠Ό͑͹ྑ͍Μͩͳ

Slide 33

Slide 33 text

͓·͚ɿίϯϖʹ଱͑͏Δ 1Z5PSDI-JHIUOJOH • ओͳมߋ఺ • %JTUSJCVUFE4BNQMFS 1Z5PSDI-JHIUOJOH͸ؔ܎ͳ͍ • ࢦఆͨ͠ QPTJUJWFOFHBUJWFൺ཰Λ࢖༻͢Δ • 5SBJOFS ӢίϯϖͰ͸ద༻͸͠·ͤΜͰ͕ͨ͠ʜ • ຖ FQPDIຖʹ QPTJUJWFOFHBUJWFΛมߋͰ͖ΔΑ͏ʹͨ͠ • -PHHFS -JHIUOJOH-PHHFS#BTF • ෆཁͳ΋ͷΛอଘ͠ͳ͍Α͏ʹͯ͠࠷௿ݶͷ΋ͷ͚ͩอଘ͢ΔΑ͏ʹͨ͠ • ೖྗύϥϝʔλҰཡͱ͔͸ࣗ෼Ͱ :".-Ͱอ࣋ͯ͠ΔͷͰʜ • $IFDLQPJOU .PEFM$IFDLQPJOU • ҎԼͷೋछྨͷॏΈΛ྆ํอଘͰ͖ΔΑ͏ʹͨ͠ σϑΥϧτ͸ยํͷΈ • ࠷৽ FQPDIͷ XFJHIU MBUFTUQU #FTU-PTTͷ XFJHIU CFTU@MPTTQU • ͜Ε͸ JTTVFͳΜͩΑͳ • lDLQUzʹ͢Δͱ 1Z5PSDI-JHIUOJOHͷ໋໊نଇʹै͏ඞཁ͋Γ ໘౗

Slide 34

Slide 34 text

5SBJOFS ӢίϯϖͰ͸ະద༻ • ຖ FQPDIຖʹ QPTJUJWFOFHBUJWFΛมߋͰ͖ΔΑ͏ʹͨ͠ • SVO@UOH@FQPDI Λ PWFSSJEFͯ͠ TBNQMFSΛຖ FQPDI͍͡Δ

Slide 35

Slide 35 text

-PHHFS -JHIUOJOH-PHHFS#BTF Λܧঝͯ͠ • ࣗ෼ͷอଘ͍ͨ͠΋ͷ͚ͩอ ଘ͢ΔΑ͏ʹͨ͠ • !SBOL@[FSP@POMZ ͸ NVMUJ HQV ࣌ʹ (16ͷΈ࣮ߦ ͢ΔͨΊͷσίϨʔλ

Slide 36

Slide 36 text

$IFDLQPJOU .PEFM$IFDLQPJOU • -BUFTUͱ #FTU.FUSJDTͷೋछྨͷ XFJHIUΛอଘͰ͖ΔΑ͏ʹ

Slide 37

Slide 37 text

͓ΘΓ