Kaggleでソロ銀メダルを獲得するまでの取組み / Efforts to win a solo silver medal at Kaggle

機械学習/Kaggleもくもく会#10＠大阪(10/21 19:00〜)の登壇資料
https://connpass.com/event/150382/

Transcript

1. QBHFT
   ,BHHMFͰιϩۜϝμϧ
   Λ֫ಘ͢Δ·Ͱͷऔ૊Έ
   ػցֶश,BHHMF΋͘΋͘ձ!େࡕ
   !QIZTZVLJ
   
   

   View Slide

2. ࣗݾ঺հ
   w:VLJ !QIZTZVLJ
   
   wϓϩάϥϛϯάʹ1)1 4DBMBΛগ͠
   wػցֶशd
   w,BHHMFd
   w,BHHMF&YQFSU
   w͢΂ͯιϩࢀՃ
   
   
   

   View Slide

3. ࣗݾ঺հɾຊൃදʹ͍ͭͯ
   wະܦݧ͚ͩͲσʔλ෼ੳ৬ʹब͖͍ͨˠ໳લ෷͍
   w࣮຿ܦݧΛͭΉͨΊʹ೿ݣࣾһʹ
   w࣮੷࡞ΓͷͨΊʹۀ຿֎Ͱ͸,BHHMF
   w,BHHMFʹೖ໳ͨ͠ਓͷࢀߟʹͳΕ͹޾͍Ͱ͢
   
   
   

   View Slide

4. ໨࣍
   ෼ࢠίϯϖҎલͷऔ૊Έ
   ෼ࢠίϯϖͰͷऔ૊Έ
   ·ͱΊ
   
   
   

   View Slide

5. ෼ࢠίϯϖҎલͷऔ૊Έ
   

   View Slide

6. 1-"T5J$$"TUSPOPNJDBM$MBTTJpDBUJPO
   wॳࢀՃίϯϖ
   w໨ඪɿಔϝμϧ
   wࢀՃظؒɿ͔݄
   w΍ͬͨ͜ͱ
   w݁Ռ
   wֶΜͩ͜ͱ
   
   
   

   View Slide

7. ΍ͬͨ͜ͱ
   w࡞ۀ͸,FSOFMͱϩʔΧϧͷ+VQZUFS/PUFCPPLͰ
   wྑ͛͞ͳ,FSOFMΛબΜͰϕʔεϞσϧʹ
   w,FSOFM %JTDVTTJPO͸શ෦ಡΉ͙Β͍ͷؾ࣋ͪ
   wҠಈ࣌ؒத͸ৗʹಛ௃ྔ΍είΞվળͷωλग़͠
   w ౰࣌͸ࢴͰɺࠓ͸J1BE
   
   
   

   View Slide

8. ݁Ռ
   w-JHIU(#.ͷγϯάϧϞσϧ
   w5PQͰಔϝμϧ
   
   
   

   View Slide

9. ֶΜͩ͜ͱ
   wॳ৺ऀ͕γϯάϧϞσϧͰۜϝμϧݍ಺ʹߦ͘ͷ͸೉͍͠
   wιϩͰۜϝμϧΛऔΔʹ͸Ξϯαϯϒϧ͕ඞཁ
   wΞϯαϯϒϧ࣌ͷଟ༷ੑͷͨΊʹ//ͷษڧ͕ඞཁ
   
   
   

   View Slide

10. .JDSPTPGU.BMXBSF1SFEJDUJPO
    w໨ඪɿۜϝμϧ
    wࢀՃظؒɿ͔݄൒
    w΍ͬͨ͜ͱ
    w݁Ռ
    wֶΜͩ͜ͱ
    
    
    

    View Slide

11. ΍ͬͨ͜ͱ
    wҾ͖ଓ͖,FSOFM +VQZUFS/PUFCPPLͰ࡞ۀ
    w ࣮ݧͷ਺͚ͩϑΝΠϧ͕ੜ·ΕΔʜ
    w࣮ݧ؅ཧ͸खಈͰεϓϨουγʔτ
    w// $BUCPPTUΛֶΜͰ-JHIU(#.ͱΞϯαϯϒϧ
    
    
    

    View Slide

12. ݁Ռ
    w$7ͱ-#ͷ૬͕ؔऔΕͳ͔ͬͨ
    w pOBMTVCNJU͸-#ͷείΞͰબΜͩ
    w-JHIU(#. $BUCPPTU // '.ͷBWFSBHJOH
    w 5PQͷۜϝμϧݍ͔ΒTIBLFEPXO
    
    
    

    View Slide

13. ֶΜͩ͜ͱ
    wʮόϦσʔγϣϯେࣄʯ͕஌ࣝͰͳ͘ମݧͱͯ͠ࠁ·Εͨ
    w TVCNJUΛଟ͘ॏͶΔաఔͰ-#ʹPWFSpUͯ͠͸͍͚ͳ͍
    wϩόετͳϞσϧΛ࡞ΔͨΊͷςΫχοΫ
    w "EWFSTBSJBM7BMJEBUJPO΍ग़ݱස౓͕ҟͳΔಛ௃ྔͷऔѻ͍
    w,FSOFM͸ۄੴࠞަˠࣗ෼͕ೲಘͰ͖ͨΞΠσΞͷΈ࠾༻͢΂͖
    wίʔυɺ࣮ݧͷ࣮ߦɾ؅ཧΛޮ཰Խͯ͠ख਺Λ૿΍͢
    
    
    

    View Slide

14. *OTUBOU(SBUJpDBUJPO
    w໨తɿ,FSOFMPOMZίϯϖͷ࿅शɺ.BMXBSFͷϦϋϏϦ
    wࢀՃظؒɿ೔ؒ
    w΍ͬͨ͜ͱɿຊདྷͷΫϥε෼ྨͰ͸ͳ͘Ϋϥε෼ྨ
    w݁ՌɿQSFEJDUͷ࣮૷ϛεͷ͍ͤͰ5PQͷಔϝμϧ
    wֶΜͩ͜ͱɿࣗ৴ͷ͋ΔԾઆ͸೪Γڧ͘ݕূ͢΂͠
    
    
    

    View Slide

15. ෼ࢠίϯϖͰͷऔ૊Έ
    

    View Slide

16. 1SFEJDUJOH.PMFDVMBS1SPQFSUJFT
    w໨ඪɿۜϝμϧɺTVCNJUճ਺Λ཈͑Δ
    wࢀՃظؒɿ͔݄
    w΍ͬͨ͜ͱ
    w݁Ռ
    wֶΜͩ͜ͱ
    
    
    

    View Slide

17. ΍ͬͨ͜ͱ
    wQJQFMJOFͷ࡞੒ʢ&%"ͨ͠ΓϕʔεϞσϧ࡞Γͳ͕Βʣ
    w +VQZUFS/PUFCPPLͰ͸ͳ͘TDSJQUͰ؅ཧ
    w ࣮ݧ؅ཧΛࣗಈԽ
    w/PUFCPPL͸&%"ɾՄࢹԽʹͷΈ࢖༻
    w(JUʹΑΔίʔυ؅ཧ
    w(16ඞਢͰ͋Δ//ͷΈ,FSOFMΛ࢖༻
    
    
    

    View Slide

18. QJQFMJOFུ֓
    
    USBJO
    WBMJEBUJPO
    UFTU
    DSFBUFQZ
    GFBUIFSܗࣜͰ
    ಛ௃ྔΛอଘ
    DPOpHTKTPO
    NPEFMQBSBN
    ࢖༻ಛ௃ྔ
    $7ͷ෼ׂ਺
    ͳͲΛࢦఆ
    Ϟσϧͷֶशϩά
    είΞɺύϥϝʔλɺ࢖༻ಛ௃ͳͲ
    ͷ࣮ݧ݁ՌΛه࿥
    TVCNJU@೔෇DTW
    ϩά
    

    View Slide

19. ݁Ռ
    w-JHIU(#. 4DI/FUͷBWFSBHJOH
    w -JHIU(#.ɿGPME$7Ͱ֤ϞσϧͷBWFSBHJOH
    w 4DI/FUɿγϯϓϧʹIPMEPVU
    w5PQͰۜϝμϧ
    w ʮTVCNJUճ਺Λ཈͑ͯۜϝμϧʯΛୡ੒
    
    
    

    View Slide

20. ֶΜͩ͜ͱ
    w࣮ݧճ਺ΛՔ͛ΔΑ͏ʹͳͬͨ
    w ࣍͸ΞΠσΞͷ࣭ΛߴΊΔ͜ͱ͕ॏཁ
    wهࣄɺॻ੶ɺ࿦จ͔ΒಘΒΕΔ஌ࣝʹԿ͔Λֻ͚߹Θͤͳ͍
    ͱɺۚϝμϧݍ಺ʹ͸͍͚ͳ͍
    w ͦͷ૊Έ߹ΘͤΛ௫Ήํ๏Λཱ͍֬ͨ͠
    
    
    

    View Slide

21. ·ͱΊ
    

    View Slide

22. ·ͱΊ
    wͨ͘͞Μࣦഊ͢Δ
    wݪҼΛֶͼɺࣗ෼ͷ΋ͷʹ͢Δ
    w͔࣍Β͸෢ثʹͳΔͷͰɺ੒ޭʹܨ͕Δ
    
    
    

    View Slide