Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Kaggle PetFinder 2nd Place Solution

Kaggle PetFinder 2nd Place Solution

Avatar for Shotaro Ishihara

Shotaro Ishihara

July 12, 2019
Tweet

More Decks by Shotaro Ishihara

Other Decks in Technology

Transcript

  1. ղ๏ͷ֓ཁ • Ϟσϧͷ3JEHFTUBDLJOH • /FVSBM/FUXPSL • -JHIU(#. • -JHIU(#. •

    9(#PPTU • ͭͷޙॲཧ • 3BOLBWFSBHJOHͰᮢ஋࠷దԽ • ը૾ॏෳͷൃݟ 
  2. νʔϜϝϯόʔ • ೔ຊਓਓνʔϜʢLBHHMFSKBʣ • LBFSVSVSV ZOLUL V UBLVPLP HFHF •

    ೔ຊޠ 4MBDLͰ΍ΓऔΓ • εϓϨουγʔτͰλεΫͳͲΛ؅ཧ • ίʔυ͸,BHHMF ,FSOFMΛ'PSL 
  3. LFSVSVSVιϩࢀՃ • QVCMJDLFSOFMϕʔεʹಔϝμϧݍ಺ ʢऴྃΧ݄൒લʣ • ػցֶशΤϯδχΞ΁ͷస৬ʹ΋੒ޭ • స৬ॕ͍Ͱ V 

    ZOLUL ͱҿΈձ ʢਓͷग़ձ͍͸લճͷNFFUVQʣ  IUUQTUBCFMPHDPNUPLZP""
  4. ಛ௃ ςΩετ • %FTDSJQUJPONFUBUFYUGFBUVSFT TFOUJNFOU  BOOPUT@EFTD CSFFE • 1VODUTͷॲཧ

    FYXIBU`T XIBU`T • .JTTQFMMͷॲཧ FYXIBUTXIBUJT • 4UFNNJOHFYHPJOHHP • /VNCFSͷॲཧ FYDBUTDBUT • #08UGJEG#.47%/.' 
  5. ಛ௃ ςΩετ • %FTDSJQUJPOPOMZ • 1VODUTͷॲཧ • .JTTQFMMͷॲཧ • /VNCFSͷॲཧ

    • &NCFEEJOHXJUIHMPWFBOEGBTUUFYU2VPSBSE NFUIPE • "WFSBHJOHFNCFEEJOHWFDUPSQFSSPXT 
  6. ಛ௃ ςΩετ • 2VPSBSE NFUIPE • FNCFEEJOHͰׂ͖ͨ߹ •  •

    ଞͷલॲཧ΋֤ϓϩηεͰ FNCFEEJOHׂ߹Λ֬ೝ͠ɺ ৗʹ্͕Δํ๏Λબ୒ͨ͠ 
  7. ಛ௃ ςΩετ • ਫ਼౓্͕͕Βͳ͔ͬͨ΋ͷ • #FSU &MNP • HMPWFUXJUUFSWFDUPSͳͲଞͷFNCFEEJOHT QZNBHOJUVEF

    • 4DSBUDIͰֶशͨ͠XW GBTUUFYU • .FUBUFYUGFBUVSFTͷFNCFEEJOHT • -FOHUIͳͲͷUFYU౷ܭྔ • தࠃޠͷલॲཧ 
  8. ಛ௃ ը૾ • ਫ਼౓্͕͕Βͳ͔ͬͨ΋ͷ • ଞͷ$//NPEFM LFSBTQZUPSDI • /*." •

    "WJUPͰ࢖ΘΕ͍ͯͨը૾ͷ౷ܭྔ XIJUFOFTT EVMMOFTT FUDʜ 
  9. ಛ௃ ςʔϒϧ • "HHSFHBUJPO • 4JNQMFNFUIPE • 3BUJPNFUIPE • Ձ֨

    CSFFEࣲݘ ࣲݘͷฏۉֹͷ৔߹ SBUJP • %JGGNFUIPE • Ձ֨ CSFFEࣲݘ ࣲݘͷฏۉֹͷ৔߹ EJGG 
  10. ಛ௃ ςʔϒϧ • ΧςΰϦͷڞى  -%"47% • શΧςΰϦͷ૊Έ߹Θͤʢ࣍·Ͱʣ • JOUFSBDUJPOTGFBUVSFT

    • FY"HF 2VBOUJUZ • FYUFSOBMEBUB • ֆจࣈ • 4UBUF #SFFE #SFFESBOLJOH 
  11. ಛ௃ ಛ௃બ୒ • શ෦Ͱdͷಛ௃ • -(#.ͷJNQPSUBODFUPQΛબ୒ • BMM  

    ͳͲͰ୳ࡧ͠ɺ$7ͱ-#ΛݟܾͯΊͨ • ࣮͸΋ͬͱগͳ͍ํ͕$7ͱQSJWBUF͸Α͔ͬͨ 
  12. Ϟσϧ • -(#.ͱ// • #FTUTJOHMF͸-(#.ͰUI //ͰUI • ΞϯαϯϒϧͰ࢖༻ͯͨ͠ͷ͸-(#.ͰUI //͸Ґ͘Β͍ ͷ΍ͭ

    ಛʹUI //͸$7ߴ͔͕ͬͨ1VCMJD͕গ͠Լ͕ͬͨ • ֶश࣌ؒ͸//ͰTFD -(#.ͰTFD • -(#.ͷύϥϝʔλ • ,FSOFMͷؙύΫϦ 
  13. ํ਑ • $//GFBUVSFT ࣍ݩ  EPDWFD ࣍ݩ UGJEG ͨ͘͞Μ 

    • ߴ࣍ݩϕΫτϧΛ௿࣍ݩʹ௵ͯ͠ར༻͢Δ͜ͱʹࣥ৺ • NFBO WBSͳͲͷ౷ܭྔ΍ 47%ͳͲΛଟ༻͠ɺTDPSF͕৳ͼͨ΋ͷ ͚ͩར༻ ݁Ռతʹ࣌ؒઅ໿ʹ • "HHSFHBUJPOͱͯ΋ޮ͖ͦ͏ • UFYU౷ܭྔಛ௃ͳͲ΋ "HHSFHBUJPOͨ͠ • $7ͪΐͬͱ্͕ͬͨ 
  14. ಛ௃ ը૾ • "WJUPίϯϖͷΧʔωϧͰݟ͚ͭͨը૾ͷαΠζಛ௃ • TJ[F XJEUI IFJHIU ΛΧʔωϧͰެ։ •

    LBFSVSVSV NPEFMʹ͸ޮ͔ͣ΋ɺ࠷ޙʹՃೖͨ͠ HFHFࢯ ͕ϕʔεʹ͍ͯͨ͠ΧʔωϧͰ࢖ΘΕ͍ͯͨ 
  15. ಛ௃ ςΩετ • γϯϓϧͳલॲཧ • TUPQ@XPSET  จࣈ ͷআ֎ •

    খจࣈԽɺվߦ λϒ ਺ࣈͷ࡟আ • ه߸ͷஔ׵ 
  16. ಛ௃ ςΩετ • %FTDSJQUJPONFUBUFYUGFBUVSFT TFOUJNFOU BOOPUT@EFTD • -FOHUIͳͲͷ UFYU౷ܭྔ •

    -FOHUIͳͲͷ UFYU౷ܭྔΛ 3FTDVFS*% Ͱ HSPVQCZ • UGJEG47%Ͱѹॖ 
  17. ͓·͚ • 4FFEΨνϟͰ΋ۚݍʢ΄΅ೖ৆ݍʣ  trial seed kaeru_seed Private Ranking 6

    31416 58 0.44945 3rd 7 310416 1033 0.44659 6th 8 310416 1324 0.44955 3rd 9 310416 1604 0.45096 2nd 10 310416 1757 0.45491 2nd trial seed kaeru_seed Private Ranking 1 77777 133777 0.45358 2nd 2 31414 1625 0.45072 2nd 3 31415 1433 0.44914 3rd 4 31415 1631 0.45271 2nd 5 31415 1850 0.44837 5th
  18. શମ૾ • UFTUͬΆ͘ͳ͍USBJOσʔλΛ࡟ͬͨ   *NBHF 5BCMF 5FYU %FOTFOFU *NBHFTJ[F

    OVN 47% &YUFSOBM "SFB 1PQVMBUJPO #SFFEEFUBJMJOGP .FUBEBUB 4FOUJNFOU 'SFRVFODZFODPEJOH 5'*%' 47% MJHIUHCN YHCPPTU USBJO EBUB ʢUFTUʹࣅ͍ͯͳ͍σʔλͷΛ࡟আʣ UFTU USBJOUFTUΛ ෼ྨ͢ΔΑ͏ʹֶश
  19. 3JEHF4UBDLJOH • 4JOHMFNPEFM͸͍͍ͤͥNPEFM • $7είΞΛݟͯɺ4UBDLFSΛݕ౼ • -(#."WFSBHF3JEHF • #FTU4JOHMF -(#.

    $7 1SJWBUF UI • #FTU4UBDLJOH$7 1SJWBUF OE 
  20. V

  21. ΍ͬͨ͜ͱ • టष͍͜ͱॾʑ୲౰ • աڈίϯϖؚΊͯEJTDVTTJPOΛ௥͏ • FYUFSOBM EBUBͷ࡞੒ • σʔλΫϨϯδϯά

    • ݱঢ়੔ཧɺλεΫ؅ཧ • PETBJΛݟΔ • UXJUUFS • ೣΧϑΣʹߦ͘  IUUQXXXOFDPSFQVCMJDKQBDDFTTIUNMUPLZP
  22. ࠶ݱίʔυɾղ๏ࢿྉͷఏग़ • ࠶ݱίʔυ • ,FSOFM0OMZίϯϖͳͷͰɺఏग़ແ͠Ͱ0,ͩͬͨ • ʢී௨ͷίϯϖͰ΍Δ࡞ۀΛίϯϖதʹڧ͍ΒΕ͍ͯΔʁʣ • ղ๏ࢿྉ •

    1PXFSQPJOUͰϖʔδऑ • #BDLHSPVOE4VNNBSZ'FBUVSFTFMFDUJPOFOHJOFFSJOH 5SBJOJOHNFUIPET*NQPSUBOUGJOEJOHT4JNQMFNPEFM 
  23. 1FUGJOEFSͰͷ׆༻ • ೖ৆ऀͷϞσϧΛ౷߹͠ lVMUJNBUFNPEFMz Λ࣮૷த • ϖοτͷૣظҾ͖औΓʹܨ͛Δ໨త  ϖοτͷϓϩϑΟʔϧΛείΞ෇͚ 

    ԿΛमਖ਼͢΂͖͔ఏҊʢը૾ɾςΩετͳͲʣ • 1FUGJOEFSͷػցֶशϓϩδΣΫτϖʔδʹࣸਅ͕ࡌͬͨ