Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Kaggle PetFinder 2nd Place Solution

Kaggle PetFinder 2nd Place Solution

Shotaro Ishihara

July 12, 2019
Tweet

More Decks by Shotaro Ishihara

Other Decks in Technology

Transcript

  1. ղ๏ͷ֓ཁ • Ϟσϧͷ3JEHFTUBDLJOH • /FVSBM/FUXPSL • -JHIU(#. • -JHIU(#. •

    9(#PPTU • ͭͷޙॲཧ • 3BOLBWFSBHJOHͰᮢ஋࠷దԽ • ը૾ॏෳͷൃݟ 
  2. νʔϜϝϯόʔ • ೔ຊਓਓνʔϜʢLBHHMFSKBʣ • LBFSVSVSV ZOLUL V UBLVPLP HFHF •

    ೔ຊޠ 4MBDLͰ΍ΓऔΓ • εϓϨουγʔτͰλεΫͳͲΛ؅ཧ • ίʔυ͸,BHHMF ,FSOFMΛ'PSL 
  3. LFSVSVSVιϩࢀՃ • QVCMJDLFSOFMϕʔεʹಔϝμϧݍ಺ ʢऴྃΧ݄൒લʣ • ػցֶशΤϯδχΞ΁ͷస৬ʹ΋੒ޭ • స৬ॕ͍Ͱ V 

    ZOLUL ͱҿΈձ ʢਓͷग़ձ͍͸લճͷNFFUVQʣ  IUUQTUBCFMPHDPNUPLZP""
  4. ಛ௃ ςΩετ • %FTDSJQUJPONFUBUFYUGFBUVSFT TFOUJNFOU  BOOPUT@EFTD CSFFE • 1VODUTͷॲཧ

    FYXIBU`T XIBU`T • .JTTQFMMͷॲཧ FYXIBUTXIBUJT • 4UFNNJOHFYHPJOHHP • /VNCFSͷॲཧ FYDBUTDBUT • #08UGJEG#.47%/.' 
  5. ಛ௃ ςΩετ • %FTDSJQUJPOPOMZ • 1VODUTͷॲཧ • .JTTQFMMͷॲཧ • /VNCFSͷॲཧ

    • &NCFEEJOHXJUIHMPWFBOEGBTUUFYU2VPSBSE NFUIPE • "WFSBHJOHFNCFEEJOHWFDUPSQFSSPXT 
  6. ಛ௃ ςΩετ • 2VPSBSE NFUIPE • FNCFEEJOHͰׂ͖ͨ߹ •  •

    ଞͷલॲཧ΋֤ϓϩηεͰ FNCFEEJOHׂ߹Λ֬ೝ͠ɺ ৗʹ্͕Δํ๏Λબ୒ͨ͠ 
  7. ಛ௃ ςΩετ • ਫ਼౓্͕͕Βͳ͔ͬͨ΋ͷ • #FSU &MNP • HMPWFUXJUUFSWFDUPSͳͲଞͷFNCFEEJOHT QZNBHOJUVEF

    • 4DSBUDIͰֶशͨ͠XW GBTUUFYU • .FUBUFYUGFBUVSFTͷFNCFEEJOHT • -FOHUIͳͲͷUFYU౷ܭྔ • தࠃޠͷલॲཧ 
  8. ಛ௃ ը૾ • ਫ਼౓্͕͕Βͳ͔ͬͨ΋ͷ • ଞͷ$//NPEFM LFSBTQZUPSDI • /*." •

    "WJUPͰ࢖ΘΕ͍ͯͨը૾ͷ౷ܭྔ XIJUFOFTT EVMMOFTT FUDʜ 
  9. ಛ௃ ςʔϒϧ • "HHSFHBUJPO • 4JNQMFNFUIPE • 3BUJPNFUIPE • Ձ֨

    CSFFEࣲݘ ࣲݘͷฏۉֹͷ৔߹ SBUJP • %JGGNFUIPE • Ձ֨ CSFFEࣲݘ ࣲݘͷฏۉֹͷ৔߹ EJGG 
  10. ಛ௃ ςʔϒϧ • ΧςΰϦͷڞى  -%"47% • શΧςΰϦͷ૊Έ߹Θͤʢ࣍·Ͱʣ • JOUFSBDUJPOTGFBUVSFT

    • FY"HF 2VBOUJUZ • FYUFSOBMEBUB • ֆจࣈ • 4UBUF #SFFE #SFFESBOLJOH 
  11. ಛ௃ ಛ௃બ୒ • શ෦Ͱdͷಛ௃ • -(#.ͷJNQPSUBODFUPQΛબ୒ • BMM  

    ͳͲͰ୳ࡧ͠ɺ$7ͱ-#ΛݟܾͯΊͨ • ࣮͸΋ͬͱগͳ͍ํ͕$7ͱQSJWBUF͸Α͔ͬͨ 
  12. Ϟσϧ • -(#.ͱ// • #FTUTJOHMF͸-(#.ͰUI //ͰUI • ΞϯαϯϒϧͰ࢖༻ͯͨ͠ͷ͸-(#.ͰUI //͸Ґ͘Β͍ ͷ΍ͭ

    ಛʹUI //͸$7ߴ͔͕ͬͨ1VCMJD͕গ͠Լ͕ͬͨ • ֶश࣌ؒ͸//ͰTFD -(#.ͰTFD • -(#.ͷύϥϝʔλ • ,FSOFMͷؙύΫϦ 
  13. ํ਑ • $//GFBUVSFT ࣍ݩ  EPDWFD ࣍ݩ UGJEG ͨ͘͞Μ 

    • ߴ࣍ݩϕΫτϧΛ௿࣍ݩʹ௵ͯ͠ར༻͢Δ͜ͱʹࣥ৺ • NFBO WBSͳͲͷ౷ܭྔ΍ 47%ͳͲΛଟ༻͠ɺTDPSF͕৳ͼͨ΋ͷ ͚ͩར༻ ݁Ռతʹ࣌ؒઅ໿ʹ • "HHSFHBUJPOͱͯ΋ޮ͖ͦ͏ • UFYU౷ܭྔಛ௃ͳͲ΋ "HHSFHBUJPOͨ͠ • $7ͪΐͬͱ্͕ͬͨ 
  14. ಛ௃ ը૾ • "WJUPίϯϖͷΧʔωϧͰݟ͚ͭͨը૾ͷαΠζಛ௃ • TJ[F XJEUI IFJHIU ΛΧʔωϧͰެ։ •

    LBFSVSVSV NPEFMʹ͸ޮ͔ͣ΋ɺ࠷ޙʹՃೖͨ͠ HFHFࢯ ͕ϕʔεʹ͍ͯͨ͠ΧʔωϧͰ࢖ΘΕ͍ͯͨ 
  15. ಛ௃ ςΩετ • γϯϓϧͳલॲཧ • TUPQ@XPSET  จࣈ ͷআ֎ •

    খจࣈԽɺվߦ λϒ ਺ࣈͷ࡟আ • ه߸ͷஔ׵ 
  16. ಛ௃ ςΩετ • %FTDSJQUJPONFUBUFYUGFBUVSFT TFOUJNFOU BOOPUT@EFTD • -FOHUIͳͲͷ UFYU౷ܭྔ •

    -FOHUIͳͲͷ UFYU౷ܭྔΛ 3FTDVFS*% Ͱ HSPVQCZ • UGJEG47%Ͱѹॖ 
  17. ͓·͚ • 4FFEΨνϟͰ΋ۚݍʢ΄΅ೖ৆ݍʣ  trial seed kaeru_seed Private Ranking 6

    31416 58 0.44945 3rd 7 310416 1033 0.44659 6th 8 310416 1324 0.44955 3rd 9 310416 1604 0.45096 2nd 10 310416 1757 0.45491 2nd trial seed kaeru_seed Private Ranking 1 77777 133777 0.45358 2nd 2 31414 1625 0.45072 2nd 3 31415 1433 0.44914 3rd 4 31415 1631 0.45271 2nd 5 31415 1850 0.44837 5th
  18. શମ૾ • UFTUͬΆ͘ͳ͍USBJOσʔλΛ࡟ͬͨ   *NBHF 5BCMF 5FYU %FOTFOFU *NBHFTJ[F

    OVN 47% &YUFSOBM "SFB 1PQVMBUJPO #SFFEEFUBJMJOGP .FUBEBUB 4FOUJNFOU 'SFRVFODZFODPEJOH 5'*%' 47% MJHIUHCN YHCPPTU USBJO EBUB ʢUFTUʹࣅ͍ͯͳ͍σʔλͷΛ࡟আʣ UFTU USBJOUFTUΛ ෼ྨ͢ΔΑ͏ʹֶश
  19. 3JEHF4UBDLJOH • 4JOHMFNPEFM͸͍͍ͤͥNPEFM • $7είΞΛݟͯɺ4UBDLFSΛݕ౼ • -(#."WFSBHF3JEHF • #FTU4JOHMF -(#.

    $7 1SJWBUF UI • #FTU4UBDLJOH$7 1SJWBUF OE 
  20. V

  21. ΍ͬͨ͜ͱ • టष͍͜ͱॾʑ୲౰ • աڈίϯϖؚΊͯEJTDVTTJPOΛ௥͏ • FYUFSOBM EBUBͷ࡞੒ • σʔλΫϨϯδϯά

    • ݱঢ়੔ཧɺλεΫ؅ཧ • PETBJΛݟΔ • UXJUUFS • ೣΧϑΣʹߦ͘  IUUQXXXOFDPSFQVCMJDKQBDDFTTIUNMUPLZP
  22. ࠶ݱίʔυɾղ๏ࢿྉͷఏग़ • ࠶ݱίʔυ • ,FSOFM0OMZίϯϖͳͷͰɺఏग़ແ͠Ͱ0,ͩͬͨ • ʢී௨ͷίϯϖͰ΍Δ࡞ۀΛίϯϖதʹڧ͍ΒΕ͍ͯΔʁʣ • ղ๏ࢿྉ •

    1PXFSQPJOUͰϖʔδऑ • #BDLHSPVOE4VNNBSZ'FBUVSFTFMFDUJPOFOHJOFFSJOH 5SBJOJOHNFUIPET*NQPSUBOUGJOEJOHT4JNQMFNPEFM 
  23. 1FUGJOEFSͰͷ׆༻ • ೖ৆ऀͷϞσϧΛ౷߹͠ lVMUJNBUFNPEFMz Λ࣮૷த • ϖοτͷૣظҾ͖औΓʹܨ͛Δ໨త  ϖοτͷϓϩϑΟʔϧΛείΞ෇͚ 

    ԿΛमਖ਼͢΂͖͔ఏҊʢը૾ɾςΩετͳͲʣ • 1FUGJOEFSͷػցֶशϓϩδΣΫτϖʔδʹࣸਅ͕ࡌͬͨ