[読み会]Deep Neural Decision Trees

読み会資料
Deep Neural Decision Trees (WHI2018)

Transcript

1. %FFQ
   /FVSBM
   %FDJTJPO
   5SFFT ಡΈձ!
   ༶໌఩
2.  wஶऀ
   w:POHYJO
   :BOH
   *SFOF
   (BSDJB
   .PSJMMP
   5JNPUIZ
   .
   )PTQFEBMFT
   w5IF
   6OJWFSTJUZ
   PG
   &EJOCVSH
   wग़య
   8)*
    ࿦จ৘ใ
3.  wܾఆ໦ͱχϡʔϥϧωοτϫʔΫΛ૊Έ߹Θͤͨʂ
   wܾఆ໦ͷղऍੑɼχϡʔϥϧωοτϫʔΫͷදݱྗʢਫ਼౓ʣͷ͍͍ ͱ͜औΓΛ໨ࢦ͍ͯ͠Δɽ ֓ཁ ͲΜͳ࿦จʁ
4.  wۙ೥ɼχϡʔϥϧωοτϫʔΫʹΑΔϞσϧͷਫ਼౓͕ߴ͍ͷͰΑ͘ ࢖ΘΕ͍ͯΔ͕ɼग़ྗʹରͯ͠ͷղऍੑ͕๡͍͠ɽ
   wैདྷ࢖ΘΕ͍ͯͨɼܾఆ໦͸χϡʔϥϧωοτϫʔΫΑΓ΋ਫ਼౓͕ ग़ͤͳ͍͜ͱ΋͋ΔҰํͰɼղऍੑʹ༏Ε͍ͯΔɽ ֓ཁ ݚڀഎܠ
5.  wطଘͷ//ϥΠϒϥϦʹ਺ߦ௥Ճ͢Δ͚ͩͰɼ࣮૷͕Մೳͳख๏Λఏ Ҋ
   wֶशํ๏͸શͯٯޡࠩి೾Ͱߦ͏͜ͱ͕ՄೳͰ͋Δɽ
   wຊख๏Ͱ͸ɼಛʹදܗࣜͷ෼ྨ໰୊ʹ༗ޮͰ͋Δɽ ֓ཁ ߩݙ
6.  w4PGU
   CJOOJOH
   GVODUJPO
   %PVHIFSUZ
   FU
   BM
    ͷςΫχοΫΛར ༻͢Δɽ
   w࣮਺ͷ࿈ଓ஋
   
   ΛCJOͰ෼͚ΔςΫχοΫɽ
   wˠ
   ඍ෼Մೳͳؔ਺Λ΋͍ͪͯߦ͏ͨΊɼٯޡࠩ఻೻͕ՄೳͰ͋ Δʂʂ x ఏҊख๏ 4PGU
   CJOOJOH
   GVODUJPO
   
7.  ఏҊख๏ 4PGU
   CJOOJOH
   GVODUJPO ͷϕΫτϧͷͳ͔ʹ binningΛߦ͏ ᮢ஋͕ೖ͍ͬͯΔ b Թ౓෇ιϑτϚοΫεؔ਺ ͷ࣌ One-hotϕΫτϧͱಉ౳ʹͳΔ τ → 0
8.  ఏҊख๏ 4PGU
   CJOOJOH
   GVODUJPO Թ౓෇ιϑτϚοΫεؔ਺ ͷ࣌ One-hotϕΫτϧͱಉ౳ʹͳΔ τ → 0
9.  w#JOOJOH
   GVODUJPOʹΑͬͯɼ෼͚ΒΕͨಛ௃ྔΛ༻͍ͯɼχϡʔϥϧ ωοτϫʔΫϞσϧͰॱి೾Λߦ͏ɽ
   w//ͷ࠷ऴग़ྗʹରͯ͠ɼΫϩωοΧʔੵΛߦ͏ʢ༿͕Ͱ͖Δʣ
   wˠ
   ΄ͱΜͲPOFIPUͱಉ͡ঢ়ଶʹͳΔɽ
   w༿Λશ݁߹ͨ݁͠Ռ͕ɼ෼ྨͨ݁͠ՌʹͳΔɽ ఏҊख๏ ༧ଌύʔτ
10.  ఏҊख๏ ༧ଌύʔτ ಛ௃ྔʹରͯ͠ BinningΛߦ͏ Biningͨ͠ಛ௃Λ༻͍ͯ χϡʔϥϧωοτϫʔΫΛߦ͏ ΫϩωοΧʔੵΛͱΓ શ݁߹͢Δ
11.  w4PGU
    CJOOJOH
    GVODUJPOͱ//෦෼͸ඍ෼ՄೳͰ͋Δ͔Βֶश͸ޡࠩ ٯ఻೻Λ༻͍Δ͜ͱ͕Ͱ͖Δʂ ఏҊख๏ ֶश࣌
12.  wطଘख๏ʢ//Ϟσϧͱܾఆ໦ϞσϧʣͱఏҊख๏Λෳ਺ͷදܗࣜ σʔληοτͰਫ਼౓ͷൺֱΛߦ͏ɽ ࣮ݧ ࣮ݧͰ֬ೝ͢Δ͜ͱ
13.  ࣮ݧ ࣮ݧ݁Ռ
14.  wطଘख๏ʹ༏ͬͨΓྼ͍ͬͯͨΓɼσʔληοτʹΑͬͯҰ௕Ұ୹Ͱ ͋ͬͨɽ
    wطଘख๏ͱಉ౳ͷੑೳ͸͍࣋ͬͯΔɽ ࣮ݧ ࣮ݧ݁Ռ
15.  wఏҊख๏Ͱ͸࢖ΘΕͳ͍ಛ௃͕͋Δ͜ͱ͕֬ೝͰ͖ͨ
    wˠ༧ଌʹඞཁͳ͍ͱ൑அͰ͖Δ ࣮ݧ ࣮ݧ݁Ռ
16.  w༿ͷΫϩωοΧʔੵΛ΋ ͱʹͲͷಛ௃ྔ͕࢖ΘΕͯ ͍Δ͔Λநग़͢Δ͜ͱ͕Ͱ ͖Δɽ ࣮ݧ Ϟσϧͷղऍੑ
17.  wಛ௃ྔ͕૿͑ͨ࣌Ͱ΋ɼ (16ʹΑΔܭࢉޮ཰͸ྑ ͔ͬͨɽ ࣮ݧ ܭࢉޮ཰
18.  wຊݚڀͰ͸ɼܾఆ໦ͱ//ϞσϧΛ૊Έ߹Θͤͨख๏ΛఏҊͨ͠ɽ
    wຊख๏Ͱ͸ɼ//Ϟσϧͱಉ౳ͷੑೳΛ࣋ͪɼܾఆ໦Έ͍ͨͳղऍੑ ͷߴ͍Ϟσϧʹͳͬͨɽ ·ͱΊ