Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
[読み会]Deep Neural Decision Trees
Search
mei28
December 03, 2020
0
27
[読み会]Deep Neural Decision Trees
読み会資料
Deep Neural Decision Trees (WHI2018)
mei28
December 03, 2020
Tweet
Share
More Decks by mei28
See All by mei28
[Human-AI Decision Making勉強会] 意思決定 with AIは個人vsグループで変わるの?
mei28
0
140
[読み会] Words are All You Need? Language as an Approximation for Human Similality Judgements
mei28
0
15
[参加報告] AAAI'23
mei28
0
56
[計算機構論] Learning Models of Individual Behavior in Chess
mei28
0
57
[計算機構論] Why do tree-based models still outperform deep learning on tabular data?
mei28
0
32
チーム開発と機械学習
mei28
0
34
[読み会] Knowledge distillation: A good teacher is patient and consistent
mei28
0
29
[読み会] ControlBurn- Feature Selection by Sparse Forests
mei28
0
18
[読み会] Learning Representations by Humans, for Humans
mei28
0
22
Featured
See All Featured
Designing Dashboards & Data Visualisations in Web Apps
destraynor
226
51k
Docker and Python
trallard
35
2.7k
How To Stay Up To Date on Web Technology
chriscoyier
782
250k
Stop Working from a Prison Cell
hatefulcrawdad
266
19k
The Pragmatic Product Professional
lauravandoore
26
5.9k
Designing the Hi-DPI Web
ddemaree
276
33k
XXLCSS - How to scale CSS and keep your sanity
sugarenia
242
1.2M
The Power of CSS Pseudo Elements
geoffreycrofte
62
5k
Robots, Beer and Maslow
schacon
PRO
155
8k
The Success of Rails: Ensuring Growth for the Next 100 Years
eileencodes
34
6.1k
The Illustrated Children's Guide to Kubernetes
chrisshort
32
47k
Embracing the Ebb and Flow
colly
80
4.2k
Transcript
%FFQ/FVSBM%FDJTJPO5SFFT ಡΈձ! ༶໌
wஶऀ w:POHYJO:BOH *SFOF(BSDJB.PSJMMP 5JNPUIZ.)PTQFEBMFT w5IF6OJWFSTJUZPG&EJOCVSH wग़య8)* จใ
wܾఆͱχϡʔϥϧωοτϫʔΫΛΈ߹Θͤͨʂ wܾఆͷղऍੑɼχϡʔϥϧωοτϫʔΫͷදݱྗʢਫ਼ʣͷ͍͍ ͱ͜औΓΛࢦ͍ͯ͠Δɽ ֓ཁ ͲΜͳจʁ
wۙɼχϡʔϥϧωοτϫʔΫʹΑΔϞσϧͷਫ਼͕ߴ͍ͷͰΑ͘ ΘΕ͍ͯΔ͕ɼग़ྗʹରͯ͠ͷղऍੑ͕͍͠ɽ wैདྷΘΕ͍ͯͨɼܾఆχϡʔϥϧωοτϫʔΫΑΓਫ਼͕ ग़ͤͳ͍͜ͱ͋ΔҰํͰɼղऍੑʹ༏Ε͍ͯΔɽ ֓ཁ ݚڀഎܠ
wطଘͷ//ϥΠϒϥϦʹߦՃ͢Δ͚ͩͰɼ࣮͕Մೳͳख๏Λఏ Ҋ wֶशํ๏શͯٯޡࠩిͰߦ͏͜ͱ͕ՄೳͰ͋Δɽ wຊख๏Ͱɼಛʹදܗࣜͷྨʹ༗ޮͰ͋Δɽ ֓ཁ ߩݙ
w4PGUCJOOJOHGVODUJPO %PVHIFSUZFUBM ͷςΫχοΫΛར ༻͢Δɽ w࣮ͷ࿈ଓ ΛCJOͰ͚ΔςΫχοΫɽ wˠඍՄೳͳؔΛ͍ͪͯߦ͏ͨΊɼٯޡ͕ࠩՄೳͰ͋ Δʂʂ
x ఏҊख๏ 4PGUCJOOJOHGVODUJPO
ఏҊख๏ 4PGUCJOOJOHGVODUJPO ͷϕΫτϧͷͳ͔ʹ binningΛߦ͏ ᮢ͕ೖ͍ͬͯΔ b ԹιϑτϚοΫεؔ ͷ࣌ One-hotϕΫτϧͱಉʹͳΔ
τ → 0
ఏҊख๏ 4PGUCJOOJOHGVODUJPO ԹιϑτϚοΫεؔ ͷ࣌ One-hotϕΫτϧͱಉʹͳΔ τ → 0
w#JOOJOHGVODUJPOʹΑͬͯɼ͚ΒΕͨಛྔΛ༻͍ͯɼχϡʔϥϧ ωοτϫʔΫϞσϧͰॱిΛߦ͏ɽ w//ͷ࠷ऴग़ྗʹରͯ͠ɼΫϩωοΧʔੵΛߦ͏ʢ༿͕Ͱ͖Δʣ wˠ΄ͱΜͲPOFIPUͱಉ͡ঢ়ଶʹͳΔɽ w༿Λશ݁߹ͨ݁͠Ռ͕ɼྨͨ݁͠ՌʹͳΔɽ ఏҊख๏ ༧ଌύʔτ
ఏҊख๏ ༧ଌύʔτ ಛྔʹରͯ͠ BinningΛߦ͏ Biningͨ͠ಛΛ༻͍ͯ χϡʔϥϧωοτϫʔΫΛߦ͏ ΫϩωοΧʔੵΛͱΓ શ݁߹͢Δ
w4PGUCJOOJOHGVODUJPOͱ//෦ඍՄೳͰ͋Δ͔Βֶशޡࠩ ٯΛ༻͍Δ͜ͱ͕Ͱ͖Δʂ ఏҊख๏ ֶश࣌
wطଘख๏ʢ//ϞσϧͱܾఆϞσϧʣͱఏҊख๏Λෳͷදܗࣜ σʔληοτͰਫ਼ͷൺֱΛߦ͏ɽ ࣮ݧ ࣮ݧͰ֬ೝ͢Δ͜ͱ
࣮ݧ ࣮ݧ݁Ռ
wطଘख๏ʹ༏ͬͨΓྼ͍ͬͯͨΓɼσʔληοτʹΑͬͯҰҰͰ ͋ͬͨɽ wطଘख๏ͱಉͷੑೳ͍࣋ͬͯΔɽ ࣮ݧ ࣮ݧ݁Ռ
wఏҊख๏ͰΘΕͳ͍ಛ͕͋Δ͜ͱ͕֬ೝͰ͖ͨ wˠ༧ଌʹඞཁͳ͍ͱஅͰ͖Δ ࣮ݧ ࣮ݧ݁Ռ
w༿ͷΫϩωοΧʔੵΛ ͱʹͲͷಛྔ͕ΘΕͯ ͍Δ͔Λநग़͢Δ͜ͱ͕Ͱ ͖Δɽ ࣮ݧ Ϟσϧͷղऍੑ
wಛྔ͕૿͑ͨ࣌Ͱɼ (16ʹΑΔܭࢉޮྑ ͔ͬͨɽ ࣮ݧ ܭࢉޮ
wຊݚڀͰɼܾఆͱ//ϞσϧΛΈ߹Θͤͨख๏ΛఏҊͨ͠ɽ wຊख๏Ͱɼ//ϞσϧͱಉͷੑೳΛ࣋ͪɼܾఆΈ͍ͨͳղऍੑ ͷߴ͍Ϟσϧʹͳͬͨɽ ·ͱΊ