SCAN - Speaker Deck

Slide 1

Slide 1 text

4$"/ OBSSBUJWFOJHIUTגࣜձࣾ ࡾ޷߁༞ શ೴ΞʔΩςΫνϟ։ൃ෦Φϑձ

Slide 2

Slide 2 text

ͱΓ͋͛Δ࿦จ SCAN: Learning Abstract Hierarchical Compositional Visual Concepts  Irina Higgins, Nicolas Sonnerat, Loic Matthey, Arka Pal, Christopher P Burgess, Matthew Botvinick, Demis Hassabis, Alexander Lerchner  DeepMind 2017 ཧղΛਂΊΔࣄΛ໨తͱ࣮ͯ͠૷͓Αͼ؆୯ͳ࣮ݧΛߦ͍·ͨ͠ IUUQTHJUIVCDPNNJZPTVEBTDBO

Slide 3

Slide 3 text

࿦จͷϞνϕʔγϣϯ w γϯϘϧͱը૾ͷ૬ޓม׵Λߦ͍͍ͨ w γϯϘϧͱը૾ͷ݁ͼ͚ͭΛগྔͷϖΞͰߦ͍͍ͨ w ֓೦ؒͷ֊૚ؔ܎Λѻ͍͍ͨ  ΑΓந৅తͳ֓೦ΑΓ۩ମతͳ֓೦ w ֓೦ͱ֓೦ؒͷԋࢉΛѻ͍͍ͨ  FY΢Ϛͱࣶ໛༷Λ͋ΘͤΔͱγϚ΢Ϛʹ

Slide 4

Slide 4 text

4$"/ֶशͷྲྀΕ ը૾ͷ%JTFOUBOHMFදݱֶश ڭࢣͳֶ͠श ը૾ͱγϯϘϧͷ݁ͼ͚ͭ ίϯηϓτͱίϯηϓτͷԋࢉֶश

Slide 5

Slide 5 text

ը૾ͷ%JTFOUBOHMFදݱֶश

Slide 6

Slide 6 text

%JTFOUBOHMFNFOU ղ͖΄͙͠ ը૾ͷߏ੒ཁૉΛղ͖΄͙͞Εͨঢ়ଶͰදݱ͍ͨ͠

Slide 7

Slide 7 text

σʔληοτ นΧϥʔ৭ύλʔϯ চΧϥʔ৭ύλʔϯ w 0CKΧϥʔ৭ύλʔϯ w 0CKλΠϓछྨ  ๧ࢠɺΞΠεΩϟϯσΟʔɺεʔπέʔε w ճస લޙҐஔΛ֤ը૾͝ͱʹϥϯμϜʹ  w YYYຕը૾Λ༻ҙ w ࣮ࡍͷ࿦จͷ΋ͷ͸ɺϥΠςΟϯά΍Χϝϥ֯౓ͳͲͷόϦΤʔγϣϯ͕΋ͬͱଟ͍ͷͰ  ຊ࣮ݧͷ΋ͷ͸όϦΤʔγϣϯ͕؆ུԽ͞Ε͍ͯΔ 

Slide 8

Slide 8 text

7BSJBUJPOBM"VUPFODPEFS

Slide 9

Slide 9 text

*OQVUͱ0VUQVUΛ͚ۙͮΔ Ж МͰ࡞ΒΕΔ෼෍ʹର͢ΔറΓ

Slide 10

Slide 10 text

Ж М ฏۉɺ෼ࢄͷਖ਼ن෼෍ʹ͚ۙͮΔΑ͏ͳਖ਼ଇԽ

Slide 11

Slide 11 text

Ќ7"&

Slide 12

Slide 12 text

ΑΓજࡏม਺ͷ෼෍ʹର͢Δ੍໿Λڧ͘͢Δ

Slide 13

Slide 13 text

Ж М ЌΛେ͖͘͢Δ͜ͱʹΑΓ  ฏۉɺ෼ࢄͷਖ਼ن෼෍N(0, I) ʹ  ͚ۙͮΔΑ͏ͳ੍໿͕ΑΓڧ͘ͳΔ

Slide 14

Slide 14 text

w q(z|x)͕N(0, I)ʹ׬શʹҰக͢Δͱ࠶ߏ੒Ͱ͖ͳ͘ͳΔ w ࠶ߏ੒Ͱ͖Δͷʹඞཁͳ৘ใΪϦΪϦ·ͰߜΔ w ͢Δͱ֤જࡏม਺z͕ɺนͷ৭ɺচͷ৭ɺΦϒδΣΫτͷ৭ɺFUDʜͱ  ͍֤ͬͨύϥϝʔλ͝ͱʹ෼཭͞Εͯ͘Δ %JTFOUBOHMFNFOU ЌΛେ͖ͯ͘͘͠

Slide 15

Slide 15 text

นΧϥʔ চΧϥʔ 0CKΧϥʔ 0CKλΠϓ

Slide 16

Slide 16 text

Ќ7"&ͷ%JTFOUBOHMF݁Ռ 0CKλΠϓ 0CKҐஔ  0CKλΠϓ΋ นΧϥʔ 0CKΧϥʔ চΧϥʔ ΦϒδΣΫτͷҐஔ લޙҐஔ ͱɺΦϒδΣΫτͷλΠϓ͕  গࠞͬͯ͟͠͠·͍ͬͯΔ &OUBOHMF͞Ε͍ͯΔ ͕ɺଞͷ͓͓ΉͶ៉ྷʹ෼཭Ͱ͖͍ͯΔ

Slide 17

Slide 17 text

w 7"&ͷЌΛେ͖͘͢Δͱɺ࠶ߏ੒͕೉͘͠ͳͬͨΓɺ࠶ߏ੒݁Ռ͕΅΍͚ͨΓ͢Δ  ϐΫηϧ୯ҐͰͷೋ৐ޡࠩܭࢉͳͲʹىҼ w 4$"/Ͱ͸ɺ࠶ߏ੒ޡࠩͷܭࢉ༻ʹผ్%FOPJTJOH"VUPFODPEFS %"& Λ༻ҙ͢Δ

Slide 18

Slide 18 text

%"& w Ұ෦ΛϚεΫͨ͠ը૾͔Βݩͷը૾Λ෮ݩ w Ќ7"&ͷֶशΑΓઌʹֶश͓ͯ͘͠

Slide 19

Slide 19 text

࠶ߏ੒ޡࠩΛ%"&ͷதؒ૚ͰऔΔ ϐΫηϧ୯Ґͷޡࠩܭࢉͷ୅ΘΓʹ'FBUVSFͰͷޡࠩܭࢉΛߦ͏

Slide 20

Slide 20 text

%JTFOUBOHMFNFOUʹ͍ͭͯ

Slide 21

Slide 21 text

นΧϥʔ চΧϥʔ 0CKλΠϓ Կ΋ͳ͠ w ݸ ࣍ݩ ͋Δજࡏม਺[ͷ͏ͪɺҙຯ͕औΕΔ͸ݸͱͳͬͨ w ҙຯ͕ͱΕͨ[ͷ෼ࢄ͸খ͘͞ɺҙຯ͕ͱΕͳ͔ͬͨ[ͷ෼෍͸΄΅N(0,I)ͱͳΔ

Slide 22

Slide 22 text

ྫ෼ࢄ͕খ͍͞෼෍ͷฏۉ͕มԽ͢Δ͜ͱͰ 0CKΧϥʔͷมԽΛදݱ͍ͯ͠Δ

Slide 23

Slide 23 text

ٯʹҙຯ͕औΕ͍ͯΔજࡏม਺ʹେ͖͍෼ࢄΛ༩͑Δͱ  ʮ0CKΧϥʔʹؔͯ͠ಛʹܾ·͍ͬͯͳ͍ʯ  ͳͲͱ͍͏ͷΛදݱ͍ͯ͠Δ͜ͱʹͳΔ

Slide 24

Slide 24 text

ը૾ͱγϯϘϧͷ݁ͼ͚ͭ

Slide 25

Slide 25 text

γϯϘϧΛ࣍ݩͷ,IPUϕΫτϧͰදݱ͢Δ ݩ࿦จͰ͸ɺ࣍ݩͰදݱ͍͕ͯͨ͠ࠓճ͸؆ུԽͨ͠

Slide 26

Slide 26 text

No content

Slide 27

Slide 27 text

Slide 28

Slide 28 text

,- γϯϘϧ͔Β  Πϝʔδ΁ͷม׵

Slide 29

Slide 29 text

นΧϥʔനͷΈΛࢦఆ นΧϥʔനɺচΧϥʔനͷΈΛࢦఆ นΧϥʔനɺচΧϥʔനɺ0CKΧϥʔനΛࢦఆ นΧϥʔനɺচΧϥʔനɺ0CKΧϥʔനɺ0CKλΠϓΞΠεΩϟϯσΟʔ

Slide 30

Slide 30 text

۩ମతίϯηϓτ ந৅తίϯηϓτ ܾ·͍ͬͯΔ ಛʹܾ·͍ͬͯͳ͍

Slide 31

Slide 31 text

۩ମతίϯηϓτ ந৅తίϯηϓτ ಈ෺ ΢Ϛ ͠·͠·ͷ΢Ϛ খ͞ͳ͠·͠·ͷ΢Ϛ ಈ෺ʹ͓͖͔͑Δͱ

Slide 32

Slide 32 text

,- Πϝʔδ͔Β  γϯϘϧ΁ͷม׵

Slide 33

Slide 33 text

w นΧϥʔന w চΧϥʔന w 0CKΧϥʔന w 0CKλΠϓΞΠεΩϟϯσΟʔ *OQVU 0VUQVU w นΧϥʔೱԫ৭ w 0CKΧϥʔࢵ ਖ਼ղ͸੺ w 0CKλΠϓ๧ࢠ

Slide 34

Slide 34 text

ίϯηϓτͱίϯηϓτͷԋࢉֶश

Slide 35

Slide 35 text

໛༷͠·͠· ಈ෺ͷछྨ΢Ϛ ΢Ϛ ͠·໛༷ ಈ෺ͷछྨ΢Ϛ  ໛༷͠·͠· "/% ࠞͥΔͱʁ

Slide 36

Slide 36 text

*/$0..0/ ಈ෺ͷछྨ΢Ϛ  ໛༷͠·͠· γϚ΢Ϛ γϚϦε ڞ௨఺ʁ ໛༷͠·͠· ಈ෺ͷछྨϦε  ໛༷͠·͠·

Slide 37

Slide 37 text

γϚ΢Ϛ ͠·໛༷ ڞ௨఺ΛҾ͘ͱʁ ಈ෺ͷछྨ΢Ϛ  ໛༷͠·͠· ໛༷͠·͠· ಈ෺ͷछྨ΢Ϛ *(/03&

Slide 38

Slide 38 text

͜ͷԋࢉͷֶशΛߟ͑Δɻ  ࠓճͷσʔληοτʹஔ͖׵͑Δͱ

Slide 39

Slide 39 text

চΧϥʔ੺ นΧϥʔന $0/$&15 $0/$&15 "/% ࠞͥΔͱʁ นΧϥʔന  চΧϥʔ੺

Slide 40

Slide 40 text

*/$0..0/ $0/$&15 $0/$&15 ڞ௨఺ʁ นΧϥʔന  চΧϥʔ੺ นΧϥʔന  চΧϥʔ੨ นΧϥʔന

Slide 41

Slide 41 text

চΧϥʔ੺ นΧϥʔന $0/$&15 $0/$&15 ڞ௨఺ΛҾ͘ͱʁ *(/03& นΧϥʔന  চΧϥʔ੺

Slide 42

Slide 42 text

,- $0/$&15 $0/$&15

Slide 43

Slide 43 text

*/$0..0/ *(/03& "/%

Slide 44

Slide 44 text

Ж М М Ж Ж М М Ж Ж М М Ж Ж М М Ж Ж М М Ж Ж М М Ж М Ж М Ж М Ж М Ж М Ж М Ж $0/$&15 $0/$&15 ԋࢉޙͷ  $0/$&15 w XJEUI TUSJEFͷ࣍ݩ৞ΈࠐΈ૚Λͭ࿈Ͷ࣮ͯ૷ͨ͠ w જࡏม਺͕֤࣍ݩຖʹ%JTFOUBOHMF͞Ε͍ͯΔͷͰɺ'$ͷ༷ͳ࣍ݩΛ·͙༷ͨͳ  ॲཧ͕ඞཁ͕ͳ͘ɺ֤࣍ݩ͝ͱʹಉ͡ॲཧ͕͞ΕΕ͹Α͍

Slide 45

Slide 45 text

w ࠷ॳڭࢣσʔλΛը૾σʔλʹͯ͠Έ͕ͨɺֶश͕೉͔ͬͨ͠ͷͰɺڭࢣσʔλΛγϯϘϧʹͨ͠Β  ֶश͕؆୯ʹͳͬͨɻ্ه͸ͦͷ݁Ռɻ  ը૾͸ɺը૾಺ͷͲͷ৘ใ͕ڭࢣσʔλʹ֘౰͢Δ͔ɺ͕Θ͔Γʹ͍͘ͷͰ೉͍͠ 0CKΧϥʔന "/% นΧϥʔന 0CKΧϥʔന 0CKλΠϓʹΞΠε */@$0..0/ 0CKΧϥʔʹന นΧϥʔന ֶशޙͷԋࢉ݁Ռ 0CKΧϥʔന นΧϥʔʹന *(/03& 0CKΧϥʔʹന 0CKΧϥʔʹന͕ਖ਼ղ นΧϥʔʹന͕ਖ਼ղ 0CKΧϥʔʹന͔ͭนΧϥʔനͳͷ͕ਖ਼ղ