Link
Embed
Share
Beginning
This slide
Copy link URL
Copy link URL
Copy iframe embed code
Copy iframe embed code
Copy javascript embed code
Copy javascript embed code
Share
Tweet
Share
Tweet
Slide 1
Slide 1 text
-FBSOJOHUP&YQMBJO"O*OGPSNBUJPO 5IFPSFUJD1FSTQFDUJWFPO.PEFM *OUFSQSFUBUJPO ಡΈձˏ ༶໌
Slide 2
Slide 2 text
wஶऀ w+JBOCP$IFO 6$#FSLFMFZ "OU'JOBODJBMͷΠϯλʔϯ w-F4POH (FPSHJB*OTUJUVUFPG5FDIOPMPHZ "OU'JOBODJBM w.BSUJO+8BJOXSJHIU 6OJWFSTJUZPG$BMJGPSOJB 5IF7PMFPO(SPVQ w.JDIBFM*+PSEBO 6OJWFSTJUZPG$BMJGPSOJB wग़య*$.- จใ
Slide 3
Slide 3 text
wϞσϧ͕ʮஅ ग़ྗ ͷࠜڌͱͳͬͨಛʯΛઆ໌͢ΔΑ͏ͳઆ໌ϞσϧΛֶश ͢Δํ๏ΛఏҊ͍ͯ͠Δɽ wैདྷͷઆ໌ϞσϧͱҧͬͯɼҰઆ໌ϞσϧͷֶशΛߦ͑આ໌ͷੜΛຖճܭ ࢉ͠ͳ͍͍ͯ͘ͷͰඇৗʹߴɽ wબΜͩཧ༝ wࣗͷݚڀʹઆ໌Մೳ"*ΛऔΓೖΕ͍ͨͱࢥͬͨͨΊɽ w ࠷ۙϗοτͰ͋Δ͔Β ֓ཁ ͲΜͳจ
Slide 4
Slide 4 text
wϥϯμϜϑΥϨετ Χʔωϧ๏ɼσΟʔϓχϡʔϥϧωοτϫʔΫͳͲෳࡶͳϞ σϧ͕ఏҊ͞ΕɼͦΕΒʹΑͬͯ༧ଌਫ਼͕ߴ·͍ͬͯΔɽ w͔͠͠ɼෳࡶͳϞσϧʹΑΔग़ྗ݁ՌΛਓ͕ؒղऍ͢Δͷࠔʹͳ͍ͬͯ Δɽ wຊจͰ༧ଌʹॏཁͳಛྔΛݟ͚ͭΔ͜ͱͰɼϞσϧͷղऍੑΛߴΊΑ͏ͱ ͍ͯ͠Δɽ ֓ཁ ݚڀഎܠ
Slide 5
Slide 5 text
ೖྗͷϕΫτϧʹؔͯ͠ɼਖ਼ղͷग़ྗͷޯΛٻΊΔɽٻΊͨޯΛ͍ɼೖྗ ʹϚεΫͯ͠આ໌ͱ͢Δɽ આ໌͍ͨ͠αϯϓϧͷपลͰہॴతʹ؆୯ͳࣝผϞσϧΛ࡞ΓɼͦΕΛͬͯઆ ໌Λߦ͏ɽ w -*.&%FFQ-*'5 LFSOFM4)"1ͳͲ͕͋Δɽ ֓ཁ طଘݚڀʹ͍ͭͯ
Slide 6
Slide 6 text
wہॴతͳઆ໌ϞσϧΛશମతʹֶश͠ɼೖྗͷߟྀʹೖΕΒΕΔɽ wہॴతͳઆ໌ϞσϧΛՃ͠ͳͯ͘ྑ͍ɽ ֓ཁ طଘݚڀͱͷҧ͍
Slide 7
Slide 7 text
ߩݙ࣍ͷΑ͏ʹͳΔ w ใྔΛͱʹͯ͠ɼΠϯελϯε͝ͱͷಛબ͕Ͱ͖ΔϑϨʔϜϫʔΫΛఏҊ ͨ͠ɽ w ϞσϧʹґଘͤͣޮͷΑ͍ɼಛબͷΞϧΰϦζϜΛఏҊͨ͠ɽ w ఏҊͨ͠ΞϧΰϦζϜ͕ਓσʔλͱϦΞϧσʔλͰޮՌ͕͋Δ͜ͱΛ࣮ݧͨ͠ɽ ֓ཁ ߩݙ
Slide 8
Slide 8 text
wఏҊख๏ͰɼϞσϧʹґଘ͠ͳ͍ͨΊճؼɼྨϞσϧͷͲͪΒʹదԠͰ͖Δɽ ʢࠓճྨϞσϧͰߟ͑Δʣ wલఏͱͯ͠ɼϞσϧͷग़ྗΛ͖݅֬ ɼઆ໌ม ֬ม ͱ͢Δɽ w͜͜Ͱɼ૬ޓใྔΛΠϯελϯε͝ͱͷಛબͷࢦඪͱͯ͠͏ɽ આ໌มͱબ͞Εͨಛྔͷ૬ޓใྔ͕࠷େͱͳΔ͜ͱ͕ࠓճͷඪɽ ℙm ( ⋅ ∣ x) Y X = x ∈ ℝd I(X; Y) = X,Y [log pXY (X, Y) pX (X)pY (Y) ] ϑϨʔϜϫʔΫ
Slide 9
Slide 9 text
w पล͔Βग़ͯ͘Δɽ w ͖݅ ͔Βग़ͯ͘Δɽ w αΠζ͕ Ͱ͋Δ͖ू߹ɽಛબʹ͏ɽ w ϋΠύʔύϥϝʔλ w ͔Β͖ू߹ʹϚοϐϯά͢Δઆ໌Ϟσϧɽ w ͰબΕͨ෦ू߹ɼ͜ΕʹΑͬͯબ͞Εͨಛͷ֬ ม ΛಘΔɽ X X ∼ ℙX ( ⋅ ) Y (Y ∣ x) ∼ ℙm ( ⋅ ∣ x) ℘k = {S ⊂ 2d ||S ∣ = k} k k ℰ ℝd S S = ℰ(x) xs ϑϨʔϜϫʔΫ ઃఆ
Slide 10
Slide 10 text
w৽͍֬͠ϕΫτϧ Λ༻͍Δͱࠓճͷత࣍ࣜΛ࠷దԽ͢Δ͜ͱʹͳ Δɽ w૬ޓใྔΛ࠷େʹ͢ΔΑ͏ͳɼಛͷ෦ۭ͕ؒࣝผϞσϧͰॏཁͳಛͰ͋ Δͱઆ໌͢Δ͜ͱ͕Ͱ͖Δɽ Xs ∈ Rk ϑϨʔϜϫʔΫ తؔ
Slide 11
Slide 11 text
wతؔΛղ͘͜ͱ͕ࠔͰ͋Δ͔ΒɼมۙࣅΛ༻͍ͯղ͘ɽ w૬ޓใྔͷԼքΛ࠷େԽ͢Δ͜ͱΛඪʹͳΔɽ ఏҊख๏
Slide 12
Slide 12 text
w ҰൠతͳϞσϧͰɼ͖݅ͷԼքͷظΛܭࢉ͢Δ͜ͱ͕ࠔͰ͋Δͨ Ίɼ࣍ͷΑ͏ͳมΛఆٛ͢Δɽ w w +FOTFOͷෆࣜʹΑΓɼԼք͕࣍ͷΑ͏ʹมߋ͞ΕΔɽ w := {ℚ ∣ ℚ = {xS → ℚS (Y ∣ xS), S ∈ ℘k}} ఏҊख๏ มԼք
Slide 13
Slide 13 text
w Λ༻͍Δͱɼࠓճͷඪ͕࣍ͷΑ͏ʹมΘΔɽ w wҰൠతͳ ͷ߹ɼࣜ Λղ͘ͷ͍·ͩʹࠔͰ͋Δɽͦ͜Ͱ࠷దԽՄೳͳ ํ๏ʹม͑Δඞཁ͕͋Δɽ ℰ, ఏҊख๏ ࠷దԽ
Slide 14
Slide 14 text
w ΛύϥϝʔλԽ͢ΔͨΊʹɼχϡʔϥϧωοτϫʔΫΛఆٛ͢Δɽ w wࠓճఆٛͨ͠ Λ༻͍ͯɼ ͱ͢Δɽ gα : ℝd × [c] → [0,1] where[c] = 0,1,…, c − 1 gα ℚx := gα (˜ xs , Y) ఏҊख๏ ΛύϥϝʔλԽ͢Δ
Slide 15
Slide 15 text
wࣜ Λਪఆ͢Δʹɼ ͜ͷ෦ۭؒΛ߹ܭ͢Δඞཁ͕͋Γେมɽ w͜ΕΛղܾ͢ΔͨΊʹɼ(VNCFMTPGUNBYUSJDLΛ༻͍Δɽ wΧςΰϦΧϧΛ࿈ଓʹͳΔΑ͏ʹ؇͢Δख๏ w(VNCFMTPGUNBYUSJDLΛͬͯɼॏΈ͚ͮΒΕͨ෦ۭؒͷαϯϓϦϯάͷۙࣅ Λߦͳ͍ͬͯ͘ɽ n Ck ఏҊख๏ αϒηοταϯϓϦϯάͷ࿈ଓ؇ Gumbel-softmax trickͷࢀߟ: http://peluigi.hatenablog.com/entry/2018/06/23/192435
Slide 16
Slide 16 text
w ͜ͷಛ͔Β ͜ͷಛΛαϯϓϦϯά͢Δํ๏Λ࣍ʹࣔ͢ɽ ͜ͷಛϕΫτϧΛಠཱʹ ճαϯϓϦϯάΛߦ͏ɽ ͔Ϳͬͨಛআͯ͠ΓΛ͢ɽ w͜͏͢Δͱ͍͍ͤͥ ͚ͩಛ͕Δɽ͜ΕΒΛࣜʹ͢Δͱ࣍ͷΑ͏ʹͳΔɽ d k d k k ఏҊख๏ ಛΛL͚ͩநग़͢Δ
Slide 17
Slide 17 text
w࠷ऴతʹɼ࠷దԽ͢Δ͖తͷͷ࣍ͷͷͰ͋Δɽ w w ʹґଘ͠ͳ͍ͷͰ͋Δ͔Βɼ܇࿅࣌Ͱɼಉ࣌ʹޯ߱ԼΛద༻͢Δ ͜ͱ͕Ͱ͖Δɽ X,ζ θ, α ఏҊख๏ ࠷ऴతͳతؔͱͦͷ࠷దԽ
Slide 18
Slide 18 text
wֶश͞Εͨઆ໌ϞσϧʹΑͬͯɼαϯϓϧ ͔ΒॏΈϕΫτϧ ࣍ݩͷ ʹϚο ϐϯά͞ΕΔɽ w͔͜͜ΒείΞ ͷେ͖͍ํΛબͯ͠ɼઆ໌༻ͷಛͱ͢Δɽ w֤αϯϓϧʹରͯ͠ɼઆ໌ϞσϧΛ௨͚ͩ͢ͰɼಛΛબ͢Δ͜ͱ͕Ͱ͖Δͷ ͰɼطଘݚڀΑΓޮΑ͘આ໌Ͱ͖ɼ͔ͭϞσϧʹґଘ͠ͳ͍Ͱ͓͜ͳ͑Δɽ X d wθ (X) pθ (X) ఏҊख๏ આ໌εςʔδ
Slide 19
Slide 19 text
wਓσʔλͱ࣮ࡍͷσʔλͷೋͭͰ࣮ݧΛߦ͏ɽ wਓσʔλͰɼ࣍ݩΨε͔Βੜͯ͠ɼ͔ͦ͜ΒछྨͷσʔληοτΛ࡞ɽ w ࣮ݧ σʔληοτ
Slide 20
Slide 20 text
wຊݚڀͷख๏ -9 ͱطଘख๏ %FFQ-*'5 4)"1 -*.&ʜ Λൺֱ͢Δɽ ࣮ݧ ࣮ݧ݁Ռ
Slide 21
Slide 21 text
wઆ໌࣌ͷ࣮ߦ࣌ؒͷ݁ՌΛҎԼʹࣔ͢ɽ ࣮ݧ ࣮ݧ݁Ռ
Slide 22
Slide 22 text
࣮ݧ݁Ռ ςΩετσʔλͰͷϋΠϥΠτ өըϨϏϡʔͷσʔληοτ
Slide 23
Slide 23 text
wөըϨϏϡʔͷจʹରͯ͠ɼΫϥυϫʔΧʹݸͷײʹ߆ΔΩʔϫʔυΛબ ͯ͠Β͏ɽ wෳͷจষΛෳͷϫʔΧʹධՁͯ͠Β͍ɼͦͷฏۉΛ)VNBOBDDVSBDZͱ͢ Δɽ ࣮ݧ݁Ռ ΫϥυϫʔΧʹධՁͯ͠Β͏
Slide 24
Slide 24 text
w૬ޓใྔΛجʹͯ͠ɼΠϯελϯε͝ͱͷಛબΛ͢ΔϑϨʔϜϫʔΫΛఏ Ҋͨ͠ɽ w-9ʹΑΓɼ͡ΊͯϦΞϧλΠϜͰϒϥοΫϘοΫεͳϞσϧΛઆ໌͢Δ͜ͱ ͕Մೳʹͳͬͨɽ ݁