Share
Embed
ガウス混合モデルにおける推論 (ベイズ推論による機械学習)
須山さんのベイズ緑本(ベイズ推論による機械学習)の4-4節, ガウス混合モデルにおける推論の輪読資料.
tanimutomo
March 05, 2019
Transcript
76 slides
-
Ψεࠞ߹Ϟσϧʹ͓͚Δਪ w ࣄલࣝ w Ψεࠞ߹Ϟσϧ w ΪϒεαϯϓϦϯά w มਪ w
่յܕΪϒεαϯϓϦϯά w ؆қ࣮ݧ w ʢϏοΫσʔλͱϕΠζֶशʣ 2 -
ଟ࣍ݩΨε w Ψεͷଟ࣍ݩόʔδϣϯ w ͭͷ࣍ݩʹண͢ΔͱɼͨͩͷΨε 9 N(x|µ, ⌃) = 1
p (2⇡)D|⌃| exp{ 1 2 (x µ)T ⌃ 1(x µ)} <latexit sha1_base64="N6rCb+fKV8k16U9bFvwWt4R3JjQ=">AAACpnicfVFNbxMxEPUuHw0ppQGOXEZElRKpiXYDUrkgRcABLlWhTVMpToLX8aZW7d3F9qJGrn8af4Ib/wbvNlW/ECNZejPzRm/8JikE1yaK/gThg4ePHm80njQ3n2492249f3Gs81JRNqK5yNVJQjQTPGMjw41gJ4ViRCaCjZOzj1V//JMpzfPsyKwKNpVkmfGUU2J8ad76hSUxp5QIu+86NU5Se+7gAq4SLEu3e50d8qUkrgvvAaeKUBs7i/UPZWxngAvenX2qRmsSXDgH7LwAbHvX5IGDmzq9Wzrd2RFcScxsL/4vF7Cbt9pRP6oD7oN4DdpoHQfz1m+8yGkpWWaoIFpP4qgwU0uU4VQw18SlZgWhZ2TJJh5mRDI9tbXNDnZ8ZQFprvzLDNTVmxOWSK1XMvHMak99t1cV/9WblCZ9N7U8K0rDMnoplJYCTA7VzWDBFaNGrDwgVHG/K9BT4g01/rJNb0J898v3wfGgH7/pR1/ftocf1nY00Cv0GnVQjPbQEH1GB2iEaNAOvgTfgsOwE+6Ho3B8SQ2D9cxLdCvC738BGWvP9Q==</latexit> -
ଟ࣍ݩΨεͷࣄޙ w ฏۉͱਫ਼ߦྻ͕ͲͪΒະͷ߹ʹɼΨεɾΟ γϟʔτ͕ڞࣄલͱͳΔ w ฏۉʢΨεଆʣͷࣄޙͷࢄɼΟγϟʔτͷࣄ ޙʹґଘ͢ΔͨΊɼฏۉʢΨεଆʣΛઌʹܭࢉ͢Δ 10 p(µ, ⇤)
= N(µ|m, ( ⇤) 1)W(⇤|⌫, W) <latexit sha1_base64="DbJg0J/FlFtWX8YAqdxFPdJ7ieY=">AAACgnicbVFbSzMxEM2u93qr+uhLsAhVtO6qoA8Koi8+iCh8tUK3ltk0q8EkuyRZoaz7Q/xbvvlrNNsu9dJvIHBy5syZySRMONPG8z4cd2Jyanpmdq4yv7C4tFxdWb3TcaoIbZKYx+o+BE05k7RpmOH0PlEURMhpK3y+KPKtF6o0i+U/009oR8CjZBEjYCzVrb4l9UCAeQqjLBBpvoNHtytr0oN8C58OOQI8u85/qfHrSC5saT0IqYFxh4ds17c+I5fWD5dSUzjJ9Lt7K9/qVmtewxsEHgd+CWqojJtu9T3oxSQVVBrCQeu27yWmk4EyjHCaV4JU0wTIMzzStoUSBNWdbLDCHG9apoejWNkjDR6wPysyEFr3RWiVxYj6b64g/5drpyY67mRMJqmhkgwbRSnHJsbFf+AeU5QY3rcAiGJ2VkyeQAEx9tcqdgn+3yePg7v9hn/Q8G4Pa2fn5Tpm0TraQHXkoyN0hi7RDWoigj6dTafh7LmT7rbruwdDqeuUNWvoV7gnX+0mwuk=</latexit> -
ͦͦࣄޙΛٻΊΔత w ϕΠζਪͷత w σʔλͷੜաఔΛ֬ΛݩʹϞσϦϯά͢Δ͜ͱͰɼ ະͷσʔλʹର͢Δ༧ଌΛߦ͏ w ࠷ऴతʹٻΊ͍ͨͷ w ༧ଌ
w ༧ଌͱ w ࣄޙʹΑͬͯɼ͚݅ͣΒΕͨ؍ଌ 11 -
w ࣄޙ͕ղੳతʹٻ·Βͳ͍ྫ w ༧ଌʹର͢ΔڞࣄલͰɼࣄલΛԾఆ͍ͯ͠ͳ ͍ͨΊʹɼࣄޙͷܗ͕ະʹͳΔͨΊɼϞσϧΤϏσϯ εΛܭࢉ͢Δඞཁੑ͕ੜͯ͡͠·͏ͨΊɼൺྫ͢Δ֬ີ ͔ؔΒαϯϓϦϯάͯ͠ɼͷಛΛಘΔ w ύϥϝʔλͷґଘ͕ؔෳࡶͰɼ ಉ࣌
ࣄޙΛٻΊΔ͜ ͱ͕ࠔ w ࠞ߹Ϟσϧ w σʔλ͕؍ଌ͞ΕΔ͜ͱͰɼΫϥελΛܾఆ͢ΔTͱɼ֤Ϋϥ ελͷύϥϝʔλʹґଘ͕ؔੜͯ͡͠·͏ ࣄޙ͕ղੳతʹٻ·Βͳ͍ 14 -
Ψεࠞ߹Ϟσϧ w Ψεࠞ߹Ϟσϧʹ͓͚Δ؍ଌ w σʔλͷੜաఔͦͷ·· w جຊతʹɼϙΞιϯࠞ߹Ϟσϧͱಉ͡ɽҧ͏ͷɼଟ࣍ ݩΨε͚ͩɽ 19 p(xn
|sn, µ, ⇤) = K Y k=1 N(xn |µk, ⇤ 1 k )sn,k <latexit sha1_base64="4VWMptUYGe+1sZwx/w+hkwfaC58=">AAACYnicbVFbS8MwFE7rbc7LNn3Uh+AQFHS0KujLQPRFUETBbcIuJU3TLTRNS5KKI/ZP+uaTL/4Qs4uizgMJ3/nOLeeLnzIqleO8Wfbc/MLiUmG5uLK6tl4qVzaaMskEJg2csEQ8+kgSRjlpKKoYeUwFQbHPSMuPLkfx1hMRkib8QQ1T0o1Rn9OQYqQM5ZWH6V4nRmrgh/o59zh8gV+uNO6B8TJz3ZiGAdqHddhJRRJ4Oqq7ee96kosR07f5bJvMi75LvainD918v6elp03bKM+9ctWpOWODs8CdgiqY2p1Xfu0ECc5iwhVmSMq266Sqq5FQFDOSFzuZJCnCEeqTtoEcxUR29ViiHO4aJoBhIszhCo7ZnxUaxVIOY99kjvaQf2Mj8r9YO1PhWVdTnmaKcDwZFGYMqgSO9IYBFQQrNjQAYUHNWyEeIIGwMr9SNCK4f1eeBc2jmntcc+5PqucXUzkKYAvsgD3gglNwDq7AHWgADN6tBWvdKlkfdtGu2JuTVNua1myCX2ZvfwIFBbY+</latexit> -
ଟ࣍ݩΨε w ਫ਼ߦྻʢڞࢄߦྻͷٯߦྻʣΛύϥϝʔλͱ͢Δ ଟ࣍ݩΨεҎԼͷࣜͰද͞ΕΔ w ରόʔδϣϯ w ٯߦྻ͕ͳ͘ͳΔͷ͕ϙΠϯτ 20 N(x|µ,
⇤) = 1 p (2⇡)D|⇤ 1| exp{ 1 2 (x µ)T ⇤(x µ)} <latexit sha1_base64="eswYZq7MIzzCmkOPt7VRhFRxy2M=">AAACqXicfVHbThsxEPUubYG0lEAfeRk1apWoJNoNSO0LUgQ89CGqQCIhapxEXscLFt4LthcRuf43voE3/qZO2JZb1ZEsnTlz5uKZKBdc6SC48/ylV6/fLK+sVt6+W3u/Xt3Y7KuskJT1aCYyOYiIYoKnrKe5FmyQS0aSSLDT6OJgHj+9YlLxLD3Rs5yNEnKW8phToh01qd7ghOhzSoT5YesLHMXm2sIv+OPgpLDbD17X1Z4S24A9wLEk1ITWYHUptam3cc4b40OX+1c2Ns3QFbMW2HUO2DQfktoWHjdsPmnYGJ9AWeN/KsB2Uq0FrWBh8BKEJaih0o4m1Vs8zWiRsFRTQZQahkGuR4ZIzalgtoILxXJCL8gZGzqYkoSpkVls2sInx0whzqR7qYYF+zjDkESpWRI55XxO9Tw2J/8VGxY6/jYyPM0LzVJ63yguBOgM5meDKZeMajFzgFDJ3axAz4lbpXbHrbglhM+//BL0261wpxUc79Y6++U6VtAW+ojqKERfUQd9R0eoh6j32et6Pa/vf/GP/YH/817qe2XOB/TEfPobxgPRAw==</latexit> lnN(x|µ, ⇤) = { 1 2 (x µ)T⇤(x µ) ln|⇤| + Dln2⇡} <latexit sha1_base64="Wn5waYNRFQtc4OROuSwy0TFzJjw=">AAACqHicfVHbahsxENVub4l7c9rHvAwxgaStza5bSF8KoclDoaG4YMcplmu0sjYRkbSLpC01sr4t/9C3/k20zpbmUjogOHNmDjNzlJWCG5skv6P43v0HDx+trbceP3n67Hl748WxKSpN2YgWotAnGTFMcMVGllvBTkrNiMwEG2fnB3V9/INpwws1tIuSTSU5VTznlNhAzdoXWEsnlMeS2DNKhPvid1Y4y91PD0v4k2BZ+Td/s6MwYk78LnxoYdcFnGtCXepd38N1ffeGfvf7EBrl/7qg2yy1bJqX8Bowt+7QQ1OBPi45YN+atTtJL1kF3AVpAzqoicGs/QvPC1pJpiwVxJhJmpR26oi2nArmW7gyrCT0nJyySYCKSGambmW0h+3AzCEvdHjKwoq9rnBEGrOQWeisDzK3azX5r9qksvn7qeOqrCxT9GpQXgmwBdS/BnOuGbViEQChmoddgZ6R4LkNf1ubkN4++S447vfSt73k67vO/sfGjjW0ibbQDkrRHtpHn9AAjRCNtqPP0TAaxa/iQTyOv121xlGjeYluRJxdAj120L4=</latexit> -
ଟ࣍ݩΨεͷڞࣄલ w ڞࣄલʢΨεɾΟγϟʔτʣ w ٻΊ͍ͨಉ࣌ࣄޙ w Ϋϥελมͱͦͷύϥϝʔλɼ֤Ϋϥελͷͷύϥ ϝʔλͷಉ࣌ࣄޙ 22 p(µk,
⇤k) = N(µk |m, ( ⇤k) 1)W(⇤k |⌫, W) <latexit sha1_base64="aOn36GYoxZm7YUylHACxQNQSirg=">AAACjHicbVHRatswFJW9rU2zrc3Wx72IhUECWWq3gWWUQtmg9GGMDpY4EHvhWpEbEUk2kjwIrr+mf7S3/c3kJKRdmguCo3PvObq6N84408bz/jrus+cv9vZrB/WXr14fHjXevB3qNFeEDkjKUzWKQVPOJB0YZjgdZYqCiDkN4vnXKh/8pkqzVP40i4xGAm4lSxgBY6lJ4z5rhQLMLE6KUOTlZN7Bm/s3azMFy7XxxYolwIvv5ZYC320kouzgVhhTA7tcfhUf/bL94BQ8ctpUVW4yf+giKNuTRtPresvAT4G/Bk20jptJ4084TUkuqDSEg9Zj38tMVIAyjHBa1sNc0wzIHG7p2EIJguqoWA6zxB8sM8VJquyRBi/Zx4oChNYLEdvKqkW9navIXblxbpJ+VDCZ5YZKsnooyTk2Ka42g6dMUWL4wgIgitleMZmBAmLs/up2CP72l5+C4WnXP+t6P3rNyy/rcdTQO/QetZCPPqFLdI1u0AAR58A5cfrOZ/fQ7bnn7sWq1HXWmmP0X7hX/wCX5cZA</latexit> p(S, µ, ⇤, ⇡|X) <latexit sha1_base64="KVwrZAHjsj+ltuAN7DvjaEBBX0I=">AAACNXicbVBNS8MwGE7n15xfVY9egkOYIKNVQY9DLx52mOg+YB0jTdMtLG1Dkgqj9k958X940oMHRbz6F0y3Irr5QsiT53ne5M3jckalsqwXo7CwuLS8Ulwtra1vbG6Z2zstGcUCkyaOWCQ6LpKE0ZA0FVWMdLggKHAZabujy0xv3xEhaRTeqjEnvQANQupTjJSm+madV5wAqaHrJzfpEXTciHlyHOjNCWJ9zjWnrq/00IyDU3j/Y+mkh32zbFWtScF5YOegDPJq9M0nx4twHJBQYYak7NoWV70ECUUxI2nJiSXhCI/QgHQ1DFFAZC+Z/DqFB5rxoB8JvUIFJ+zvjgQFMhtUO7MR5ayWkf9p3Vj5572EhjxWJMTTh/yYQRXBLELoUUGwYmMNEBZUzwrxEAmElQ66pEOwZ788D1rHVfukal2flmsXeRxFsAf2QQXY4AzUwBVogCbA4AE8gzfwbjwar8aH8Tm1Foy8Zxf8KePrGxbhrDk=</latexit> -
ΨεɾΟγϟʔτ w ΨεͱΟγϟʔτͷੵͰύϥϝʔλґଘ͋Γ w Ογϟʔτ w ର 23 p(µ, ⇤)
= N(µ|m, ( ⇤) 1)W(⇤|⌫, W) <latexit sha1_base64="3+O0nfVh5tsAITwYlkIgz5WGir8=">AAAChnicbVFbS8MwFE7rbc7b1EdfgkNwoKP1gr4IQ198EFFwTljnOE3TGUzSkqTCqP0p/inf/Dem2xDdPBDy8Z1zvnMLU8608bwvx52bX1hcqixXV1bX1jdqm1uPOskUoW2S8EQ9haApZ5K2DTOcPqWKggg57YSvV6W/80aVZol8MMOU9gQMJIsZAWOpfu0j3Q/ChEd6KOwXiOwABwLMSxjnwY2ViaBo4IsxR4Dnt8VUPH7/SRDFAbZeamBW4zk/9K3Sj07H6kzFlEryV/1O0ejX6l7TGxmeBf4E1NHE7vq1zyBKSCaoNISD1l3fS00vB2UY4bSoBpmmKZBXGNCuhRIE1b18tMYC71kmwnGi7JMGj9jfGTkIXc5tI8sW9bSvJP/zdTMTn/dyJtPMUEnGheKMY5Pg8iY4YooSw4cWAFHM9orJCyggxl6uapfgT488Cx6Pmv5x07s/qbcuJ+uooB20i/aRj85QC12jO9RGxJlzGs6Rc+xW3KZ76p6NQ11nkrON/pjb+ga5wMOs</latexit> W(⇤|⌫, W) = CW (⌫, W)|⇤|⌫ D 1 2 exp{ 1 2 Tr(W 1⇤)} <latexit sha1_base64="gqcf1/Wy5dw+bxg6dG7+mVv324o=">AAACuHicbVFdT9swFHUyNqD76sYjL1dUSCCNKmFMmyYhobGHPewBJEqR6tI5jlMsHCeynYnK5DdO2tv+zW7SPkDplSwfnXPuh6+TUknrouhfED5be/5ifWOz8/LV6zdvu+/eX9qiMlwMeKEKc5UwK5TUYuCkU+KqNILliRLD5Pa00Ye/hbGy0BduVopxzqZaZpIzh9Sk+4fmzN1wpvywhj2aFCq1sxwv+hOLpAzugerqA7S2JEPXfucYTieP05YcTdKKSteeZoZxj3Y4gO944tof1jVQk3txVyLwSM5NrdQqFwZbPCh/7Q/ielWDfaD1pNuL+lEb8BTEC9AjizibdP/StOBVLrTjilk7iqPSjT0zTnIl6g6trCgZv2VTMUKoWS7s2LeLr2EXmRSywuDRDlr2YYZnuW1mRGczvl3WGnKVNqpc9mXspS4rJzSfN8oqBa6A5hchlUZwp2YIGDcSZwV+w3BvDv+6g0uIl5/8FFwe9uOP/ej8qHfybbGODbJNdsgeiclnckJ+kDMyIDz4FIyCNBDh1/BXOA3l3BoGi5wt8ihC8x/QUtW2</latexit> lnW(⇤|⌫, W) = ⌫ D 1 2 ln|⇤| 1 2 Tr(W 1⇤) + lnCW (⌫, W) <latexit sha1_base64="WUXdLuEAYKkoC+Y6f7bXtvMLmQU=">AAACvnicbVFdaxNBFJ1dv2r8aNRHXy4GoUUTdqugIEKwPvjgQ4WmKWRjuDs7246Zj2VmVgzj/knBB/+Ns+mKbZoLwxzuPefcO3fySnDrkuRPFN+4eev2nZ27vXv3Hzzc7T96fGJ1bSibUC20Oc3RMsEVmzjuBDutDEOZCzbNl4dtffqdGcu1Onaris0lnilecooupBb935mRXqgmk+jOKQo/bWAvy7Uo7EqGK/scvAqEn5Cp+iWsaXkZWPu995CVBqkPBRjCx3DSxh800DkGxTabYaf6zz02oeUl569+mDbbxPvw4p/54eLqwBuzLfqDZJSsA66DtAMD0sXRov8rKzStJVOOCrR2liaVm3s0jlPBml5WW1YhXeIZmwWoUDI79+v1N/A8ZAootQlHOVhnLys8Stu+JDDbEe1mrU1uq81qV76de66q2jFFLxqVtQCnof1LKLhh1IlVAEgND7MCPcewXRd+vBeWkG4++To4ORilr0bJl9eD8YduHTvkKXlG9khK3pAx+USOyITQ6F2E0bdoGY/jMpaxvqDGUad5Qq5E/OMvwaXYng==</latexit> -
Α͘ग़ͯ͘Δରࣜ w ଟ࣍ݩΨε w Ογϟʔτ 24 lnW(⇤|⌫, W) = ⌫
D 1 2 ln|⇤| 1 2 Tr(W 1⇤) + lnCW (⌫, W) <latexit sha1_base64="WUXdLuEAYKkoC+Y6f7bXtvMLmQU=">AAACvnicbVFdaxNBFJ1dv2r8aNRHXy4GoUUTdqugIEKwPvjgQ4WmKWRjuDs7246Zj2VmVgzj/knBB/+Ns+mKbZoLwxzuPefcO3fySnDrkuRPFN+4eev2nZ27vXv3Hzzc7T96fGJ1bSibUC20Oc3RMsEVmzjuBDutDEOZCzbNl4dtffqdGcu1Onaris0lnilecooupBb935mRXqgmk+jOKQo/bWAvy7Uo7EqGK/scvAqEn5Cp+iWsaXkZWPu995CVBqkPBRjCx3DSxh800DkGxTabYaf6zz02oeUl569+mDbbxPvw4p/54eLqwBuzLfqDZJSsA66DtAMD0sXRov8rKzStJVOOCrR2liaVm3s0jlPBml5WW1YhXeIZmwWoUDI79+v1N/A8ZAootQlHOVhnLys8Stu+JDDbEe1mrU1uq81qV76de66q2jFFLxqVtQCnof1LKLhh1IlVAEgND7MCPcewXRd+vBeWkG4++To4ORilr0bJl9eD8YduHTvkKXlG9khK3pAx+USOyITQ6F2E0bdoGY/jMpaxvqDGUad5Qq5E/OMvwaXYng==</latexit> lnN(x|µ, ⇤) = { 1 2 (x µ)T⇤(x µ) ln|⇤| + Dln2⇡} <latexit sha1_base64="p4xtHdep4ri4CTik/E7TDgwJQ7w=">AAACu3icfVFNbxMxEPUuUEpK20CPXEZElVpBot2ARC+VqsKBA0JFatpKcVp5vd7E1PaubC8icvwnufFv8KZ7aJOKkSw/v3nz4ZmsEtzYJPkbxU+ePtt4vvmis/Vye2e3++r1hSlrTdmIlqLUVxkxTHDFRpZbwa4qzYjMBLvMbj83/stfTBteqnM7r9hEkqniBafEBuqm+wdr6YTyWBI7o0S47/5gibPC/fawAJyVIjdzGS4s6/cP3t9CnZwcwnEHuz7gQhPqUu+GHu7n6K/kOLw+hzb0/zrot80t1osu4B1gbt0XD60IhrjigH3npttLBsnSYB2kLeih1s6aIeQlrSVTlgpizDhNKjtxRFtOBfMdXBtWEXpLpmwcoCKSmYlbzt7DfmByKEodjrKwZO9HOCJN03lQNl81q76GfMw3rm1xNHFcVbVlit4VKmoBtoRmkZBzzagV8wAI1Tz0CnRGwgpsWHczhHT1y+vgYjhIPwySHx97J6ftODbRG/QWHaAUfUIn6Cs6QyNEo6PoOppGs/g4pvHPWNxJ46iN2UMPLK7/AZfb2UM=</latexit> -
جຊతͳํ w αϯϓϦϯάͱۙࣅͷͲͪΒͷख๏ʹ͓͍ͯɼ જࡏมͱύϥϝʔλ͚ͯߦ͏ w ྫ ΪϒεαϯϓϦϯάͷ߹ 25 S ⇠
p(S|X, , ⇡) <latexit sha1_base64="vIlmRB4iCj6Om2YPliWrWshNaO4=">AAACN3icbVBNS8NAEN3Ur1q/oh69LBahgpREBT0WvXiSivYDmlA2m027dDcJuxuhxP4rL/4Nb3rxoIhX/4GbNoJtHVj2zZsZZt7zYkalsqwXo7CwuLS8Ulwtra1vbG6Z2ztNGSUCkwaOWCTaHpKE0ZA0FFWMtGNBEPcYaXmDy6zeuidC0ii8U8OYuBz1QhpQjJSmuua1w5Hqe0F6O4KOpBzGlT/MA/xN2qMj6HgR8+WQ689heoWPprmYHnbNslW1xgHngZ2DMsij3jWfHT/CCSehwgxJ2bGtWLkpEopiRkYlJ5EkRniAeqSjYYg4kW461j2CB5rxYRAJ/UIFx+zfiRRxmd2mOzMZcraWkf/VOokKzt2UhnGiSIgni4KEQRXBzEToU0GwYkMNEBZU3wpxHwmElba6pE2wZyXPg+Zx1T6pWjen5dpFbkcR7IF9UAE2OAM1cAXqoAEweASv4B18GE/Gm/FpfE1aC0Y+swumwvj+AdSJrRs=</latexit> µ, ⇤, ⇡ ⇠ p(µ, ⇤, ⇡|X, S) <latexit sha1_base64="rNMMi1irwxkx080dBMGuZj8UnK8=">AAACb3icnVHLSgMxFM2Mr1pftS5cVCRYhBZKmVFBl0U3LlxUtA/olJLJZNrQZGZIMkIZZ+sHuvMf3PgHZtoitnXlhZCTc++5uTlxI0alsqwPw1xb39jcym3nd3b39g8Kh8W2DGOBSQuHLBRdF0nCaEBaiipGupEgiLuMdNzxXZbvvBAhaRg8q0lE+hwNA+pTjJSmBoU3xw2ZJydcbw6Pa/D3+UH38dAiF1HoSMphVPmH8hU6HKmR6yfdtPaDn9LqoFC26tY04Cqw56AM5tEcFN4dL8QxJ4HCDEnZs61I9RMkFMWMpHknliRCeIyGpKdhgDiR/WTqVwrPNeNBPxR6BQpO2d+KBHGZDa0rsxHlci4j/8r1YuXf9BMaRLEiAZ5d5McMqhBm5kOPCoIVm2iAsKB6VohHSCCs9BfltQn28pNXQfuibl/WrcercuN2bkcOlMAZqAAbXIMGuAdN0AIYfBpFo2ScGF/msXlqwlmpacw1R2AhzOo3S0a9lw==</latexit> -
ํ w જࡏมͱύϥϝʔλΛ͚ͯαϯϓϦϯά 27 S ⇠ p(S|X, , ⇡) <latexit
sha1_base64="vIlmRB4iCj6Om2YPliWrWshNaO4=">AAACN3icbVBNS8NAEN3Ur1q/oh69LBahgpREBT0WvXiSivYDmlA2m027dDcJuxuhxP4rL/4Nb3rxoIhX/4GbNoJtHVj2zZsZZt7zYkalsqwXo7CwuLS8Ulwtra1vbG6Z2ztNGSUCkwaOWCTaHpKE0ZA0FFWMtGNBEPcYaXmDy6zeuidC0ii8U8OYuBz1QhpQjJSmuua1w5Hqe0F6O4KOpBzGlT/MA/xN2qMj6HgR8+WQ689heoWPprmYHnbNslW1xgHngZ2DMsij3jWfHT/CCSehwgxJ2bGtWLkpEopiRkYlJ5EkRniAeqSjYYg4kW461j2CB5rxYRAJ/UIFx+zfiRRxmd2mOzMZcraWkf/VOokKzt2UhnGiSIgni4KEQRXBzEToU0GwYkMNEBZU3wpxHwmElba6pE2wZyXPg+Zx1T6pWjen5dpFbkcR7IF9UAE2OAM1cAXqoAEweASv4B18GE/Gm/FpfE1aC0Y+swumwvj+AdSJrRs=</latexit> µ, ⇤, ⇡ ⇠ p(µ, ⇤, ⇡|X, S) <latexit sha1_base64="rNMMi1irwxkx080dBMGuZj8UnK8=">AAACb3icnVHLSgMxFM2Mr1pftS5cVCRYhBZKmVFBl0U3LlxUtA/olJLJZNrQZGZIMkIZZ+sHuvMf3PgHZtoitnXlhZCTc++5uTlxI0alsqwPw1xb39jcym3nd3b39g8Kh8W2DGOBSQuHLBRdF0nCaEBaiipGupEgiLuMdNzxXZbvvBAhaRg8q0lE+hwNA+pTjJSmBoU3xw2ZJydcbw6Pa/D3+UH38dAiF1HoSMphVPmH8hU6HKmR6yfdtPaDn9LqoFC26tY04Cqw56AM5tEcFN4dL8QxJ4HCDEnZs61I9RMkFMWMpHknliRCeIyGpKdhgDiR/WTqVwrPNeNBPxR6BQpO2d+KBHGZDa0rsxHlci4j/8r1YuXf9BMaRLEiAZ5d5McMqhBm5kOPCoIVm2iAsKB6VohHSCCs9BfltQn28pNXQfuibl/WrcercuN2bkcOlMAZqAAbXIMGuAdN0AIYfBpFo2ScGF/msXlqwlmpacw1R2AhzOo3S0a9lw==</latexit> w જࡏมΛαϯϓϦϯά w Ж ϽͱК͕ಠཱʹͳΔ w ЖͱϽΛαϯϓϦϯά w КΛαϯϓϦϯά -
Ϋϥελม4ͷΈαϯϓϦϯά w ύϥϝʔλ Ж Ͻ К ͢Ͱʹαϯϓϧ͞Ε͍ͯΔͱԾ ఆʢఆʣͱԾఆͯ͠ɼ4ʹؔ͢Δ͜͏ͷΈʹண 28 S
⇠ p(S|X, µ, ⇤, ⇡) / p(X, S, µ, ⇤, S, ⇡) / p(X|S, µ, ⇤)p(S|⇡) = N Y n=1 p(xn |sn, µ, ⇤)p(sn |⇡) <latexit sha1_base64="kV9CtaF7EdC7oBXS1szMIyG1eaw=">AAADkniclVJbb9MwFHYTYKNc1gFvvFhUoE1CVQJDIKTB2F54mNAQdKtUl8hxnM2ab7IdRBXyf/g9vPFv5mQBpesmjSNZ+c53Lt+xc1LNmXVR9KcXhDdu3lpZvd2/c/fe/bXB+oNDqwpD6JgorswkxZZyJunYMcfpRBuKRcrpUXq6V8ePvlNjmZJf3VzTmcDHkuWMYOepZL33CwnsTtK8/FJBZJmAeqPD/IR/nUn1HKJU8czOhf8gUSz6+14zw4ucZpv9ZxBpo7RTncZNr38i1+x7Rb7XgAhdIdOZ/3o6m0vXv0xquxHLklJux9W38lPVqfpRJbIja737v8K2bbEonQyG0ShqDC6DuAVD0NpBMviNMkUKQaUjHFs7jSPtZiU2jhFOqz4qLNWYnOJjOvVQYkHtrGxWqoJPPZPBXBl/pIMN260osbD1bD6zntpejNXkZbFp4fI3s5JJXTgqyblQXnDo/1y9nzBjhhLH5x5gYpifFZITbDBxfov7/hHii1deBocvRvHLUfR5a7iz2z7HKngMnoANEIPXYAd8BAdgDEiwFrwK3gXvw0fh2/BDuHeeGvTamodgwcL9MzRzJsA=</latexit> -
ύϥϝʔλͷαϯϓϦϯά w જࡏม4͢Ͱʹαϯϓϧ͞Ε͍ͯΔͱԾఆʢఆʣͱ͠ ͯɼύϥϝʔλ Ж Ͻ К ͷಉ࣌ࣄޙΛܭࢉ w ЖͱϽଟ࣍ݩΨεͷ߹ಠཱʹͳΒͳ͍ͷͰɼ
ЖͱϽͷࣄޙͱɼКͷࣄޙΛผʑʹٻΊͯɼαϯ ϓϦϯά͢Δ 32 p(µ, ⇤, ⇡|X, S) / p(X, S, µ, ⇤, ⇡) / p(X|S, µ, ⇤)p(S|⇡)p(µ, ⇤)p(⇡) <latexit sha1_base64="G58/eK0Edhpmo+Az9MiOpldYL2w=">AAADM3icjVLLSsNAFJ3Ed31VXboZLEoLUhIVdCm6UXChaGuhKWUymejgJDPMTIQS+09u/BEXgrhQxK3/4KQt0odCL4ScnHvPuXduxheMKu04r5Y9MTk1PTM7l5tfWFxazq+sVhVPJCYVzBmXNR8pwmhMKppqRmpCEhT5jFz7d8dZ/vqeSEV5fKVbgjQidBPTkGKkDdVcsU5F0fM5C1QrMi8vSrZh//eZsQrQICcofIBehPStH6a19vYvvmyXclvQE5ILzaEx/rNm0Gy8hiXoef9Y980ynnepT37ZkQ+1Gmcjw1VG18wXnLLTCTgK3B4ogF6cN/PPXsBxEpFYY4aUqruO0I0USU0xI+2clygiEL5DN6RuYIwiohpp55+34aZhAhhyaZ5Yww7br0hRpLLZTGV2VjWcy8i/cvVEhweNlMYi0STG3UZhwqBZe3aBYEAlwZq1DEBYUjMrxLdIIqzNNcuZJbjDRx4F1Z2yu1t2LvYKh0e9dcyCdbABisAF++AQnIBzUAHYerRerHfrw36y3+xP+6tbals9zRoYCPv7BzdXCVY=</latexit> 4ͷ؍ଌʹΑΓಠཱʹͳͬͨ -
Ж Ͻ Кͷࣄޙ w ֤ύϥϝʔλʹؔͷ͋Δ߲͚ͩʹ w ЖͱϽͷࣄޙ w Кͷࣄޙ 33
p(µ, ⇤|X, S) / p(X|S, µ, ⇤)p(µ, ⇤) <latexit sha1_base64="z80pCzN5bgYxvRBSswodjSXPdJA=">AAAClHicjVFLSwMxEM6ur1pfrYIXL8EiWChlV4V68FAtggcRRfuAbinZbFZDs5uQZIWy7i/y33jz35hti7TqwYGQLzPfTGa+8QWjSjvOp2UvLa+srhXWixubW9s7pfJuR/FEYtLGnHHZ85EijMakralmpCckQZHPSNcftfJ495VIRXn8pMeCDCL0HNOQYqSNa1h6F8eez1mgxpG5vCipwfn3rakUIPgGvQjpFz9Me1ntGz9m1aInJBeaQ1PmmzFHf8wW6/1dvwr/00V1WKo4dWdi8DdwZ6ACZnY/LH14AcdJRGKNGVKq7zpCD1IkNcWMZEUvUUQgPELPpG9gjCKiBulE1AweGU8AQy7NiTWceOczUhSpvD/DzIdVP2O5869YP9Hh+SClsUg0ifH0ozBh0KiYbwgGVBKs2dgAhCU1vUL8giTC2uyxaERwf478G3RO6u5p3Xk4qzSvZnIUwAE4BMfABQ3QBDfgHrQBtspWw2pal/a+fWG37Osp1bZmOXtgwey7L6BoylY=</latexit> p(µ, ⇤, ⇡|X, S) / p(X, S, µ, ⇤, ⇡) / p(X|S, µ, ⇤)p(S|⇡)p(µ, ⇤)p(⇡) <latexit sha1_base64="G58/eK0Edhpmo+Az9MiOpldYL2w=">AAADM3icjVLLSsNAFJ3Ed31VXboZLEoLUhIVdCm6UXChaGuhKWUymejgJDPMTIQS+09u/BEXgrhQxK3/4KQt0odCL4ScnHvPuXduxheMKu04r5Y9MTk1PTM7l5tfWFxazq+sVhVPJCYVzBmXNR8pwmhMKppqRmpCEhT5jFz7d8dZ/vqeSEV5fKVbgjQidBPTkGKkDdVcsU5F0fM5C1QrMi8vSrZh//eZsQrQICcofIBehPStH6a19vYvvmyXclvQE5ILzaEx/rNm0Gy8hiXoef9Y980ynnepT37ZkQ+1Gmcjw1VG18wXnLLTCTgK3B4ogF6cN/PPXsBxEpFYY4aUqruO0I0USU0xI+2clygiEL5DN6RuYIwiohpp55+34aZhAhhyaZ5Yww7br0hRpLLZTGV2VjWcy8i/cvVEhweNlMYi0STG3UZhwqBZe3aBYEAlwZq1DEBYUjMrxLdIIqzNNcuZJbjDRx4F1Z2yu1t2LvYKh0e9dcyCdbABisAF++AQnIBzUAHYerRerHfrw36y3+xP+6tbals9zRoYCPv7BzdXCVY=</latexit> p(⇡|X, S) / p(S|⇡)p(⇡) <latexit sha1_base64="j5W9LmEl/qzvLBW6h4wvNMsLplQ=">AAACTHicbVDLSgMxFM3UV62vUZdugkVoQcqMCrosunFZ0T6gM5RMmmlDM5OQZIQy9gPduHDnV7hxoYhgpi3Ftl4IOZxzT3LvCQSjSjvOm5VbWV1b38hvFra2d3b37P2DhuKJxKSOOeOyFSBFGI1JXVPNSEtIgqKAkWYwuMn05iORivL4QQ8F8SPUi2lIMdKG6thYlLyAs64aRubyBIVP0IuQ7gdh2hqdzvD9qFzwhORCc2gsMzZrn/OX4eKL5Y5ddCrOuOAycKegCKZV69ivXpfjJCKxxgwp1XYdof0USU0xI6OClygiEB6gHmkbGKOIKD8dhzGCJ4bpwpBLc2INx+xfR4oilc1mOrMt1KKWkf9p7USHV35KY5FoEuPJR2HCoEkkSxZ2qSRYs6EBCEtqZoW4jyTC2uRfMCG4iysvg8ZZxT2vOHcXxer1NI48OALHoARccAmq4BbUQB1g8AzewSf4sl6sD+vb+pm05qyp5xDMVW79Fxk3tIU=</latexit> -
ЖͱϽͷࣄޙ w 4͕ఆͰ͋Δ͜ͱʹҙ͢Εɼ୯ͳΔଟ࣍ݩΨε ͷࣄޙͱಉͱΈͳͤΔ 34 p(µ, ⇤|X, S) / p(X|S,
µ, ⇤)p(µ, ⇤) <latexit sha1_base64="z80pCzN5bgYxvRBSswodjSXPdJA=">AAAClHicjVFLSwMxEM6ur1pfrYIXL8EiWChlV4V68FAtggcRRfuAbinZbFZDs5uQZIWy7i/y33jz35hti7TqwYGQLzPfTGa+8QWjSjvOp2UvLa+srhXWixubW9s7pfJuR/FEYtLGnHHZ85EijMakralmpCckQZHPSNcftfJ495VIRXn8pMeCDCL0HNOQYqSNa1h6F8eez1mgxpG5vCipwfn3rakUIPgGvQjpFz9Me1ntGz9m1aInJBeaQ1PmmzFHf8wW6/1dvwr/00V1WKo4dWdi8DdwZ6ACZnY/LH14AcdJRGKNGVKq7zpCD1IkNcWMZEUvUUQgPELPpG9gjCKiBulE1AweGU8AQy7NiTWceOczUhSpvD/DzIdVP2O5869YP9Hh+SClsUg0ifH0ozBh0KiYbwgGVBKs2dgAhCU1vUL8giTC2uyxaERwf478G3RO6u5p3Xk4qzSvZnIUwAE4BMfABQ3QBDfgHrQBtspWw2pal/a+fWG37Osp1bZmOXtgwey7L6BoylY=</latexit> ଟ࣍ݩΨε ʢ༧ଌʣ ΨεɾΟγϟʔτ ʢࣄલʣ -
ЖͱϽͷࣄޙͷܭࢉ w ରΛͱͬͯܭࢉ͠Α͏ʂ 35 lnN(x|µ, ⇤) = { 1 2
(x µ)T⇤(x µ) ln|⇤| + Dln2⇡} <latexit sha1_base64="Wn5waYNRFQtc4OROuSwy0TFzJjw=">AAACqHicfVHbahsxENVub4l7c9rHvAwxgaStza5bSF8KoclDoaG4YMcplmu0sjYRkbSLpC01sr4t/9C3/k20zpbmUjogOHNmDjNzlJWCG5skv6P43v0HDx+trbceP3n67Hl748WxKSpN2YgWotAnGTFMcMVGllvBTkrNiMwEG2fnB3V9/INpwws1tIuSTSU5VTznlNhAzdoXWEsnlMeS2DNKhPvid1Y4y91PD0v4k2BZ+Td/s6MwYk78LnxoYdcFnGtCXepd38N1ffeGfvf7EBrl/7qg2yy1bJqX8Bowt+7QQ1OBPi45YN+atTtJL1kF3AVpAzqoicGs/QvPC1pJpiwVxJhJmpR26oi2nArmW7gyrCT0nJyySYCKSGambmW0h+3AzCEvdHjKwoq9rnBEGrOQWeisDzK3azX5r9qksvn7qeOqrCxT9GpQXgmwBdS/BnOuGbViEQChmoddgZ6R4LkNf1ubkN4++S447vfSt73k67vO/sfGjjW0ibbQDkrRHtpHn9AAjRCNtqPP0TAaxa/iQTyOv121xlGjeYluRJxdAj120L4=</latexit> -
Α͘ग़ͯ͘Δରࣜ w ଟ࣍ݩΨε w Ογϟʔτ 37 lnW(⇤|⌫, W) = ⌫
D 1 2 ln|⇤| 1 2 Tr(W 1⇤) + lnCW (⌫, W) <latexit sha1_base64="WUXdLuEAYKkoC+Y6f7bXtvMLmQU=">AAACvnicbVFdaxNBFJ1dv2r8aNRHXy4GoUUTdqugIEKwPvjgQ4WmKWRjuDs7246Zj2VmVgzj/knBB/+Ns+mKbZoLwxzuPefcO3fySnDrkuRPFN+4eev2nZ27vXv3Hzzc7T96fGJ1bSibUC20Oc3RMsEVmzjuBDutDEOZCzbNl4dtffqdGcu1Onaris0lnilecooupBb935mRXqgmk+jOKQo/bWAvy7Uo7EqGK/scvAqEn5Cp+iWsaXkZWPu995CVBqkPBRjCx3DSxh800DkGxTabYaf6zz02oeUl569+mDbbxPvw4p/54eLqwBuzLfqDZJSsA66DtAMD0sXRov8rKzStJVOOCrR2liaVm3s0jlPBml5WW1YhXeIZmwWoUDI79+v1N/A8ZAootQlHOVhnLys8Stu+JDDbEe1mrU1uq81qV76de66q2jFFLxqVtQCnof1LKLhh1IlVAEgND7MCPcewXRd+vBeWkG4++To4ORilr0bJl9eD8YduHTvkKXlG9khK3pAx+USOyITQ6F2E0bdoGY/jMpaxvqDGUad5Qq5E/OMvwaXYng==</latexit> lnN(x|µ, ⇤) = { 1 2 (x µ)T⇤(x µ) ln|⇤| + Dln2⇡} <latexit sha1_base64="p4xtHdep4ri4CTik/E7TDgwJQ7w=">AAACu3icfVFNbxMxEPUuUEpK20CPXEZElVpBot2ARC+VqsKBA0JFatpKcVp5vd7E1PaubC8icvwnufFv8KZ7aJOKkSw/v3nz4ZmsEtzYJPkbxU+ePtt4vvmis/Vye2e3++r1hSlrTdmIlqLUVxkxTHDFRpZbwa4qzYjMBLvMbj83/stfTBteqnM7r9hEkqniBafEBuqm+wdr6YTyWBI7o0S47/5gibPC/fawAJyVIjdzGS4s6/cP3t9CnZwcwnEHuz7gQhPqUu+GHu7n6K/kOLw+hzb0/zrot80t1osu4B1gbt0XD60IhrjigH3npttLBsnSYB2kLeih1s6aIeQlrSVTlgpizDhNKjtxRFtOBfMdXBtWEXpLpmwcoCKSmYlbzt7DfmByKEodjrKwZO9HOCJN03lQNl81q76GfMw3rm1xNHFcVbVlit4VKmoBtoRmkZBzzagV8wAI1Tz0CnRGwgpsWHczhHT1y+vgYjhIPwySHx97J6ftODbRG/QWHaAUfUIn6Cs6QyNEo6PoOppGs/g4pvHPWNxJ46iN2UMPLK7/AZfb2UM=</latexit> -
Ͻͷࣄޙ w ٻΊͨЖͷࣄޙΛར༻ͯ͠ɼϽͷࣄޙΛٻΊΔ w ϕΠζͷఆཧΑΓ w ͖݅֬ͷఆٛΑΓ w ࿈ཱํఔࣜతʹͱ͘ͱ 41
ΨεɾΟγϟʔτ ͷಉ࣌ࣄલ ଟ࣍ݩΨεͷ ؍ଌ ٻΊ͍ͨϽ ͷࣄޙ Жͷࣄޙ ʢ͖ͬ͞ٻΊͨʣ -
w ରͷܭࢉ݁Ռ w ࣄલͷର Ͻͷࣄޙͷܭࢉ 44 lnW(⇤|⌫, W) = ⌫
D 1 2 ln|⇤| 1 2 Tr(W 1⇤) + lnCW (⌫, W) <latexit sha1_base64="WUXdLuEAYKkoC+Y6f7bXtvMLmQU=">AAACvnicbVFdaxNBFJ1dv2r8aNRHXy4GoUUTdqugIEKwPvjgQ4WmKWRjuDs7246Zj2VmVgzj/knBB/+Ns+mKbZoLwxzuPefcO3fySnDrkuRPFN+4eev2nZ27vXv3Hzzc7T96fGJ1bSibUC20Oc3RMsEVmzjuBDutDEOZCzbNl4dtffqdGcu1Onaris0lnilecooupBb935mRXqgmk+jOKQo/bWAvy7Uo7EqGK/scvAqEn5Cp+iWsaXkZWPu995CVBqkPBRjCx3DSxh800DkGxTabYaf6zz02oeUl569+mDbbxPvw4p/54eLqwBuzLfqDZJSsA66DtAMD0sXRov8rKzStJVOOCrR2liaVm3s0jlPBml5WW1YhXeIZmwWoUDI79+v1N/A8ZAootQlHOVhnLys8Stu+JDDbEe1mrU1uq81qV76de66q2jFFLxqVtQCnof1LKLhh1IlVAEgND7MCPcewXRd+vBeWkG4++To4ORilr0bJl9eD8YduHTvkKXlG9khK3pAx+USOyITQ6F2E0bdoGY/jMpaxvqDGUad5Qq5E/OMvwaXYng==</latexit> -
Ж Ͻ Кͷࣄޙ w ֤ύϥϝʔλʹؔͷ͋Δ߲͚ͩʹ w ЖͱϽͷࣄޙ w Кͷࣄޙ 46
p(µ, ⇤|X, S) / p(X|S, µ, ⇤)p(µ, ⇤) <latexit sha1_base64="z80pCzN5bgYxvRBSswodjSXPdJA=">AAAClHicjVFLSwMxEM6ur1pfrYIXL8EiWChlV4V68FAtggcRRfuAbinZbFZDs5uQZIWy7i/y33jz35hti7TqwYGQLzPfTGa+8QWjSjvOp2UvLa+srhXWixubW9s7pfJuR/FEYtLGnHHZ85EijMakralmpCckQZHPSNcftfJ495VIRXn8pMeCDCL0HNOQYqSNa1h6F8eez1mgxpG5vCipwfn3rakUIPgGvQjpFz9Me1ntGz9m1aInJBeaQ1PmmzFHf8wW6/1dvwr/00V1WKo4dWdi8DdwZ6ACZnY/LH14AcdJRGKNGVKq7zpCD1IkNcWMZEUvUUQgPELPpG9gjCKiBulE1AweGU8AQy7NiTWceOczUhSpvD/DzIdVP2O5869YP9Hh+SClsUg0ifH0ozBh0KiYbwgGVBKs2dgAhCU1vUL8giTC2uyxaERwf478G3RO6u5p3Xk4qzSvZnIUwAE4BMfABQ3QBDfgHrQBtspWw2pal/a+fWG37Osp1bZmOXtgwey7L6BoylY=</latexit> p(µ, ⇤, ⇡|X, S) / p(X, S, µ, ⇤, ⇡) / p(X|S, µ, ⇤)p(S|⇡)p(µ, ⇤)p(⇡) <latexit sha1_base64="G58/eK0Edhpmo+Az9MiOpldYL2w=">AAADM3icjVLLSsNAFJ3Ed31VXboZLEoLUhIVdCm6UXChaGuhKWUymejgJDPMTIQS+09u/BEXgrhQxK3/4KQt0odCL4ScnHvPuXduxheMKu04r5Y9MTk1PTM7l5tfWFxazq+sVhVPJCYVzBmXNR8pwmhMKppqRmpCEhT5jFz7d8dZ/vqeSEV5fKVbgjQidBPTkGKkDdVcsU5F0fM5C1QrMi8vSrZh//eZsQrQICcofIBehPStH6a19vYvvmyXclvQE5ILzaEx/rNm0Gy8hiXoef9Y980ynnepT37ZkQ+1Gmcjw1VG18wXnLLTCTgK3B4ogF6cN/PPXsBxEpFYY4aUqruO0I0USU0xI+2clygiEL5DN6RuYIwiohpp55+34aZhAhhyaZ5Yww7br0hRpLLZTGV2VjWcy8i/cvVEhweNlMYi0STG3UZhwqBZe3aBYEAlwZq1DEBYUjMrxLdIIqzNNcuZJbjDRx4F1Z2yu1t2LvYKh0e9dcyCdbABisAF++AQnIBzUAHYerRerHfrw36y3+xP+6tbals9zRoYCPv7BzdXCVY=</latexit> p(⇡|X, S) / p(S|⇡)p(⇡) <latexit sha1_base64="j5W9LmEl/qzvLBW6h4wvNMsLplQ=">AAACTHicbVDLSgMxFM3UV62vUZdugkVoQcqMCrosunFZ0T6gM5RMmmlDM5OQZIQy9gPduHDnV7hxoYhgpi3Ftl4IOZxzT3LvCQSjSjvOm5VbWV1b38hvFra2d3b37P2DhuKJxKSOOeOyFSBFGI1JXVPNSEtIgqKAkWYwuMn05iORivL4QQ8F8SPUi2lIMdKG6thYlLyAs64aRubyBIVP0IuQ7gdh2hqdzvD9qFzwhORCc2gsMzZrn/OX4eKL5Y5ddCrOuOAycKegCKZV69ivXpfjJCKxxgwp1XYdof0USU0xI6OClygiEB6gHmkbGKOIKD8dhzGCJ4bpwpBLc2INx+xfR4oilc1mOrMt1KKWkf9p7USHV35KY5FoEuPJR2HCoEkkSxZ2qSRYs6EBCEtqZoW4jyTC2uRfMCG4iysvg8ZZxT2vOHcXxer1NI48OALHoARccAmq4BbUQB1g8AzewSf4sl6sD+vb+pm05qyp5xDMVW79Fxk3tIU=</latexit> -
Кͷࣄޙ w ࠞ߹ൺКͷࣄޙɼ؍ଌͱಠཱ w ϙΞιϯࠞ߹Ϟσϧͷ࣌ͱಉ͡Ͱ͋ΔͨΊɼ݁Ռ͚ͩ 47 p(⇡|X, S) / p(S|⇡)p(⇡)
<latexit sha1_base64="j5W9LmEl/qzvLBW6h4wvNMsLplQ=">AAACTHicbVDLSgMxFM3UV62vUZdugkVoQcqMCrosunFZ0T6gM5RMmmlDM5OQZIQy9gPduHDnV7hxoYhgpi3Ftl4IOZxzT3LvCQSjSjvOm5VbWV1b38hvFra2d3b37P2DhuKJxKSOOeOyFSBFGI1JXVPNSEtIgqKAkWYwuMn05iORivL4QQ8F8SPUi2lIMdKG6thYlLyAs64aRubyBIVP0IuQ7gdh2hqdzvD9qFzwhORCc2gsMzZrn/OX4eKL5Y5ddCrOuOAycKegCKZV69ivXpfjJCKxxgwp1XYdof0USU0xI6OClygiEB6gHmkbGKOIKD8dhzGCJ4bpwpBLc2INx+xfR4oilc1mOrMt1KKWkf9p7USHV35KY5FoEuPJR2HCoEkkSxZ2qSRYs6EBCEtqZoW4jyTC2uRfMCG4iysvg8ZZxT2vOHcXxer1NI48OALHoARccAmq4BbUQB1g8AzewSf4sl6sD+vb+pm05qyp5xDMVW79Fxk3tIU=</latexit> -
-FU`TΪϒεαϯϓϦϯά w ٻΊͨࣄޙ w ύϥϝʔλ͕αϯϓϧ͞Ε͍ͯΔͱԾఆͨ͠ જࡏมͷࣄޙ w જࡏม͕αϯϓϧ͞Ε͍ͯΔͱԾఆͨ͠ ύϥϝʔλͷࣄޙ w
ͲͪΒ͔Λαϯϓϧͯ͋͛͠ͳ͍ͱɼΛܾఆ͢Δ͜ͱ͕Ͱ͖ ͳ͍ w ॳظΛઃఆͯ͠ɼަޓʹαϯϓϦϯά͢Δ͜ͱͰ ྆ํͷͷਫ਼ΛߴΊ͍ͯ͘ 48 -
Ψεࠞ߹Ϟσϧʹ͓͚Δมਪ w جຊతʹΪϒεαϯϓϦϯάͷಋग़ͱྲྀΕಉ͡ w ٻΊΔۙࣅΛજࡏมͱύϥϝʔλʹ͚Δ w ύϥϝʔλΛݻఆͯ͠4ͷࣄޙΛٻΊΔ w 4Λݻఆͯ͠ύϥϝʔλͷࣄޙΛٻΊΔ w
Ж ϽͷࣄޙΛٻΊΔʢЖΛઌʹٻΊΔͭʣ w КͷࣄޙΛٻΊΔ w ۙࣅࣄޙͷܭࢉʹඞཁͳظΛٻΊΔ 52 ҧ͍ϚδͰ͜Ε͘Β͍ -
่յܕΪϒεαϯϓϦϯά w ϝϦοτ w αϯϓϧ͢Δมͷ͕গͳ͍ͷͰɼۙࣅਫ਼͕ߴ͍ w ద༻݅ w ͋ΔมͰपลԽՄೳͰ͋Δ͜ͱ w
पล͞Ε͔ͨΒαϯϓϦϯάՄೳͰ͋Δ͜ͱ 59 -
֤TOʹର͢Δࣄޙ w \T ʜ T/^aTOΛݻఆͯ͠ɼTOʹର͢ΔࣄޙΛٻΊΔ w ӈͷ߲ɼϙΞιϯࠞ߹ϞσϧͷํΛͦͷ··ར༻Մೳ w YOͷͷ߲Ψεʹґଘ͢Δ߲ͳͷͰܭࢉ͕ඞཁ w
\T ʜ T/^aTO \Y ʜ Y/^aYOʹΑͬͯಘΒΕΔࣄޙ ͱͦΕʹجͮ͘༧ଌͷੵͱ͔͚ͯ͠Δ 61 XIFSF -
9aYO 4aTOʹجͮ͘ࣄޙ w Լهͷࣄޙͷ9Λ9aOʹɼ4Λ4aOʹஔ͖͑Ε͍͍ w ಘΒΕΔࣄޙʢΪϒε4ͱಉ͡ʣ 63 p(µ, ⇤|X, S)
/ p(X|S, µ, ⇤)p(µ, ⇤) <latexit sha1_base64="z80pCzN5bgYxvRBSswodjSXPdJA=">AAAClHicjVFLSwMxEM6ur1pfrYIXL8EiWChlV4V68FAtggcRRfuAbinZbFZDs5uQZIWy7i/y33jz35hti7TqwYGQLzPfTGa+8QWjSjvOp2UvLa+srhXWixubW9s7pfJuR/FEYtLGnHHZ85EijMakralmpCckQZHPSNcftfJ495VIRXn8pMeCDCL0HNOQYqSNa1h6F8eez1mgxpG5vCipwfn3rakUIPgGvQjpFz9Me1ntGz9m1aInJBeaQ1PmmzFHf8wW6/1dvwr/00V1WKo4dWdi8DdwZ6ACZnY/LH14AcdJRGKNGVKq7zpCD1IkNcWMZEUvUUQgPELPpG9gjCKiBulE1AweGU8AQy7NiTWceOczUhSpvD/DzIdVP2O5869YP9Hh+SClsUg0ifH0ozBh0KiYbwgGVBKs2dgAhCU1vUL8giTC2uyxaERwf478G3RO6u5p3Xk4qzSvZnIUwAE4BMfABQ3QBDfgHrQBtspWw2pal/a+fWG37Osp1bZmOXtgwey7L6BoylY=</latexit> -
·ͱΊ w ϕΠζਪʹΑΔػցֶशͷΞϓϩʔνͰɼΫϥελϦ ϯάྨͷΑ͏ͳݸʑͷλεΫઃఆɼϞσϧ্ͷม ͷ݅ͷҧ͍ʹա͗ͳ͍ w ΑΓෳࡶͳσʔλΛϞσϦϯά͢ΔʹɼෳࡶͳΛԾ ఆ͢Δඞཁ͕͋ΔɽʢΫϥελຖʹΛมߋ͢Δ͜ͱʣ w ϕΠζֶशͷຊ࣭తͳ࡞ۀ
w खݩʹ͋ΔσʔλΛΑΓΑ͘දݱͰ͖ΔΑ͏ϞσϧΛ୳ٻ w ϞσϧʹԠͨ͡ޮతͳਪΞϧΰϦζϜΛద༻͢Δ 72 -
ຊʹσʔλ͔ΒΓ͍ͨ͜ͱ w σʔλ/͕େ͖͍߹ͷ༧ଌʹ΄ͱΜͲҙຯ͕ͳ͍ w ྫʣେنੈௐࠪ w ࠃຽͷΛ௫Ήͷ༰қʢେମͷ͜ͱௐͳͯ͘Θ͔Δʣ w ຊʹσʔλ͔ΒΓ͍ͨ͜ͱ w
ঁੑͷࢦࣔͷ w ྸຖͷ w ʑɼ͕݅ࡉ͔͍ͱ͜Ζʹڵຯ͕͋Γɼ͔ͭͦ͜ʹσʔλੳͷ Ձ͕͋Δ w ݁ՌతʹɼσʔλΛੳͯ͠ݟΛಘ͍ͨ߹ͷ΄ͱΜͲͰɼσʔ λेͰͳ͍ 75 -
࣍ݩͱաֶश w ػցֶशʹ͓͚ΔॏཁͳΞϓϩʔνʮར༻ՄೳͳใΛ ౷߹͢Δ͜ͱʯͰ͋Δ w ྫʣ&$αΠτͷਪનͷ߹ w Ϣʔβʔͷྸɼ৬ۀɼطࠗɼझຯɼπΠʔτʑɼଟ͘ͷ ใΛར༻ͯ͠ਪન͍ͨ͠ͱ͍͏Ϟνϕʔγϣϯ͕͋Δ w
͜ΕΒͷଟ༷ͳใΛ֬ͷΈ߹ΘͤͰɼϞσϦϯά ͢Δ͜ͱͰɼҰͭͷϞσϧʹ౷߹͢Δ͜ͱ͕Ͱ͖Δ w ߏங͞ΕͨϞσϧύϥϝʔλଟ͘࠷ਪఆͰաֶशͯ͠ ͠·͏͜ͱ͕ଟ͍ͨΊɼσʔλͷ࣍ݩ͕େ͖͍߹ʹɼ ಛʹϕΠζֶश͕ޮՌΛൃش͢Δ 76