2021.09.16 SMASH21 Summer Symposium https://sites.google.com/view/sig-macc/smash/smash21-summer-symposium
ࡾ ༔հ1,2ɺ็ ߃ݑ31. Pepabo R&D Institute, GMO Pepabo, Inc., 2. भେֶ େֶӃγεςϜใՊֶ ใೳֶઐ߈3. भେֶ େֶӃγεςϜใՊֶݚڀӃ ใೳֶ෦2021.09.16 SMASH21 Summer SymposiumSynapse: จ຺ͱ࣌ؒܦաʹԠͯ͡ਪનख๏ͷબΛ࠷దԽ͢ΔϝλਪનγεςϜ
View Slide
1. ͡Ίʹ2. ؔ࿈ݚڀ3. ఏҊख๏4. ධՁ5. ͓ΘΓʹ2࣍
1.͡Ίʹ
• ใγεςϜʹ͓͚ΔใաଟΛղܾ͢ΔɺਪનγεςϜͷಋೖ• ͳΜΒ͔ͷํࡦʢ=ਪનख๏ʣʹج͖ͮଟͷબࢶ͔Βར༻ऀ͕ڵຯΛ࣋ͭͷΛఏҊ͢ΔγεςϜ4എܠ6TFST3FDPNNFOEBUJPO.FUIPE1SPEVDUTIUUQTJDPOTDPN
• ใγεςϜʹ͓͚ΔใաଟΛղܾ͢ΔɺਪનγεςϜͷಋೖ• ͳΜΒ͔ͷํࡦʢ=ਪનख๏ʣʹج͖ͮଟͷબࢶ͔Βར༻ऀ͕ڵຯΛ࣋ͭͷΛఏҊ͢ΔγεςϜ• ଟ͘ͷਪનख๏͕ఏҊ͞Ε͍ͯΔ5എܠ6TFST3FDPNNFOEBUJPO.FUIPET1SPEVDUTIUUQTJDPOTDPN
• ใγεςϜʹ͓͚ΔใաଟΛղܾ͢ΔɺਪનγεςϜͷಋೖ• ͳΜΒ͔ͷํࡦʢ=ਪનख๏ʣʹج͖ͮଟͷબࢶ͔Βར༻ऀ͕ڵຯΛ࣋ͭͷΛఏҊ͢ΔγεςϜ• ଟ͘ͷਪનख๏͕ఏҊ͞Ε͍ͯΔ → ޮՌతͳʮਪનख๏ͷબఆʯ͕ॏཁ6എܠ6TFST#FTU3FDPNNFOEBUJPO.FUIPE1SPEVDUTIUUQTJDPOTDPN
7എܠ• ޮՌతͳਪનख๏ঢ়گ࣌ؒͷܦաʹΑͬͯҟͳΔ• ͔͠͠ͳ͕Βɺ࣮ڥͰͷܧଓతͳਪનख๏ͷධՁʹػձଛࣦ͕͏ӡ༻্ͷ՝• ใγεςϜʹ͓͚ΔใաଟΛղܾ͢ΔɺਪનγεςϜͷಋೖ• ͳΜΒ͔ͷํࡦʢ=ਪનख๏ʣʹج͖ͮଟͷબࢶ͔Βར༻ऀ͕ڵຯΛ࣋ͭͷΛఏҊ͢ΔγεςϜ• ଟ͘ͷਪનख๏͕ఏҊ͞Ε͍ͯΔ → ޮՌతͳʮਪનख๏ͷબఆʯ͕ॏཁ
• ਪનख๏ͷ༏ྼঢ়گʢ=จ຺ʣͱ࣌ؒͷܦաʹΑͬͯࠨӈ͞ΕΔ• ޮՌతͳਪનख๏Λػձଛࣦ͕ͳ͍Α͏ʹจ຺ͱ࣌ؒͷܦաʹԠ͍͚͍ͯͨ͡• จ຺ͱ࣌ؒͷܦաʹԠͯ͡ਪનख๏ͷબΛࣗಈ͔ͭܧଓతʹ࠷దԽ͢ΔϝλਪનγεςϜ• → ࠷ળͳਪનख๏ͷબΛଟόϯσΟοτͱΈͳͯ͠ղ͘8ݚڀͷతͱఏҊͷࠎࢠ
2.ؔ࿈ݚڀ
ଟόϯσΟοτ
• ʮʯͱݺΕΔෳͷީิ͔ΒಘΒΕΔใुΛ࠷େԽ͢Δ• ϓϨΠϠʔҰͷࢼߦͰ1ͭͷΛબ͠ɺใुΛಘΔ• ͦΕͧΕͷ͋Δใुʹै͍ใुΛੜ• ͨͩ͠ɺϓϨΠϠʔ͜ͷใुΛࢼߦͷ݁Ռ͔Βਪଌ͢Δඞཁ͕͋Δ11ଟόϯσΟοτ• ϓϨΠϠʔ͋Δ࣌ͷͷධՁʹج͖ͮʮ׆༻ʯͱʮ୳ࡧʯΛฒߦͯ͠ߦ͏• ͜ͷτϨʔυΦϑΛղফ͢ΔͨΊʹ༷ʑͳղ๏͕ఏҊ͞Ε͍ͯΔ
• ͝ͱͷใुৗʹಉ͡Ͱ͋Δͱ͍͏Ծఆ• → ঢ়گଐੑ͝ͱʹใु͕ҟͳΔͷͰͳ͍͔ʁ• ྫʣ͝ͱʹਓؾͷ͕ҧ͏ɺ࠷ۙɺಉ͡ΧςΰϦͷΛങͬͨ• → ࣌ؒͷܦաʹΑͬͯใु͕มԽ͢ΔͷͰͳ͍͔ʁ• ྫʣ৽͍͠χϡʔεهࣄɺҰ࣌తͳྲྀߦ12ଟόϯσΟοτͷ֦ு• ʮจ຺͖ʯ·ͨʮඇఆৗʯͳଟόϯσΟοτͱ֦ͯ͠ு͞Ε͍ͯΔ
ਪનख๏ͷબఆʹ͓͚Δ؍ͷཧ
• ਪનख๏ͷ૬ରతͳੑೳͷ༏ྼΛॿ͢ΔཁҼͷଘࡏ14ਪનख๏ͷબఆʹ͓͚Δจ຺ͷߟྀͷॏཁੑ<><USBOE .BOE3JFEM +8IFOSFDPNNFOEFSTGBJMQSFEJDUJOHSFDPNNFOEFSGBJMVSFGPSBMHPSJUINTFMFDUJPOBOEDPNCJOBUJPO 1SPDFFEJOHTPGUIFTJYUI"$.DPOGFSFODFPO3FDPNNFOEFSTZTUFNT QQr <>#SBVOIPGFS . $PEJOB 7BOE3JDDJ '4XJUDIJOHIZCSJEGPSDPMETUBSUJOHDPOUFYUBXBSFSFDPNNFOEFSTZTUFNT 1SPDFFEJOHTPGUIFUI"$.$POGFSFODFPO3FDPNNFOEFSTZTUFNT QQr <>"OEFSTPO " .BZTUSF - "OEFSTPO * .FISPUSB 3BOE-BMNBT ."MHPSJUINJDF⒎FDUTPOUIFEJWFSTJUZPGDPOTVNQUJPOPOTQPUJGZ 1SPDFFEJOHTPG5IF8FC$POGFSFODF QQr ઌߦݚڀ ֓ཁ ਪનख๏ͷબఆʹؔ͢ΔཁҼͷੳɾར༻<>ϋΠϒϦουਪનʹ͓͚Δਪનख๏ͷબఆࣦഊͷݪҼΛ୳ͬͨݚڀར༻ऀ͝ͱʹਪનख๏Λ͍͚Δ͜ͱͰੑೳ͕վળ͞ΕΔͱใࠂ͠ɼͦͷཁҼͷੳ͕ඞཁ<>ίʔϧυελʔτͷঢ়گʹݶఆͨ͠ϋΠϒϦουਪનͷݚڀਪનख๏ͷબʹӨڹΛٴ΅͢ཁҼͱͯ͠ɼར༻ऀɼίϯςΩετʹର͢ΔධՁͷੵ۩߹Λར༻<>ԻָετϦʔϛϯάαʔϏεʹ͓͚Δࢹௌͱਪનख๏ͷޮՌͷݚڀਪનख๏ͷબʹӨڹΛٴ΅͢ཁҼͱͯ͠ɼࢹௌͷଟ༷ੑʹணͰ͖Δ͜ͱΛࣔͨ͠
• ར༻ऀͷᅂใͷੵʹ͍ɺਪનਫ਼ͷ্͕ظͰ͖Δਪનख๏ͷଘࡏ15ਪનख๏ͷબఆʹ͓͚Δ࣌ؒͷܦաͷߟྀͷॏཁੑ༰ϕʔεͷਪનख๏Ұఆͷਫ਼ᅂใΛ༻͍Δਪનख๏ਫ਼͕ঃʑʹ্ਪનख๏ͷ༗ޮੑ͕ඇఆৗͰ͋Δ͜ͱΛલఏͱͨ͠ղ๏͕ඞཁͱͳΔ
ଟόϯσΟοτͷղ๏Λ༻͍ͨਪનख๏ͷબఆ
• ઌߦݚڀʹ͓͚Δจ຺ͱ࣌ؒͷܦաͷߟྀ17ଟόϯσΟοτͷղ๏Λ༻͍ͨਪનख๏ͷબఆઌߦݚڀ จ຺ ࣌ؒͷܦա<> º º<> <> ˚ º ͱͳΔਪનख๏͕จ຺Λѻ͏͕ਪનख๏ͷબఆʹจ຺Λߟྀ͠ͳ͍<> <> ˓ º <>ਪન࣌ͷӾཡதͷಛੑΛจ຺ͱͯ͠ར༻ʢ<>ఏࣔͳ͠ʣˎ͍ͣΕͷख๏࣌ؒͷܦաͷߟྀ͕ेͰͳ͍<>'FMDJP $; 1BJYB_P ,7 #BSDFMPT $"BOE1SFVY 1"NVMUJBSNFECBOEJUNPEFMTFMFDUJPOGPSDPMETUBSUVTFSSFDPNNFOEBUJPO 1SPDFFEJOHTPGUIFUI$POGFSFODFPO6TFS.PEFMJOH "EBQUBUJPOBOE1FSTPOBMJ[BUJPO QQr <>#SPEFO # )BNNBS . /JMTTPO #+BOE1BSBTDIBLJT %&OTFNCMFSFDPNNFOEBUJPOTWJBUIPNQTPOTBNQMJOHBOFYQFSJNFOUBMTUVEZXJUIJOFDPNNFSDF SEJOUFSOBUJPOBMDPOGFSFODFPOJOUFMMJHFOUVTFSJOUFSGBDFT QQr <>$BO_BNBSFT 3 3FEPOEP .BOE$BTUFMMT 1.VMUJBSNFESFDPNNFOEFSTZTUFNCBOEJUFOTFNCMFT 1SPDFFEJOHTPGUIFUI"$.$POGFSFODFPO3FDPNNFOEFS4ZTUFNT QQr <>4BOUBOB .3 .FMP -$ $BNBSHP ') #SBOE_BP # 4PBSFT " 0MJWFJSB 3.BOE$BFUBOP 4$POUFYUVBM.FUB#BOEJUGPS3FDPNNFOEFS4ZTUFNT4FMFDUJPO 'PVSUFFOUI"$.$POGFSFODFPO3FDPNNFOEFS4ZTUFNT QQr <>ࡾ༔հɼ็߃ݑ4ZOBQTFจ຺ʹԠͯ͡ܧଓతʹਪનख๏ͷબΛ࠷దԽ͢ΔਪનγεςϜ ిࢠใ௨৴ֶձจࢽ% 7PM /P QQr
3.ఏҊख๏
• จ຺ͱ࣌ؒͷܦաʹԠͯ͡ਪનख๏ͷબΛࣗಈ͔ͭܧଓతʹ࠷దԽ͢ΔϝλਪનγεςϜ• ػձଛࣦΛ͑ͨจ຺ͱ࣌ؒͷܦաʹԠͨ͡࠷ળͳબΛୡ͢ΔͨΊɺจ຺͖ɺ͔ͭɺඇఆৗͳଟόϯσΟοτͷղ๏Λ༻͍Δ• ਪનख๏ͷ༗ޮੑ͕ٯస͢Δঢ়گʢޙड़ʣʹରॲ͢ΔͨΊɺैདྷͷղ๏Λ֦ு͠ɺੵۃతͳ୳ࡧΛଅ͢• બͨ͠ਪનख๏ͱ͜Εʹର͢Δར༻ऀͷԠΛه͠ɺબͷܧଓతͳվળʹ༻͍Δ19ఏҊγεςϜ (Synapse)
20ఏҊγεςϜ (Synapse)
จ຺ͱ࣌ؒͷܦաΛߟྀͨ͠ଟόϯσΟοτͷղ๏
22Time-varying Thompson Sampling (TVTP) [15]Dynamic Context drift Modelingจ຺͖ɺ͔ͭɺඇఆৗͳใुͷมԽΛѻ͏ͨΊใुͷมಈΛΈࠐΜͩϞσϧ͕༻͍ΒΕΔ<>;FOH $ 8BOH 2 .PLIUBSJ 4BOE-J 50OMJOFDPOUFYUBXBSFSFDPNNFOEBUJPOXJUIUJNFWBSZJOHNVMUJBSNFECBOEJU 1SPDFFEJOHTPGUIFOE"$.4*(,%%JOUFSOBUJPOBMDPOGFSFODFPO,OPXMFEHFEJTDPWFSZBOEEBUBNJOJOH QQr <>'JH(SBQIJDBMNPEFMSFQSFTFOUBUJPOGPSCBOEJUQSPCMFNyk,t⇠ N(xTt(cwk+ ✓k ⌘k,t), 2k)AAAC13ichVG/axRBFP6y8UeMP3LGRrAJHpELhmPuFBSrkDRWklxySSSbDLOTubthf7I7d3pZlnQidlYWVgoW4h+gvY3/gEUaWxXLCDYWvt1bEA3Gt+zO975539tv5jmRpxPD2MGYNX7i5KnTE2cmz547f2GqcnF6PQn7sVRtGXphvOmIRHk6UG2jjac2o1gJ3/HUhuMu5fsbAxUnOgzWzDBS277oBrqjpTBE8UpryFN33mR2on3bF6YnhZfey2oPudkp8qSTrmU1ydMH3M2u26anjOCuHe6Gxs5hoZ6bJ33XFztN7s7xSpXVWREzR0GjBFWUsRxW3sLGLkJI9OFDIYAh7EEgoWcLDTBExG0jJS4mpIt9hQyTpO1TlaIKQaxL3y5lWyUbUJ73TAq1pL949MaknMEs+8hes0P2gb1hX9nPf/ZKix65lyGtzkirIj715PLqj/+qfFoNer9Vx3o26OB24VWT96hg8lPIkX6w9+xw9U5rNr3GXrJv5P8FO2Dv6QTB4Lt8taJaz4/x45AXujEaUOPvcRwF681640a9uXKzurBYjmoCV3AVNZrHLSzgLpbRpv7v8Amf8cW6b+1bj6zHo1JrrNRcwh9hPf0FKiWypw==ίϯςΩετ ఆৗ߲ ඇఆৗ߲ʢεέʔϧ߲ɺυϦϑτ߲ʣ؍ଌޡࠩ
23Time-varying Thompson Sampling (TVTP) [15]ঢ়ଶۭؒϞσϧใुϞσϧͷύϥϝʔλͷࣄޙͱυϦϑτ߲ͷજࡏঢ়ଶͷஞ࣍ਪఆʹཻࢠϑΟϧλͱΧϧϚϯϑΟϧλ͕༻͍ΒΕΔ<>;FOH $ 8BOH 2 .PLIUBSJ 4BOE-J 50OMJOFDPOUFYUBXBSFSFDPNNFOEBUJPOXJUIUJNFWBSZJOHNVMUJBSNFECBOEJU 1SPDFFEJOHTPGUIFOE"$.4*(,%%JOUFSOBUJPOBMDPOGFSFODFPO,OPXMFEHFEJTDPWFSZBOEEBUBNJOJOH QQr <>'JH(SBQIJDBMNPEFMSFQSFTFOUBUJPOGPSCBOEJUQSPCMFNyk,t⇠ N(xTt(cwk+ ✓k ⌘k,t), 2k)AAAC13ichVG/axRBFP6y8UeMP3LGRrAJHpELhmPuFBSrkDRWklxySSSbDLOTubthf7I7d3pZlnQidlYWVgoW4h+gvY3/gEUaWxXLCDYWvt1bEA3Gt+zO975539tv5jmRpxPD2MGYNX7i5KnTE2cmz547f2GqcnF6PQn7sVRtGXphvOmIRHk6UG2jjac2o1gJ3/HUhuMu5fsbAxUnOgzWzDBS277oBrqjpTBE8UpryFN33mR2on3bF6YnhZfey2oPudkp8qSTrmU1ydMH3M2u26anjOCuHe6Gxs5hoZ6bJ33XFztN7s7xSpXVWREzR0GjBFWUsRxW3sLGLkJI9OFDIYAh7EEgoWcLDTBExG0jJS4mpIt9hQyTpO1TlaIKQaxL3y5lWyUbUJ73TAq1pL949MaknMEs+8hes0P2gb1hX9nPf/ZKix65lyGtzkirIj715PLqj/+qfFoNer9Vx3o26OB24VWT96hg8lPIkX6w9+xw9U5rNr3GXrJv5P8FO2Dv6QTB4Lt8taJaz4/x45AXujEaUOPvcRwF681640a9uXKzurBYjmoCV3AVNZrHLSzgLpbRpv7v8Amf8cW6b+1bj6zHo1JrrNRcwh9hPf0FKiWypw==ΧϧϚϯϑΟϧλཻࢠϑΟϧλ
24Time-varying Thompson Sampling (TVTP) [15]֬Ұக๏֤ͰٻΊͨύϥϝʔλͷࣄޙʹै͍αϯϓϦϯάͨ݁͠ՌΛͷબఆʹ༻͍Δ͜ͱͰଟόϯσΟοτղ๏ͱ౷߹<>;FOH $ 8BOH 2 .PLIUBSJ 4BOE-J 50OMJOFDPOUFYUBXBSFSFDPNNFOEBUJPOXJUIUJNFWBSZJOHNVMUJBSNFECBOEJU 1SPDFFEJOHTPGUIFOE"$.4*(,%%JOUFSOBUJPOBMDPOGFSFODFPO,OPXMFEHFEJTDPWFSZBOEEBUBNJOJOH QQr <>'JH(SBQIJDBMNPEFMSFQSFTFOUBUJPOGPSCBOEJUQSPCMFNyk,t⇠ N(xTt(cwk+ ✓k ⌘k,t), 2k)AAAC13ichVG/axRBFP6y8UeMP3LGRrAJHpELhmPuFBSrkDRWklxySSSbDLOTubthf7I7d3pZlnQidlYWVgoW4h+gvY3/gEUaWxXLCDYWvt1bEA3Gt+zO975539tv5jmRpxPD2MGYNX7i5KnTE2cmz547f2GqcnF6PQn7sVRtGXphvOmIRHk6UG2jjac2o1gJ3/HUhuMu5fsbAxUnOgzWzDBS277oBrqjpTBE8UpryFN33mR2on3bF6YnhZfey2oPudkp8qSTrmU1ydMH3M2u26anjOCuHe6Gxs5hoZ6bJ33XFztN7s7xSpXVWREzR0GjBFWUsRxW3sLGLkJI9OFDIYAh7EEgoWcLDTBExG0jJS4mpIt9hQyTpO1TlaIKQaxL3y5lWyUbUJ73TAq1pL949MaknMEs+8hes0P2gb1hX9nPf/ZKix65lyGtzkirIj715PLqj/+qfFoNer9Vx3o26OB24VWT96hg8lPIkX6w9+xw9U5rNr3GXrJv5P8FO2Dv6QTB4Lt8taJaz4/x45AXujEaUOPvcRwF681640a9uXKzurBYjmoCV3AVNZrHLSzgLpbRpv7v8Amf8cW6b+1bj6zHo1JrrNRcwh9hPf0FKiWypw==a(t) = arg maxj=1,KxTt¯wk,t 1 ¯wk,t 1⇠ Nm(¯µwk, ¯⌃wk)AAADNnichVHPa9RAFH6Jv+r6o6seFLwEl8oW1mVSBUVYKAoqCNJ2u22hacNkdnY7biaJyWS3dYh/gP+AB08KHsSTJ7178R/w0Is3EfEiVPDiwZdsQGxpfSGZ9775vjff5HmRLxJFyLZhHjp85OixieOVEydPnZ6snjm7lIRpzHiHhX4Yr3g04b4IeEcJ5fOVKOZUej5f9ga38/3lIY8TEQaLaivia5L2A9ETjCqE3OpbJ+AjFkpJg652aNyXdDPTjqRqI4y0E0sLsSc56PhCCpVkFbqu62o6a5VsVz9s2Y37mbXpqvVCmPT0YuZ4NNajzNWDhrpiZ86jlHat3WAiZKFg1NcPMlfWC4IjU6SM3EHWGNdtgQeV0LRbrZEmKcLam9hlUoMy5sLqO3CgCyEwSEEChwAU5j5QSPBZBRsIRIitgUYsxkwU+xwyqKA2RRZHBkV0gN8+VqslGmCd90wKNcNTfHxjVFowRT6R12SHfCRvyDfye99euuiRe9nC1RtreeROPr3Q/vVflcRVwcZf1YGeFfTgRuFVoPeoQPJbsLF++PjZTvvmwpS+TF6S7+j/BdkmH/AGwfAnezXPF54f4MdDL/jHcED27nHsTZZmmvbV5sz8tdrsrXJUE3ARLkEd53EdZuEezEEHmHHeaBl3jLvme/Oz+cX8OqaaRqk5B/+E+eMP3kjYHA==ࣄޙ ࣄޙ
25TVTPͷ՝a(t) = arg maxj=1,KxTt¯wk,t 1 ¯wk,t 1⇠ Nm(¯µwk, ¯⌃wk)AAADNnichVHPa9RAFH6Jv+r6o6seFLwEl8oW1mVSBUVYKAoqCNJ2u22hacNkdnY7biaJyWS3dYh/gP+AB08KHsSTJ7178R/w0Is3EfEiVPDiwZdsQGxpfSGZ9775vjff5HmRLxJFyLZhHjp85OixieOVEydPnZ6snjm7lIRpzHiHhX4Yr3g04b4IeEcJ5fOVKOZUej5f9ga38/3lIY8TEQaLaivia5L2A9ETjCqE3OpbJ+AjFkpJg652aNyXdDPTjqRqI4y0E0sLsSc56PhCCpVkFbqu62o6a5VsVz9s2Y37mbXpqvVCmPT0YuZ4NNajzNWDhrpiZ86jlHat3WAiZKFg1NcPMlfWC4IjU6SM3EHWGNdtgQeV0LRbrZEmKcLam9hlUoMy5sLqO3CgCyEwSEEChwAU5j5QSPBZBRsIRIitgUYsxkwU+xwyqKA2RRZHBkV0gN8+VqslGmCd90wKNcNTfHxjVFowRT6R12SHfCRvyDfye99euuiRe9nC1RtreeROPr3Q/vVflcRVwcZf1YGeFfTgRuFVoPeoQPJbsLF++PjZTvvmwpS+TF6S7+j/BdkmH/AGwfAnezXPF54f4MdDL/jHcED27nHsTZZmmvbV5sz8tdrsrXJUE3ARLkEd53EdZuEezEEHmHHeaBl3jLvme/Oz+cX8OqaaRqk5B/+E+eMP3kjYHA==¯⌃wk=1p2pXi=12(i)k⌃(i)wk, where p is number of particlesAAAC+3ichVHLahRBFL3dvmISzUQ3gpvGIRJBhuqJkBAIBN24TDJOEkhnmuqyZlJMP4qq6smj6B/wB1y4UnHhYyt+gBt/wEXAHxCXEdy48HZPg2gw3qa7zj11z+1TdSMZC20IOXbcc+cvXLw0cXlyavrK1ZnG7LVNneWK8S7L4kxtR1TzWKS8a4SJ+bZUnCZRzLei4YNyf2vElRZZ+sgcSr6b0EEq+oJRg1TYGAURVTboiEFCi9Duh8NiJegryqxfWNlrF4HOk54MrVjxEZdlPdueF3eKcDhW9WyVVdLA8AM0Ye96+3tccU96QntpnkRceVnfk1QZwWKui7DRJC1ShXca+DVoQh1rWeMDBPAYMmCQQwIcUjCIY6Cg8dkBHwhI5HbBIqcQiWqfQwGTqM2ximMFRXaI3wFmOzWbYl721JWa4V9ifBUqPZgjn8lrckI+kbfkK/n5z1626lF6OcQ1Gmu5DGee3Oj8+K8qwdXA3m/VmZ4N9GGp8irQu6yY8hRsrB8dPT3pLG/M2dvkBfmG/p+TY/IRT5COvrNX63zj2Rl+IvSCN4YD8v8ex2mw2W75C632+r3m6v16VBNwE27BPM5jEVbhIaxBF/t/cVxnypl2C/el+8Z9Ny51nVpzHf4I9/0vB86+jg==• ࢼߦճͷ૿Ճʹ͏ਪનख๏ͷબఆͷภΓ• ͋Δ࣌ͰධՁͷ͍ਪનख๏Λ୳ࡧ͢Δػձ͕ۃʹԼ• ༗ޮੑ͕ٯస͢ΔΑ͏ͳঢ়گͷै͕ΕΔࢼߦճͷ૿Ճʹ͏ٸܹͳݮগʹΑΓ͋Δ࣌ͷධՁʹج͍ͮͨબʹݻఆ͞ΕΔ
26ఏҊํࣜ: Aggressive Exploration TVTP (AE-TVTP)a(t) = arg maxj=1,KxTt¯wk,t 1 ¯wk,t 1⇠ Nm(¯µwk, ¯⌃wk)AAADNnichVHPa9RAFH6Jv+r6o6seFLwEl8oW1mVSBUVYKAoqCNJ2u22hacNkdnY7biaJyWS3dYh/gP+AB08KHsSTJ7178R/w0Is3EfEiVPDiwZdsQGxpfSGZ9775vjff5HmRLxJFyLZhHjp85OixieOVEydPnZ6snjm7lIRpzHiHhX4Yr3g04b4IeEcJ5fOVKOZUej5f9ga38/3lIY8TEQaLaivia5L2A9ETjCqE3OpbJ+AjFkpJg652aNyXdDPTjqRqI4y0E0sLsSc56PhCCpVkFbqu62o6a5VsVz9s2Y37mbXpqvVCmPT0YuZ4NNajzNWDhrpiZ86jlHat3WAiZKFg1NcPMlfWC4IjU6SM3EHWGNdtgQeV0LRbrZEmKcLam9hlUoMy5sLqO3CgCyEwSEEChwAU5j5QSPBZBRsIRIitgUYsxkwU+xwyqKA2RRZHBkV0gN8+VqslGmCd90wKNcNTfHxjVFowRT6R12SHfCRvyDfye99euuiRe9nC1RtreeROPr3Q/vVflcRVwcZf1YGeFfTgRuFVoPeoQPJbsLF++PjZTvvmwpS+TF6S7+j/BdkmH/AGwfAnezXPF54f4MdDL/jHcED27nHsTZZmmvbV5sz8tdrsrXJUE3ARLkEd53EdZuEezEEHmHHeaBl3jLvme/Oz+cX8OqaaRqk5B/+E+eMP3kjYHA==¯⌃wk=1p2pXi=12(i)k⌃(i)wk, where p is number of particlesAAAC+3ichVHLahRBFL3dvmISzUQ3gpvGIRJBhuqJkBAIBN24TDJOEkhnmuqyZlJMP4qq6smj6B/wB1y4UnHhYyt+gBt/wEXAHxCXEdy48HZPg2gw3qa7zj11z+1TdSMZC20IOXbcc+cvXLw0cXlyavrK1ZnG7LVNneWK8S7L4kxtR1TzWKS8a4SJ+bZUnCZRzLei4YNyf2vElRZZ+sgcSr6b0EEq+oJRg1TYGAURVTboiEFCi9Duh8NiJegryqxfWNlrF4HOk54MrVjxEZdlPdueF3eKcDhW9WyVVdLA8AM0Ye96+3tccU96QntpnkRceVnfk1QZwWKui7DRJC1ShXca+DVoQh1rWeMDBPAYMmCQQwIcUjCIY6Cg8dkBHwhI5HbBIqcQiWqfQwGTqM2ximMFRXaI3wFmOzWbYl721JWa4V9ifBUqPZgjn8lrckI+kbfkK/n5z1626lF6OcQ1Gmu5DGee3Oj8+K8qwdXA3m/VmZ4N9GGp8irQu6yY8hRsrB8dPT3pLG/M2dvkBfmG/p+TY/IRT5COvrNX63zj2Rl+IvSCN4YD8v8ex2mw2W75C632+r3m6v16VBNwE27BPM5jEVbhIaxBF/t/cVxnypl2C/el+8Z9Ny51nVpzHf4I9/0vB86+jg==• ࢼߦճͷ૿Ճʹ͏ਪનख๏ͷબఆͷภΓΛղফ• ͋Δ࣌ͰධՁͷ͍ਪનख๏Λੵۃతʹ୳ࡧ͢ΔػձΛઃ͚Δ• ͷ༗༻ੑ͕ٯస͢Δڥʹ͓͍ͯɺैੑͷ্ΛਤΔཻࢠͷฏۉ ཻ֤ࢠͰͷࢉͷΈ
4.ධՁ
• ࣮ࡍͷECαΠτ͔Β࠾औͨ͠4ͭͷਪનख๏ͷΧςΰϦ͝ͱͷΫϦοΫͷਪҠ࣮σʔλΛ༻͍ͯఏҊγεςϜͷ༗ޮੑΛධՁ͢Δ• 2019/6/20ʙ8/4·Ͱͷ225ສճͷਪનσʔλ͔Βࢉग़• 4ͭͷਪનख๏ͱ18ͷΧςΰϦ͝ͱʹɺ1࣌ؒ୯ҐͰूܭ28ධՁσʔλͱਪનख๏
• બͨ͠ਪનख๏͔ΒಘΒΕΔΫϦοΫͷγϛϡϨʔγϣϯ• ਪનख๏ͷબʹɺఏҊํࣜΛؚΉଟόϯσΟοτͷղ๏Λ༻͍Δ• બͨ͠ਪનख๏࣮σʔλͷΫϦοΫΛύϥϝʔλͱ͢ΔϕϧψʔΠʹै͍ɺਪન݁Ռ͕ΫϦοΫ͞ΕΔͷͱ͢Δ• ཚΛ༻͍ͨγϛϡϨʔγϣϯΛฏۉԽ͢ΔͨΊ50ճͷγϛϡϨʔγϣϯ݁ՌͷฏۉΛ݁Ռͱͯ͠༻͍Δ• ࣮ࡍͷਪનγεςϜͷڍಈͱ߹ΘͤΔͨΊɺใु1࣌ؒ͝ͱʹ·ͱΊͯϑΟʔυόοΫ͞ΕΔͷͱ͢Δ29ධՁํ๏(1/2)
• จ຺ͱ࣌ؒͷܦաͷߟྀͷͦΕͧΕͷد༩Λ໌Β͔ʹ͢Δ4άϧʔϓͷγϛϡϨʔγϣϯΛ࣮ࢪ30ධՁํ๏(2/2)࣌ؒͷܦաº ˓จ຺º"ىटͷ࠷ળͳਪનख๏ΛશظؒҰ؏ͯ͠༻͍Δ$࣌͝ͱʹධՁͷߴ͍ਪનख๏ΛόϯσΟοτΛ༻͍ͯબఆ˓#จ຺͝ͱʹ࠷ળͳਪનख๏ΛશظؒҰ؏ͯ͠༻͍Δ%จ຺͝ͱ࣌͝ͱʹධՁͷߴ͍ਪનख๏ΛόϯσΟοτΛ༻͍ͯબఆ• จ຺ʹɺਪન࣌ʹӾཡதͷΧςΰϦΛ༻͍Δ• ଟόϯσΟοτղ๏ɺLTS(จ຺)ɺTVTP(จ຺/࣌ؒͷܦա)ɺAE-TVTP(จ຺/࣌ؒͷܦա)
• Bάϧʔϓʢจ຺ʣظट࣌ʹ͓͍ͯAάϧʔϓͱจ຺ʹΑΔࠩҟ͕΄΅ͳ͍ͨΊ݁Ռࠩҟͳ͠• Cάϧʔϓʢ࣌ؒͷܦաʣਪનख๏ͷ༗ޮੑͷมԽʹैͨ͜͠ͱͰվળ͕ݟΒΕΔ• Dάϧʔϓʢจ຺ͱ࣌ؒͷܦաʣΧςΰϦ͝ͱͷมԽʹैͨ͜͠ͱͰߋͳΔվળ͕ݟΒΕΔ31ධՁ݁Ռ: AάϧʔϓΛج४ͱͨ͠ྦྷੵใुͷࠩͷൺֱจ຺ͱ࣌ؒͷܦաͷߟྀͳΒͼʹɺٯసڥͷैੑΛߴΊͨఏҊํࣜʹΑͬͯ૿Ճจ຺ͷΈ࣌ؒͷܦաͷΈ
• Dάϧʔϓͷจ຺͝ͱͷվળ݁ՌΛੳ͢Δͱɺਪનख๏ͷ༗ޮੑͷมಈͷগͳ͍จ຺Ͱɺશͯͷղ๏ʹ͓͍ͯ୳ࡧͷίετΛճऩͰ͖͍ͯͳ͍• มಈͷେ͖͍จ຺Ͱੵۃతͳ୳ࡧʹΑΓAE-TVTP͕େ͖͘վળͨ͠ɻTVTPਪનख๏͕ݻఆ͞ΕվળʹࢸΒͳ͔ͬͨ32ධՁ݁Ռ: ਪનख๏ͷ༗ޮੑͷมಈ߹͍ͱվળ
33ߟ• ਪનख๏ͷ༗ޮੑ͕ٯస͢Δࠨྻʹ͓͍ͯఏҊख๏͕༗ޮ• ӈྻʹ͓͍ͯɺఏҊख๏ͷੵۃతͳ୳ࡧʹىҼͯ͠ɺظؒதܧଓతʹྦྷੵϦάϨοτ͕૿Ճ͢Δɻ3ׂఔͰಉ༷ͷࣄΛ֬ೝɻਪનख๏ͷ༗ޮੑʹٯస͕͋ΔΧςΰϦ ࠨͱɺͳ͍ΧςΰϦ ӈʹ͓͚ΔྦྷੵϦάϨοτͷਪҠˎྦྷੵϦάϨοτਪનख๏ͷ͏ͪ࠷େͷظͱબͨ͠ਪનख๏ͷظͷࠩΛظؒ·Ͱʹ߹ܭͨ͠ͷมԽͷͳ͍ظؒʹ͓͍ͯػձଛࣦΛݮ͢ΔదԠతͳ୳ࡧख๏ͷݚڀ
5.͓ΘΓʹ
• ଟόϯσΟοτΛ༻͍ͯɺจ຺ͱ࣌ؒͷܦաʹԠͯ͡ਪનख๏ͷબΛࣗಈత͔ͭܧଓతʹ࠷దԽ͢ΔϝλਪનγεςϜΛఏҊ͠ɺͦͷ༗ޮੑΛࣔͨ͠• จ຺ͱ࣌ؒͷܦաͷߟྀͳΒͼʹٯసڥͷैੑΛߴΊͨఏҊํࣜʹΑͬͯɺߟྀ͠ͳ͍߹ͱൺֱͯ͠ྦྷੵΫϦοΫͷ্ʹܨ͕Δ͜ͱ͕Θ͔ͬͨ• ਪનख๏ͷ༏ྼʹมԽͷͳ͍ظؒͰ݁Ռ͕ٯస͢ΔՄೳੑ͕֬ೝ͞Εͨ͜ͱͰɺػձଛࣦΛݮ͢Δղ๏͕ॏཁͰ͋Δ͜ͱࣔࠦ͞Εͨ• ࠓޙͷ՝ͱͯ͠ɺਪનख๏ͷબʹӨڹΛٴ΅͢ޮՌͷߴ͍จ຺ͷൃݟɺͳΒͼʹಛఆͷจ຺ʹ͓͍ͯධՁͷߴ͍ਪનख๏ͷཱ֬ʹΑΔจ຺͝ͱͷޮՌ্ͷ࣮ݱ͕ڍ͛ΒΕΔ35͓ΘΓʹ
monochromegane
trafficbrain
rpc
satotaichi
johannyjm
kentaitakura
schulta
matsui_528
hpprc
hsato
inoichan
mi141
marcelosomers
mraible
holman
sugarenia
skipperchong
bcantrill
gr2m
jonrohan
quramy
kastner
brad_frost
notwaldorf