AGI福岡第3回 - Speaker Deck

Slide 1

Slide 1 text

"(*෱Ԭୈճ !ΤϯδχΞΧϑΣ

Slide 2

Slide 2 text

Φʔϓχϯά

Slide 3

Slide 3 text

ʮ൚༻ਓ޻஌ೳʢ"(*ʣʯͱʮಛԽܕਓ޻஌ೳʯ ൚༻ਓ޻஌ೳʢ˺ڧ͍"*ʣ ˠώτͷ஌ೳͷΑ͏ͳ൚༻ੑΛ࣋ͭ"* FHυϥ͑΋Μɺమ࿹ΞτϜͳͲ ಛԽܕਓ޻஌ೳʢ˺ऑ͍"*ʣ ˠݶఆతͳ໰୊ղܾ΍ਪ࿦ FHνΣε΍কعͷ"*ɺը૾ೝࣝͳͲ ࠷৽ͷ--.͸ͲͪΒʁ

Slide 4

Slide 4 text

"(*ͷొ৔͸ؒۙʁ 4*56"5*0/"-"8"3&/&44 ΑΓ IUUQTTJUVBUJPOBMBXBSFOFTTBJGSPNBHJ UPTVQFSJOUFMMJHFODF

Slide 5

Slide 5 text

೥ϊʔϕϧ෺ཧֶ৆ © Johan Jarnestad/The Royal Swedish Academy of Sciences John Hop fi eld and Geoffrey Hinton. Ill. Niklas Elmehed © Nobel Prize Outreach ೥ͷϊʔϕϧ෺ཧֶ৆͸ɺ δϣϯɾ+ɾϗοϓϑΟʔϧυʢถࠃʣͱδΣϑϦʔɾ&ɾώϯτϯʢΧφμʣ͕ड৆

Slide 6

Slide 6 text

೥ϊʔϕϧ෺ཧֶ৆ • ड৆ཧ༝  → ػցֶशͱਓ޻χϡʔϥϧωοτϫʔΫͷج൫Λߏங͠ɺσʔλύλʔϯͷ هԱɾ࠶ݱΛՄೳʹͨ͠ޭ੷ɻ • ओͳۀ੷  → ϗοϓϑΟʔϧυɿεϐϯܥͷ෺ཧֶͷݪཧΛԠ༻ͨ͠ʮϗοϓϑΟʔϧυ ωοτϫʔΫʯΛ։ൃ͠ɺσʔλύλʔϯͷอଘͱ෮ݩΛ࣮ݱɻ  → ώϯτϯɿʮϘϧπϚϯϚγϯʯΛ։ൃ͠ɺσʔλ͔Βಛ௃Λֶश͢Δٕज़ Λཱ֬ɻAIͱػցֶशͷඈ༂తͳਐలʹߩݙɻ • Өڹ  → AIͱ෺ཧֶͷ༥߹ʹΑΔൃలΛଅਐ͠ɺԠ༻෼໺ͰͷՄೳੑΛେ͖֦͘େɻ

Slide 7

Slide 7 text

"(*෱Ԭͷҙٛ w "(*࣌୅ʹ޲͚ͯɺࠓ͔ΒͰ͖Δ͜ͱΛڞʹߟ͑ɺ ࣮ߦ͍ͯ͜͠͏ʂ

Slide 8

Slide 8 text

ӡӦऀ঺հ w զ࠺޾௕ʢ4"*-BCגࣜձࣾʣ w ۙ౻ݑࣇʢגࣜձࣾελσΟετʣ w େ৓৴ߊʢ/0#%"5"גࣜձࣾʣ w ੨໦྄޺ʢςΠϧ΢Πϯυגࣜձࣾʣ

Slide 9

Slide 9 text

୅දऀ঺հ զ࠺޾௕ :VLJOBHB"[VNB !ZVLZ@B[ 4"*-BCגࣜձࣾ୅දऔక໾ w "*ؔ࿈ͷڭҭɺݚڀ w ཧֶത࢜ʢ෺ཧֶʣ w ๏੓େֶσβΠϯ޻ֶ෦݉೚ߨࢣ w 6EFNZͰສਓΛࢦಋ w ༗໊اۀͰ"*ݚमΛ୲౰ w ஶॻʹʮ͸͡ΊͯͷσΟʔϓϥʔχϯάʯͳͲ w झຯ͸ϒϥδϦΞϯॊज़"*Ξʔτ

Slide 10

Slide 10 text

ϋογϡλά BHJGVLVPLB

Slide 11

Slide 11 text

"(*෱Ԭ%JTDPSEίϛϡχςΟ

Slide 12

Slide 12 text

:PV5VCFϥΠϒ ʮ&OHJOFFSDBGF"(*෱ԬʯͰ:PV5VCFݕࡧ

Slide 13

Slide 13 text

ࠓճͷίʔυ IUUQTHJUIVCDPNZVLJOBHBIPQ fi FME@CPMU[NBOO

Slide 14

Slide 14 text

ϗοϓϑΟʔϧυωοτϫʔΫͱ͸ʁ

Slide 15

Slide 15 text

δϣϯɾϗοϓϑΟʔϧυࢯͷ঺հ ݚڀऀͱͯ͠ͷܦྺ • ೥ੜ·ΕɺΞϝϦΧͷ෺ཧֶऀɾੜ෺෺ཧֶऀ • ϓϦϯετϯେֶͰ෺ཧֶΛઐ߈ʢ1I%ʣ • ΧϦϑΥϧχΞ޻ՊେֶɺϓϦϯετϯେֶͳͲͰڭ佃 • ෺ཧֶ͔ΒਆܦՊֶ΁ݚڀྖҬΛ֦େ • ෳࡶܥͷݚڀͰଟେͳޭ੷ ओͳۀ੷ͱධՁ • ೥ɿϗοϓϑΟʔϧυωοτϫʔΫΛఏҊ • ෺ཧֶͷ֓೦Λ༻͍ͯχϡʔϥϧωοτΛཧ࿦Խ • ݱ୅ͷਂ૚ֶशͷཧ࿦తج൫Λங͍ͨઌۦऀͷҰਓ Ill. Niklas Elmehed © Nobel Prize Outreach

Slide 16

Slide 16 text

ϗοϓϑΟʔϧυωοτϫʔΫͷݩ࿦จ ถࠃՊֶΞΧσϛʔلཁʹܝࡌ IUUQTXXXQOBTPSHEPJQOBT

Slide 17

Slide 17 text

جຊΞʔΩςΫνϟ ωοτϫʔΫߏ଄ • ͢΂ͯͷχϡʔϩϯ͕૬ޓʹ݁߹ • ֤χϡʔϩϯ͸૒ํ޲ʹ઀ଓɺͨͩࣗ͠ݾ݁߹͸ଘࡏ͠ͳ͍ • ݁߹ͷॏΈ͸ରশతʢ ʣ • χϡʔϩϯͷঢ়ଶ͸཭ࢄ஋ʢ ʣ·ͨ͸ೋ஋ʢ ʣ ಈ࡞ͷಛ௃ • ΤωϧΪʔؔ਺ ʹجͮ͘ঢ়ଶߋ৽ ◦ ɿχϡʔϩϯ ͷᮢ஋ʢόΠΞεʣ • ඇಉظతͳঢ়ଶߋ৽ʢҰ౓ʹͭͷχϡʔϩϯʣ • ہॴతͳ৘ใͷΈͰߋ৽൑அ • ΤωϧΪʔ࠷খԽʹΑΔ҆ఆঢ়ଶ΁ͷऩଋ • ෺ཧֶͷεϐϯάϥεϞσϧͱྨࣅͨ͠ৼΔ෣͍ wij = wji si ∈ − 1, + 1 si ∈ 0,1 E = − 1 2 ∑ i,j wij si sj − ∑ i θi si θi i

Slide 18

Slide 18 text

ಈ࡞ݪཧ ঢ়ଶߋ৽ͷϝΧχζϜ • ֤χϡʔϩϯ΁ͷೖྗɿ • ߋ৽نଇɿ ཭ࢄ஋ʢ૒ۃੑʣͷ৔߹ɿ ೋ஋ʢ୯ۃੑʣͷ৔߹ɿ • ඇಉظతͳߋ৽ʢϥϯμϜʹબΜͩͭͷχϡʔϩϯΛߋ৽ʣ • ͢΂ͯͷχϡʔϩϯ͕҆ఆ͢Δ·Ͱ܁Γฦ͠ hi = ∑ j wij sj + θi si = { +1 JG hi ≥ 0 −1 JG hi < 0 si = { 1 JG hi ≥ 0 0 JG hi < 0

Slide 19

Slide 19 text

ಈ࡞ݪཧ ΤωϧΪʔͱऩଋ • ΤωϧΪʔؔ਺͸ঢ়ଶߋ৽ʹΑΓ୯ௐݮগ • γεςϜ͸ඞͣہॴ࠷খ஋ʹऩଋ • ࠷ऴঢ়ଶ͸ॳظঢ়ଶʹґଘ • ΤωϧΪʔ஍ܗͷΠϝʔδɿ ◦ࢁʢෆ҆ఆঢ়ଶʣ͔Β୩ʢ҆ఆঢ়ଶʣ΁ ◦ෳ਺ͷ҆ఆঢ়ଶʢہॴ࠷খ஋ʣ͕ଘࡏ ◦هԱύλʔϯ͸҆ఆঢ়ଶͷҰͭʹରԠ

Slide 20

Slide 20 text

ֶशͱهԱ ֶशʢॏΈͷܾఆʣ • ݁߹ՙॏͷֶशଇɿ ʢ ʣ ◦ ɿχϡʔϩϯ਺ ◦ ɿهԱͤ͞Δύλʔϯ਺ ◦ ɿύλʔϯ ʹ͓͚Δχϡʔϩϯ ͷঢ়ଶ • Ұ౓ͷܭࢉͰॏΈΛܾఆʢඇ൓෮తʣ • ੜ෺ֶతͳϔϒଇʹجͮ͘ هԱ༰ྔͱಛ௃ • ཧ࿦తͳهԱ༰ྔɿ ◦ ݸͷχϡʔϩϯͰ໿ ݸͷύλʔϯΛهԱՄೳ • ϊΠζΛؚΉೖྗ͔Βͷ૝ى͕Մೳ • ύλʔϯͷҰ෦͔ΒશମΛ࠶ߏ੒ wij = 1 N ∑p μ=1 sμ i sμ j i ≠ j N p sμ i μ i pmax ≈ 0.14N N 0.14N

Slide 21

Slide 21 text

Ԡ༻ྫͱಛ௃ ୅දతͳԠ༻ྫ • ࿈૝هԱγεςϜ ◦ύλʔϯ෮ݩɾϊΠζআڈ ◦ෆ׬શͳೖྗ͔Βͷ૝ى • ૊Έ߹Θͤ࠷దԽ໰୊ ◦८ճηʔϧεϚϯ໰୊ ◦εέδϡʔϦϯά໰୊ ར఺ͱݶք • ར఺ɿฒྻॲཧ͕Մೳɺϋʔυ΢ΣΞ࣮૷͕༰қ • ݶքɿهԱ༰ྔͷ੍ݶʢ ʣɺہॴղʹؕΔՄೳੑ 0.14N

Slide 22

Slide 22 text

ൃలͱӨڹ ௚઀తͳൃల • ϘϧπϚϯϚγϯ΁ͷਐԽ ◦֬཰తͳৼΔ෣͍ͷಋೖɺӅΕ૚ͷ௥Ճ • ࿈ଓ஋Ϟσϧͷ։ൃ ◦ΞφϩάχϡʔϩϯͷಋೖɺΑΓ๛͔ͳදݱೳྗͷ֫ಘ ݱ୅΁ͷӨڹ • ෺ཧֶͷ஌ݟͷ׆༻ ◦ΤωϧΪʔ࠷খԽʹΑΔֶश ◦֬཰తΞϓϩʔνͷجૅ

Slide 23

Slide 23 text

ϗοϓϑΟʔϧυωοτϫʔΫͷίʔυ IUUQTHJUIVCDPNZVLJOBHBIPQ fi FME@CPMU[NBOOUSFFNBJOTFDUJPO@

Slide 24

Slide 24 text

ϘϧπϚϯϚγϯͱ͸ʁ

Slide 25

Slide 25 text

δΣϑϦʔɾώϯτϯࢯͷ঺հ Ill. Niklas Elmehed © Nobel Prize Outreach ܦྺͱݚڀ෼໺ • ೥ΠΪϦεੜ·ΕɺʮσΟʔϓϥʔχϯάͷ෕ʯ • τϩϯτେֶڭतɺ(PPHMF3FTFBSDIॴଐ • ೝ஌৺ཧֶ͔Βਓ޻஌ೳݚڀ΁ • ਂ૚ֶशͷཧ࿦తجૅΛཱ֬ ओͳۀ੷ • ޡࠩٯ఻೻๏ͷ࠶ൃݟʢ೥ʣ • %FFQ#FMJFG/FUXPSLͷఏҊʢ೥ʣ • νϡʔϦϯά৆ड৆ʢ೥ʣ • "*҆શੑ΁ͷܯ৊ʢ೥ʣ

Slide 26

Slide 26 text

ϘϧπϚϯϚγϯͷݩ࿦จ τϩϯτେֶͷ΢ΣϒαΠτʹܝࡌ IUUQTXXXDTUPSPOUPFEVdGSJU[BCTQTDPHTDJCNQEG

Slide 27

Slide 27 text

എܠͱ஀ੜ ։ൃͷഎܠ • ೥୅ɺϗοϓϑΟʔϧυωοτϫʔΫͷݶք • ౷ܭྗֶʢϘϧπϚϯ෼෍ʣͷԠ༻Λண૝ • )JOUPO4FKOPXTLJʹΑΔڞಉݚڀʢ೥ʣ • ֬཰తͳৼΔ෣͍ͷಋೖ ओཁͳֵ৽఺ • ֬཰తͳχϡʔϩϯͷಋೖ • Թ౓ύϥϝʔλʹΑΔ੍ޚ • ӅΕϢχοτͷಋೖ • ΤωϧΪʔ࠷খԽͱ֬཰తֶशͷ౷߹

Slide 28

Slide 28 text

جຊΞʔΩςΫνϟ ωοτϫʔΫߏ଄ • Մࢹ૚ͱӅΕ૚ͷ૚ߏ଄ • ͢΂ͯͷϢχοτ͕ؒ૒ํ޲ʹ݁߹ • ֬཰తͳঢ়ଶભҠɿ ◦ ɿঢ়ଶมԽʹ൐͏ΤωϧΪʔมԽ ◦ ɿԹ౓ύϥϝʔλ ΤωϧΪʔؔ਺ • ◦ ɿϢχοτؒͷ݁߹ॏΈ ◦ ɿϢχοτͷঢ়ଶʢ·ͨ͸ʣ ◦ ɿόΠΞε߲ • Թ౓ ʹΑͬͯঢ়ଶ෼෍Λ੍ޚ p(si = 1) = 1 1 + e−ΔEi/T ΔEi T E = − ∑ i

Slide 29

Slide 29 text

ಈ࡞ϝΧχζϜ ঢ়ଶભҠͷ࢓૊Έ • ϘϧπϚϯ෼෍ʹै͏֬཰తͳঢ়ଶߋ৽ ◦ ◦ ɿ෼഑ؔ਺ ɿશϢχοτͷঢ়ଶϕΫτϧ • ΪϒεαϯϓϦϯάʹΑΔঢ়ଶભҠ ◦ϥϯμϜʹબΜͩϢχοτΛ֬཰తʹߋ৽ ◦೤ฏߧঢ়ଶʹ౸ୡ͢Δ·Ͱ܁Γฦ͠ Թ౓੍ޚͱ࠷దԽ • γϛϡϨʔςουΞχʔϦϯάͷར༻ ◦ߴԹ͔Β։࢝͠ɺঃʑʹԹ౓ΛԼ͛Δ ◦ہॴղճආͱେҬత࠷దԽ • Թ౓ʹΑΔ୳ࡧɾऩଋͷ੍ޚ ◦ߴԹɿϥϯμϜͳ୳ࡧ௿Թɿہॴతͳ࠷దԽ P(s) = 1 Z e−E(s)/T Z s

Slide 30

Slide 30 text

ֶशΞϧΰϦζϜ ֶशͷجຊࣜ • ॏΈߋ৽ଇɿ ◦ ɿֶश཰ ◦ ɿσʔλͷظ଴஋ʢਖ਼૬ʣ ◦ ɿϞσϧͷظ଴஋ʢෛ૬ʣ ࣮૷্ͷ޻෉ • ίϯτϥεςΟϒμΠόʔδΣϯεʢ$%ʣ๏ͷಋೖ ◦׬શͳऩଋΛ଴ͨͣʹֶश ◦গ਺εςοϓͷαϯϓϦϯάͰ୅༻ • Թ౓εέδϡʔϧͷઃఆ ◦ֶशॳظ͸ߴԹͰ୳ࡧతʹ ◦ֶशޙظ͸௿ԹͰऩଋΛଅਐ Δwij = η(⟨si sj ⟩data − ⟨si sj ⟩model ) η ⟨ ⋅ ⟩data ⟨ ⋅ ⟩model

Slide 31

Slide 31 text

ൃలͱԠ༻ Ϟσϧͷൃల • ੍ݶϘϧπϚϯϚγϯʢ3#.ʣͷߟҊ ◦૚ؒͷΈͷ݁߹ʹΑΔޮ཰Խ ◦%FFQ#FMJFG/FUXPSLͷجૅʹ • %FFQ-FBSOJOHֵ໋΁ͷߩݙ ◦ਂ૚ֶशͷࣄલֶशख๏ͱͯ͠׆༻ ◦ੜ੒Ϟσϧͷجຊ֓೦Λཱ֬

Slide 32

Slide 32 text

ϘϧπϚϯϚγϯͷίʔυ IUUQTHJUIVCDPNZVLJOBHBIPQ fi FME@CPMU[NBOOUSFFNBJOTFDUJPO@

Slide 33

Slide 33 text

෱Ԭͷ"(* ੝Γ্͍͖͛ͯ·͠ΐ͏ʂ