Upgrade to Pro — share decks privately, control downloads, hide ads and more …

원석이의 모두연에서 강화학습 보석되기

Avatar for Wonseok Jung Wonseok Jung
December 15, 2018
410

원석이의 모두연에서 강화학습 보석되기

Avatar for Wonseok Jung

Wonseok Jung

December 15, 2018
Tweet

Transcript

  1. Modulabs CTRL ە੢ Modulabs RLXDL ە੢ Modulabs KAIR ҕزە੢ %FFQ3FJOGPSDFNFOU-FBSOJOHझఠ٣

    ъച೟णোҳ߂ъച೟ण؀ഥ 3FJOGPSDFNFOUMFBSOJOHਵ۽3PCPUJDT೟ण
  2. Modulabs CTRL ە੢ Modulabs RLXDL ە੢ Modulabs KAIR ҕزە੢ Modulabs

    ಽ੖झ௥ 3FJOGPSDFNFOUMFBSOJOHਵ۽3PCPUJDT೟ण %FFQ3FJOGPSDFNFOU-FBSOJOHझఠ٣ ъച೟णোҳ߂ъച೟ण؀ഥ
  3. Modulabs CTRL ە੢ Modulabs RLXDL ە੢ Modulabs KAIR ҕزە੢ Modulabs

    ಽ੖झ௥ 3FJOGPSDFNFOUMFBSOJOHਵ۽3PCPUJDT೟ण _ӝಽ੖झ௥ীࢲҕࠗ઺  ӝъച೟णӝୡबചಌप੉  ੉ߣীࣻܐޅೡ٠ %FFQ3FJOGPSDFNFOU-FBSOJOHझఠ٣ ъച೟णোҳ߂ъച೟ण؀ഥ
  4. Modulabs CTRL ە੢ Modulabs RLXDL ە੢ Modulabs KAIR ҕزە੢ Modulabs

    ಽ੖झ௥ 3FJOGPSDFNFOUMFBSOJOHਵ۽3PCPUJDT೟ण _ӝಽ੖झ௥ীࢲҕࠗ઺  ӝъച೟णӝୡबചಌप੉  ੉ߣীࣻܐޅೡ٠ %FFQ3FJOGPSDFNFOU-FBSOJOHझఠ٣ ъച೟णোҳ߂ъച೟ण؀ഥ Modulabs DeepLearningCollege ъച೟णোҳਗ ֙ъച೟ण೐۽ં౟ ֤ࣗޙ੘ࢿѐ৮ܐ ѐোҳ૓೯઺ ࣗ੢שҗ ઑӝࣻܐೣ
  5. 
 1SFTFOUBUJPOBOE-FDUVSFT ਘ_ 5FOTPSGMPX,33FJOGPSDFNFOU-FBSOJOH ऱ੉Ӓېݠ%*:ъച೟ण ա݅੄गಌܻ݃য়ڣٯڣٯٜ݅ӝ  IUUQTXXXZPVUVCFDPNXBUDI W#.*JSCW2X 

    ী੉੹౟ܳࠗఌ೧5IFSJTFPG3FJOGPSDFNFOU-FBSOJOH IUUQTXXXZPVUVCFDPNXBUDI WVI9V"L3G.2 TUೣԋೞח٩۞׬ஶಌ۠झ3VOOJOH"* IUUQTXXXTMJEFTIBSFOFUXPOTFPLKVOHEFFQMFBSOJOHDPOG ౵੉௑௏ܻইੋҕ૑מगಌܻ݃য়੄Ѣ੄ݽٚѪ IUUQTTQFBLFSEFDLDPNXPOTFPLKVOHBEPUJTVQFSNBSJP XJUISFJOGPSDFNFOUMFBSOJOH  ೠҴ੿ࠁ୊ܻ೟ഥъച೟ण੉ۿҗपઁ IUUQTXXXTMJEFTIBSFOFUXPOTFPLKVOHSM ా҅աۄъച೟ण੉ۿҗपઁ IUUQTXXXTMJEFTIBSFOFUXPOTFPLKVOHSM ੗അҊ١೟Ү&YQMPSBUJPO .FUB3-ӒܻҊա
 IUUQTXXXTMJEFTIBSFOFUXPOTFPLKVOHSM ؘ੉ఠঠ֥੗যࢲ৬_ؘ੉ఠࢎ੉঱झח୊਺੉૑  IUUQTTQFBLFSEFDLDPNXPOTFPLKVOHIPXUPCFDPNFB EBUBTDJFOUJTU ѐ੄ߊ಴߂ъ੄
 ো݈ѐߊ಴৘੿

  6. 3FTFBSDI <>8POTFPL +VOH 3&8"3%4)"1*/(*4"--:06/&&%
 -FBSOJOHTLJMMTXJUIBTQFDJGJFESFXBSEGVODUJPO 1PTU"*   <>8POTFPLKVOH .JOKJ,JN

    4FPLKFPOH4POH.PEVMBCT 1PTU"*  &YQMPSBUJPONFUIPEGPSSFEVDJOHVODFSUBJOUZVTJOH2FOUSPQZJOEFFQ SFJOGPSDFNFOUMFBSOJOH #FTU1PTUFS"XBSE  + ࣗ੢שҗೣԋೞחૌѢ਍োҳs ѐ੄֤ޙ੘ࢿ

  7. LAW OF EFFECT - &EXBSE5IPSOEJLF   - -BXPGFGGFDUযڃ೯ز੄Ѿҗо݅઒झ۞਋ݶ׮਺ীبӒ೯زਸ߈ࠂೠ׮ ߈؀۽݅઒ೞ૑ঋਵݶӒ೯زਸೞ૑ঋח׮

    - 3FJOGPSDFNFOU ъച ੉੹ীੌযդ೯زਸ߈ࠂೞѱ݅٘ח੗ӓ - 1VOJTINFOU ୊ߥ ੉੹ীੌযդ೯زਸೖೞѱ݅٘ח੗ӓ HOW ANIMALS LEARN
  8. HOW HUMANS LEARN -TAP BALL %BZ %BZ %BZ %BZ ୭Ҋ੼ࣻ


    ݏ਷പࣻ ୭Ҋ੼ࣻ
 ݏ਷പࣻ ୭Ҋ੼ࣻ
 ݏ਷പࣻ ୭Ҋ੼ࣻ ݏ਷പࣻ HOW HUMANS LEARN
  9. LEARNING 3FJOGPSDFNFOUMFBSOJOH਷3FXBSE ࠁ࢚ ਸ୭؀ചೞחBDUJPO ೯ز ਸࢶఖೠ׮ -FBSOFS ߓ਋ח੗ חৈ۞BDUJPOਸ೧ࠁݴ SFXBSEܳо੢֫ѱ߉חBDUJPOਸ଺ח׮

    ࢶఖػBDUJPO੉׼੢੄SFXBSEࡺ݅ইצ ׮਺੄࢚ടژח׮਺ੌযաѱؼ SFXBSEীب৔ೱਸՙசࣻب੓׮ "DUJPO ׼੢੄ ࢚ട߸ച ޷ې੄࢚ട 3FXBSE ޷ې੄3FXBSE REINFORCEMENT LEARNING
  10. MARKOV DECISION PROCESS &OWJSPONFOU 3FXBSE At Rt St Rt+1 St+1

    REINFORCEMENT LEARNING 5BQUIFCBMM 1PTJUJWF3FXBSE

  11. োҳਗ ഥࢎਗ ೟ࠗࢤ ؀೟ਗࢤ ߔࣻ ઱ࠗ Ҋ١೟ࢤ Үࣻ ѐߊ੗ ࣻ೟੗

    ׮নೠ୹न੄ݽفোোҳਗٜ Үਭ ࣻ೟ ஹೊఠҗ೟ ٩۞׬ ъച೟ण ࠶۾୓ੋ
  12. োҳਗ ഥࢎਗ ೟ࠗࢤ ؀೟ਗࢤ ߔࣻ ઱ࠗ Ҋ١೟ࢤ Үࣻ ѐߊ੗ ࣻ೟੗

    ׮নೠ୹न੄ݽفোোҳਗٜ Үਭ ࣻ೟ ஹೊఠҗ೟ ٩۞׬ ъച೟ण ࠶۾୓ੋ োҳ
  13. োҳਗ ഥࢎਗ ೟ࠗࢤ ؀೟ਗࢤ ߔࣻ ઱ࠗ Ҋ١೟ࢤ Үࣻ ѐߊ੗ ࣻ೟੗

    ׮নೠ୹न੄ݽفোোҳਗٜ Үਭ ࣻ೟ ஹೊఠҗ೟ ٩۞׬ ъച೟ण ࠶۾୓ੋ োҳ ъച೟ण ৔࢚୊ܻ ੗োয୊ܻ ۽ࠁ౮झ ݽ߄ੌݠन۞׬
  14. "DUJPO "HFOU &OWJSPONFOU 3FXBSE At Rt 4UBUF St Rt+1 St+1

    REINFORCEMENT LEARNING ਗࢳ ACTIONS
  15. WONSEOK JUNG ߊݺо ݅ചо җ೟੗ Ѥ୷о оࣻ Ѻైӝࢶࣻ ੗زର٣੗੉ց ઁಿ٣੗੉ց

    ੘ҋо EXPLORATION ఋై੉झ౟ ࣿ૘਍৔ ஠ۨ੉ࢲ झ௢ఠ׮੉ߡ ੘о ಁ࣌٣੗੉ց ೾झ౟ۨ੉ց Үਭо ҃৔ஶࢸఢ౟ ؘ੉ఠࢎ੉঱౭झ౟ ੋҕ૑מোҳਗ Үਭо ੋҕ૑מূ૑פয ۽ࠈੋҕ૑מোҳਗ
  16. ਗࢳ ࠁࢳ োҳਗ ഥࢎਗ ೟ࠗࢤ ؀೟ਗࢤ ߔࣻ ઱ࠗ Ҋ١೟ࢤ Үࣻ

    ѐߊ੗ ࣻ೟੗ ৌ੿੸੉Ҋ ഴܯೠ ݽفোোҳਗשҗೣԋ
  17. 
 .PEVMBCT$53-3FTFBSDIFS $JUZ6OJWFSTJUZPG/FX:PSL#BSVDI $PMMFHF %BUB4DJFODF.BKPS  $POOFYJPO"*'PVOEFS %FFQ-FBSOJOH$PMMFHF3FJOGPSDFNFOU -FBSOJOH3FTFBSDIFS CTRL

    MEMBERS 8POTFPL+VOH ,ZVOHIXBO,JN 
 .PEVMBCT$53-3FTFBSDIFS )BOTVOH6OJWFSTJUZ
 &MFDUSPOJDJOGPSNBUJPO&OHJOFFSJOH.BKPS  *OUFSFTUFE"* 3FJOGPSFNFOUMFBSOJOH  (BNF )ZP+FPOH+FPO 
 .PEVMBCT$53-3FTFBSDIFS #JOHIBNUPO6OJWFSTJUZ.4PG.FDIBOJDBM &OHJOFFSJOH.BKPS .BUIJOTUSVDUPSBU$PMMFHF1SFQ*OTUJUVUF *OUFSFTU"QQMJDBUJPOPG6OJUZ.-"HFOUT JO3- ("/
  18. CTRL MEMBERS 4FVOH+BF-FF 
 .PEVMBCT$53-3FTFBSDIFS 1SJODFUPO6OJWFSTJUZ$MBTTPG .BUIFNBUJDT.BKPS  4DSBUDIXPSL--$$PGPVOEFS 3FTFBSDI

    &YQFSJNFOUTXJUIUIF.BSLPGG4VSGBDF@ XJUI.BUUIFXEF$PVSDZ*SFMBOEVOEFS )BOZBOH6OJWFSTJUZ
 .4#JPJOGPSNBUJDT #*(-BC 
 6OJUZ%FWFMPQFS .BSWSVT 
 *OUFSFTUFE73"3 
 3FJOGPSDFNFOUMFBSOJOH "*JOUFSBDUJPO 1I% 2VBMJUZ4ZTUFNT-BC1045&$) 
 4FBSDI3FDPNNFOEFS4ZTUFN&OHJOFFS
 *OUFSFTUFE3-"QQMJDBUJPOJO&WFSZXIFSF .PEVMBCT$53-3FTFBSDIFS .PEVMBCT$53-3FTFBSDIFS +XBXPO4FP 7JDT,XPO
  19. CTRL MEMBERS :VOLZV$IPJ 
 .PEVMBCT$53-3FTFBSDIFS 73/&3% 4VIZVL1BSL 
 .PEVMBCT$53-3FTFBSDIFS .BTUFS

    /BUVSBM-BOHVBHF1SPDFTTJOH ,PSFB 6OJWFSTJUZ  %BUB*OHFTUJPO5FBN-FBEFSBU/$40'5 *OUFSFTUFE"QQMZ3FJOGPSDFNFOU-FBSOJOH 5FDIOJRVFTUP%BUB1SPDFTTJOH"SFB ,VSU 
 .PEVMBCT$53-3FTFBSDIFS 3-/&3%
  20. 
 .PEVMBCT,"*33FTFBSDIFS $JUZ6OJWFSTJUZPG/FX:PSL#BSVDI $PMMFHF %BUB4DJFODF.BKPS  $POOFYJPO"*'PVOEFS %FFQ-FBSOJOH$PMMFHF3FJOGPSDFNFOU -FBSOJOH3FTFBSDIFS 3FJOGPSDFNFOU-FBSOJOH

    0CKFDU %FUFDUJPO $IBUCPU KAIR MEMBERS 8POTFPL+VOH $IFPMIVJ.JO 
 .PEVMBCT,"*33FTFBSDIFS #4JO.FDIBOJDBM&OH,PSFB6OJW .4DDBOEJEBUFJO.FDIBOJDBM&OH,PSFB 6OJW 3FTFBSDIGJFME%FFQSFJOGPSDFNFOUMFBSOJOH GPSSPCPUJDT 3PCPUDPOUSPMJOUFSGBDF *OUFSFTUT%FFQ3-BOEPQUJNBMDPOUSPM  3PCPUJDT $IJOFTF 8IJ,XPO 
 .PEVMBCT,"*33FTFBSDIFS JOUFSFTUFE3- NBOJQVMBUPS 4PHBOH6OJW$IFNJDBMBOE#JPFOHJOFFSJOH .FEJQJYFM"*SFTFBSDIFSMFBSOJOHGPS SPCPUJDT 3PCPUDPOUSPMJOUFSGBDF
  21. 
 .PEVMBCT,"*33FTFBSDIFS ,ZVOHIFF6OJWFSTJUZ.FDIBOJDBMBOE 4PGUXBSFFOHJOFFSJOH EVBMNBKPS  *OUFSFTUSPCPUJDTBOETJNVMBUJPO 3- NM BHFOU

    
 .PEVMBCT,"*33FTFBSDIFS 4FPVM/BUJPOBM6OJWFSTJUZ .FDIBOJDBM "FSPTQBDF&OHJOFFSJOH.BKPS  4QBDF/FSE *OUFSFTU3PCPUJDT /BWJHBUJPO$POUSPM  #BUUMFHSPVOE .BDBSPO 
 .PEVMBCT,"*33FTFBSDIFS %BFKFPO6OJWFSTJUZ &MFDUSPOJD*OGPSNBUJPO$PNNVOJDBUJPO &OHJOFFSJOH  *OUFSFTUFE3FJOGPDFNFOU-FBSOJOH  4JN3FBM KAIR MEMBERS 4VCJO:BOH 4FPZFPO:BOH +VOUBF,JN
  22. 
 .PEVMBCT,"*33FTFBSDIFS 4VOHLZVOLXBO6OJW.FDIBOJDBM FOHJOFFSJOH#4 4FPVM/BUJPOBM6OJW.4TUVEFOU *OUFSFTUFE)VNBOPJE 5PSRVFDPOUSPM  3- 


    .PEVMBCT,"*33FTFBSDIFS ,PSFB6OJWFSTJUZ $POUSPM3PCPUJDT 4ZTUFN *OUFSFTU2VBOUJ[FE/FVSBM/FUXPSLTBOE "4*$*NQMFNFOUBUJPO 4UBUFFTUJNBUJPO 3- 
 .PEVMBCT,"*33FTFBSDIFS #4JO$PNQVUFS4DJFODFBOE&OHJOFFSJOH 3FTFBSDI&OHJOFFSBU.FEJQJYFM *OUFSFTUFEJO$POWFY0QUJNJ[BUJPO  $PNQVUFS7JTJPO BOE3FJOGPSDFNFOU -FBSOJOH KAIR MEMBERS %POHIZFPO,JN +FPOHIPPO,JN +JOXPP1BSL
  23. 
 .PEVMBCT,"*33FTFBSDIFS #4JO.BUIFNBUJDTBOE$PNQVUFS 4DJFODFJO,PSFB6OJW .4$PVSTFJO&MFDUSJDBM&OHJO4FPVM /BUJPOBM6OJW 3FTFBSDIGJFME4UPDIBTUJD$POUSPM1SPDFTT KAIR MEMBERS 4JIZVO$IPJ

    4FVOH+BF3ZBO-FF 
 .PEVMBCT,"*33FTFBSDIFS 1SJODFUPO6OJW$MBTTPG .BUIFNBUJDT  FOEUPFOE"*3FTFBSDIFS %FFQ-FBSOJOH;FSP5P"MM4FBTPO1Z5PSDI $POUFOU$POUSJCVUPS *OUFSFTUT%BUBFGGJDJFOU3- $VSJPTJUZESJWFO -FBSOJOH .FUB-FBSOJOH
  24. ਗࢳ ࠁࢳ োҳਗ ഥࢎਗ ೟ࠗࢤ ؀೟ਗࢤ ߔࣻ ઱ࠗ Ҋ١೟ࢤ Үࣻ

    ѐߊ੗ ࣻ೟੗ ֙ೣԋࠁࢳ੉ؼোҳਗݽ૘೤פ׮