Upgrade to Pro — share decks privately, control downloads, hide ads and more …

원석이의 모두연에서 강화학습 보석되기

Wonseok Jung
December 15, 2018
390

원석이의 모두연에서 강화학습 보석되기

Wonseok Jung

December 15, 2018
Tweet

Transcript

  1. Modulabs CTRL ە੢ Modulabs RLXDL ە੢ Modulabs KAIR ҕزە੢ %FFQ3FJOGPSDFNFOU-FBSOJOHझఠ٣

    ъച೟णোҳ߂ъച೟ण؀ഥ 3FJOGPSDFNFOUMFBSOJOHਵ۽3PCPUJDT೟ण
  2. Modulabs CTRL ە੢ Modulabs RLXDL ە੢ Modulabs KAIR ҕزە੢ Modulabs

    ಽ੖झ௥ 3FJOGPSDFNFOUMFBSOJOHਵ۽3PCPUJDT೟ण %FFQ3FJOGPSDFNFOU-FBSOJOHझఠ٣ ъച೟णোҳ߂ъച೟ण؀ഥ
  3. Modulabs CTRL ە੢ Modulabs RLXDL ە੢ Modulabs KAIR ҕزە੢ Modulabs

    ಽ੖झ௥ 3FJOGPSDFNFOUMFBSOJOHਵ۽3PCPUJDT೟ण _ӝಽ੖झ௥ীࢲҕࠗ઺  ӝъച೟णӝୡबചಌप੉  ੉ߣীࣻܐޅೡ٠ %FFQ3FJOGPSDFNFOU-FBSOJOHझఠ٣ ъച೟णোҳ߂ъച೟ण؀ഥ
  4. Modulabs CTRL ە੢ Modulabs RLXDL ە੢ Modulabs KAIR ҕزە੢ Modulabs

    ಽ੖झ௥ 3FJOGPSDFNFOUMFBSOJOHਵ۽3PCPUJDT೟ण _ӝಽ੖झ௥ীࢲҕࠗ઺  ӝъച೟णӝୡबചಌप੉  ੉ߣীࣻܐޅೡ٠ %FFQ3FJOGPSDFNFOU-FBSOJOHझఠ٣ ъച೟णোҳ߂ъച೟ण؀ഥ Modulabs DeepLearningCollege ъച೟णোҳਗ ֙ъച೟ण೐۽ં౟ ֤ࣗޙ੘ࢿѐ৮ܐ ѐোҳ૓೯઺ ࣗ੢שҗ ઑӝࣻܐೣ
  5. 
 1SFTFOUBUJPOBOE-FDUVSFT ਘ_ 5FOTPSGMPX,33FJOGPSDFNFOU-FBSOJOH ऱ੉Ӓېݠ%*:ъച೟ण ա݅੄गಌܻ݃য়ڣٯڣٯٜ݅ӝ  IUUQTXXXZPVUVCFDPNXBUDI W#.*JSCW2X 

    ী੉੹౟ܳࠗఌ೧5IFSJTFPG3FJOGPSDFNFOU-FBSOJOH IUUQTXXXZPVUVCFDPNXBUDI WVI9V"L3G.2 TUೣԋೞח٩۞׬ஶಌ۠झ3VOOJOH"* IUUQTXXXTMJEFTIBSFOFUXPOTFPLKVOHEFFQMFBSOJOHDPOG ౵੉௑௏ܻইੋҕ૑מगಌܻ݃য়੄Ѣ੄ݽٚѪ IUUQTTQFBLFSEFDLDPNXPOTFPLKVOHBEPUJTVQFSNBSJP XJUISFJOGPSDFNFOUMFBSOJOH  ೠҴ੿ࠁ୊ܻ೟ഥъച೟ण੉ۿҗपઁ IUUQTXXXTMJEFTIBSFOFUXPOTFPLKVOHSM ా҅աۄъച೟ण੉ۿҗपઁ IUUQTXXXTMJEFTIBSFOFUXPOTFPLKVOHSM ੗അҊ١೟Ү&YQMPSBUJPO .FUB3-ӒܻҊա
 IUUQTXXXTMJEFTIBSFOFUXPOTFPLKVOHSM ؘ੉ఠঠ֥੗যࢲ৬_ؘ੉ఠࢎ੉঱झח୊਺੉૑  IUUQTTQFBLFSEFDLDPNXPOTFPLKVOHIPXUPCFDPNFB EBUBTDJFOUJTU ѐ੄ߊ಴߂ъ੄
 ো݈ѐߊ಴৘੿

  6. 3FTFBSDI <>8POTFPL +VOH 3&8"3%4)"1*/(*4"--:06/&&%
 -FBSOJOHTLJMMTXJUIBTQFDJGJFESFXBSEGVODUJPO 1PTU"*   <>8POTFPLKVOH .JOKJ,JN

    4FPLKFPOH4POH.PEVMBCT 1PTU"*  &YQMPSBUJPONFUIPEGPSSFEVDJOHVODFSUBJOUZVTJOH2FOUSPQZJOEFFQ SFJOGPSDFNFOUMFBSOJOH #FTU1PTUFS"XBSE  + ࣗ੢שҗೣԋೞחૌѢ਍োҳs ѐ੄֤ޙ੘ࢿ

  7. LAW OF EFFECT - &EXBSE5IPSOEJLF   - -BXPGFGGFDUযڃ೯ز੄Ѿҗо݅઒झ۞਋ݶ׮਺ীبӒ೯زਸ߈ࠂೠ׮ ߈؀۽݅઒ೞ૑ঋਵݶӒ೯زਸೞ૑ঋח׮

    - 3FJOGPSDFNFOU ъച ੉੹ীੌযդ೯زਸ߈ࠂೞѱ݅٘ח੗ӓ - 1VOJTINFOU ୊ߥ ੉੹ীੌযդ೯زਸೖೞѱ݅٘ח੗ӓ HOW ANIMALS LEARN
  8. HOW HUMANS LEARN -TAP BALL %BZ %BZ %BZ %BZ ୭Ҋ੼ࣻ


    ݏ਷പࣻ ୭Ҋ੼ࣻ
 ݏ਷പࣻ ୭Ҋ੼ࣻ
 ݏ਷പࣻ ୭Ҋ੼ࣻ ݏ਷പࣻ HOW HUMANS LEARN
  9. LEARNING 3FJOGPSDFNFOUMFBSOJOH਷3FXBSE ࠁ࢚ ਸ୭؀ചೞחBDUJPO ೯ز ਸࢶఖೠ׮ -FBSOFS ߓ਋ח੗ חৈ۞BDUJPOਸ೧ࠁݴ SFXBSEܳо੢֫ѱ߉חBDUJPOਸ଺ח׮

    ࢶఖػBDUJPO੉׼੢੄SFXBSEࡺ݅ইצ ׮਺੄࢚ടژח׮਺ੌযաѱؼ SFXBSEীب৔ೱਸՙசࣻب੓׮ "DUJPO ׼੢੄ ࢚ട߸ച ޷ې੄࢚ട 3FXBSE ޷ې੄3FXBSE REINFORCEMENT LEARNING
  10. MARKOV DECISION PROCESS &OWJSPONFOU 3FXBSE At Rt St Rt+1 St+1

    REINFORCEMENT LEARNING 5BQUIFCBMM 1PTJUJWF3FXBSE

  11. োҳਗ ഥࢎਗ ೟ࠗࢤ ؀೟ਗࢤ ߔࣻ ઱ࠗ Ҋ١೟ࢤ Үࣻ ѐߊ੗ ࣻ೟੗

    ׮নೠ୹न੄ݽفোোҳਗٜ Үਭ ࣻ೟ ஹೊఠҗ೟ ٩۞׬ ъച೟ण ࠶۾୓ੋ
  12. োҳਗ ഥࢎਗ ೟ࠗࢤ ؀೟ਗࢤ ߔࣻ ઱ࠗ Ҋ١೟ࢤ Үࣻ ѐߊ੗ ࣻ೟੗

    ׮নೠ୹न੄ݽفোোҳਗٜ Үਭ ࣻ೟ ஹೊఠҗ೟ ٩۞׬ ъച೟ण ࠶۾୓ੋ োҳ
  13. োҳਗ ഥࢎਗ ೟ࠗࢤ ؀೟ਗࢤ ߔࣻ ઱ࠗ Ҋ١೟ࢤ Үࣻ ѐߊ੗ ࣻ೟੗

    ׮নೠ୹न੄ݽفোোҳਗٜ Үਭ ࣻ೟ ஹೊఠҗ೟ ٩۞׬ ъച೟ण ࠶۾୓ੋ োҳ ъച೟ण ৔࢚୊ܻ ੗োয୊ܻ ۽ࠁ౮झ ݽ߄ੌݠन۞׬
  14. "DUJPO "HFOU &OWJSPONFOU 3FXBSE At Rt 4UBUF St Rt+1 St+1

    REINFORCEMENT LEARNING ਗࢳ ACTIONS
  15. WONSEOK JUNG ߊݺо ݅ചо җ೟੗ Ѥ୷о оࣻ Ѻైӝࢶࣻ ੗زର٣੗੉ց ઁಿ٣੗੉ց

    ੘ҋо EXPLORATION ఋై੉झ౟ ࣿ૘਍৔ ஠ۨ੉ࢲ झ௢ఠ׮੉ߡ ੘о ಁ࣌٣੗੉ց ೾झ౟ۨ੉ց Үਭо ҃৔ஶࢸఢ౟ ؘ੉ఠࢎ੉঱౭झ౟ ੋҕ૑מোҳਗ Үਭо ੋҕ૑מূ૑פয ۽ࠈੋҕ૑מোҳਗ
  16. ਗࢳ ࠁࢳ োҳਗ ഥࢎਗ ೟ࠗࢤ ؀೟ਗࢤ ߔࣻ ઱ࠗ Ҋ١೟ࢤ Үࣻ

    ѐߊ੗ ࣻ೟੗ ৌ੿੸੉Ҋ ഴܯೠ ݽفোোҳਗשҗೣԋ
  17. 
 .PEVMBCT$53-3FTFBSDIFS $JUZ6OJWFSTJUZPG/FX:PSL#BSVDI $PMMFHF %BUB4DJFODF.BKPS  $POOFYJPO"*'PVOEFS %FFQ-FBSOJOH$PMMFHF3FJOGPSDFNFOU -FBSOJOH3FTFBSDIFS CTRL

    MEMBERS 8POTFPL+VOH ,ZVOHIXBO,JN 
 .PEVMBCT$53-3FTFBSDIFS )BOTVOH6OJWFSTJUZ
 &MFDUSPOJDJOGPSNBUJPO&OHJOFFSJOH.BKPS  *OUFSFTUFE"* 3FJOGPSFNFOUMFBSOJOH  (BNF )ZP+FPOH+FPO 
 .PEVMBCT$53-3FTFBSDIFS #JOHIBNUPO6OJWFSTJUZ.4PG.FDIBOJDBM &OHJOFFSJOH.BKPS .BUIJOTUSVDUPSBU$PMMFHF1SFQ*OTUJUVUF *OUFSFTU"QQMJDBUJPOPG6OJUZ.-"HFOUT JO3- ("/
  18. CTRL MEMBERS 4FVOH+BF-FF 
 .PEVMBCT$53-3FTFBSDIFS 1SJODFUPO6OJWFSTJUZ$MBTTPG .BUIFNBUJDT.BKPS  4DSBUDIXPSL--$$PGPVOEFS 3FTFBSDI

    &YQFSJNFOUTXJUIUIF.BSLPGG4VSGBDF@ XJUI.BUUIFXEF$PVSDZ*SFMBOEVOEFS )BOZBOH6OJWFSTJUZ
 .4#JPJOGPSNBUJDT #*(-BC 
 6OJUZ%FWFMPQFS .BSWSVT 
 *OUFSFTUFE73"3 
 3FJOGPSDFNFOUMFBSOJOH "*JOUFSBDUJPO 1I% 2VBMJUZ4ZTUFNT-BC1045&$) 
 4FBSDI3FDPNNFOEFS4ZTUFN&OHJOFFS
 *OUFSFTUFE3-"QQMJDBUJPOJO&WFSZXIFSF .PEVMBCT$53-3FTFBSDIFS .PEVMBCT$53-3FTFBSDIFS +XBXPO4FP 7JDT,XPO
  19. CTRL MEMBERS :VOLZV$IPJ 
 .PEVMBCT$53-3FTFBSDIFS 73/&3% 4VIZVL1BSL 
 .PEVMBCT$53-3FTFBSDIFS .BTUFS

    /BUVSBM-BOHVBHF1SPDFTTJOH ,PSFB 6OJWFSTJUZ  %BUB*OHFTUJPO5FBN-FBEFSBU/$40'5 *OUFSFTUFE"QQMZ3FJOGPSDFNFOU-FBSOJOH 5FDIOJRVFTUP%BUB1SPDFTTJOH"SFB ,VSU 
 .PEVMBCT$53-3FTFBSDIFS 3-/&3%
  20. 
 .PEVMBCT,"*33FTFBSDIFS $JUZ6OJWFSTJUZPG/FX:PSL#BSVDI $PMMFHF %BUB4DJFODF.BKPS  $POOFYJPO"*'PVOEFS %FFQ-FBSOJOH$PMMFHF3FJOGPSDFNFOU -FBSOJOH3FTFBSDIFS 3FJOGPSDFNFOU-FBSOJOH

    0CKFDU %FUFDUJPO $IBUCPU KAIR MEMBERS 8POTFPL+VOH $IFPMIVJ.JO 
 .PEVMBCT,"*33FTFBSDIFS #4JO.FDIBOJDBM&OH,PSFB6OJW .4DDBOEJEBUFJO.FDIBOJDBM&OH,PSFB 6OJW 3FTFBSDIGJFME%FFQSFJOGPSDFNFOUMFBSOJOH GPSSPCPUJDT 3PCPUDPOUSPMJOUFSGBDF *OUFSFTUT%FFQ3-BOEPQUJNBMDPOUSPM  3PCPUJDT $IJOFTF 8IJ,XPO 
 .PEVMBCT,"*33FTFBSDIFS JOUFSFTUFE3- NBOJQVMBUPS 4PHBOH6OJW$IFNJDBMBOE#JPFOHJOFFSJOH .FEJQJYFM"*SFTFBSDIFSMFBSOJOHGPS SPCPUJDT 3PCPUDPOUSPMJOUFSGBDF
  21. 
 .PEVMBCT,"*33FTFBSDIFS ,ZVOHIFF6OJWFSTJUZ.FDIBOJDBMBOE 4PGUXBSFFOHJOFFSJOH EVBMNBKPS  *OUFSFTUSPCPUJDTBOETJNVMBUJPO 3- NM BHFOU

    
 .PEVMBCT,"*33FTFBSDIFS 4FPVM/BUJPOBM6OJWFSTJUZ .FDIBOJDBM "FSPTQBDF&OHJOFFSJOH.BKPS  4QBDF/FSE *OUFSFTU3PCPUJDT /BWJHBUJPO$POUSPM  #BUUMFHSPVOE .BDBSPO 
 .PEVMBCT,"*33FTFBSDIFS %BFKFPO6OJWFSTJUZ &MFDUSPOJD*OGPSNBUJPO$PNNVOJDBUJPO &OHJOFFSJOH  *OUFSFTUFE3FJOGPDFNFOU-FBSOJOH  4JN3FBM KAIR MEMBERS 4VCJO:BOH 4FPZFPO:BOH +VOUBF,JN
  22. 
 .PEVMBCT,"*33FTFBSDIFS 4VOHLZVOLXBO6OJW.FDIBOJDBM FOHJOFFSJOH#4 4FPVM/BUJPOBM6OJW.4TUVEFOU *OUFSFTUFE)VNBOPJE 5PSRVFDPOUSPM  3- 


    .PEVMBCT,"*33FTFBSDIFS ,PSFB6OJWFSTJUZ $POUSPM3PCPUJDT 4ZTUFN *OUFSFTU2VBOUJ[FE/FVSBM/FUXPSLTBOE "4*$*NQMFNFOUBUJPO 4UBUFFTUJNBUJPO 3- 
 .PEVMBCT,"*33FTFBSDIFS #4JO$PNQVUFS4DJFODFBOE&OHJOFFSJOH 3FTFBSDI&OHJOFFSBU.FEJQJYFM *OUFSFTUFEJO$POWFY0QUJNJ[BUJPO  $PNQVUFS7JTJPO BOE3FJOGPSDFNFOU -FBSOJOH KAIR MEMBERS %POHIZFPO,JN +FPOHIPPO,JN +JOXPP1BSL
  23. 
 .PEVMBCT,"*33FTFBSDIFS #4JO.BUIFNBUJDTBOE$PNQVUFS 4DJFODFJO,PSFB6OJW .4$PVSTFJO&MFDUSJDBM&OHJO4FPVM /BUJPOBM6OJW 3FTFBSDIGJFME4UPDIBTUJD$POUSPM1SPDFTT KAIR MEMBERS 4JIZVO$IPJ

    4FVOH+BF3ZBO-FF 
 .PEVMBCT,"*33FTFBSDIFS 1SJODFUPO6OJW$MBTTPG .BUIFNBUJDT  FOEUPFOE"*3FTFBSDIFS %FFQ-FBSOJOH;FSP5P"MM4FBTPO1Z5PSDI $POUFOU$POUSJCVUPS *OUFSFTUT%BUBFGGJDJFOU3- $VSJPTJUZESJWFO -FBSOJOH .FUB-FBSOJOH
  24. ਗࢳ ࠁࢳ োҳਗ ഥࢎਗ ೟ࠗࢤ ؀೟ਗࢤ ߔࣻ ઱ࠗ Ҋ١೟ࢤ Үࣻ

    ѐߊ੗ ࣻ೟੗ ֙ೣԋࠁࢳ੉ؼোҳਗݽ૘೤פ׮