ぜんぶ AWS でやらないワケ

DeNA では一部のサービスを AWS で運用している一方、大部分のサービスはオンプレミス DC で運用しています。このセッションでは、DeNA のサービスを AWS へ完全移行をすると仮定した場合に、直面しそうな困難や足りないと思われる機能などの、”ぜんぶ AWS でやらないワケ” をお話したいと思います。

Transcript

1. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. ͥΜͿ
   "84
   Ͱ΍Βͳ͍ϫέ March 15, 2014 ! Takumi Sakamoto / @takus IT Platform Dept. System Infrastructure Management Gr.
 DeNA Co., Ltd.
2. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. "CPVU
   .F ɾࡔຊ
   ୎າ
   5BLVNJ
   4BLBNPUP
   ɾ!UBLVT
   ɾ0QFSBUJPO
   &OHJOFFS
   ɾ%F/"
   $P
   -5%
   d 2
3. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. ࢲͱ
   "84 ɾ
   4041
   ͷ
   %ZOBNP
   ͷ࿦จಡΜͰײಈ
   ɾ
   .Zͱ͍͏ࣸਅڞ༗ΞϓϦΛӡ༻ 3
4. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. 4
5. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. ࠷ۙ͸৭ʑ΍ͬͯ·͢ 5 ιʔγϟϧήʔϜࣄۀ ΤϯλʔςΠϝϯτࣄۀ
6. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. ͥΜͿ
   "84
   Ͱ΍Βͳ͍ϫέ 6
7. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. ϝΠϯ͸ΦϯϓϨϛε؀ڥ ɾ%F/"
   ͷαʔϏεͷଟ͘͸ΦϯϓϨͰӡ༻
   ɾ౦೔ຊɾ੢೔ຊͷڌ఺Ͱ
   %3
   ߏ੒
   "DU"DU
   ɾαʔόͷ୆਺͸਺ઍ୆ن໛ 7
8. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. ίετӡ༻Ͱ༏ҐͳΒ
   "84
   ΋ ɾւ֎ࢢ৔޲͚ͷαʔόΛݱ஍ʹ༻ҙ͢Δ
   ɾϐʔΫ࣌ͷ࢖༻཰͕ಛʹߴ͍Ұ෦ͷαʔό
   ɾ৽نαʔϏεͰधཁ͕ಡΈʹ͍͘৔߹ 8
9. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. ຊ೔͓࿩͢Δ಺༰ ɾΦϯϓϨ"84
   ྆ํͷϢʔβͱͯ͠
   w γεςϜΞʔΩςΫνϟɾΦϖϨʔγϣϯͷ঺հ
   ɾ͜ΕͰ࠷ڧͷ
   "84
   ʹ
   w "84
   ࢖͏্Ͱ΍ͬͯΔ͜ͱͳͲ
   w "84
   Ͱ࣮ݱͰ͖ͨΒ͍͍͜ͱ 9
10. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. γεςϜΞʔΩςΫνϟ 10
11. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. γεςϜͷجຊߏ੒ ɾΦϯϓϨͰ΋
    "84
    Ͱ΋جຊతͳߏ੒͸ಉ͡
    ɾ8FC%BUBCBTF$BDIF
    ͷ
    
    ૚ߏ଄
    
    Ћ
    ɾECDBDIF
    ͸
    %/4
    ϥ΢ϯυϩϏϯͰෛՙ෼ࢄ 11 Load Balancer web/app server web/app server Web/App mydns mysql memcached mysql MySQL memcached Memcached MyDNS Load Balancer
12. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. ϩʔυόϥϯα ɾΦϯϓϨͰ͸
    )BSEXBSF
    -#
    Λར༻
    ɾ&-#
    ͱಉ༷ʹ
    "1*
    Ͱϝϯόͷૢ࡞͕Մೳ
    ɾߴՁ͕ͩେྔͷτϥϑΟοΫΛ҆ఆͯ͠ࡹ͚͍ͯΔ
    ɾγΣϧεΫϦϓτͰϔϧενΣοΫͱ͔ 12
13. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. ϩʔυόϥϯα ɾ"84
    Ͱ͸΋ͪΖΜ
    &-#
    Λར༻
    ɾ҆Ձʹར༻Ͱ͖ͯεέʔϧ΋͢Δ͕ݒ೦΋͋Δ
    ɾಥൃతͳΞΫηε૿ՃϦΞϧλΠϜ௨৴
    ޙड़ 13
14. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. 8FC"QQ ɾΦϯϓϨ
    
    "84
    Ͱಉߏ੒
    w 8FC
    "QBDIF
    
    /HJOY
    w "QQ
    1MBDL
    
    'BTU$(*
    1FSM
    ɾ"QQ
    ͸಺੡ͷ
    8"'
    Ͱ։ൃ͢Δ͜ͱ͕ଟ͍ ˞ 14 ※  DeNA͕։ൃͨ͠৽ͨͳϑϨʔϜϫʔΫGunyaSiFͱ͸ʁ
15. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. .Z42- ɾΦϯϓϨ
    
    "84
    Ͱಉߏ੒
    w .Z42-
    
    
    *OOP%#
    w .)"
    GPS
    .Z42-
    ʹΑΔϚελͷ৑௕Խ
    w 2.
    ΍
    )BOEMFS4PDLFU
    ΋ར༻
    ɾ3%4
    ͱͷൺֱ͸ޙ൒Ͱ 15
16. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. .FNDBDIFE ɾΦϯϓϨ
    
    "84
    Ͱಉߏ੒
    w ಛघͳ͜ͱ͸͋·Γͯ͠ͳ͍
    w &MBTUJD$BDIF
    ͸࢖͍ͬͯͳ͍
    • ϩά͕औΕͳ͍ͳͲͷσϝϦοτ͕ଟ͍
    w 3FEJT
    ͸
    3FEJT
    4FOUJOFM
    Ͱ৑௕ԽͰ͖Δ 16
17. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. $%/ ɾ"LBNBJ
    $%/
    
    $MPVE'SPOU
    w "LBNBJ
    ͕ଟ͍͕
    $MPVE'SPOU
    ࢖͏͜ͱ΋͋Δ
    w Ձ֨ͱΤοδϩέʔγϣϯͷ਺ͳͲʹҧ͍͋Γ 17
18. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. &YUFSOBM
    %/4 ɾ"LBNBJ
    (5.
    
    3PVUF
    w ΦϯϓϨͰ
    "LBNBJɺ"84
    Ͱ
    3PVUF
    Λར༻
    ɾ"1*
    ͷ࢓༷͕େ͖͘ҧ͏ͷ͕ಛ௃త
    w "LBNBJ
    ͸κʔϯ୯ҐͰશ্ॻ͖͔͠Ͱ͖ͳ͍
    w 3PVUF
    ͸Ϩίʔυ୯ҐͰૢ࡞Ͱ͖Δ 18
19. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. αʔόɾΦϖϨʔγϣϯ 19
20. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. جຊతͳํ਑ ɾΦϯϓϨͱ
    "84
    Ͱ୯Ұͷӡ༻Λ࣮ݱ͍ͯ͠Δ
    w ਓతϦιʔεͷྲྀಈੑ͕ߴ·Δ
    w ؂ࢹεΫϦϓτͳͲ΋ྲྀ༻Մೳ
    w ϊ΢ϋ΢ͷڞ༗͕༰қ 20
21. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. (MPCBM*OGSB
    'SBNFXPSL ɾαʔόɾΦϖϨʔγϣϯͷͨΊͷπʔϧηοτ
    w αʔό؅ཧπʔϧ
    "ENJO5PPM
    w ֤छίϚϯυ
    αʔόϦετऔಘɺDSPO
    ϥούʔ
    w ؂ࢹπʔϧ༻εΫϦϓτ
    ઃఆϑΝΠϧࣗಈੜ੒౳
    w ศརϞδϡʔϧ
    MPHHFSɺΞϥʔτϝʔϧૹ৴ 21
22. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. ΦϯϓϨɾ"84
    Ͱಉ͡ૢ࡞͕Մೳ # => get active server list get-hosts -u1 web -u2 ff ww0001 ww0002 ... ww2046 ! # => check diff diff_infra /etc/passwd /etc/passwd LOCAL a030159cf068b727b2a14398dcec6f63 wd0005 a030159cf068b727b2a14398dcec6f63 wd0007 641b11cf9a916ebf4ece86e55a3376c1 ! # => generate monitoring configurations make-nagios-conf -t $(get-hosts -u web:ff --delimtier ,) ! # => deploy global-infra resources dist-infra -x 22
23. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. ϓϩϏδϣχϯά ɾίϐʔݩͷαʔόΛෳ੡ͯ͠αʔόΛ࡞੒
    w ίϐʔݩαʔό͸ඞཁͳϛυϧ΢ΣΞ͕શೖΓ
    ɾ5PVSZP
    ߏ੒؅ཧπʔϧ
    ͰαʔόຖͷઃఆΛมߋ
    w ͋·Γෳࡶͳ͜ͱ͸͍ͯ͠ͳ͍
    w ઃఆϑΝΠϧฤूɺσʔϞϯͷىಈͳͲ 23
24. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. ϓϩϏδϣχϯάͷྫ # => create instance from golden AMI ec2-create-instances -p ww -t c3.xlarge -z us-west-1b ! # => provisioning by touryo(edit config files, start daemons) touryo run ww2000 ww2000: Some run scripts executed. Test again... … ok 1 - httpd.conf ok 2 - daemontools apache 1..2 ok 10 - apache … All tests successful. ! # => deploy application dist-project -x ! # => register to load balancer update-elb -u1 web -u2 ff 24
25. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. ͜ΕͰ࠷ڧͷ
    "84
    ʹ 25
26. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. "84
    Λ࢖͏্Ͱ΍ͬͯΔ͜ͱ ɾ1FSM
    ͔Β
    "84
    ΛૢΔ
    ɾ3%4
    ͸࢖Θͣ
    .Z42-
    PO
    &$
    ɾ؂ࢹ͸
    $MPVE8BUDI
    Λ࢖͍ͬͯͳ͍
    ɾ"VUP4DBMJOH
    ͸ࣗલͰߏங͍ͯ͠Δ
    ɾ&-#
    ͷঢ়ଶมԽΛ؂ࢹ 26
27. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. 1FSM
    ͔Β
    "84
    ΛૢΔ ɾ"84$-*8SBQQFS
    Λར༻
    w จࣈ௨Γ
    "84
    $-*
    ͷϥούʔ
    w "84
    $-*
    ͱಉ͡Α͏ͳ࢖͍উखͰ࢖͑Δ
    w SFT
    
    BXTFD EFTDSJCFJOTUBODFT 
    ɾৄࡉ͸ງ಺͞Μͷ
    1SPHSBNNJOH
    "84
    XJUI
    1FSM
    Ͱ 27
28. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. .Z42-
    PO
    &$ ɾ3%4
    ʹൺ΂ͯϝϦοτ͕ଟ͍
    w .)"
    Ͱ
    3%4
    ΑΓߴ଎ʹϑΣΠϧΦʔόʔͰ͖Δ
    w ετϨʔδΤϯδϯ͕ࣗ༝ʹબ΂Δ 28
29. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. .)"
    WT
    3%4
    .VMUJ"; ɾো֐࣌ͷϑΣΠϧΦʔόʔ࣌ؒͷҧ͍
    w .)"
    ͸
    
    ඵఔ౓ɺ3%4
    ͸
    ʙ
    ෼ఔ౓
    ɾϝϯςφϯεੑ
    εέʔϧΞοϓ΍εΩʔϚมߋ
    w ͲͪΒ΋ແఀࢭͰՄೳ
    ɾϚελ੾Γସ͑࣌ͷϨϓϦΧܨ͗௚͠
    w .)"
    ͸৽Ϛελʹܨ͗௚ͯ͘͠ΕΔ 29
30. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. ετϨʔδΤϯδϯ͕બ΂Δ ɾ2.
    ΍
    )BOEMFS4PDLFU
    ͕࢖͑Δ
    w ࣾ಺ʹ࡞ऀ͕͍ͯ໰୊͕͋Ε͹͙͢ରԠͰ͖Δ
    w "84
    ͳΒ
    424
    ΍
    %ZOBNP%#
    ΋͋Δ͚Ͳ
    
    ɾ༰ྔޮ཰ͷ͍͍
    5PLV%#
    ͳͲ΋બ୒Ͱ͖Δ
    w JOOPEC
    ʹൺ΂ͯ
    
    ͷαΠζʹͳΔ
    ˞
    w ϢʔβΞΫςΟϏςΟͷอ࣋ͳͲʹ༗༻ 30 ˞
    5PLV%#
    W
    &WFO
    #FUUFS
    $PNQSFTTJPO
31. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. $MPVE8BUDI
    ͷΞϥʔϜ ɾ୯७ͳػೳ͔͠ఏڙ͞Εͯͳ͍ͷͰ࢖ͬͯͳ͍
    ɾαʔό͕ଟ͍ͱΞϥʔτരൃͯ͠͠·͏
    w શ
    8FC
    ͔ΒҰ੪ʹ
    $16
    ͷ௨஌͕དྷΔ౳
    ɾҰ࣌తʹ௨஌ࢭΊΔΈ͍ͨͳػೳ͕ݟ౰ͨΒͳ͍
    w /BHJPT
    ͷ
    4DIFEVMFE
    %PXOUJNF
    ૬౰ 31
32. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. ࢮ׆؂ࢹ͸
    /BHJPT ɾઃఆϑΝΠϧ͸ߏங࣌ʹࣗಈੜ੒͍ͯ͠Δ
    ɾಛఆΫϥελͷΞϥʔτΛ·ͱΊΔ࢓૊ΈΛ࣮૷
    w $16
    Ξϥʔτ͸Ϋϥελຖʹ
    
    ௨͔͜͠ͳ͍
    ɾ/BHJSB
    /"(*PT
    3FTUGVM
    "QJ
    w /BHJPT
    ͷεςʔλεΛ
    3&45
    "1*
    ͰऔΕͯศར 32
33. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. $MPVE8BUDI
    ͷάϥϑ ɾ࢖͍উख͕Α͘ͳ͍ͷͰ࢖͍ͬͯͳ͍
    w 
    िؒ෼ͷσʔλ͔͠ΈΕͳ͍
    w άϥϑ͕ҰཡͰ͖ͳ͍
    w /BNF
    ΍
    5BHT
    ͰϝτϦΫε୳ͤͳ͍
    w ΞΧ΢ϯτ͕ෳ਺͋Δͱ੾Γସ͕͑໘౗ 33
34. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. αʔόϦιʔε؂ࢹ ɾ$MPVE'PSFDBTU
    w $16
    
    .FN
    
    %JTL
    
    %#
    ͷ
    214
    ͳͲ
    w ϫʔΧʔΛ෼ࢄॲཧͤͯ͞εέʔϧΞ΢τͰ͖Δ
    w ඞཁʹԠͯ͡औಘ͢ΔϝτϦΫεΛ૿΍͢ͷ΋༰қ
    • 1PSUJOH
    .Z42-
    HSBQIT
    GSPN
    QFSDPOBNPOJUPSJOHQMVHJOT
    
    • "EE
    TFWFSBM
    HSBQIT
    PG
    SFEJT
     34
35. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. $MPVE'PSFDBTU
    ͷྫ 35
36. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. τϨϯυ؂ࢹ ɾ(SPXUI'PSFDBTU
    w )551
    Ͱ஋Λ
    1045
    ͢Δ͚ͩͰՄࢹԽͰ͖Δ
    w &-#
    ͷϦΫΤετ਺ɾΤϥʔ਺
    w %#
    ͷ
    TIBSE
    ຖͷϢʔβ਺ͷภΓ
    ɾ,JCBOB
    
    'MVFOUE
    
    &MBTUJD4FBSDI
    w ௚ۙͷΞΫηεϩάղੳʹ࢖ͬͯΔ 36
37. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. (SPXUI'PSFDBTU ɾྫ
    DMPVEXBUDIHG
    Ͱ
    &-#
    ΛՄࢹԽ
    w ('
    ͷ͍ΔαʔόͰ
    EBFNPO
    ىಈ͢Δ͚ͩ
    w IUUQTHJUIVCDPNIJSPTFBXTDMPVEXBUDIHG 37
38. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. ,JCBOB
    ʹΑΔΞΫηεϩάՄࢹԽ 38 σϓϩΠՄࢹԽ
39. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. ,JCBOB
    Ͱ৚݅ͷߜΓࠐΈ ɾಛఆͷ
    63-
    ͰߜΓࠐΈ
    
    
    ɾ&$
    ͷಛఆλάͰߜΓࠐΈ
    ! ɾ&$
    ͷϝλσʔλͰߜΓࠐΈ
    39 tagset_project:  ff path:  /user/* az:  us-­‐west-­‐1b  AND  instance_type:  m1.large
40. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. ,JCBOB
    ʹΑΔ
    
    ͷՄࢹԽ 40 σβΠφͷਓ͕֬ೝͯ͠௚ͤΔ
41. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. ࢀߟ
    &MBTUJDTFBSDI
    
    'MVFOUE 41
42. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. ࢀߟ
    'MVFOUE
    ͷૹ৴ଆ <source> type tail_ex tag raw.acc.ff path /var/log/apache/ff.acc.%Y%m%d format ltsv </source> ! <match raw.acc.ff> type record_reformer remove_keys conn_status,num_ka,pid,user,ua,referer enable_ruby false output_tag reformed.acc.ff </match> ! <match reformed.acc.ff> type ec2_metadata output_tag acc.ff <record> hostname ${tagset_name} project ${tagset_project} instance_type ${instance_type} az ${availability_zone} </record> </match> 42 ϩάಡΈࠐΈ ෆཁϑΟʔϧυ࡟আ &$
    ͷϝλσʔλ௥Ճ
43. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. ࢀߟ
    'MVFOUE
    ͷड৴ଆ <match acc.**> type record_reformer output_tag reformed.${tag} path ${req} </match> ! <match reformed.acc.*> type rewrite remove_prefix reformed add_prefix es <rule> … </rule> </match> ! <match es.acc.*> type forest subtype elasticsearch remove_prefix es <template> logstash_format true </template> </match> 43 SFR
    ϑΟʔϧυΛෳ੡ ΫΤϦετϦϯάআڈ &MBTUJDTFBSDI
    ʹอଘ
44. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. "VUP4DBMJOH
    Ќ ɾಠࣗͷ࣮૷Ͱ΍͍ͬͯΔ
    w ඞཁʹԠͯ͡ΧελϚΠζ͢Δͷ͕༰қ
    ɾର৅͸
    XFC
    αʔόͷΈ
    ɾ$16
    ͱ
    ϫʔΧʔͷϏδʔ཰͕ج४ 44
45. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. "VUP4DBMJOH
    ͷϙϦγʔ
    ɾΞΫςΟϏςΟ͕ଟ͍࣌ؒ͸εέʔϧͤ͞ͳ͍
    w ٸܹͳมԽʹαʔό௥Ճ͕ؒʹ߹Θͳ͍
    w ήʔϜຖʹϑΟʔόʔλΠϜ͕͋Γ༧ଌ͕೉͍͠
    w ͔ͱ͍ͬͯᮢ஋௿Ίʹ͢Δͱແବ͕ଟ͍
    ɾΞΫςΟϏςΟ͕௿͍࣌ؒʹ୆਺ΛݮΒ͢ʢಛʹਂ໷ʣ
    w ಥൃతʹΞΫςΟϏςΟ͕૿͑Δ͜ͱ͸·ͣͳ͍ 45
46. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. "VUP4DBMJOH
    ͷྫ 46 ϦΫΤετ਺ Πϯελϯε਺ $16
    ࢖༻཰ ͋Δఔ౓୆਺Ωʔϓ ੵۃతʹࢭΊΔ
47. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. &-#
    ͷঢ়ଶ؂ࢹ ɾ&-#
    ͷ
    *1
    ΞυϨεͷมԽΛ
    *3$
    ʹ௨஌
    w &-#
    ͸εέʔϧΞοϓͨ͠Γ͢Δͱ
    *1
    ͕มΘΔʁ
    w ΞϥʔτͷݪҼ੾Γ෼͚ʹར༻͍ͯ͠Δ
    w IUUQTHJUIVCDPNIJSPTFNPOJUPSFMCBEESFTT 47
48. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. "84
    Ͱ࣮ݱͰ͖ͨΒ͍͍͜ͱ ɾଞͷ
    *BB4
    ͷ͍͍ͱ͜ͲΓ
    ɾϦʔδϣϯؒ௨৴ͷ޲্
    ɾ&-#
    ͷݟ͑ΔԽɾແ௨৴
    ɾϚωδϝϯτίϯιʔϧͷϚϧνΞΧ΢ϯτ
    ɾαϙʔτʹؔͯ͠ 48
49. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. ΄͔ͷ
    *BB4
    ͷ͍͍ͱ͜ͲΓ ɾͨͱ͑͹
    (PPHMF
    $PNQVUF
    &OHJOF
    ͔Β
    w 
    ෼୯ҐͰͷ՝ۚ
    w ٸܹͳΞΫηε૿Ճʹ଱͑͏Δϩʔυόϥϯα
    w ϥΠϒϚΠάϨʔγϣϯ
    w ෳ਺
    7.
    ʹ઀ଓՄೳͳ
    1FSTJTUFOU
    σΟεΫ 49 ˞
    "84ΑΓ(PPHMF
    $PNQVUF
    &OHJOFΛબͼͨ͘ͳΔͷཧ༝
50. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. Ϧʔδϣϯؒ௨৴ͷ޲্ ɾάϩʔόϧͳαʔϏεͰϦʔδϣϯؒ௨৴͍͖͍ͯͨ͠
    w ݱঢ়͸
    +164
    Ͱ׬શʹಠཱͨ͠؀ڥʹͳ͍ͬͯΔ
    w "QQ
    ͸Ϧʔδϣϯຖɺ%#
    ͸ڞ௨Έ͍ͨʹ͍ͨ͠
    ɾ*#.
    ͷ
    TPGUMBZFS
    ͕͜ͷ͋ͨΓ͸༏Ґͱͷ͜ͱ ˞
    w ֤
    %$
    ͱ
    /8
    ڌ఺͕
    (CQT
    ͷઐ༻ઢ
    w ωοτϫʔΫͷ࢖༻ྉ͸ແྉ 50 ˞
    "84Ϧʔδϣϯؒ௨৴޲্ͱࠓޙͷΤίγεςϜ
51. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. ϢʔβʹΑΔ
    &-#
    ͷ؅ཧ ɾιʔγϟϧήʔϜ͸ಥൃతͳΞΫηε૿͕೔ৗ
    w ຖճϓϨ΢Υʔϛϯά͸ͪΐͬͱπϥΠ
    ɾ΋͏ͪΐͬͱϢʔβ͕؅ཧͰ͖ΔΑ͏ʹͳΔͱخ͍͠
    w ΩϟύγςΟ֬ೝɺࣄલʹΩϟύγςΟ௥Ճ 51
52. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. &-#
    ͷڧ੍੾அ ɾ)551
    ͷϦΞϧλΠϜ௨৴Ͱෆศ
    w ήʔϜ΍νϟοτͳͲͰར༻͢Δέʔε͕૿͑ͯΔ
    w ແ௨৴ঢ়ଶ͕ଓ͘ͱڧ੍తʹ઀ଓ͕੾Εͯ͠·͏
    w ࠷େͰ
    
    ෼·Ͱ͸৳͹ͤΔͱ͍͏΢ϫα ˞
    w ΦϓγϣϯͰઃఆͰ͖Δͱخ͍͠ 52 ※ https://forums.aws.amazon.com/thread.jspa?messageID=382182#
53. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. Ϛωδϝϯτίϯιʔϧ ɾϚϧνΞΧ΢ϯτରԠͯ͠΄͍͠
    w αʔϏε͕ͨ͘͞Μ͋ΔͱߦͬͨΓདྷͨΓ͕ͪ͠
    w Ԧಓͳͷ͸
    $ISPNF
    ͷϚϧνϢʔβػೳʁ
    w ผͷϒϥ΢βΛىಈ͢Δͱ͍͏ख΋ 53
54. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. "84
    4VQQPSU ɾͪΐ͏Ͳ͍͍αϙʔτϓϥϯ͕ͳ͍
    w ۓٸͳ࣭໰Λ·ΕʹૹΔఔ౓
    w &-#
    ͷϓϨ΢Υʔϛϯά͸࢖͍͍͕ͨ࣌͋Δ
    w ར༻ྉۚͷ਺ύʔηϯτ͔͔Δ
    ɾαϙʔτ΋ΦϯσϚϯυͰ
    w ༏ઌ౓෇͖ͷνέοτങ͑ΔΈ͍ͨͳ࢓૊Έ͕Α͍ʁ 54
55. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. ·ͱΊ 55
56. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. ͥΜͿ
    "84
    Ͱ΍Βͳ͍ϫέ 56
57. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. Ͱ͖ͳ͍͜ͱ͸
    ͨͿΜ
    ͳ͍ 57
58. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. ͥΜͿ
    "84
    Ͱ΍ΔϝϦοτ ɾγεςϜશମΛ
    "84
    ্Ͱͷӡ༻ʹ࠷దԽͰ͖Δ
    w ݱঢ়͸ΦϯϓϨͷγεςϜΛ
    "84
    Ͱӡ༻ͯ͠Δ
    ɾӡ༻໘Ͱͷ޻਺͕ݮΔ
    w αʔόͷނো
    Πϯελϯεো֐
    ͕ൺֱతগͳ͍
    w ΩϟύγςΟϓϥϯχϯάָ͕ʹ 58
59. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. ͥΜͿ
    "84
    Ͱ΍ΔσϝϦοτ ɾࣗ෼͚ͨͪͩͰͲ͏ʹ΋Ͱ͖ͳ͍ཁૉ͕૿͑Δ
    w ϓϥοτϑΥʔϚʔͱͯ͠ͷઆ໌੹೚͕Ռͨͤͳ͍
    ɾେن໛ʹͳͬͯ͘ΔͱίετϝϦοτ͕ݟ͍ͩ͠ʹ͍͘
    w ن໛͕େ͖͍ͱେྔʹόϧΫͰ࢓ೖΕՄೳ
    w 3*
    ͋ΓͰ΋ίετ༏Ґʹ͸ͳΒͳ͍ 59
60. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. ·ͱΊ ɾߟ͑ͯΈΔͱ
    "84
    Ҡߦ͢Δͷʹػೳతͳน͸গͳ͍
    w ͦΕ͚ͩ
    "84
    ͷαʔϏε͸׬੒౓͕ߴ͍
    ɾҰํͰɺۚમతͳ໘ͰҠߦϝϦοτ͕Έ͑ͳ͍ঢ়گ
    w ن໛͕େ͖͍ͱݟੵ΋Γ΋೉͍͠Ұ໘΋͋Δ͕
    w େ͖ͳϝϦοτ͕ͳ͍ͱ։ൃଆͷ޻਺֬อ΋೉͍͠ 60
61. Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. 61 Thank you