ゲームインフラとGoogle Cloud Platformと酒！

Transcript

1. ($&ࣄྫͱHSBTZTͷ࢓૊Έ঺հ
2. ձࣾ঺հ ໊ࣾ גࣜձࣾgrasys ઃཱ 2014೥11݄13೔ ୅ද ௕୩઒༞հ ࣄۀ಺༰ MSP γεςϜઃܭɾߏஙɾӡ༻อक 2015೥1݄ʹͳΓ·ͨ͠ʂ
3. ࣗݾ঺հ ࢯ໊ ௕୩઒ ༞հ ܦྺ GMO, Yahoo Japan, Squere Enix etc…
 2010೥ʹgms(gloopsͷલ਎)΁ೖࣾ Πϯϑϥ໘ͷ͢΂ͯͷઃܭ ։ൃ෦෦௕ͱͯ͠։ൃ෦૊৫ԽɺΤϯδχΞͷ࠾༻ ࣥߦ໾һɺϓϦϯγύϧΠϯϑϥετϥΫνϟʔΞʔΩςΫτ ৬छ ͍ΘΏΔΠϯϑϥΤϯδχΞ GCPྺ GCEॳظͷࠒ͔Β ͦͷଞ azure, aws΋৮͍ͬͯ·͢ɻ publish Fusion-IOΛ2011೥ʹຊ൪ಋೖ͠Fusion-IOࣾʹऔΓ্͛ΒΕΔ SoftwareDesign2012.03هࣄ 2012೥DellͷCMग़ԋʢςϨϏ౦ژ ϫʔϧυϏδωεαςϥΠτʣ IcingaʢnagiosͷforkʣͷϢʔβʔίϛϡχςΟʹܝࡌ facebook: yusuke.exzm
4. ($&ࣄྫ঺հ
5. Application WebSocket HTTP Load Balancer Cloud Storage BigQuery Percona XtraDB Cluster Redis UserData Shard Redis WebSocket HealthyList Monitor Operation Static IP Static IP Static IP CNAME asset.xxx.com Cloud Storage CBDLVQ KPI Data Cloud Monitoring Cloud Logging 2014೥લ൒ࠒʹߏ੒ͨ͠΋ͷʹݱঢ়ͷΞϨϯδΛՃ͓͑ͯΓ౰࣌ͷߏ੒ͱ͸ҟͳ͍ͬͯ·͢ɻ
6. "QQMJDBUJPO nginx gunicorn django haproxy maxscale consul serf fluentd redis XtraDB XtraDB XtraDB redis bigquery ֤छInstance৘ใ JOqVYEC΁ͷNFUSJDTૹ৴ ֤छ؂ࢹ4UBUVTͳͲ HTTP Load Balancer
7. 8FC4PDLFU nginx gunicorn django haproxy maxscale consul serf fluentd redis XtraDB XtraDB XtraDB redis bigquery ֤छInstance৘ใ JOqVYEC΁ͷNFUSJDTૹ৴ ֤छ؂ࢹ4UBUVTͳͲ redis HTTP Load Balancer
8. "QQMJDBUJPOͱ8FC4PDLFUͷ࿈ܞ redis consul HTTP API - nginx - DNS - supervisord - haproxy - maxscale - connections ্هstatus͕͢΂ͯOKͷInstanceΛ RedisͷListͱͯ͠อଘ
9. Network Load Balancer rabbitmq cluster percona xtradb cluster application old api operation monitor BigQuery Cloud DNS Network Load Balancer application new api redis image cache jobqueue worker application customer api key data temporary data asset Network Load Balancer Network Load Balancer ݱࡏ४උத application sub system ha-mode Cloud Storage
10. Network Load Balancer master node client node data node kibana elasticsearch elasticsearch elasticsearch elasticsearch elasticsearch fluentd fluentd elasticsearch fluentd elasticsearch fluentd elasticsearch fluentd Static IP 1೔ಛʹଟ͍೔Ͱ150GB ͪΐͬͱଟΊͷ೔Ͱ40GB ී௨͸6ʙ8GB
11. Photon΋΍ͬͯͨΓ͠·͢ɾɾɾ ࣮ࡍͷ୆਺ͱ͔͸ݴ͑·ͤΜ͕ʂ͆
15. ͍͢·ͤΜ͕ݴ͑·ͤΜɾɾɾ w ๭༷ࣾͱίϯιʔϧήʔϜͱ͔
    w ๭༷ࣾͱεϚʔτϑΥϯ޲͚ظ଴ͷλΠτϧ
    w ๭༷ࣾͱ*1ͷεϚʔτϑΥϯ޲͚ήʔϜͱ͔
    w ݱࡏ๭༷ࣾͱΊͬͪΌઃܭதͩͬͨΓͱ͔
16. ήʔϜۀքͷΈͳ͞·΁ w ΦϯϓϨϛε͔Βͷ($1Ҡߦʹ͍ͭͯͷ஫ҙ఺ͳͲ͸͍͔ͭ͘ ͋Γ·͕͢ɺ
 ͿͬͪΌ͚͜͜͡Ό࿩͠੾Εͳ͍ͷͰ͝૬ஊ͍ͩ͘͞ɻ
    w Ή͠Ζৗ࣌઀ଓͱ͔
    w όοΫΤϯυͲ͏͢Δͷͱ͔
    w σʔλ௨৴ͷετϦʔϜόοϑΝ࢖͍͍ͨͱ͔
    w άϩʔόϧόϥϯγϯάͱৗ࣌઀ଓͷϋϯυϦϯάͱ͔
17. HSBTZT
    BSDIJUFDUVSF
18. ·ͣ͸ɾɾɾ
    ͏͕ͪΑ͘࢖ͬͯΔΈͳ͞Μ
20. provisioning configration ֤छMiddleware setup etc…
 ؀ڥม਺/PATH/LDࣗಈઃఆ configration ֤छMiddlewareࣗಈઃఆ fluentd, haproxy, etc… clustering serf/consulࣗಈઃఆ operation perlͷcinnamonͰͰ͖͍ͯΔ
 ΦʔέετϨʔγϣϯπʔϧ bootstrap monitoring init੍ޚ: glauncher monitoring: gmonitor HSBTZT
    6UJMJUJFT Utilities envutils cfgutils clutils clctl gutils
21. DPOTVM w DMVTUFS৘ใ
    w ؂ࢹ ࣗࣾ։ൃͷHPMBOH੡ͷ࢓૊Έ ͷൃߦ
    w ؆қతͳΦʔέετϨʔγϣϯπʔϧͱͯ͠
22. TFSG w QFSM
    DJOOBNPO ΦʔέετϨʔγϣϯπʔ ϧ ͷSPMF৘ใͷιʔε
    w কདྷతʹഇࢭ༧ఆ
23. UFSSBGPSN w *OTUBODFੜ੒
    w %JTL
    "UUBDI
    w 'JSFXBMMઃఆ
    w -PBE
    #BMBODFSੜ੒
    w FUD
24. SFSVO w #BTI
    $PNNBOE
    -JOF
    'SBNFXPSL
    w SFSVO
    <NPEVMFT>
    <DPNNBOET>
    w ίϚϯυͷମܥԽ͕ߦ͑ͯඇৗʹศརʂ
    w HDMPVEͰTOBQTIPUͱͬͯEJTLͭͬͯ͘JNBHFੜ੒ͱ͔ΊΜͲ֮ͯ͑ͯ͘͘͞ΒΕͳ͍
    w *OTUBODFͷ.BDIJOF4J[Fͱ͔ͷ3FTJ[Fͱ͔͹͹ͬͱ΍Γ͍ͨ
    w FMBTUJDTFBSDIͷDMVTUFSTUBUVTͱ͔OPEFTͱ͔DVSMͰ͍͍֮ͪͪ͑ͯΒΕͳ͍
    w ίϚϯυ௕͍΋ͷͰΑ͘࢖͏΋ͷͳͲΛొ࿥ͯ͠ศརʹ࣮ߦͯ͠·͢ɻ
    w Ұ౓΍ͬͨ͜ͱ͸΋͏΍Βͳ͍ʂ͆
26. FOWVUJMT w ؀ڥߏ੒πʔϧ
    w CBTISDࣗಈੜ੒ 1"5)
    ."/1"5)
    1,(@$0/'*(@%*3ͱ͔
    w MEDPOpHʢ௥Ճͨ͠-%ͷDPOpHࣗಈੜ੒ͱ௥Ճ
    w VTSMPDBMFUD HJU؅ཧ ͱFUD഑ԼͷࣗಈTZNMJOL
    w OUQEઃఆ͔ΒDISPOZEͷDPOpHࣗಈੜ੒
    w SFSVOͷNPEVMF
    EJSFDUPSZ΋ؚΜͰ͍ͯHJUͰ؅ཧ
27. DMVUJMT w DPOTVMTFSGͷࣗಈઃఆ
    w *OTUBODFͷىಈγʔέϯεͰࣗಈઃఆͯ͠ ىಈͯ͘͠ΔΑ͏ʹ͢ΔͨΊͷπʔϧ
    w HJUͰ؅ཧ
28. DMDUM w ΦʔέετϨʔγϣϯπʔϧ
    w ฼ମ͸QFSMͷDJOOBNPO
    w DJOOBNPO
    <SPMF>
    <UBTL>
    w HJUͰ؅ཧ
    w TFSGͷΫϥελ৘ใ͔ΒΦʔέετϨʔγϣϯͷ3PMFΛࣗಈੜ੒
    w কདྷతʹ͸DPOTVMͷXSBQQFSͳͲʹҠߦͯ͠TFSGґଘΛݮΒ͍ͯ͘͠ ํ਑Ͱഇࢭ͍ͯ͘͠༧ఆ
29. HNPOJUPS w HPMBOHͰ։ൃ͍ͯ͠Δ؂ࢹϓϩάϥϜ
    w HNPOJUPS
    <TVCDPNNBOE>
    w Ϧιʔε؂ࢹɺ௨৴ɺϛυϧ΢ΣΞͷεςʔλεऔಘ
    w DPOTVMʹΩοΫ͞ΕΔܗͰىಈ
    w DPOTVMͷ؂ࢹ*OUFSGBDF͸/BHJPT1MVHJOͱಉ͡
    w *OqVY%#΁௚઀σʔλΛॻ͖ࠐΉʢঃʑʹ4UBDL%SJWFSͷ$VTUPN.FUSJDT΋௥Ճ ͞Εͭͭ͋Δ
    w αϒίϚϯυ͕ଟ͘ͳΓ͖͍͗ͯͯͯ͢ࠔͬͯΔ͆͆ʢͰ΋ؾʹ͠ͳ͍ʂ
31. JOqVYEC
    
    HSBGBOB w ࣌ܥྻσʔλϕʔεͱͦͷϑϩϯτΤϯυ
    w ֤छ؂ࢹσʔλΛೖΕάϥϑαϯϓϦϯά
32. w ͜Ε͸Ϧιʔε༻ͷ μογϡϘʔυ
    w ֤छϛυϧ΢ΣΞ༻ ͷ΋ͷ΋͋Γ·͢ɻ
    w ୯Ұϗετɺαʔό छผຖʹߜΔ͜ͱ΋ Ͱ͖ΔΑ͏ʹ͍ͯ͠ ·͢ɻ
33. TUSFDIFSͷ($4൛ w ໊લ͚ͭͯͳ͍ɾɾɾ
    w ௨ৗͰ͸ରԠͰ͖ͳ͍ϨϕϧͷΫϥελ޲͚
    w (PPHMF
    $MPVE
    4UPSBHFΛར༻ͨ͠େن໛޲͚σϓϩ Ππʔϧ
    w 
    JOTUBODFT͘Β͍ʹରͯ͠഑෍ର৅ʹରͯ͠഑෍ ͢ΔαΠζʹ΋ΑΓ·͕͢ඵఔ౓Ͱ׬ྃ͠·͢ɻ
34. #BDLVQ
    'SBNFXPSL w ຖճTIFMMTDSJQUͳͲͰ࡞Δͷ͕ΊΜͲ͍ͷͰ GSBNFXBPSLԽΛਐΊ͍ͯ·͢ɻ
    w HPMBOH੡ͷ$-*
    'SBNFXPSL
    w .Z42-.POHP%#
    w (PPHMF
    $MPVE
    4UPSBHF
    4UBOEBSE/FBSMJOFͷ#VML "SDIJWFͷৼΓସ͑ͳͲʹରԠ༧ఆ
35. HSBTZTͰ͸͝঺հͨ͠Α͏ʹ
 ͨ͘͞ΜͷΠϯϑϥ޲͚ͷπʔϧΛ։ൃ͠ ͍ͯ·͢ɻ
36. .41ࣄۀऀͱͯ͠
 Πϯελϯε௥Ճͱ͔؅ཧͱ͍ͬͨ୯७ͳ ࡞ۀͰ͸ͳ͘
 ҰॹʹෛՙରࡦΛݕ౼ͨ͠Γ
 ඞཁ͋Ε͹ߏ੒มߋ΋ଧ਍͍ͯ͠·͢ɻ
    ։ൃऀͷํͱҰॹʹӡ༻͍ͯ͘͠ܗΛ
 ͔ͳΓॏࢹ͍ͯ͠·͢ɻ
37. ͝ڵຯ͋Ε͹
 ͓ؾܰʹ͝࿈བྷ͍ͩ͘͞ʂ
38. ͝ਗ਼ௌ͋Γ͕ͱ͏͍͟͝·ͨ͠ɻ ࣭͝໰͋Γ·ͨ͠Β͓ؾܰʹͲ͏ͧʂ Facebookͷ༑ୡਃ੥΋͓ؾܰʹͲ͏ͧʂ ௕୩઒ ༞հ facebook: yusuke.exzm