Upgrade to Pro — share decks privately, control downloads, hide ads and more …

MDH-LT-Thursday-20170126

A8f802dfbbdd43f6e3be9936c3cbed7f?s=47 Shuhei Kimura
January 26, 2017
Technology
0
1.4k

 MDH-LT-Thursday-20170126

A8f802dfbbdd43f6e3be9936c3cbed7f?s=128

Shuhei Kimura

January 26, 2017
Tweet

More Decks by Shuhei Kimura

See All by Shuhei Kimura
Akka streamsを活用したログ集計に優しいデータフローの構築
A8f802dfbbdd43f6e3be9936c3cbed7f?s=48 kimurashuhei
2
3.7k
pmconf2017
A8f802dfbbdd43f6e3be9936c3cbed7f?s=48 kimurashuhei
0
3.1k
AWS Summit Tokyo 2015
A8f802dfbbdd43f6e3be9936c3cbed7f?s=48 kimurashuhei
0
44

Other Decks in Technology

See All in Technology
JAWS-UG 朝会 #36 登壇資料
08dd0b93e011904f40d60d5a1b54c671?s=48 takakuni
1
550
Istioを活用したセキュアなマイクロサービスの実現/Secure Microservices with Istio
00851927294532e0742c2c174730dff0?s=48 ido_kara_deru
3
410
私のAWS愛を聞け！ここが好きだよAmazon FSx for NetApp ONTAP
586ad2cd1cfc66759754e86d0ce73f17?s=48 non97
0
760
フィンテック養成勉強会#24
525442fc70ca92f82ae503f826956137?s=48 finengine
0
330
ECS Exec を使った ECS の トラブルシューティング
6378d4cb0e5e7cfabe13d144827a6a28?s=48 dohara
0
110
ぼくらが選んだ次のMySQL 8.0 / MySQL80 Which We Choose
A3966f193f4bef226a0d3e3c1f728d7f?s=48 line_developers
PRO
7
2.9k
データをコネコネ！メール配信用データ生成の仕組み
Cdb7fe48c050935995f8a6a58a5ceba9?s=48 kappezoro
0
120
ログ集約基盤をCloudWatchからOpenSearchに変えてみた
098ad475722e3697ec2fba28c8654f9f?s=48 yuhta28
0
130
OpenShiftのサポートを始めるぞ！高頻度で更新されるOSSを効果的にキャッチアップする仕組みを考えました！
4cb5b950cfd0eabf5d6b828c951d4549?s=48 loftkun
0
330
インフラのテストに VPC Reachability Analyzer は外せないという話
3e77f9dbec6a87756d1dbdddab283aee?s=48 nulabinc
PRO
2
710
MySQL v5.7 勉強会/study-mysql-ver-5-7
8847086af047cbf895ab3277b59529fe?s=48 andpad
0
2k
SPAとWebアプリケーションでCognitoの使い方はどう変わるのか？ / How do we use cognito with SPA and web applications?
7d75345644fa75da12a5e5215ac2352a?s=48 kitano_yuichi
0
380

Featured

See All Featured
Facilitating Awesome Meetings
245cee81a9c424266e5e401d844ea881?s=48 lara
29
4.1k
Building Better People: How to give real-time feedback that sticks.
9952dfcd5d338f8a8e7175c8a8f65fb5?s=48 wjessup
344
17k
The Language of Interfaces
Fde6c3a50ca518a909ef35c22c0ee0e4?s=48 destraynor
148
21k
How to name files
0a4f62e90c976eeb44d33add75cca5af?s=48 jennybc
40
63k
Testing 201, or: Great Expectations
A9704266587836f7e784235e5073b93e?s=48 jmmastey
21
5.5k
Building an army of robots
5f2da528927a2ec9ba4fec2069cbc958?s=48 kneath
298
40k
GitHub's CSS Performance
64827b31aef81498662e8af4bd6d5157?s=48 jonrohan
1020
420k
WebSockets: Embracing the real-time Web
E76911cbe088e5b850d966de3fc7435b?s=48 robhawkes
57
5.5k
How GitHub (no longer) Works
78b475797a14c84799063c7cd073962f?s=48 holman
297
140k
Design and Strategy: How to Deal with People Who Don’t "Get" Design
95d9f37115fbb0d13135d0f77132f856?s=48 morganepeng
107
16k
The Mythical Team-Month
E6c6e133e74c3b83f04d2861deaa1c20?s=48 searls
210
39k
YesSQL, Process and Tooling at Scale
D09fad3e36ae6841f54820be0e907f7a?s=48 rocio
157
12k

Transcript

  1. ECS্Ͱಈ͘DockerΞϓϦέʔγϣϯΛTerraformΛ ࢖ͬͯσϓϩΠ͢ΔΑ͏ʹͯ͠Έͨ࿩ Dynalyst System Engineer Shuhei Kimura

  2. DynalystͰ͸γεςϜ͸͢΂ͯAWSͰߏங͞Ε͍ͯ·͢ ֓ཁ - ϦλʔήςΟϯά޿ࠂ഑৴αʔϏεϓϥοτϑΥʔϜͰ͢ɻ - ੈքதͷސ٬ʹαʔϏεΛఏڙ͠·͢ɻ ن໛ײ - RTBͰ͸ɺϐʔΫ࣌໿13ສQPS@Asia/Tokyo Region,

    10ສQPS@US/East Region - ೖࡳαʔό਺͸྆RegionͰ໿120୆ - ܭଌͳͲॾʑؚΊͯEC2 200୆ۙ͘Instance͕Քಇத - ֤छϩά͸͓Αͦ1.5TB/dayΛS3ʹอଘ

  3. Ͳ͏΍ͬͯΞϓϦέʔγϣϯͷϦϦʔεͯ͠·͔͢ʁ ࣮ߦ؀ڥ x σϓϩΠํ๏ = Ұൠతʹͱͯ΋ଟ༷Ͱ͋Δ - Fabric/CapistranoͳͲΛ࢖ͬͯEC2ʹΞϓϦΛϦϦʔε - Apex/aws-cliͳͲΛ࢖ͬͯLambdaFunctionΛϦϦʔε

    - ElasticbeanstalkΛར༻ͯ͠ELB+EC2ߏ੒ͷΞϓϦΛRollingUpdateϦϦʔε - Chef/Ansible/PuppetͳͲͰपล؀ڥؚΊͯprovisionͯ͠ϦϦʔε DynalystͰ͸ɺ͍Ζ͍Ζͳٕज़త௅ઓͷ݁Ռ .. ͍Ζ͍Ζͳ࣮ߦ؀ڥͰ৭ʑͳΞϓϦ͕ಈ͍͍ͯΔঢ়ଶΛ ίπίπFabricͷtaskΛ௥Ճͨ͠Γϝϯςͨ͠Γ͠ͳ͕Βɺ ͳΜͱ͔΍Γ͘Γ͍ͯ͠Δঢ়ଶɻ

  4. σϓϩΠͷ؍఺͔ΒEC2 Container Service ʹະདྷΛײͨ͡ ECS Cluster - αʔόϦιʔε͸ແବͳ͘༗ޮʹ࢖͍ͭͭ ECS Task

    Definition - ʓʓͳΞϓϦΛ ECS Service - XXͳ෩ʹಈ͔͍ͨ͠ ͍ΖΜͳΞϓϦέʔγϣϯΛಈ͔͢େલఏ͕ͱͯ΋౷Ұ͞Εͨঢ়ଶʹͳΔ Batch΋API΋Worker΋Consumer΋͍͍ͩͨECS্Ͱಈ͔ͤΔ DockerContainerԽ͢Δ͜ͱ͕σϓϩΠͷγϯϓϧԽʹܨ͕Δͱ͍͏ߟ͑

  5. ECS Docker ApplicationΛTerraformΛ࢖ͬͯϦϦʔε͠Α͏ ͳΜͰTerraformʁ - ίʔυͰ͔͚Δ - ECSͱͷIntegration͕ͪΌΜͱ։ൃ͞Εͯͨ - ੜͷAPIୟ͘ͷ͸͖ͬͱͲ͔͜Ͱ࠳ં͢Δ,

    retryͱ͔πϥͦ͏ - terraformͷΊΜͲ͍͘͞ͱ͜ΖΛ͋Μ·Γؾʹ͠ͳͯ͘Α͍ 㱺 stateյΕͯ΋ͳΜͱ΋ͳ͍ɻ࠶ߏஙͯ͠deploy͠௚ͤ͹͍͍ɻ - MultiRegionΛߟ͑Δͱɺಉ࣌ʹσϓϩΠͱ͔͕౰ͨΓલʹͳͬͯ͘͸ͣ 㱺 ݁ہͷͱ͜Ζத਎͸AWS APIͳͷͰ౿Έ୆αʔό͍ΒͣͰσϓϩΠͰ͖Δʂ 㱺 CircleCI͔Βterraform࣮ߦ͢Δͱ͔͢Ε͹ɺσϓϩΠ؀ڥߏங΋͍Βͳ͍

  6. ΍ͬͯΈͨΒ͜͏ͳͬͨᶃ ͱΓ͋͑ͣɺTerraform࣮ߦ؀ڥతʹ͸CircleCI೚ͤʹͯ͠ΈΔ

  7. ΍ͬͯΈͨΒ͜͏ͳͬͨᶄ TaskDefinition Service ErrorLogCount LogGroup

  8. ΍ͬͯΈͨΒ͜͏ͳͬͨᶅ ΞϓϦέʔγϣϯ͕ಈ͚ͩ͘Ͱͳ͘ɺͦͷपล΋ؚΊͯ ༻ҙͰ͖Δ఺͸ඇৗʹΘ͔Γ΍ͯ͘͢Α͘ͳͬͨɻ

  9. ෳ਺Regionʹෳ਺ͷAppΛϦϦʔε͢Δͷ΋ɺRollback΋؆୯ ޷͖ͳΑ͏ʹpr͢Δɻ ౰વreviewϑϩʔ࡞ͬͯ΋͍͍ɻ

  10. ·ͱΊ ECS x Terraform ͷ૊Έ߹ΘͤࢥͬͯͨΑΓྑ͛͞ ࠓޙ΋͍Ζ͍Ζͳٕज़͕ग़ͯ͘ΔͷͰɺࢼߦࡨޡ͍ͯ͘͠ ʮSSHͨ͠Βෛ͚ʯΛݱ࣮ͷ΋ͷʹ͢Δ΂͘ϒϥογϡΞοϓ