Upgrade to Pro — share decks privately, control downloads, hide ads and more …

コンテナをSpot Fleetで起動するという選択肢

Avatar for Kazuma Watanabe Kazuma Watanabe
December 14, 2016
Technology
1.1k
2

コンテナをSpot Fleetで起動するという選択肢

JAWS-UG コンテナ支部 #7

Avatar for Kazuma Watanabe

Kazuma Watanabe

December 14, 2016

More Decks by Kazuma Watanabe

See All by Kazuma Watanabe
Terraform言語の静的解析 / static analysis of Terraform language
Avatar for Kazuma Watanabe wata727
1
160
SmartHRにおけるBiTemporal Data Modelの実践のその後 / After the practice of BiTemporal Data Model in SmartHR
Avatar for Kazuma Watanabe wata727
1
3.9k
PHPを検査するPHPを書く / Write PHP inspection by PHP
Avatar for Kazuma Watanabe wata727
1
2.4k
快適なコードレビューを目指して / For a comfortable code review
Avatar for Kazuma Watanabe wata727
1
710
現実世界でのコンテナの運び方
Avatar for Kazuma Watanabe wata727
3
1.2k
Lintの付き合い方とPahoutのご紹介
Avatar for Kazuma Watanabe wata727
0
210
Querlyで始めるコードレビューの自動化
Avatar for Kazuma Watanabe wata727
2
480
エンジニア向けSaaSを支えるInfrastructure as Code
Avatar for Kazuma Watanabe wata727
5
2.5k
SideCIのインフラ構築を自動化した話
Avatar for Kazuma Watanabe wata727
1
2.2k

Other Decks in Technology

See All in Technology
Bucharest Tech Week 2026 - Reinventing testing practices in the AI era
Avatar for Eric Deandrea edeandrea
PRO
1
150
ポケモンの型をTypeScriptの型システムで表現してみた
Avatar for subroh_0508 subroh0508
0
370
protovalidate-es を導入してみた
Avatar for 弁護士ドットコム bengo4com
0
170
RSA暗号を手計算したくなること、ありますよね？？ (20260615_orestudy6_rsa)
Avatar for Koki Senda thousanda
0
280
NAB Show 2026 動画技術関連レポート / NAB Show 2026 Report
Avatar for CyberAgent cyberagentdevelopers
PRO
0
170
機械学習を「社会実装」するということ 2026年夏版 / Social Implementation of Machine Learning June 2026 Version
Avatar for Moe Uchiike（内池 もえ） moepy_stats
4
1.6k
FDE という解 ― 暗黙知と明示知をつなぐ、伴走型エンジニアリング ―
Avatar for 太田 博三 otanet
0
130
DevOps Agentで始めるAWS運用 〜フロンティアエージェントが変える運用の現場〜
Avatar for nyankotaro nyankotaro
1
390
2026.06.13_AI時代に事業会社が「SIer出身エンジニア」を求める理由 / Why Businesses Seek Engineers with a System Integrator Background in the AI ​​Era
Avatar for jumpei_ikegami jumtech
0
1.1k
タクシーアプリ『GO』の実践的データ活用
Avatar for GO Inc. dev mot_techtalk
3
190
2026TECHFRESH畢業分享會 - Lightning Talk - 資料也要 CI/CD? 用 Airbyte 自動化資料同步
Avatar for LINE Developers Taiwan line_developers_tw
PRO
0
850
"何を作るか"を任される エンジニアは、どう育つのか
Avatar for ofuji-works yutaokafuji
1
610

Featured

See All Featured
VelocityConf: Rendering Performance Case Studies
Avatar for Addy Osmani addyosmani
333
25k
[RailsConf 2023 Opening Keynote] The Magic of Rails
Avatar for Eileen M. Uchitelle eileencodes
31
10k
Between Models and Reality
Avatar for mayunak mayunak
4
330
Agile Leadership in an Agile Organization
Avatar for Dr. Kim W Petersen kimpetersen
PRO
0
160
The Success of Rails: Ensuring Growth for the Next 100 Years
Avatar for Eileen M. Uchitelle eileencodes
47
8.2k
Darren the Foodie - Storyboard
Avatar for Kevinho.art khoart
PRO
3
3.4k
Building an army of robots
Avatar for Kyle Neath kneath
306
46k
[Rails World 2023 - Day 1 Closing Keynote] - The Magic of Rails
Avatar for Eileen M. Uchitelle eileencodes
38
2.9k
How to Talk to Developers About Accessibility
Avatar for Jason CranfordTeague jct
2
230
Believing is Seeing
Avatar for Spiro Bolos oripsolob
1
140
Deep Space Network (abreviated)
Avatar for Tony Rice tonyrice
0
170
JAMstack: Web Apps at Ludicrous Speed - All Things Open 2022
Avatar for David Neal reverentgeek
1
470

Transcript

  1. ίϯςφΛSpot FleetͰ ্ཱͪ͛Δͱ͍͏બ୒ࢶ JAWS-UG ίϯςφࢧ෦ #7 @wata727

  2. @wata727 • Kazuma Watanabe • Engineer in Actcat, Inc. •

    AWS Solution Architect • https://twitter.com/wata727_

  3. Containers in SideCI

  4. Sandbox Containers • ࣮ߦ؀ڥΛίϯςφԽ͙ͯ͢͠ഁغ͢Δ • 5,000 containers / day EPDLFS

    Ubuntu Host GitHub Clone Comment

  5. Sandbox Containers • ࣮ߦ؀ڥΛίϯςφԽ͙ͯ͢͠ഁغ͢Δ • 5,000 containers / day EPDLFS

    Ubuntu Host GitHub Clone Comment

  6. Spot Fleet ?

  7. εϙοτΠϯελϯεΛ ຊ൪Ͱ࢖ͬͯΔํʁ ʢ༧૝: 10%ʣ ※௥ه: 5%͘Β͍Ͱͨ͠

  8. Amazon Spot Instance • ༧උͷEC2ίϯϐϡʔςΟϯάੑೳʹೖࡳ • ͓͍҆ʂʂʂ • ͱ͋Δc4.2xlargeͷྫ: $0.39

    → $0.06 ڻ͖ͷ

  9. ͨͩ͠… • ೖࡳՁ֨ΛԼճΔͱམͪΔ • ߴ͘ͳͬͨΒผͷϓʔϧʢAZͱΠϯελϯε λΠϓͷ૊Έ߹ΘͤʣͷεϙοτΠϯελϯ εΛىಈ͢Δ is ೉͍͠ •

    ͦΜͳʹ؁͍࿩͸ͳ͍͔…

  10. Spot Fleet • εϙοτΠϯελϯεͷλʔήοτ༰ྔΛҡ ࣋͢ΔͨΊͷ࢓૊Έ • ௥Ճྉۚແ͠ • ஋ஈ͕ߴಅͨ͠ΒɺผͷϓʔϧͰҰ൪͍҆ε ϙοτΠϯελϯε͕ࣗಈͰ্ཱ͕ͪΔ

  11. Spot Fleetͷઓུ • lowest: બ୒ͨ͠தͰৗʹҰ൪͍҆ϓʔϧ͔Β ىಈ͢Δɺ͍͕҆ߴಅ͢Δͱશ෦མͪΔ • diversified: ՄೳͳݶΓϓʔϧΛ෼ࢄͭͭ͠ɺ ͍҆ॱʹىಈ͢Δɺߴ͍ͱ͖΋͋Δ͕ɺ৑௕

    Խͱߴಅ࣌ͷϦεΫܰݮ͕ظ଴Ͱ͖Δ

  12. ͸͡Ί͔ͨ • ެࣜͷνϡʔτϦΞϧ͕͔ͳΓஸೡͳͷͰɺ ͦΕʹैͬͯ࡞ͬͯΈΔͱྑͦ͞͏ • ͦΕ͢Β໘౗ͳਓ΁ • https://github.com/wata727/ tf_aws_ecs_on_spotfleet

  13. Demo

  14. Spot Fleet in SideCI

  15. EC2ΛSpot Fleetʹ͠·ͨ͠

  16. Spot Fleetʹ͢ΔͨΊʹ • ಥવΠϯελϯε͕མͪͯ΋ࠔΒͳ͍Α͏ʹ ઃܭ͢ΔʢϦτϥΠͱ͔ʣ • ىಈͨ͠Βɺ͙͢ʹαʔϏεΠϯͰ͖ΔΑ͏ ʹϢʔβσʔλͱ͔ઃఆ͓ͯ͘͠ • େମAutoScalingʹඞཁͳ΋ͷͱಉ͡ɺඞવత

    ʹো֐ʹڧ͍ઃܭʹͳΔ

  17. ҆ఆͯ͠Քಇͤ͞ΔͨΊͷTips • diversifiedͱlowestͰ෼͚Δ

  18. ҆ఆͯ͠Քಇͤ͞ΔͨΊͷTips • Spot Fleet ؒͷೖࡳՁ֨ʹࠩΛ͚ͭΔ • ೖࡳՁ֨Λ௒͑ͨ࣌఺ͰผͷҰ൪͍҆ϓʔϧ ͔ΒΠϯελϯε͕ىಈ͢Δ͜ͱΛར༻͢Δ • ೖࡳՁ͕͚֨҆Ε͹ɺఆظతʹҰ൪͍҆Πϯ

    ελϯεϓʔϧ΁ͷ࠶ׂΓ౰͕ͯߦΘΕΔ

  19. Ձ֨҆ͨ͘͠Β͙͢མͪͳ͍ʁ • EC2ͷ՝ۚ୯Ґ͸1࣌ؒ͝ͱ͔ͩΒɺ୹ִ͍ؒ Ͱ࠶ىಈͨ͠Β༨ܭʹߴ͘ͳΔΜ͡Ό… • ࣮͸ىಈ1࣌ؒҎ಺ʹεϙοτՁ֨ͷߴಅͰڧ ੍λʔϛωʔτ͞Εͨ৔߹͸ର৅֎ʹͳΔ • http://aws.typepad.com/sajp/2016/11/aws- black-belt-online-seminar-amazon-ec2-spot-

    instances.html

  20. Ͱɺ҆ఆͯ͠·͔͢ʁ • ҙ֎ͱ҆ఆͯ͠·͢ • 2िؒ͘Β͍ฏؾͰੜ͖࢒ͬͯΔΠϯελϯε ͞Μ΋͍·ͨ͠

  21. ͱ͋Δm4.2xlargeͷ1೔

  22. Spot Fleet ӡ༻Ͱ ϋϚͬͨ͜ͱ

  23. ಥવͷىಈΤϥʔ • Spot FleetͰΠϯελϯε͕ىಈ͠ͳ͘ͳͬͨ • VPC಺ͰIPΞυϨε͕֬อͰ͖ͯͳ͍…ʁ • ͦΜͳഅࣛͳͱࢥ͍ͭͭ΋VPCΛ֬ೝ

  24. ʊਓਓਓਓਓਓਓਓਓਓʊ ʼɹར༻ՄೳͳIP਺: 1ɹʻ ʉY^Y^Y^Y^Y^Y^Y^Yʉ

  25. VPC಺ͷIP͕ރׇ • /25Ͱ128͋Δ͸ͣͷIP͕ރׇ • ݪҼ͸େྔʹੜ੒͞Ε͍ͯͨENI (!) • TerraformͰىಈͨ͠Spot Fleet͸ಛఆͷ৚݅ ԼͰ

    DeleteOnTermination ͕falseͷΠϯελ ϯεΛىಈ͢Δ

  26. PR౤͛·ͨ͠ • Ͱ΋Ϛʔδ͞ΕΔ༧ײແ͠

  27. Ձ֨ͷҟৗͳཚߴԼ • Ұ࣌ظɺ࢖ͬͯΔϓʔϧͷ஋ஈ͕ݢฒΈߴಅ ͯ͠શવ҆ఆͯ͠ΠϯελϯεΛ֬อͰ͖ͳ ͍࣌ظ͕͋ͬͨ • ΦϯσϚϯυฒྻىಈͯ྇͗͠·ͨ͠ • ถେ౷ྖબͷλΠϛϯά͕ؔ܎͔ͯͨ͠΋…

  28. diversifiedͳͷʹภΔ • ͳ͔ͥdiversifiedͰىಈ͢ΔΠϯελϯε͕ಉ ͡ϓʔϧ͔Βىಈ͍ͯ͠Δ • AWSͷํʹฉ͍ͨͱ͜Ζɺ෼ࢄ͢ΔͳΒ͹3 ୆Ҏ্͸ඞཁΒ͍͠ • ఆظతʹΠϯελϯεΛ࡟আͰ͖Ε͹ɺ࠷҆ ͷϓʔϧ͔Βىಈ͢ΔͷͰ෼ࢄ͢Δ͔΋…ʁ

  29. Chaos Monkeyͷػӡ

  30. ͪͳΈʹ • Chaos Monkey in Lambda΋͋ΔΑ

  31. ·ͱΊ

  32. ·ͱΊ • ͓҆͘ͳΔͷ͸΋ͪΖΜɺෆྀͷো֐Λ૝ఆ ͨ͠ઃܭΛ༨ّͳ͘͞ΕΔͷͰɺΞʔΩςΫ νϟ͕ڧਟʹͳΔ • ੲ͸εϙοτΠϯελϯε͸Ұ࣌తͳόον ॲཧ޲͖͕ͩͬͨɺSpot Fleet͕ঢ়گΛม͑ͨ •

    ࠷ߴͳͷͰΈΜͳ࢖͓͏ʂʂ