Share
Embed
Transcript
58 slides
-
Amazon ECSσϓϩΠπʔϧ ecspresso ։ൃ5ͷาΈ ໘ന๏ਓΧϠοΫ ౻ݪढ़Ұ (@fujiwara) AWS Dev Day
2023 Tokyo 2023.06.22 -
@fujiwara SREνʔϜ ISUCON 1,2,5,11 ! ༏উ4ճ ISUCON 3,8,12,13 ӡӦ(ग़)4ճ github.com/kayac/ecspresso
Amazon ECS σϓϩΠπʔϧ github.com/fujiwara/lambroll AWS Lambda σϓϩΠπʔϧ -
ecspresso ͱ github.com/kayac/ecspresso ൃԻʮΤεϓϨοιʯ ☕ Amazon Elastic Container Service (Amazon
ECS) ͷͨΊͷσϓϩΠπʔϧ ʮλεΫఆٛʯͱʮαʔϏεʯΛϑΝΠϧͰཧ͢Δ Go࣮ γϯάϧόΠφϦͰಈ࡞͢ΔCLI λεΫఆٛͱαʔϏεҎ֎(جຊతʹ)ཧ͠ͳ͍ -
λεΫఆٛɺαʔϏεͷઃఆAWS Command Line Interface (AWS CLI)ޓͷJSONϑΝΠϧ ϑΝΠϧςϯϓϨʔτͱͯ͠ѻΘΕΔ ྫ: σϓϩΠ͝ͱʹՄมͷΠϝʔδλάΛڥมͰࢦఆ //
ඞਢͷڥม "image": "debian:{{ must_env `IMAGE_TAG` }}" // ઃఆ͞Εͯͳ͍߹ͷσϑΥϧτΛࢦఆ "image": "nginx:{{ env `IMAGE_TAG` `latest` }}" -
AWS CloudFormation, AWS Cloud Development Kit (CDK), Terraformͱ࿈ܞՄೳ ґଘ͢ΔϦιʔεͷIDΛϋʔυίʔυͤͣʹղܾ #
ઃఆϑΝΠϧ ecspresso.yml plugins: - name: tfstate config: url: s3://my-bucket/terraform.tfstate // αʔϏεఆٛϑΝΠϧ "securityGroups": [ "{{ tfstate `aws_security_group.default.id` }}" ], -
ӡ༻ʹศརͳαϒίϚϯυ͕ͨ͘͞Μ run: ୯ମλεΫΛ࣮ߦ (RunTask) status: αʔϏεͷঢ়ଶΛදࣔ scale: αʔϏεͷλεΫΛมߋ refresh: αʔϏεͷλεΫΛશͯೖΕ͑
diff: σϓϩΠલʹมߋࠩΛදࣔ verify: σϓϩΠલʹ༻͢Δ֎෦ϦιʔεΛ֬ೝ exec: Amazon ECS ExecͰλεΫʹଓ (·ͩ·ͩ͋Γ·͢) -
ecspressoΛ͝ར༻ͷօ༷ 2 ϒοΫΥʔΧʔ, ϕΨίʔϙϨʔγϣϯ, LayerX ϑΝϯϑΝʔϨ, ίωώτ, εϚʔτϥϯυ, ͯͳ CARTA
HOLDINGS, ΧϯϜ, Classi, ϑΥʔΠοτ PR TIMES, ArkEdge Space, τϥετόϯΫ, λΠϛʔ Retty, MICIN, ηʔϑΟʔ, AmebaϚϯΨ, BASE ϚωʔϑΥϫʔυ, STORES, Kakedas, mediba Nature, Connected Base, (ΧϠοΫ) 2 ॱෆಉɺܝࡌڐՄΛಘͨͷͷΈ -
AWS Summit Tokyo 2023 ʮχϯςϯυʔΞΧϯτ ϦϊϕʔγϣϯϓϩδΣΫτʯͷൃද3 www.itmedia.co.jp/news/articles/ 2305/11/news048.html ΑΓҾ༻ ҰํͰFargateͷઃఆAmazon
CDKΛͬͯ ͍ͳ͍ͱ͍͏ɻίʔυͷઃஔΛࣗಈԽ͢Δπʔϧ ͱͷ૬ੑͷ͕ྑ͘ͳ͍͜ͱ͕ཧ༝ͱ͍͍ɺ ΘΓʹΧϠοΫͷΦʔϓϯιʔειϑτΣΞ ʮecspressoʯʢΤεϓϨοιʣΛ׆༻ͨ͠ ͱ͍ͯ͠Δɻ 3 https://pages.awscloud.com/rs/112-TZM-766/images/CUS-20AWS- Summit-2023Nintendo-Systems_FINAL.pdf -
ଞͷπʔϧௐͯΈΔ • ecs-deploy: λεΫఆٛࣗମͷίʔυཧͰ͖ͳ͍ github.com/silinternational/ecs-deploy • ecs-cli: ϩʔϧόοΫ͕Ͱ͖ͳ͍ github.com/aws/amazon-ecs-cli ϩʔϧόοΫ
= 1ͭલͷλεΫఆٛΛαʔϏεʹઃఆ͢Δ ! ʮAPI/CLIΛճݺͿ͚ͩͳΒࣗ࡞Ͱ͖ΔͷͰ…?ʯ ʮҰݟ؆୯ͦ͏ͳͷͰɺࣗલ࣮পͷୈҰาʯ -
ઃܭࢥ(1) αʔϏεɺλεΫఆٛͷཧʹಛԽ ʲཧ༝ʳଞͷϦιʔεͱϥΠϑαΠΫϧ ͕ҧ͏͜ͱ͕ଟ͍ͨΊ • Amazon VPC, ALB, Amazon RDS...
ظؒ͏ɺมߋසൟͰͳ͍ • λεΫఆٛɺαʔϏε σϓϩΠ͢Δͨͼʹߋ৽ ཧ͢Δओମ͕ҧ͏͜ͱଟ͍ ୯ҰͷπʔϧͰશͯΛཧ͢Δͱɺҙਤ ͠ͳ͍มߋࣄނ͕ى͜ΔՄೳੑ͕ߴ͍ -
2017.11.07 ։ൃ։࢝ 2017.11.09 v0.1.0 ࣮༻తͳ࠷ॳͷόʔδϣϯ deploy, rollback, statusίϚϯυͷΈ ఆٛϑΝΠϧͷςϯϓϨʔτॲཧڥมͷల։ͷΈ ͍ΘΏΔMVP(Minimum
Viable Product) ίʔυ411ߦ5 5 ecspresso v2.2.1Ͱ5703ߦ (ͲͪΒςετΛআ͘) -
v0.1.0 ecspresso --help usage: ecspresso --config=CONFIG [<flags>] <command> [<args> ...]
Flags: --help Show context-sensitive help (also try --help-long and --help-man). --config=CONFIG config file Commands: help [<command>...] Show help. deploy [<flags>] deploy service status [<flags>] show status of service rollback [<flags>] rollback service -
v0.1.0 $ find . -name '*.go' | xargs wc -l
32 ./service.go 35 ./config.go 56 ./cmd/ecspresso/main.go 288 ./ecspresso.go 411 ߹ܭ -
2017.11.29 AWS Fargate GA6 2017.12.07 ecspresso v0.2.2 AWS FargateରԠ σϓϩΠπʔϧΛࣗ࡞͢Δ
→ Amazon ECSͷ৽ػೳʹରԠ͢ΔͨΊʹ ࣗͰ࣮͢Δඞཁ͕͋Δ 6 https://aws.amazon.com/jp/blogs/aws/aws-fargate/ -
2018 2018.03.30 v0.4.0 deleteίϚϯυ࣮ 2018.04.05 v0.5.0 runίϚϯυ࣮ @ijin͞Μ͔Βrun taskΛ࣮ͨ͠ Pull
Request 2018.11.15 Secrets Support for Amazon ECS7 2018.11.20 v0.6.5 SecretsରԠ 7 https://aws.amazon.com/jp/about-aws/whats-new/2018/11/aws-launches- secrets-support-for-amazon-elastic-container-servic/ -
2019 2019.04.10 CircleCIͱecspressoʹΑΔ ECSͷσϓϩΠϝϯτύΠϓϥΠϯ8 ॳΊͯͷଞࣾࣄྫ 2019.09.11 --no-wait Pull Request @Songmu9
2019.09.12 v0.9.0 waitίϚϯυ࣮ CI/CDͰͷར༻͕૿͖͑ͯͨ 9 https://github.com/kayac/ecspresso/pull/38 8 https://devblog.thebase.in/entry/2019/04/10/110000 -
2019.10.08 AWS Dev Day Tokyo 2019 ୈ1ճ AWS Fargate ͔ΜͨΜσϓϩΠબखݖ10
@torics ͞Μʹհ͞ΕΔ 10 https://speakerdeck.com/toricls/the-very-first-aws-fargate-easy-deployment- tooling-championship -
ecspresso init ͷൃ໌ ecspresso͕ಈ࡞͢ΔͨΊʹ࠷3ͭͷϑΝΠϧ͕ඞཁ͕ͩ… • ઃఆϑΝΠϧ: READMEΛݟͯงғؾͰ • λεΫఆٛϑΝΠϧ: aws
ecs describe-task-definition • αʔϏεఆٛϑΝΠϧ: ࣗͰͳΜͱ͔ ͜Ε͕໘ͩͬͨ ! طଘͷαʔϏεͷใΛݩʹ࡞ΕΔͷͰ? -
2019.10.12 ecspresso v0.11.0 initίϚϯυ࣮ طଘͷΫϥελ໊ɺαʔϏε໊Λࢦఆͯ͠ઃఆϑΝΠϧΛੜ $ ecspresso init --cluster default
--service myapp 2023/05/31 14:46:00 myapp/default save service definition to ecs-service-def.json 2023/05/31 14:46:00 myapp/default save task definition to ecs-task-def.json 2023/05/31 14:46:00 myapp/default save config to ecspresso.yml $ tree . ├── ecs-service-def.json ├── ecs-task-def.json └── ecspresso.yml -
init ҎલʗҎޙ Ҏલ: ઃఆϑΝΠϧΛखॻ͖͢Δͱ͑Δ → ڧ͍ڵຯ͕͋Δਓ͔͑͠ͳ͍ Ҏޙ: ECSͰಈ͘αʔϏεΛ͍࣋ͬͯΔਓͩΕͰ ίϚϯυҰൃͰ͑Δ ެࣜπʔϧஶ໊OSS:
ֶश͢Δಈػ͕ڧ͍(ඞཁੑ͕͋Δ) ऑখOSS: ϋʔυϧ͕ߴ͍ͱ୯ʹΘΕͳ͍(ಈػ͕ऑ͍) ʲڭ܇ʳઃఆϑΝΠϧΛΜͰॻౕ͖͍͍ͨͳ͍ -
Dev Day 2019Ҏ߱ GitHub ։ൃՃ 2019.10.16 v0.12.0 CodeDeployʹΑΔBlue/GreenσϓϩΠ 2020.03.31 v0.14.0
tfstateࢀরػೳՃ 20202݄͔ΒίϩφՒ ༵ۚʹҿΈʹߦ͔ͳ͘ͳΔ → ՈͰOSS։ൃΛ͢ΔΑ͏ʹ -
Amazon ECSͷػೳՃʹߴʹै͍ͯ͘͠ ͜ͷ͜Ζɺ৽ػೳ͕ଟ͔ͬͨ Fargate Spot, Amazon Elastic File System (EFS)
mount, Fargate Platoform 1.4.0, S3 envfile... ৽ػೳϦϦʔεޙɺ͙͢ʹαϙʔτ͠ଓ͚͍ͯ͘ 2020.01.17 Amazon ECS͔ΒAmazon EFSϚϯτՄೳʹ13 2020.01.20 ecspresso v0.13.5 EFSϚϯταϙʔτ ͳͥ͜Ε͕Մೳͳͷ͔ 13 https://aws.amazon.com/jp/about-aws/whats-new/2020/01/amazon-ecs-preview-support-for-efs-file-systems-now-available/ -
৽ػೳϦϦʔε → Softwares Development Kit (SDK)ߋ৽ ecspressoJSONΛSDKͷߏମʹಡΈࠐΜͰ༻͢Δ → SDKΛόʔδϣϯΞοϓ͢Δ͚ͩͰػೳՃʹै 1.
SDKΛόʔδϣϯΞοϓ 2. (ඞཁʹԠͯ͡)ߏମͷΛҠ͠ସ͍͑ͯΔͱ͜ΖΛमਖ਼ 3. ಈ࡞֬ೝ 4. ! -
ઃܭࢥ ࠶ܝ (1) Amazon ECSαʔϏεͱλεΫఆٛͷཧʹಛԽ → มߋ͢ΔՕॴ͕࠷খݶʹͳΔ (2) Amazon ECSઐ༻ͷπʔϧͱͯ͠࡞Δ
→ ԼखʹநԽ͍ͯ͠ͳ͍ͨΊɺSDK͕ఏڙ͢ΔΞοϓσʔτ Λͦͷ··ड͚ೖΕΒΕΔ มߋʹߴʹैͰ͖Δઃܭͩͬͨ(݁Ռ) -
v1.0 ! 2020.09.05 v0.99.0 (v1ͷͨΊͷpre-release൛) 2020.10.20 AWS Dev Day Tokyo
ୈ2ճ AWS Fargate ͔ΜͨΜσϓϩΠબखݖ15 2020.10.20 ecspresso v1.0.0 ͍ͭ·Ͱv0.xͩͬͨͷͰɺ֮ޛΛܾΊͯv1ϦϦʔε େ͖ͳඇޓͳ͠ 15 https://speakerdeck.com/toricls/the-easiest-deployment-championship-2020-find-your-winner-for-aws-fargate -
όʔδϣχϯάํ جຊతʹSemantic Versioning v{major}.{minor}.{patch} • ϝδϟʔόʔδϣϯ͕ಉҰͳΒඇޓೖΕͳ͍ (v1, v2...) • όάमਖ਼ʹΑΔڍಈมߋΉΛಘͳ͍߹͕͋Δ
• ػೳ͕૿͑ͨΒϚΠφʔόʔδϣϯΛ্͛Δ (v1.1, v1.2...) • όάमਖ਼ύονόʔδϣϯͰ (v1.1.1, v1.1.2...) • খ͍͞ػೳՃύονόʔδϣϯͰೖΔ͜ͱ͕͋Δ -
υΩϡϝϯτͷඋ͕՝ʹ ࣾ֎Ͱར༻͕૿͖͕͑ͯͨɺ࣭ʹ͑Δͷ͕໘… υΩϡϝϯτΛॻ͘ͷਏ͍…(ओʹӳޠ) ! ΞυϕϯτΧϨϯμʔͰ24ຊॻ͍ͨΒॆ࣮͢ΔͷͰ? 2020.12 ecspresso Advent Calendar 202016
2020.12.11 v1.2.0 verify, renderίϚϯυՃ 2020.12.24 ecspresso handbook ൃച 16 https://adventar.org/calendars/5916 -
2021 ػೳՃ͕ଓ͘ظ 2021.01.12 v1.3.0 CloudFormation plugin 2021.03.15 Amazon ECS Exec
GA17 2021.04.10 v1.5.0 tasks, exec ίϚϯυՃ 2021.10.29 v1.7.0 ఆٛϑΝΠϧྨʹJsonnetαϙʔτ 17 https://aws.amazon.com/jp/about-aws/whats-new/2021/03/amazon-ecs-now-allows-you-to-run-commands-in-a-container- running-on-amazon-ec2-or-aws-fargate/ -
ecspresso exec Amazon ECS Exec (ಈ࡞தͷλεΫʹଓͯ͠ίϚϯυΛ࣮ߦͰ͖Δ) ʹରԠ͢Δ ecspresso exec Λ࣮
(ޙ͔Βࢥ͑)͜Εͪΐͬͱҳؾຯ ઃܭࢥ(1) αʔϏεͱλεΫఆٛͷཧʹಛԽ ❌ execಈ࡞தͷλεΫͦͷͷΛ૬खʹ͢Δػೳ σϓϩΠΛཧ͢Δ = ฏ࣌ ಈ࡞தͷλεΫʹԿ͔͢Δ = ҟৗ࣌ -
2022 ͦͯ͠v2 2021-01-19 aws-sdk-go-v2 GA18 ecspressoaws-sdk-goʹґଘ͍ͯ͠Δ SDK͕ߋ৽͞Εͳ͍ = ৽ػೳʹैͰ͖ͳ͍ =
ࠔΔ(͕ࣗ) aws-sdk-go (v1)Ͳ͏ͳΔ?? 18 https://aws.amazon.com/jp/about-aws/whats-new/2021/01/aws-sdk-for-go-version-2-now-generally-available/ -
AWS SDKͷαϙʔτঢ়گ(֓؍) ෳฏߦͰαϙʔτ͞Εଓ͚Δ͔ݴޠʹΑͬͯ·ͪ·ͪ19 JavaScript, Python, Java, Go࠷৽2ϝδϟʔόʔδϣϯ ͦΕҎ֎ͷݴޠ1όʔδϣϯͷΈ AWS෦Ͱͷར༻͕ଟͦ͏ͳݴޠੜ͖͢Δ͕͋Γͦ͏ ϦϦʔεޙ10ܦա͢Δͱ΄΅αϙʔτऴྃ(Java͚ͩྫ֎)
aws-sdk-go(v1)2015ϦϦʔε 19 https://docs.aws.amazon.com/sdkref/latest/guide/version-support-matrix.html -
AWS SDKϝϯςφϯεϙϦγʔ20 1. General Availability (GA) GAʹͳͬͨSDK࠷24ϲ݄ؒαϙʔτ 2. Maintenance Announcement
SDK͕ϝϯςφϯεϞʔυʹͳΔ6ϲ݄લʹΞφϯε 3. Maintenance ϝϯςφϯεϞʔυʹೖΔͱॏཁͳόάमਖ਼ͷΈ ৽ػೳͷՃͳ͠ → ৽ػೳͷߋ৽(อূ)ऴྃΞφϯε͔Βؒ 20 https://docs.aws.amazon.com/sdkref/latest/guide/maint-policy.html -
2022.01 ecspresso v2Λܾஅ ํ: جຊతͳޓੑอͭ(ઃఆϑΝΠϧɺσϓϩΠͷڍಈ) aws-sdk-go-v2ʹҠߦ createίϚϯυഇࢭ → deployίϚϯυ͚ͩͰႈʹ ϩάͷݻఆจࣈંΓฦ͠ɺͷಉҰߦॻ͖͑Λഇࢭ
→ CI/CDڥͰͷར༻͕૿͖͑ͯͨͨΊ ͦͷଞ େ͖͘ͳ͍͕ඇޓಈ࡞ʹͳΔͷΛ͍͔ͭ͘ -
github.com/fujiwara/ecsta ecspresso͔ΒλεΫૢ࡞ػೳΛΓग़ͨ͠πʔϧ(ϥΠϒϥϦ) ҙͷλεΫʹexecͳͲͷૢ࡞͕Ͱ͖ͯศར describe: λεΫͷใΛJSONͰදࣔ exec: ECS ExecͰλεΫʹଓ list: ΫϥελͷλεΫҰཡΛදࣔ
logs: λεΫ͕CloudWatch Logsʹग़ྗͨ͠ϩάΛදࣔ portforward: ECS ExecΛͬͨϙʔτϑΥϫʔυ stop: λεΫΛఀࢭ trace: λεΫ͕ىಈ→ఀࢭ·ͰͷΠϕϯτɺϩάΛ࣌ܥྻදࣔ -
ecspresso 5ͷาΈΛৼΓฦͬͯ ίπίπଓ͚Δͷେࣄ ՖۚOSS։ൃ͕श׳Խ→ ! ͍ͭͰʹissueΛݟΔ͔ɺͱͳΔ ۚમతͳݟฦΓͪΐͬͱخ͍͠ GitHub Sponsorsืूத github.com/sponsors/fujiwara
ZennͷചΓ্͛(࠷ۙ1ສԁ/݄ఔ) (ͰͦΕΛతʹ͠ͳ͍ํ͕ྑͦ͞͏)