Share
Embed
Datadog Agent on CloudRunによるGCPトレーサビリティの向上
株式会社ビットキー / Bitkey Inc. PRO
October 05, 2022
Transcript
55 slides
-
ࠤʑྃ 3ZP4BTBLJ ௨৴ܥ4*FSೖࣾ ɾݩʑ/8ΤϯδχΞͩͬͨͷͰ#(1ͬͨଞڌ/8࡞ͬͨΓͱ͔ ɾ࣏ࣗମͱ͔ެிܥγεςϜʹܞΘͬͨΓ͢Δ͜ͱ͕ଟ͔͔ͬͨͳ ɾڮྊݕϩϘοτ։ൃͬͨΓͱ͔ ϑϦʔϥϯεʹస ɾϖωτϨʔγϣϯςετͬͨΓͱ͔
ɾ0QFO4UBULͱ0QFO4IJGU݁ߏͬͯͨΓͱ͔ ɾϋΠϒϦουΫϥυ࡞ͬͨΓͱ͔ ϏοτΩʔʹ43&ͱͯ͠δϣΠϯ ˞ͿͬͪΌ͚͋·Γ43&ͬͯͳ͍͚ͲͶ ެͷͰਓʹઆ໌Ͱ͖ΔΑ͏ͳً͔͍͠ܦྺ࣋ͬͯͳ͍ͷͰ αΫοͱྲྀ͠·͢ʂʂʂ -
Bitkeyʹ͓͚ΔαʔϏεΞʔΩςΫνϟ - جຊతʹ($1Λར༻ͨ͠αʔόʔϨεΞʔΩςΫνϟ - CloudFunctions (AWSͰ͍͏ͱ͜ΖͷLambda) - CloudRun (AWSͰ͍͏ͱ͜ΖͷAppRunner͕͍ۙ) -
*P5͕͍͔ͭ͘ଘࡏ͢Δ͕ɺͦΕΒAWS IoTʹΑͬͯߏ - Ճ͑ͯͦΕΒΛॲཧ͢ΔͨΊʹLambda API GatewayΛར༻ GCP x AWS ͳ ΞʔΩςΫνϟ -
Bitkeyʹ͓͚Δݱঢ়ͷࢄτϨʔεར༻ʹ͍ͭͯ - 1000͍ۙFaaS͕ଘࡏ͢ΔͨΊɺͲ͕͜Ͳ͏ܨ͕͍ͬͯͯɺԿ͕Ͳ͏ॲ ཧ͕ਐΜ͔͕ͩΘ͔Βͳ͍ - υΩϡϝϯτ·ͱʹͳ༷͘ઃܭͷѲ͕ࠔ - τϥϒϧγϡʔτԿ͔ϦϑΝΫλ͢Δͷʹͱͯͭͳ͍͕ൃੜ x
1000ऑ x 100ऑ Ͳ͏ʹ͔Ͱ͖ͳ͍͔ɾɾɾʁ ͤΊͯτϥϒϧγϡʔςΟϯάΛԿͱ͔ɾɾɾʂ -
Bitkeyʹ͓͚Δݱঢ়ͷࢄτϨʔεར༻ʹ͍ͭͯ - ͳͥDatadog APMͷTraceػೳͰμϝͩͬͨͷʁ - ࠷ॳʹߟ͑ͨͷવDatadog APMͩͬͨ - "1.ར༻ͷͨΊʹ Datadog
Agent ͕ඞཁ - LT"84'BSHBUFͰެࣜαϙʔτ͞Ε͍ͯΔ͕ɺ #JULFZͷϝΠϯͰ͋Δ($1$MPVE'VODUJPOTͰαϙʔτ͞Ε͍ͯͳ͍ ͦΕͦͷͣͰAgentαΠυΧʔతʹಈ͘ ※k8sͷ߹ͪΐͬͱޠฐͷ͋Δݴ͍ํ͚ͩͲ -
Bitkeyʹ͓͚Δݱঢ়ͷࢄτϨʔεར༻ʹ͍ͭͯ - -BNCEBͰ͋ΕExtensionDatadog ForwarderͳͲΛͬͯ؆୯ʹτϨʔε ϩάσʔλΛऩूͰ͖Δ - 93BZͰྑ͍ͳΒ͞Βʹ؆୯ʹ࿈ܞͰ͖Δ - EEUSBDFWT93BZҎԼΛࢀর -
IUUQTEPDTEBUBEPHIRDPNKBTFSWFSMFTTEJTUSJCVUFE@USBDJOH - 'BSHBUFͷ߹ɺͦͦ1PEతʹෳίϯςφΛ·ͱΊͯىಈͰ͖ΔͨΊ "HFOUΛαΠυΧʔͱͯ͠ىಈͰ͖Δ GCF CloudRun Ͱ͜Ε͕Ͱ͖ͳ͍ -
Datadog AgentΛGCPͰίετͰ͏ͨΊʹؤுͬͨ FYQPSUFSͷ͛ઌΛม͑Δ͚ͩʂʂʂʂ gcloud beta run deploy dd-agent \
--image gcr.io/datadoghq/agent \ --port 8126 \ --memory 1024Mi \ --region asia-northeast1 \ --allow-unauthenticated \ --set-env-vars "DD_HOSTNAME=common-dd-agent" \ --set-env-vars "DD_APM_ENABLED=true" \ --set-env-vars "DD_APM_NON_LOCAL_TRAFFIC=true" \ --set-secrets "DD_API_KEY=DD_API_KEY:latest" \ --execution-environment gen2 ͓ΉΖʹgcloudίϚϯυΛࡌ͓ͤͯ͘ɻ͜ΕͰऴΘΓɻ -
Datadog AgentΛGCPͰίετͰ͏ͨΊʹؤுͬͨ Datadog Agent on CloudRunͷྑ͞ - ϑϧϚωʔδυͳͷͰΊͪΌͪ͘Όӡ༻ίετ͕͍ - ਵϦιʔε
71$-# ͷઃܭཧ͕ෆཁ - ެࣜʹఏڙ͞Ε͍ͯΔίϯςφΠϝʔδΛͬͯɺ͋ͱڥมͱͯ͠ ίϯϑΟάΛ༩͑ͯ͋͛ΕͦΕͰऴΘΓ $MPVE'VODUJPOT %BUBEPH"HFOUPO$MPVE3VO EEUSBDF1VTI $POUBJOFS 3FHJTUSZ -
Datadog AgentΛGCPͰίετͰ͏ͨΊʹؤுͬͨ Datadog Agent on CloudRunͷྑ͞ - Կߟ͑ͣͱউखʹΦʔτεέʔϧͯ͘͠ΕΔͷͰ ࠓޙͷεέʔϥϏϦςΟʹඇৗʹ༏ΕΔ
- #JULFZ࣮ͩͱɺΠϯελϯεd͙Β͍Ͱʑεέʔϧ͍ͯ͠Δ - Ͳ͏ͤ($1ͷ%$෦ͰΠϯλʔίωΫτͳ௨৴͕ߦΘΕΔͷͰ ($'͔ΒݟͯϨΠςϯγ͕ݱ࣮తʹʹͳΔ͜ͱͳ͍ͣ ໝ -
Datadog AgentΛGCPͰίετͰ͏ͨΊʹؤுͬͨ • ࢀߟఔʹ%BUBEPH"HFOUͰ͏ڥมͱ͔ ◦ IUUQTEPDTEBUBEPHIRDPNKBDPOUBJOFSTEPDLFS UBC&"&#"FOWJSPONFOUWBSJBCMFT ◦ IUUQTEPDTEBUBEPHIRDPNKBDPOUBJOFSTEPDLFSBQN UBCMJOVY
• ͜ͷลΛΑ͘͏ͣ Key Value ิ DD_APM_ENV your_environment datadog্Ͱೝࣝ͞ΕΔenvͷσϑΥϧτઃఆɻ ΫϥΠΞϯτίʔυଆͰ্ॻ͖Ͱ͖Δɻ DD_HOSTNAME your_ddagent_name ࢦఆͨ͠ϗετ໊Ͱdatadogʹه͞ΕΔͷͰͪΌΜ ͱߟ͑ͯʂ DD_APM_ENABLED true APMͷ༗ޮԽઃఆ DD_OTLP_CONFIG_RECEIVER_PROT OCOLS_HTTP_ENDPOINT 0.0.0.0:4318 ޙड़͢ΔOpenTelemetyͷαϙʔτͷͨΊʹඞਢ DD_APM_NON_LOCAL_TRAFFIC true ֎෦τϥϑΟοΫΛड͚͚Δઃఆɻ ࠓճͷΑ͏ͳέʔεͷ߹trueඞਢ DD_API_KEY Secret:DD_API_KEY:latest ݴΘ͕ͣͳɻฏจͰஔ͔ͳ͍Α͏ʹ͠·͠ΐ͏ɻ -
Datadog AgentΛGCPͰίετͰ͏ͨΊʹؤுͬͨ ͞ΒʹݱࡏͷDatadog AgentOTLPίϨΫλʔΛαϙʔτ͍ͯ͠Δʂ DD_OTLP_CONFIG_RECEIVER_PROTOCOLS_HTTP_ENDPOINT Λఆٛͯ͋͛͠ΕOK 0QFO5FMFNFUSZͷऔΓࠐΈ͕Ͱ͖ΔʂEEUSBDFʹґଘ͢Δඞཁ͕ͳ͍ʂʂ طଘ࣮ͷ0QFO5FMFNFUSZͷ෦Λม͑ͣɺ&YQPSUFSͷ࣮Λ%BUBEPH"HFOUʹ͚ͯ͋͛ΕऴΘΓ ޙड़
$MPVE'VODUJPOT %BUBEPH"HFOUPO$MPVE3VO 0QFO5FMFNFUSZ1VTI 05-1ίϨΫλʔ -
Datadog AgentΛGCPͰίετͰ͏ͨΊʹؤுͬͨ ҙ - $MPVE3VOͷGen2 Λ͓͏ - (FO-JOVYͷΤϛϡϨʔγϣϯͰ͋Δ͜ͱ͋ͬͯΊͪΌͪ͘ΌΤϥʔग़Δ - Gen2LinuxͦͷͷͳͷͰશ͘ͳ͠
- ͨͩͦ͠ΕͰ%BUBEPH"HFOU͕ఏڙ͢Δ֤छػೳ͕ ͪΐͪ͜ΐ͜Τϥʔग़͢λΠϛϯά͕͋ΔͷͰແବͳػೳఀࢭͪ͠Όͬͨํ͕ྑ͍ - QSPDFTTͱ͔TZTQSPCFͱ͔ -
Datadog AgentΛGCPͰίετͰ͏ͨΊʹؤுͬͨ Infrastructure as Code ָউ • طʹCloudRunΛߏ͢ΔͨΊͷterraformίʔυࣾͰطʹཱ֬ ◦
͜ͷߏαΫοͱίʔυԽྃʂ • $MPVE3VOͳͷͰ༨ܭͳ͜ͱΛߟ͑Δ͜ͱগͳ͘ΊͪΌͪ͘ΌָͪΜӡ༻ʂ • উखʹεέʔϧͯ͘͠ΕΔͷͰ࠾༻ϓϩμΫτ͕૿͖͔͑ͯͨΒෛՙ͕ɾɾɾͱ͔ ߟ͑ͳͯ͘0, -
Datadog AgentΛGCPͰίετͰ͏ͨΊʹؤுͬͨ FYQPSUFSͷ͛ઌΛม͑Δ͚ͩʂʂʂʂ import tracer from 'dd-trace'; export const
setupTracing = (args: {serviceName?: string; serviceVersion?: string}) => { return tracer.init({ service: args.serviceName ?? 'unknownFunction', version: args.serviceVersion ?? 'unknownVersion', url: 'https://your-dd-agent.run.app', env: 'develop', }); }; ͍ͬ͢͝୯७ɻurlͯ͋͛͠Δ͚ͩɻڥมͰՄɻ -
Datadog AgentΛGCPͰίετͰ͏ͨΊʹؤுͬͨ 0QFO5FMFNFUSZͰͷ࣮͕طʹ͋ΔͳΒɺFYQPSUFSͷ͛ઌΛม͑Δ͚ͩʂ const exporter = new OTLPTraceExporter({url: "https://your-dd-agent.run.app"});
provider.addSpanProcessor(new SimpleSpanProcessor(exporter)); -
Datadog AgentΛGCPͰίετͰ͏ͨΊʹؤுͬͨ - $MPVE3VO -PBE#BMBODFSΛ༧Ίߏங͓͚ͯ͠ ͖ͳ'2%/ͰΞΫηεͰ͖ΔͷͰ͞Βʹྑ͠ $MPVE'VODUJPOT %BUBEPH"HFOUPO$MPVE3VO
QVTI IUUQT ZPVSDVTUPNEPNBJO -PBE#BMBODFS IUUQT IPHFIPHFBSVOBQQ -
Datadog AgentΛGCPͰίετͰ͏ͨΊʹؤுͬͨ - yes - ͋Δఔɺ$MPVE"SNPSͰෆਖ਼ͳ௨৴ޚՄೳ - ͕ɺͦͷΤϯυϙΠϯτʹରͯ͠%BUBEPH"HFOU͕ߏங͞Ε͍ͯΔ͜ͱΛ ΒΕͨ߹ʹͲ͏͠Α͏ͳ͍
- ݱ࣮తʹຊ൪ڥͰ࠾༻͢ΔͷͰ͋ΕɺαʔόʔϨείωΫλʔͰ ($'$MPVE3VOͨͪͱΠϯλʔφϧଓ͠ɺ෦తͳΞΫηε͚ͩʹ ݶఆ͓͍ͯͨ͠ํ͕ઈରྑ͍ -
ݒ೦ͱࠓޙͷ - ݱঢ়ͱࠓޙ - ͜ͷΈΛͬͯɺ0QFO5FMFNFUSZ $MPVE5SBDFͷڥ͔Β Ұ෦ΛҠߦͤͯ͞ςετத - %BUBEPH"1.ͷTraceػೳ͕ඇৗʹ༏लͰ
τϨʔεΛͬͨੳτϥϒϧγϡʔτ͕ඇৗʹΔʂΔʂ -
ݒ೦ͱࠓޙͷ - ݱঢ়ͱࠓޙ - EEUSBDFݱ࣮తʹ͑ΔΑ͏ʹͳͬͨͷͰɺ 0QFO5FMFNFUSZWTEEUSBDFͳධՁ࣮ࢪத - "84ଆͷ-BNCEBͨͪ"1.ʹू͍ͤͯ͞ΔͷͰ Ϋϥυԣஅ͔ͭϑϩϯτʙόοΫΤϯυʙIoTͳҰؾ௨؏ͳτϨʔεΛࢦ͍ͨ͠
- ͨͩ͠લड़ͷݒ೦͕͋ΔͷͰɺ͜ͷ··͍ଓ͚Δ͔ෆಁ໌ - ҰํͰ͔ͳΓ"1.ʹྑ͞Λײ͍ͯ͡ΔͷͰνϡʔχϯάͭͭ͠ ໘ධՁ͠ଓ͚͍ͨ -
ݒ೦ͱࠓޙͷ - ·ͱΊ - %BUBEPH"1.6*69͕༏Ε͍ͯͯϚδͰΔΑ - LT"84ʹґଘͨ͠αʔϏε͡Όͳ͍ΜͩΑͳ͊ɾɾɾ "1.͑ͳ͍Μ͔ͳ͍͊ͬͯ͏ਓɺఘΊͳ͍Ͱʂʂ -
ίϯςφΠϝʔδ͕͋ΔΜ͔ͩΒͲ͏ʹͰͳΔΑ - $MPVE3VO͑ϚδͰઈָͪΜʹ࣮ͱӡ༻͕Ͱ͖ΔΑ - ࠓͷ%BUBEPH"HFOU0QFO5FMFNFUSZʹରԠ͍ͯ͠ΔͷͰɺ طଘ࣮͔ΒͷϚΠάϨʔγϣϯίετʹ͍͚ΔΑ -
ݒ೦ͱࠓޙͷ - Φν - LT͍׳ΕͯΔͳΒ (,&"VUPQJMPUͰ࣮ͨ͠ํ͕ ָͩ҆͠৺Ͱ͖ͦ͏ɻ
)FMNͰΠϯετʔϧͰ͖Δ͠Ͷɻ - ࢀߟIUUQTEPDTEBUBEPHIRDPNKBDPOUBJOFSTLVCFSOFUFTEJTUSJCVUJPOT UBCIFMNBVUPQJMPU apiVersion: apps/v1 kind: Deployment metadata: name: dd-agent spec: replicas: 3 selector: matchLabels: app: dd-agent template: metadata: labels: app: dd-agent spec: containers: - name: dd-agent image: datadog/agent:latest ports: - containerPort: 8126 env: - name: DD_API_KEY valueFrom: secretKeyRef: name: dd-api-key key: DD_API_KEY