Tweet
Tweet

Slide 1

Slide 1 text

Tatsuhiko Kubo@cubicdaiya Fastly Meetup #1 2019/02/20 System Integration with Fastly

Slide 2

Slide 2 text

@cubicdaiya / Tatsuhiko Kubo Principal Engineer, Tech Lead, SRE @ Mercari, Inc.

Slide 3

Slide 3 text

No content

Slide 4

Slide 4 text

ϝϧΧϦʹ͍ͭͯ • ೔ຊ࠷େͷϑϦϚΞϓϦ • 3෼Ͱ؆୯ʹग़඼ • 1) ࣸਅΛࡱΔ • 2) ঎඼৘ใΛهೖ • 3) ग़඼ϘλϯΛԡ͢ • ҆৺҆શͳܾࡁɾऔҾ • ΤεΫϩʔ • ಗ໊഑ૹ

Slide 5

Slide 5 text

ྦྷܭग़඼਺ͷਪҠ

Slide 6

Slide 6 text

Fastly products in Mercari • Full-Site Delivery • ImageOptimizer • Web Application Firewall • Enterprise Support • etc…

Slide 7

Slide 7 text

Agenda • FastlyͱαʔυύʔςΟͷαʔϏεɾπʔϧͷ૊Έ߹ΘͤʹΑΔΠϯςά Ϩʔγϣϯ • DatadogɺGoogle BigQueryɺetc… • Fastly APIʹΑΔΠϯςάϨʔγϣϯ • https://docs.fastly.com/api/

Slide 8

Slide 8 text

FastlyͱαʔυύʔςΟͷαʔϏεɾπʔϧͷ૊Έ߹Θͤ • Fastly͸৭ʑͳαʔϏε΍πʔϧͱ૊Έ߹ΘͤΔ͜ͱ͕Մೳ • DatadogɺAmazon S3ɺGoogle Cloud StorageɺGoogle BigQueryɺ… • ϦϞʔτϩάετϦʔϛϯά • https://docs.fastly.com/guides/streaming-logs/

Slide 9

Slide 9 text

૊Έ߹ΘͤͷྫʢDatadog Integrationʣ + https://docs.datadoghq.com/integrations/fastly/

Slide 10

Slide 10 text

Datadog Integration with Fastly • FastlyͷϝτϦΫεΛDatadog্ͰදࣔɺΧελϚΠζͰ͖Δ • e.g. hit_ratio, requests, bandwidth, status_4xx, status_5xx, etc… • ෳ਺ͷϝτϦΫεΛ૊Έ߹ΘͤͯಠࣗͷϝτϦΫεΛ࡞੒͢Δ͜ͱ΋Մೳ • ᮢ஋Λઃఆͯ͠ΞϥʔτΛඈ͹͢͜ͱ΋Ͱ͖Δ • Historical Stats APIͷσʔλ͕ͦͷ··Datadog্Ͱѻ͑ΔΠϝʔδ

Slide 11

Slide 11 text

FastlyͷϝτϦΫεΛDatadog্ͰදࣔɺΧελϚΠζ

Slide 12

Slide 12 text

HTTP/2 Ratio (http2 ÷ requests) × 100

Slide 13

Slide 13 text

Ωϟογϡώοτ཰ͷܭࢉʢShielding͕༗ޮͳ৔߹ʣ Hit Ratio(True) = (1 − miss − shield requests − shield ) × 100 miss: Number of cache misses shield: number of requests from Shield to Origin requests: Number of Requests Processed The truth about cache hit ratios: https://www.fastly.com/blog/truth-about-cache-hit-ratios

Slide 14

Slide 14 text

Ωϟογϡώοτ཰ͷܭࢉʢShielding͕༗ޮͳ৔߹ʣ Hit Ratio(True) = (1 − miss − shield requests − shield ) × 100

Slide 15

Slide 15 text

Origin Shield • Edge POPͱOriginͷதؒʹ഑ஔ͢ΔPOP • Edge POPͷΩϟογϡʹώοτ͠ͳ͔ͬͨ෼ΛΧόʔ • Ωϟογϡώοτ཰ͷେ͖ͳ޲্͕ݟࠐΊΔ • Documents • https://docs.fastly.com/ja/guides/performance-tuning/shielding • hit_ratio͸Edge POPͷΈͷΩϟογϡώοτ཰

Slide 16

Slide 16 text

Shieldingͷon/offͰӨڹΛड͚ΔϝτϦΫεͷྫ • hit_ratio • only Edge POP • requests • involve shield • bandwidth • beresp_header_bytes + beresp_body_bytes + resp_header_bytes + resp_body_bytes • resp_header_bytes, resp_body_bytes • involve shield_header_bytes, shield_body_bytes

Slide 17

Slide 17 text

૊Έ߹ΘͤͷྫʢGoogle BigQuery & DataStudioʣ BigQuery DataStudio real-time streaming σʔλιʔε ͱͯ͠ར༻

Slide 18

Slide 18 text

ϦϞʔτϩάετϦʔϛϯά • Amazon S3΍Google Cloud StorageɺGoogle BigQueryΛ͸͡Ίɺ ৭ʑͳαʔϏεʹϩάΛసૹՄೳ • Syslog΋Մೳ • Datadog IntegrationΑΓ΋खؒ͸ଟ͍͚Ͳɺॊೈੑ͸ߴ͍ • ϩάͷεΩʔϚʹVCLͷม਺͕ར༻Ͱ͖Δ

Slide 19

Slide 19 text

Fastly APIʹΑΔIntegration

Slide 20

Slide 20 text

Fastly API • FastlyͷػೳΛRESTfulͳAPIӽ͠ʹར༻Ͱ͖Δ • e.g. PurgeɺStatsɺConfigurationɺWAFɺetc… • Documents • https://docs.fastly.com/api/ • ػೳʹΑͬͯ͸API͔Β͔͠ར༻Ͱ͖ͳ͍΋ͷ΋͋Δ • όʔδϣϯͷϩοΫɺWAF౳

Slide 21

Slide 21 text

Fastly APIΛར༻͢Δʹ͸ • ϙʔλϧ্ͰAPIτʔΫϯΛൃߦ • ༗ޮൣғʢର৅ͱͳΔαʔϏεʣ΍ظݶɺݖݶʢRead, Write౳ʣΛઃఆ • Datadog Integration΋APIτʔΫϯΛൃߦ͢Δ͜ͱͰར༻Մೳ

Slide 22

Slide 22 text

curlͰFastly APIΛୟ͘ $ curl \ -X GET -H ‘Fastly-Key: xxx’ \ -H ‘Accept: application/json’ \ https://api.fastly.com/…

Slide 23

Slide 23 text

Fastly APIʹΑΔΦϖϨʔγϣϯ • Pros • curlͰૢ࡞Ͱ͖ͯศར • Cons • ֮͑ΒΕͳ͍ͷͰຖճެࣜυΩϡϝϯτݟͳ͕ΒAPIୟ͍ͯΔ • APIΫϥΠΞϯτΛॻ͘͜ͱʹͨ͠

Slide 24

Slide 24 text

mfc

Slide 25

Slide 25 text

mfc • In-house Fastly CLI at Mercari • GoͰ࣮૷ • ओʹACL΍WAFܥͷΦϖϨʔγϣϯͰͨ·ʹ࢖͏

Slide 26

Slide 26 text

mfc configuration $ cat ~/.fastly/conf.toml [target] service = “service-A” [[services]] service = “service-A” apikey = “…” waf = “…” [[services]] service = “service-B” apikey = “…”

Slide 27

Slide 27 text

Usage of mfc • $ mfc Usage of mfc: config the utility for mfc configuration service the utility for fastly service acl the utility for fastly ACL waf the utlity fro fastly WAF (etc…) • ػೳྖҬຖʹαϒίϚϯυΛఆٛ • ACL, Service, Version౳ • ౰ॳ͸ผʑͷϓϩάϥϜ͚ͩͬͨͲɺ૿͖͑ͯͨͷͰ౷߹ switch args[1] { case “config”: return config.NewCLI().Run(args) case “service”: return service.NewCLI().Run(args) case “acl”: return acl.NewCLI().Run(args) case “…” … } ಈ࡞Πϝʔδ

Slide 28

Slide 28 text

ACL operation $ mfc acl show | jq -r ‘.[].name’ whitelist blacklist … $ mfc acl list -name whitelist $ mfc acl add -name whitelist \ -ip x.x.x.x/32 \ -comment “Added x to whitelist” ■ACLͷҰཡΛྻڍ ■ACLΤϯτϦͷҰཡΛྻڍ ■ACLʹΤϯτϦΛ௥Ճ $ mfc acl del -name blacklist \ -entry-id xxx ■ACL͔ΒΤϯτϦΛ࡟আ ■ACLΛ࡞੒ $ mfc acl create -name whitelist -version 10 ■ ACLʹσʔλΛಉظ $ mfc acl sync -name blacklist \ -provider blacklist.json

Slide 29

Slide 29 text

WAF operation $ mfc waf list … $ mfc acl -h Usage of waf: mfc waf list list all active waf objects mfc waf rule show show waf rule mfc waf rule status show and change waf rule status mfc waf rule vcl show waf rule vcl mfc waf ruleset show show waf ruleset mfc waf ruleset update update waf ruleset $ mfc waf rule show -id rule_id $ mfc waf rule status -id rule_id ■ WAF ObjectͷҰཡΛྻڍ ■ WAF Ruleͷ֓ཁΛ֬ೝ ■ WAF RuleͷεςʔλεΛ֬ೝ ■ Help $ mfc waf rule status -id rule_id -set disabled ■ WAF RuleͷεςʔλεΛdisabledʹมߋ ■ WAF Ruleͷ࣮૷(VCL)ΛಡΉ $ mfc waf rule vcl -id rule_id

Slide 30

Slide 30 text

ActiveͳόʔδϣϯΛநग़͢Δ $ mfc service versions latest: 91 active: 90

Slide 31

Slide 31 text

ActiveͳόʔδϣϯΛநग़͢Δ • GET /service/service_id/version • ֘౰αʔϏεͷ͢΂ͯͷόʔδϣϯʹؔ͢Δ৘ใΛฦ͢ • active?, locked?, comment, number, created_at, updated_at, … • refs -> https://docs.fastly.com/api/config#version

Slide 32

Slide 32 text

ActiveͳόʔδϣϯΛநग़͢Δ • ConfigurationܥͷAPI͸όʔδϣϯͷࢦఆΛཁٻ͢Δ΋ͷ͕ଟ͍ • e.g. ACL • GET /service/service_id/version/version/acl • mfcʹΑΔૢ࡞͸activeͳόʔδϣϯʹରͯ͠ߦ͏΋ͷ͕ଟ͍ • ຖճactiveͳόʔδϣϯͲΕ͚ͩͬʁΈ͍ͨͳࣄଶ͸໘౗ͳͷͰආ͚͍ͨ • e.g. mfc acl show ͸activeͳόʔδϣϯΛࣗಈͰऔಘ࣮ͯ͠ߦ͞ΕΔ

Slide 33

Slide 33 text

References • API Client librariesʢAPIͷΫϥΠΞϯτ΍ϥΠϒϥϦͷϦετʣ • https://docs.fastly.com/api/clients • waflyctlʢFastly WAF CLIʣ • https://github.com/fastly/waflyctl