Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Speaker Deck
PRO
Sign in
Sign up for free
AdServer Casual Monitoring by fluentd, Mackerel
Takumi KANZAKI
November 10, 2015
Technology
0
1.6k
AdServer Casual Monitoring by fluentd, Mackerel
Fashion Tech meetup #1 LT
Takumi KANZAKI
November 10, 2015
Tweet
Share
More Decks by Takumi KANZAKI
See All by Takumi KANZAKI
SmartHRにおけるアカウントモデルの移行のはなし/Story of migration of account model in SmartHR - Rails Developers Meetup 2018 Day 4 Nouvelle Vague -
tknzk
5
1.5k
新生児〜生後6ヶ月を支えた技術/kosodate-engineer-meetup-3
tknzk
4
1.3k
kosodate_engineer_meetup_2
tknzk
3
4.5k
eb_with_multi_container_docker
tknzk
1
1.9k
Other Decks in Technology
See All in Technology
モブに早く慣れたい人のためのガイド / A Guide to Getting Started Quickly with Mob Programming
cybozuinsideout
PRO
1
1.2k
noteの品質課題に立ち上げ直後のQAチームが挑んだ軌跡
hiroki_tanaka
1
190
現状のFedCMの動作解説と OIDCとの親和性について- OpenID TechNight vol.19
ritou
2
390
Amazon ECRに無駄なコストがかかっていた
iwamot
0
150
PUTとPOSTどっち使う?
hankehly
0
140
RDRA + JavaによるレジャーSaaSプロダクトの要件定義と実装のシームレスな接続
jjebejj
PRO
2
470
ウォーターフォールとアジャイルと楽楽明細/Waterfall×Agile×Rakurakumeisai
whitefox_73
1
340
JJUG2022_spring_Keycloak (Red Hat Single Sign-on)
tinoue
0
190
セキュリティ 開運研修2022 / security 2022
cybozuinsideout
PRO
2
2.8k
GeoLocationAnchor and MKTileOverlay
toyship
0
100
IoTLT88-NTKanazawa-laundry-dry
yukima0707
0
160
公式版Scratchやtoio DoでIoT(ブラウザ上でのJavaScript実行で) / ビジュアルプログラミングIoTLT vol.11
you
0
150
Featured
See All Featured
Product Roadmaps are Hard
iamctodd
34
6.5k
Done Done
chrislema
174
14k
Design by the Numbers
sachag
271
17k
Three Pipe Problems
jasonvnalue
89
8.7k
Practical Orchestrator
shlominoach
178
8.6k
Teambox: Starting and Learning
jrom
123
7.7k
Java REST API Framework Comparison - PWX 2021
mraible
PRO
11
4.7k
Optimizing for Happiness
mojombo
365
63k
Designing the Hi-DPI Web
ddemaree
272
32k
Fashionably flexible responsive web design (full day workshop)
malarkey
396
62k
Intergalactic Javascript Robots from Outer Space
tanoku
261
25k
What the flash - Photography Introduction
edds
61
10k
Transcript
FasionTech Meetup LT AdServer Casual Monitoring by fluentd, Mackerel 1
VASILY Inc. 2015
Me • Takumi Kanzaki (@tknzk) • VASILY Inc. Backend Engineer
• 2015.04~ • iQONADΛϝΠϯͰ୲ 2 VASILY Inc. 2015
iQONAD • iQON͓Αͼ֎෦ΞϓϦʹࠂ৴Λߦ͍ͬͯΔADωοτϫʔΫ • 2014.10~ 3 VASILY Inc. 2015
iQONAD • software, middleware • Ruby, Rails, sinatra • MySQL,
memcached, Redis • infra • EC2, RDS • docker, Elasticbeanstalk (2015.06~) • auto-scaling 4 VASILY Inc. 2015
Why Casual Monitoring • ॳظ։ൃ2िؒͰϩʔϯν • طଘͷΈ • ੜϩάΛऩूͯ͠ूܭ •
fluentdͰlog-serverʹू͍ͯ͠Δ͕ະूܭ 5 VASILY Inc. 2015
Casual Monitoring? • ͓͓·͔ͳঢ়ଶΛࢹ͍ͨ͠ • աڈͲΜͳঢ়گ͔ͩͬͨΛѲ͍ͨ͠ 6 VASILY Inc. 2015
Casual Monitoring? • ৴ͷਪҠ • impression/clickͳͲͷਪҠ • ৴ΤϥʔͷਪҠ • http
status codeͷਪҠ • etc.. 7 VASILY Inc. 2015
without Casual Monitoring? • ϩάੳ • BigQuery • latency monitoring
• error rate • NewRelic 8 VASILY Inc. 2015
Log Collect • fluentd • mackerel 9 VASILY Inc. 2015
fluentd • Fluentd is an open source data collector for
unified logging layer. 10 VASILY Inc. 2015
Mackerel • A RevolutionaryNew Kind ofApplication PerformanceManagement 11 VASILY Inc.
2015
plugin • fluent-plugin-datacounter • fluent-plugin-mackerel • (fluent-plugin-zabbix) 12 VASILY Inc.
2015
fluent-plugin-datacounter • ಛఆͷkeyͷΛಛఆͷִؒͰूܭͯ͘͠ΕΔ <store> type datacounter count_interval 1m count_key publisher_id
aggregate all tag stats.delivery.publisher pattern1 publisher_id_1 ^1$ pattern2 publisher_id_2 ^2$ pattern3 publisher_id_3 ^3$ pattern4 publisher_id_4 ^4$ </store> 13 VASILY Inc. 2015
fluent-plugin-mackerel <match stats.delivery.publisher> type mackerel api_key MACKEREL_API_KEY service iqon-ad metrics_name
ad_server_delivery_publisher.${out_key} out_keys unmatched_count,publisher_id_1_count,publisher_id_2_count,publisher_id_3_count,publisher_id_4_count </match> 14 VASILY Inc. 2015
metrics 15 VASILY Inc. 2015
spike • ֎෦৴͍ͯ͠ΔͷͰ৴ઌΞϓϦͰpush৴͕͋Δspike • աڈͷspikeใΛ͋ͭΊ͓͓ͯ·͔ʹ࣌ؒΛѲ • time scheduled base auto-scalingͰରԠ
16 VASILY Inc. 2015
metrics page • iQONADͷ෦πʔϧʹmackerelͷάϥϑΛΓ͚ͭ • iframe, markdown ͳͲͰ֎෦ʹshareͰ͖Δ • ͪΖΜmackerelͷೝূඞཁ
17 VASILY Inc. 2015
18 VASILY Inc. 2015
Alert • custom metricsͷঢ়گࢹରʹઃఆͰ͖Δ • nginxͷstatusͷerror countͳͲ 19 VASILY Inc.
2015
Future • norikra • norikra-listener-mackerel 20 VASILY Inc. 2015
Conclusion • fluentdͱmackerelΛ͔ͭͬͯ؆୯ʹσʔλͷϞχλϦϯά • fluentdͷconfigΛগ͠ॻ͍ͯɺmackerelͷཧπʔϧ͔ΒΆͪ ΆͪઃఆͰྃ • mackerel͍͢͝ศར!!! • άϥϑΛΓग़ͯ͠ϖϥΠνͷϖʔδΛͭ͘Δ͜ͱͰΤϯδχ
ΞҎ֎ʹ • ϞχλϦϯά͍ͯ͠Δσʔλࢹରʹઃఆ 21 VASILY Inc. 2015
We are hiring! • info@vasily.jp 22 VASILY Inc. 2015
end ͋Γ͕ͱ͏͍͟͝·ͨ͠ 23 VASILY Inc. 2015