Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
AdServer Casual Monitoring by fluentd, Mackerel
Search
Takumi KANZAKI
November 10, 2015
Technology
0
1.8k
AdServer Casual Monitoring by fluentd, Mackerel
Fashion Tech meetup #1 LT
Takumi KANZAKI
November 10, 2015
Tweet
Share
More Decks by Takumi KANZAKI
See All by Takumi KANZAKI
SmartHRにおけるアカウントモデルの移行のはなし/Story of migration of account model in SmartHR - Rails Developers Meetup 2018 Day 4 Nouvelle Vague -
tknzk
6
2.2k
新生児〜生後6ヶ月を支えた技術/kosodate-engineer-meetup-3
tknzk
4
2.2k
kosodate_engineer_meetup_2
tknzk
3
5.8k
eb_with_multi_container_docker
tknzk
1
2.4k
Other Decks in Technology
See All in Technology
MagicPod導入から半年、オープンロジQAチームで実際にやったこと
tjoko
0
110
エンジニアが主導できる組織づくり ー 製品と事業を進化させる体制へのシフト
ueokande
1
120
「その開発、認知負荷高すぎませんか?」Platform Engineeringで始める開発者体験カイゼン術
sansantech
PRO
2
1.1k
IoT x エッジAI - リアルタイ ムAI活用のPoCを今すぐ始め る方法 -
niizawat
0
130
プラットフォーム転換期におけるGitHub Copilot活用〜Coding agentがそれを加速するか〜 / Leveraging GitHub Copilot During Platform Transition Periods
aeonpeople
1
250
Snowflake Intelligenceにはこうやって立ち向かう!クラシルが考えるAI Readyなデータ基盤と活用のためのDataOps
gappy50
0
290
Platform開発が先行する Platform Engineeringの違和感
kintotechdev
4
590
初めてAWSを使うときのセキュリティ覚書〜初心者支部編〜
cmusudakeisuke
1
290
新アイテムをどう使っていくか?みんなであーだこーだ言ってみよう / 20250911-rpi-jam-tokyo
akkiesoft
0
370
Codeful Serverless / 一人運用でもやり抜く力
_kensh
7
460
会社紹介資料 / Sansan Company Profile
sansan33
PRO
7
380k
メルカリIBISの紹介
0gm
0
870
Featured
See All Featured
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
kevinliebholz
34
6k
Large-scale JavaScript Application Architecture
addyosmani
513
110k
ピンチをチャンスに:未来をつくるプロダクトロードマップ #pmconf2020
aki_iinuma
127
53k
How STYLIGHT went responsive
nonsquared
100
5.8k
Facilitating Awesome Meetings
lara
55
6.5k
Typedesign – Prime Four
hannesfritz
42
2.8k
Faster Mobile Websites
deanohume
309
31k
Designing Dashboards & Data Visualisations in Web Apps
destraynor
231
53k
Rails Girls Zürich Keynote
gr2m
95
14k
Understanding Cognitive Biases in Performance Measurement
bluesmoon
29
1.9k
The World Runs on Bad Software
bkeepers
PRO
70
11k
Documentation Writing (for coders)
carmenintech
74
5k
Transcript
FasionTech Meetup LT AdServer Casual Monitoring by fluentd, Mackerel 1
VASILY Inc. 2015
Me • Takumi Kanzaki (@tknzk) • VASILY Inc. Backend Engineer
• 2015.04~ • iQONADΛϝΠϯͰ୲ 2 VASILY Inc. 2015
iQONAD • iQON͓Αͼ֎෦ΞϓϦʹࠂ৴Λߦ͍ͬͯΔADωοτϫʔΫ • 2014.10~ 3 VASILY Inc. 2015
iQONAD • software, middleware • Ruby, Rails, sinatra • MySQL,
memcached, Redis • infra • EC2, RDS • docker, Elasticbeanstalk (2015.06~) • auto-scaling 4 VASILY Inc. 2015
Why Casual Monitoring • ॳظ։ൃ2िؒͰϩʔϯν • طଘͷΈ • ੜϩάΛऩूͯ͠ूܭ •
fluentdͰlog-serverʹू͍ͯ͠Δ͕ະूܭ 5 VASILY Inc. 2015
Casual Monitoring? • ͓͓·͔ͳঢ়ଶΛࢹ͍ͨ͠ • աڈͲΜͳঢ়گ͔ͩͬͨΛѲ͍ͨ͠ 6 VASILY Inc. 2015
Casual Monitoring? • ৴ͷਪҠ • impression/clickͳͲͷਪҠ • ৴ΤϥʔͷਪҠ • http
status codeͷਪҠ • etc.. 7 VASILY Inc. 2015
without Casual Monitoring? • ϩάੳ • BigQuery • latency monitoring
• error rate • NewRelic 8 VASILY Inc. 2015
Log Collect • fluentd • mackerel 9 VASILY Inc. 2015
fluentd • Fluentd is an open source data collector for
unified logging layer. 10 VASILY Inc. 2015
Mackerel • A RevolutionaryNew Kind ofApplication PerformanceManagement 11 VASILY Inc.
2015
plugin • fluent-plugin-datacounter • fluent-plugin-mackerel • (fluent-plugin-zabbix) 12 VASILY Inc.
2015
fluent-plugin-datacounter • ಛఆͷkeyͷΛಛఆͷִؒͰूܭͯ͘͠ΕΔ <store> type datacounter count_interval 1m count_key publisher_id
aggregate all tag stats.delivery.publisher pattern1 publisher_id_1 ^1$ pattern2 publisher_id_2 ^2$ pattern3 publisher_id_3 ^3$ pattern4 publisher_id_4 ^4$ </store> 13 VASILY Inc. 2015
fluent-plugin-mackerel <match stats.delivery.publisher> type mackerel api_key MACKEREL_API_KEY service iqon-ad metrics_name
ad_server_delivery_publisher.${out_key} out_keys unmatched_count,publisher_id_1_count,publisher_id_2_count,publisher_id_3_count,publisher_id_4_count </match> 14 VASILY Inc. 2015
metrics 15 VASILY Inc. 2015
spike • ֎෦৴͍ͯ͠ΔͷͰ৴ઌΞϓϦͰpush৴͕͋Δspike • աڈͷspikeใΛ͋ͭΊ͓͓ͯ·͔ʹ࣌ؒΛѲ • time scheduled base auto-scalingͰରԠ
16 VASILY Inc. 2015
metrics page • iQONADͷ෦πʔϧʹmackerelͷάϥϑΛΓ͚ͭ • iframe, markdown ͳͲͰ֎෦ʹshareͰ͖Δ • ͪΖΜmackerelͷೝূඞཁ
17 VASILY Inc. 2015
18 VASILY Inc. 2015
Alert • custom metricsͷঢ়گࢹରʹઃఆͰ͖Δ • nginxͷstatusͷerror countͳͲ 19 VASILY Inc.
2015
Future • norikra • norikra-listener-mackerel 20 VASILY Inc. 2015
Conclusion • fluentdͱmackerelΛ͔ͭͬͯ؆୯ʹσʔλͷϞχλϦϯά • fluentdͷconfigΛগ͠ॻ͍ͯɺmackerelͷཧπʔϧ͔ΒΆͪ ΆͪઃఆͰྃ • mackerel͍͢͝ศར!!! • άϥϑΛΓग़ͯ͠ϖϥΠνͷϖʔδΛͭ͘Δ͜ͱͰΤϯδχ
ΞҎ֎ʹ • ϞχλϦϯά͍ͯ͠Δσʔλࢹରʹઃఆ 21 VASILY Inc. 2015
We are hiring! •
[email protected]
22 VASILY Inc. 2015
end ͋Γ͕ͱ͏͍͟͝·ͨ͠ 23 VASILY Inc. 2015