Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
AdServer Casual Monitoring by fluentd, Mackerel
Search
Takumi KANZAKI
November 10, 2015
Technology
0
1.7k
AdServer Casual Monitoring by fluentd, Mackerel
Fashion Tech meetup #1 LT
Takumi KANZAKI
November 10, 2015
Tweet
Share
More Decks by Takumi KANZAKI
See All by Takumi KANZAKI
SmartHRにおけるアカウントモデルの移行のはなし/Story of migration of account model in SmartHR - Rails Developers Meetup 2018 Day 4 Nouvelle Vague -
tknzk
6
2k
新生児〜生後6ヶ月を支えた技術/kosodate-engineer-meetup-3
tknzk
4
2k
kosodate_engineer_meetup_2
tknzk
3
5.4k
eb_with_multi_container_docker
tknzk
1
2.2k
Other Decks in Technology
See All in Technology
AWSサービスメニュー開発をしていてAWSを好きだ!と感じた瞬間
toru_kubota
0
130
ゆめみのアクセシビリティの現在地と今後
ryokatsuse
3
290
エンジニアリングマネージャーはどう学んでいくのか #devsumi / How Do Engineering Managers Continue to Learn and Grow?
expajp
4
1.3k
ここがすごいよ! AWS Systems Manager!
saichan11
0
1.8k
シフトレフトで挑む セキュリティの生産性向上
sekido
PRO
0
270
コンテナ・K8s研修 - 前半 コンテナ基礎・ハンズオン【MIXI 24新卒技術研修】
mixi_engineers
PRO
0
170
目標設定は好きですか? アジャイルとともに目標と向き合い続ける方法 / Do you like target Management?
kakehashi
10
3k
コンテナ・K8s研修 - 後半 Kubernetes 基礎&ハンズオン【MIXI 24新卒技術研修】
mixi_engineers
PRO
1
120
データベース研修 DB基礎【MIXI 24新卒技術研修】
mixi_engineers
PRO
0
220
Git 研修 Basic【MIXI 24新卒技術研修】
mixi_engineers
PRO
0
310
Classmethod流のPlatform Engineering / classmethod-platform-engineering-devio2024
tomoki10
0
480
コミュニティサービスに「あなたへ」フィードを リリースするまでの試行錯誤
takapy
1
150
Featured
See All Featured
Making the Leap to Tech Lead
cromwellryan
127
8.7k
What’s in a name? Adding method to the madness
productmarketing
PRO
21
2.9k
Happy Clients
brianwarren
94
6.6k
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
panda_program
78
15k
Imperfection Machines: The Place of Print at Facebook
scottboms
262
13k
A Philosophy of Restraint
colly
200
16k
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
marcduiker
16
1.6k
Robots, Beer and Maslow
schacon
PRO
157
8.1k
Java REST API Framework Comparison - PWX 2021
mraible
PRO
20
7.2k
Designing for humans not robots
tammielis
247
25k
Building a Scalable Design System with Sketch
lauravandoore
458
32k
Fashionably flexible responsive web design (full day workshop)
malarkey
399
65k
Transcript
FasionTech Meetup LT AdServer Casual Monitoring by fluentd, Mackerel 1
VASILY Inc. 2015
Me • Takumi Kanzaki (@tknzk) • VASILY Inc. Backend Engineer
• 2015.04~ • iQONADΛϝΠϯͰ୲ 2 VASILY Inc. 2015
iQONAD • iQON͓Αͼ֎෦ΞϓϦʹࠂ৴Λߦ͍ͬͯΔADωοτϫʔΫ • 2014.10~ 3 VASILY Inc. 2015
iQONAD • software, middleware • Ruby, Rails, sinatra • MySQL,
memcached, Redis • infra • EC2, RDS • docker, Elasticbeanstalk (2015.06~) • auto-scaling 4 VASILY Inc. 2015
Why Casual Monitoring • ॳظ։ൃ2िؒͰϩʔϯν • طଘͷΈ • ੜϩάΛऩूͯ͠ूܭ •
fluentdͰlog-serverʹू͍ͯ͠Δ͕ະूܭ 5 VASILY Inc. 2015
Casual Monitoring? • ͓͓·͔ͳঢ়ଶΛࢹ͍ͨ͠ • աڈͲΜͳঢ়گ͔ͩͬͨΛѲ͍ͨ͠ 6 VASILY Inc. 2015
Casual Monitoring? • ৴ͷਪҠ • impression/clickͳͲͷਪҠ • ৴ΤϥʔͷਪҠ • http
status codeͷਪҠ • etc.. 7 VASILY Inc. 2015
without Casual Monitoring? • ϩάੳ • BigQuery • latency monitoring
• error rate • NewRelic 8 VASILY Inc. 2015
Log Collect • fluentd • mackerel 9 VASILY Inc. 2015
fluentd • Fluentd is an open source data collector for
unified logging layer. 10 VASILY Inc. 2015
Mackerel • A RevolutionaryNew Kind ofApplication PerformanceManagement 11 VASILY Inc.
2015
plugin • fluent-plugin-datacounter • fluent-plugin-mackerel • (fluent-plugin-zabbix) 12 VASILY Inc.
2015
fluent-plugin-datacounter • ಛఆͷkeyͷΛಛఆͷִؒͰूܭͯ͘͠ΕΔ <store> type datacounter count_interval 1m count_key publisher_id
aggregate all tag stats.delivery.publisher pattern1 publisher_id_1 ^1$ pattern2 publisher_id_2 ^2$ pattern3 publisher_id_3 ^3$ pattern4 publisher_id_4 ^4$ </store> 13 VASILY Inc. 2015
fluent-plugin-mackerel <match stats.delivery.publisher> type mackerel api_key MACKEREL_API_KEY service iqon-ad metrics_name
ad_server_delivery_publisher.${out_key} out_keys unmatched_count,publisher_id_1_count,publisher_id_2_count,publisher_id_3_count,publisher_id_4_count </match> 14 VASILY Inc. 2015
metrics 15 VASILY Inc. 2015
spike • ֎෦৴͍ͯ͠ΔͷͰ৴ઌΞϓϦͰpush৴͕͋Δspike • աڈͷspikeใΛ͋ͭΊ͓͓ͯ·͔ʹ࣌ؒΛѲ • time scheduled base auto-scalingͰରԠ
16 VASILY Inc. 2015
metrics page • iQONADͷ෦πʔϧʹmackerelͷάϥϑΛΓ͚ͭ • iframe, markdown ͳͲͰ֎෦ʹshareͰ͖Δ • ͪΖΜmackerelͷೝূඞཁ
17 VASILY Inc. 2015
18 VASILY Inc. 2015
Alert • custom metricsͷঢ়گࢹରʹઃఆͰ͖Δ • nginxͷstatusͷerror countͳͲ 19 VASILY Inc.
2015
Future • norikra • norikra-listener-mackerel 20 VASILY Inc. 2015
Conclusion • fluentdͱmackerelΛ͔ͭͬͯ؆୯ʹσʔλͷϞχλϦϯά • fluentdͷconfigΛগ͠ॻ͍ͯɺmackerelͷཧπʔϧ͔ΒΆͪ ΆͪઃఆͰྃ • mackerel͍͢͝ศར!!! • άϥϑΛΓग़ͯ͠ϖϥΠνͷϖʔδΛͭ͘Δ͜ͱͰΤϯδχ
ΞҎ֎ʹ • ϞχλϦϯά͍ͯ͠Δσʔλࢹରʹઃఆ 21 VASILY Inc. 2015
We are hiring! •
[email protected]
22 VASILY Inc. 2015
end ͋Γ͕ͱ͏͍͟͝·ͨ͠ 23 VASILY Inc. 2015