Fashion Tech meetup #1 LT
FasionTech Meetup LTAdServer Casual Monitoring byfluentd, Mackerel1 VASILY Inc. 2015
View Slide
Me• Takumi Kanzaki (@tknzk)• VASILY Inc. Backend Engineer• 2015.04~• iQONADΛϝΠϯͰ୲2 VASILY Inc. 2015
iQONAD• iQON͓Αͼ֎෦ΞϓϦʹࠂ৴Λߦ͍ͬͯΔADωοτϫʔΫ• 2014.10~3 VASILY Inc. 2015
iQONAD• software, middleware• Ruby, Rails, sinatra• MySQL, memcached, Redis• infra• EC2, RDS• docker, Elasticbeanstalk (2015.06~)• auto-scaling4 VASILY Inc. 2015
Why Casual Monitoring• ॳظ։ൃ2िؒͰϩʔϯν• طଘͷΈ• ੜϩάΛऩूͯ͠ूܭ• fluentdͰlog-serverʹू͍ͯ͠Δ͕ະूܭ5 VASILY Inc. 2015
Casual Monitoring?• ͓͓·͔ͳঢ়ଶΛࢹ͍ͨ͠• աڈͲΜͳঢ়گ͔ͩͬͨΛѲ͍ͨ͠6 VASILY Inc. 2015
Casual Monitoring?• ৴ͷਪҠ• impression/clickͳͲͷਪҠ• ৴ΤϥʔͷਪҠ• http status codeͷਪҠ• etc..7 VASILY Inc. 2015
without Casual Monitoring?• ϩάੳ• BigQuery• latency monitoring• error rate• NewRelic8 VASILY Inc. 2015
Log Collect• fluentd• mackerel9 VASILY Inc. 2015
fluentd• Fluentd is an open source data collector for unified logging layer.10 VASILY Inc. 2015
Mackerel• A RevolutionaryNew Kind ofApplication PerformanceManagement11 VASILY Inc. 2015
plugin• fluent-plugin-datacounter• fluent-plugin-mackerel• (fluent-plugin-zabbix)12 VASILY Inc. 2015
fluent-plugin-datacounter• ಛఆͷkeyͷΛಛఆͷִؒͰूܭͯ͘͠ΕΔtype datacountercount_interval 1mcount_key publisher_idaggregate alltag stats.delivery.publisherpattern1 publisher_id_1 ^1$pattern2 publisher_id_2 ^2$pattern3 publisher_id_3 ^3$pattern4 publisher_id_4 ^4$13 VASILY Inc. 2015
fluent-plugin-mackereltype mackerelapi_key MACKEREL_API_KEYservice iqon-admetrics_name ad_server_delivery_publisher.${out_key}out_keys unmatched_count,publisher_id_1_count,publisher_id_2_count,publisher_id_3_count,publisher_id_4_count14 VASILY Inc. 2015
metrics15 VASILY Inc. 2015
spike• ֎෦৴͍ͯ͠ΔͷͰ৴ઌΞϓϦͰpush৴͕͋Δspike• աڈͷspikeใΛ͋ͭΊ͓͓ͯ·͔ʹ࣌ؒΛѲ• time scheduled base auto-scalingͰରԠ16 VASILY Inc. 2015
metrics page• iQONADͷ෦πʔϧʹmackerelͷάϥϑΛΓ͚ͭ• iframe, markdown ͳͲͰ֎෦ʹshareͰ͖Δ• ͪΖΜmackerelͷೝূඞཁ17 VASILY Inc. 2015
18 VASILY Inc. 2015
Alert• custom metricsͷঢ়گࢹରʹઃఆͰ͖Δ• nginxͷstatusͷerror countͳͲ19 VASILY Inc. 2015
Future• norikra• norikra-listener-mackerel20 VASILY Inc. 2015
Conclusion• fluentdͱmackerelΛ͔ͭͬͯ؆୯ʹσʔλͷϞχλϦϯά• fluentdͷconfigΛগ͠ॻ͍ͯɺmackerelͷཧπʔϧ͔ΒΆͪΆͪઃఆͰྃ• mackerel͍͢͝ศར!!!• άϥϑΛΓग़ͯ͠ϖϥΠνͷϖʔδΛͭ͘Δ͜ͱͰΤϯδχΞҎ֎ʹ• ϞχλϦϯά͍ͯ͠Δσʔλࢹରʹઃఆ21 VASILY Inc. 2015
We are hiring!• [email protected]22 VASILY Inc. 2015
end͋Γ͕ͱ͏͍͟͝·ͨ͠23 VASILY Inc. 2015