Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Mapion Log/Monitoring

Sponsored · Ship Features Fearlessly Turn features on and off without deploys. Used by thousands of Ruby developers. →
Avatar for One compath One compath
March 24, 2017
Technology
0
250

Mapion Log/Monitoring

2017.03.24 WOVN x Mapion 勉強会

Avatar for One compath

One compath

March 24, 2017
Tweet

More Decks by One compath

See All by One compath
社内の制度を使って新規事業を⽴ち上げてみた話 OCEM#3
Avatar for One compath mapion
0
200
新規事業のアプリ、Flutterで作ってます〜U-ROUTEのポイ活対応編〜 OCEM#3
Avatar for One compath mapion
0
230
ウォーキングアプリ「aruku&」ってどうやって作ってるの？ OCEM#3
Avatar for One compath mapion
0
220
ONE COMPATH／ワンコンパス Company Deck For Engineer（会社紹介資料）
Avatar for One compath mapion
0
8.1k
ONE COMPATHの地図の開発技術～入門編～ OCEM #2
Avatar for One compath mapion
0
230
脱レガシー! Aurora PostgreSQLに移行してみた OCEM #2
Avatar for One compath mapion
1
970
エンジニアなので「技術」で仕事を効率化してみた ～Slack連携でチームの生産性が向上～　OCEM#2
Avatar for One compath mapion
0
220
20221112_FOSS4G2022Online.pdf
Avatar for One compath mapion
0
1.8k
ONE COMPATH／ワンコンパス　Company Deck（会社資料）
Avatar for One compath mapion
0
380

Other Decks in Technology

See All in Technology
実践 Datadog MCP Server
Avatar for 株式会社ヌーラボ nulabinc
PRO
2
240
WebアクセシビリティをCI/CDで担保する ― axe DevTools × Playwright C#実践ガイド
Avatar for tomokusaba tomokusaba
2
180
OCHaCafe S11 #2 コンテナ時代の次の一手：Wasm 最前線
Avatar for oracle4engineer oracle4engineer
PRO
2
150
AlloyDB 奮闘記
Avatar for hatappi hatappi
0
160
1GB RAMのラズピッピで何ができるのか試してみよう / 20260319-rpijam-1gb-rpi-whats-possible
Avatar for Akira Ouchi akkiesoft
0
540
Zeal of the Convert: Taming Shai-Hulud with AI
Avatar for Rami McCarthy ramimac
0
150
品質を経営にどう語るか #jassttokyo / Communicating the Strategic Value of Quality to Executive Leadership
Avatar for kyonmm kyonmm
PRO
2
680
中央集権型を脱却した話　分散型をやめて、連邦型にたどり着くまで
Avatar for SansanTech sansantech
PRO
1
110
形式手法特論：SMT ソルバで解く認可ポリシの静的解析 #kernelvm / Kernel VM Study Tsukuba No3
Avatar for y_taka_23 ytaka23
1
610
Tebiki Engineering Team Deck
Avatar for Tebiki, Inc. tebiki
0
27k
Zero Data Loss Autonomous Recovery Service サービス概要
Avatar for oracle4engineer oracle4engineer
PRO
2
13k
【Λ（らむだ）】最近のアプデ情報 / RPALT20260318
Avatar for Λ lambda
0
120

Featured

See All Featured
The B2B funnel & how to create a winning content strategy
Avatar for Katarina Dahlin katarinadahlin
PRO
1
310
The Illustrated Guide to Node.js - THAT Conference 2024
Avatar for David Neal reverentgeek
1
310
Introduction to Domain-Driven Design and Collaborative software design
Avatar for Kenny Baas-Schwegler baasie
1
640
Sam Torres - BigQuery for SEOs
Avatar for Tech SEO Connect techseoconnect
PRO
0
220
DBのスキルで生き残る技術 - AI時代におけるテーブル設計の勘所
Avatar for soudai sone soudai
PRO
64
52k
AI in Enterprises - Java and Open Source to the Rescue
Avatar for ivargrimstad ivargrimstad
0
1.2k
How to Get Subject Matter Experts Bought In and Actively Contributing to SEO & PR Initiatives.
Avatar for Liv Day livdayseo
0
85
Mobile First: as difficult as doing things right
Avatar for Swwweet swwweet
225
10k
The AI Revolution Will Not Be Monopolized: How open-source beats economies of scale, even for LLMs
Avatar for Ines Montani inesmontani
PRO
3
3.1k
The browser strikes back
Avatar for Jono Alderson jonoalderson
0
810
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
Avatar for mongodb mongodb
49
9.9k
Google's AI Overviews - The New Search
Avatar for Barry Adams badams
0
940

Transcript

  1. Mapion Log/Monitoring ByɹSuto Mapion Infrastructure Group Hironori Suto.

  2. Logs. (Access log.)

  3. Mapion Log. ֤γεςϜͷཁٻʹԠͯ͡ෳ਺ύλʔϯ ݹ͘ͳΓ͍͗ͯ͢Δ෦෼΋͋ΔͷͰ௚͍͖͍ͯͨ͠ ͱ͜Ζ΋͋Γ·͢ɻ

  4. ELB+S3+Redshift ELB EC2 Access Logs S3 Redshift Other data

  5. ELB+S3+Redshift Pros - Less changes. - Sql like search. Cons

    - Cost.

  6. ELB+S3+Athena ELB EC2 Access Logs S3 Athena

  7. ELB+S3+Athena Pros - Less changes. - Sql like search. -

    Low cost. Cons - Only Access Logs.

  8. ELB+S3+Athena+ re-dash ELB EC2 Access Logs S3 Athena Other data

  9. Re-dash Visualizing tool for any data sources. MySQL,PostgreSQL,Elastic search mongoDB,

    Athena and so on.

  10. Re-dash

  11. EC2(or nova) + fluentd+kibana ELB EC2 Access Proxy Server Fluentd(td-agent)

    EC2 Elastic search + Elastic search service

  12. Pros - Search. - Any logs. - Realtime Watch. Cons

    - Cost. EC2(or nova) + fluentd+kibana

  13. Legacy… Maintenance cost… SCP + awstats.

  14. Monitoring

  15. Monitoring - Zabbix (Helion & AWS) 1 Zabbix Instance →

    AWS(vpc) ≒100 instance 1 Zabbix Instance → Helion ≒100 instance 3 Zabbix Instance → AWS(classic) ≒80 instance

  16. Monitoring - Cloudwatch for AWS system (ELB etc)

  17. AutoScale + Zabbix Zabbix Zabbix API Chef +Script New Server

  18. AutoScale + Zabbix  Zabbix Zabbix API Script Delete Server

  19. AutoScale + Zabbix Zabbix Alert Log.

  20. Service Check(Nagios) ELB AWS Public cloud Nagios