$30 off During Our Annual Pro Sale. View details »

Mapion Log/Monitoring

Mapion Log/Monitoring

2017.03.24 WOVN x Mapion 勉強会

One compath

March 24, 2017
Tweet

More Decks by One compath

Other Decks in Technology

Transcript

  1. Mapion Log/Monitoring ByɹSuto Mapion Infrastructure Group Hironori Suto.

  2. Logs. (Access log.)

  3. Mapion Log. ֤γεςϜͷཁٻʹԠͯ͡ෳ਺ύλʔϯ ݹ͘ͳΓ͍͗ͯ͢Δ෦෼΋͋ΔͷͰ௚͍͖͍ͯͨ͠ ͱ͜Ζ΋͋Γ·͢ɻ

  4. ELB+S3+Redshift ELB EC2 Access Logs S3 Redshift Other data

  5. ELB+S3+Redshift Pros - Less changes. - Sql like search. Cons

    - Cost.
  6. ELB+S3+Athena ELB EC2 Access Logs S3 Athena

  7. ELB+S3+Athena Pros - Less changes. - Sql like search. -

    Low cost. Cons - Only Access Logs.
  8. ELB+S3+Athena+ re-dash ELB EC2 Access Logs S3 Athena Other data

  9. Re-dash Visualizing tool for any data sources. MySQL,PostgreSQL,Elastic search mongoDB,

    Athena and so on.
  10. Re-dash

  11. EC2(or nova) + fluentd+kibana ELB EC2 Access Proxy Server Fluentd(td-agent)

    EC2 Elastic search + Elastic search service
  12. Pros - Search. - Any logs. - Realtime Watch. Cons

    - Cost. EC2(or nova) + fluentd+kibana
  13. Legacy… Maintenance cost… SCP + awstats.

  14. Monitoring

  15. Monitoring - Zabbix (Helion & AWS) 1 Zabbix Instance →

    AWS(vpc) ≒100 instance 1 Zabbix Instance → Helion ≒100 instance 3 Zabbix Instance → AWS(classic) ≒80 instance
  16. Monitoring - Cloudwatch for AWS system (ELB etc)

  17. AutoScale + Zabbix Zabbix Zabbix API Chef +Script New Server

  18. AutoScale + Zabbix  Zabbix Zabbix API Script Delete Server

  19. AutoScale + Zabbix Zabbix Alert Log.

  20. Service Check(Nagios) ELB AWS Public cloud Nagios