Tweet
Tweet

Slide 1

Slide 1 text

Mapion Log/Monitoring ByɹSuto Mapion Infrastructure Group Hironori Suto.

Slide 2

Slide 2 text

Logs. (Access log.)

Slide 3

Slide 3 text

Mapion Log. ֤γεςϜͷཁٻʹԠͯ͡ෳ਺ύλʔϯ ݹ͘ͳΓ͍͗ͯ͢Δ෦෼΋͋ΔͷͰ௚͍͖͍ͯͨ͠ ͱ͜Ζ΋͋Γ·͢ɻ

Slide 4

Slide 4 text

ELB+S3+Redshift ELB EC2 Access Logs S3 Redshift Other data

Slide 5

Slide 5 text

ELB+S3+Redshift Pros - Less changes. - Sql like search. Cons - Cost.

Slide 6

Slide 6 text

ELB+S3+Athena ELB EC2 Access Logs S3 Athena

Slide 7

Slide 7 text

ELB+S3+Athena Pros - Less changes. - Sql like search. - Low cost. Cons - Only Access Logs.

Slide 8

Slide 8 text

ELB+S3+Athena+ re-dash ELB EC2 Access Logs S3 Athena Other data

Slide 9

Slide 9 text

Re-dash Visualizing tool for any data sources. MySQL,PostgreSQL,Elastic search mongoDB, Athena and so on.

Slide 10

Slide 10 text

Re-dash

Slide 11

Slide 11 text

EC2(or nova) + fluentd+kibana ELB EC2 Access Proxy Server Fluentd(td-agent) EC2 Elastic search + Elastic search service

Slide 12

Slide 12 text

Pros - Search. - Any logs. - Realtime Watch. Cons - Cost. EC2(or nova) + fluentd+kibana

Slide 13

Slide 13 text

Legacy… Maintenance cost… SCP + awstats.

Slide 14

Slide 14 text

Monitoring

Slide 15

Slide 15 text

Monitoring - Zabbix (Helion & AWS) 1 Zabbix Instance → AWS(vpc) ≒100 instance 1 Zabbix Instance → Helion ≒100 instance 3 Zabbix Instance → AWS(classic) ≒80 instance

Slide 16

Slide 16 text

Monitoring - Cloudwatch for AWS system (ELB etc)

Slide 17

Slide 17 text

AutoScale + Zabbix Zabbix Zabbix API Chef +Script New Server

Slide 18

Slide 18 text

AutoScale + Zabbix  Zabbix Zabbix API Script Delete Server

Slide 19

Slide 19 text

AutoScale + Zabbix Zabbix Alert Log.

Slide 20

Slide 20 text

Service Check(Nagios) ELB AWS Public cloud Nagios