運用の負担を減らすログ送信システムの設計

SRE-SET Automation Night #2発表資料 https://mercari.connpass.com/event/79046/

Transcript

1. 
     
    (oshiumi)
   ,   Monolith, Aiming SRE-SET Automation Night #2 2018/03/06
2. Aiming    
    CARAVAN STORIES
3. Monolith
      !"
    # $% KPI  
   BigQuery 
4.  &'()*+, -./0123456
5.   
6. 
   
7. lolo 78 9:; 9&'<+= />? @5A<+= BQpartition ! Pub/Sub"#$% BC/DEFGH23<+=
8. lolo logIJ &'()* KL-MNO/P QR logging load → lolo
9. lolo
10. lolo ETL Extract / Transform / Load  +,  +, -.
11. 
    
12. lolo 1SCT1Uextract, transform, loadV W XY ZJ[\]\^
    _
13.  `abc< H\d=H =e /01231456,787 9:;<=>?@A5BCC!BC fg/h^ijTk^4lIV:m
14. lolo !"# warn DEF6,C,GHIJKLBMN BQ
     → 
     error DEF6,C,OHIJ1PQBMN 
     →   fatal DEF6,CBCMN
15. !$%&'() warn error fatal nao ◦ × × pqr ◦ ◦ × ijTst!HlITu*v wx0yV2
16. *+,-. X
    _Jz{|E RSTUVWX7. fatalV}FvA ~/
    _T€< = ‚ƒ„…mV 9 t wx0yV2
17. /01 naoV†<=‡|Vˆ YZ[\]^_1PQB`\ D‰/01JEFGH23<+=  !-. 
     a6b6cd"#$%&  
18. 2('