Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Don't let your log go away
Search
Olivier Dolbeau
March 24, 2015
Programming
1
380
Don't let your log go away
Talk given at Paris Tech Talk MeetUp
Olivier Dolbeau
March 24, 2015
Tweet
Share
More Decks by Olivier Dolbeau
See All by Olivier Dolbeau
Jane & Webby
odolbeau
0
280
Translating a monolingual application
odolbeau
2
380
DX: Developer eXperience
odolbeau
0
50
DX: Developer eXperience
odolbeau
0
370
EasyAdminBundle introduction
odolbeau
0
130
REX API Platform
odolbeau
0
1k
Features flags at BlaBlaCar
odolbeau
4
810
25+ million members in 22 countries, how to scale with Symfony2
odolbeau
1
370
Be gentle with your prod!
odolbeau
1
580
Other Decks in Programming
See All in Programming
ファイル先頭の use の意味、説明できますか? 〜PHP の namespace と autoloading の関係を正しく理解しよう〜 / namespace and autoloading in php
okashoi
2
470
Compiling Python to WebAssembly with py2wasm
syrusakbary
0
130
設計の知識と技能で駆動するソフトウェア開発
masuda220
PRO
18
10k
自作ソフト(VMagicMirror)がVRMA対応してる話+実装のTips
bakudreameater
0
110
Crafting a Own PHP - ウキウキ手作りミニマリストPHP
uzulla
4
1.1k
Enhancing Applications with Accessibility API
kishikawakatsumi
3
890
OpenAPI を守るのは難しい
ohmori_yusuke
1
140
オブジェクト指向は必要なのか / Is object-oriented needed?
kishida
27
19k
The Future of C++ Interoperability: Insights from Porting a Game to Swift
teamhimeh
0
270
LLMチャットボットのアプリケーション設計Tips
os1ma
4
660
導入から5年が経って見えた Datadog APM 運用の課題
bgpat
2
540
Creating Retro-Style Photos Using Swift
ski
1
340
Featured
See All Featured
GitHub's CSS Performance
jonrohan
1023
450k
Design and Strategy: How to Deal with People Who Don’t "Get" Design
morganepeng
113
18k
Learning to Love Humans: Emotional Interface Design
aarron
266
39k
Why You Should Never Use an ORM
jnunemaker
PRO
50
8.6k
How to name files
jennybc
62
92k
Principles of Awesome APIs and How to Build Them.
keavy
119
16k
Robots, Beer and Maslow
schacon
PRO
154
7.9k
Docker and Python
trallard
33
2.6k
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
marcduiker
11
1.4k
Bash Introduction
62gerente
604
210k
Let's Do A Bunch of Simple Stuff to Make Websites Faster
chriscoyier
501
140k
Imperfection Machines: The Place of Print at Facebook
scottboms
257
12k
Transcript
DON’T LET YOUR LOG GO AWAY @odolbeau 1
WHO AM I? Olivier Dolbeau @odolbeau Work at BlaBlaCar 2
Log 3
Which logs are we talking about? 4
access logs 5
syslog syslog 6
application logs 7
Access 8
SSH 9
Analyze 10
tail grep cat 11
This is specific to its access logs My roommate uses
this to colorise his access logs… 12
13
14
15
16
17
Inputs Filters Outputs 41 inputs • syslog • udp •
varnishlog • gelf • … 50 filters • date • geoip • i18n • urldecode • … 55 outputs • elasticsearch • redis • email • graphite • … And there are also some codecs 18
Kibana 19
20
ELK 21
22
syslog syslog 23
24
*.* @127.0.0.1:514;RSYSLOG_ForwardFormat 25
input { udp { port => 514 type => syslog
} } Logstash - Input 26
filter { if [type] == "syslog" { grok { match
=> [ "message", "<%{POSINT:syslog_pri}>% {TIMESTAMP_ISO8601:syslog_timestamp} %{SYSLOGHOST:syslog_hostname} % {DATA:syslog_program}(?:\[%{POSINT:syslog_pid}\])?: % {GREEDYDATA:syslog_message}" ] add_field => [ "received_at", "%{@timestamp}" ] add_field => [ "received_from", "%{host}" ] add_tag => [ "rsyslog" ] } } } Logstash - Filter 27
output { elasticsearch_http { host => “my_es.blablacar.com” port => 9200
index => "logstashv1-%{+YYYY.MM.dd}" manage_template => false } } Logstash - Output 28
29
syslog 30
31
32
None