Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
Don't let your log go away
Search
Olivier Dolbeau
March 24, 2015
Programming
530
1
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
Don't let your log go away
Talk given at Paris Tech Talk MeetUp
Olivier Dolbeau
March 24, 2015
Transcript
33 slides
DON’T LET YOUR LOG GO AWAY @odolbeau 1
WHO AM I? Olivier Dolbeau @odolbeau Work at BlaBlaCar 2
Log 3
Which logs are we talking about? 4
access logs 5
syslog syslog 6
application logs 7
Access 8
SSH 9
Analyze 10
tail grep cat 11
This is specific to its access logs My roommate uses
this to colorise his access logs… 12
13
14
15
16
17
Inputs Filters Outputs 41 inputs • syslog • udp •
varnishlog • gelf • … 50 filters • date • geoip • i18n • urldecode • … 55 outputs • elasticsearch • redis • email • graphite • … And there are also some codecs 18
Kibana 19
20
ELK 21
22
syslog syslog 23
24
*.* @127.0.0.1:514;RSYSLOG_ForwardFormat 25
input { udp { port => 514 type => syslog
} } Logstash - Input 26
filter { if [type] == "syslog" { grok { match
=> [ "message", "<%{POSINT:syslog_pri}>% {TIMESTAMP_ISO8601:syslog_timestamp} %{SYSLOGHOST:syslog_hostname} % {DATA:syslog_program}(?:\[%{POSINT:syslog_pid}\])?: % {GREEDYDATA:syslog_message}" ] add_field => [ "received_at", "%{@timestamp}" ] add_field => [ "received_from", "%{host}" ] add_tag => [ "rsyslog" ] } } } Logstash - Filter 27
output { elasticsearch_http { host => “my_es.blablacar.com” port => 9200
index => "logstashv1-%{+YYYY.MM.dd}" manage_template => false } } Logstash - Output 28
29
syslog 30
31
32
None
More Decks by Olivier Dolbeau
See All by Olivier Dolbeau
Throw new \Exception(); Oui, mais laquelle ?
odolbeau
1
360
Jane & Webby
odolbeau
0
540
Translating a monolingual application
odolbeau
2
720
DX: Developer eXperience
odolbeau
1
150
DX: Developer eXperience
odolbeau
1
600
EasyAdminBundle introduction
odolbeau
0
280
REX API Platform
odolbeau
0
1.4k
Features flags at BlaBlaCar
odolbeau
5
1.3k
25+ million members in 22 countries, how to scale with Symfony2
odolbeau
2
700
Other Decks in Programming
See All in Programming
例外からRich Errorsまで Kotlinエラーハンドリングの進化を読み解く
shiita0903
0
220
AI時代のIaC入門 〜なぜインフラをコードで管理したいのか?〜 / Introduction to IaC in the AI Era
akihisaikeda
6
1.6k
Kotlin JVM用に作られたライブラリのKMPを前提とした再設計
jsoizo
0
210
AI時代のFlutter品質設計 — アプリ品質を守るQuality Layers
omatty198
0
390
AIが生成したコードは読むべきか?抽象化設計とコードの品質保証 / abstraction-design-and-quality
minodriven
16
9.4k
SODA - FACT BOOK(EN)
sodainc
1
260
手の動かし方がわからなかった私が個人開発者になるまで
usagi0920_pochi
0
300
オーケストレーション記述言語 Katari
yukikurage
0
270
クラウドエージェントは、 何がそんなに便利なのか / what makes cloud agents so useful
rkaga
5
940
imagewebp()の向こう側: WebPはなぜ JPEG・PNGより軽いのか
yuzneri
0
130
Crash Auto Pipelines
veronikapj
1
440
Proxmox x Talos Linux x Terraform で実現するなんかいい感じの Kubernetes クラスタ / A Sleek Kubernetes Cluster Powered by Proxmox, Talos Linux, and Terraform
nnaka2992
0
270
Featured
See All Featured
Practical Tips for Bootstrapping Information Extraction Pipelines
honnibal
25
2.2k
Build The Right Thing And Hit Your Dates
maggiecrowley
39
3.5k
How to optimise 3,500 product descriptions for ecommerce in one day using ChatGPT
katarinadahlin
PRO
3
3.9k
jQuery: Nuts, Bolts and Bling
dougneiner
66
8.7k
The Illustrated Children's Guide to Kubernetes
chrisshort
51
53k
How STYLIGHT went responsive
nonsquared
100
6.4k
Measuring Dark Social's Impact On Conversion and Attribution
stephenakadiri
2
330
Intergalactic Javascript Robots from Outer Space
tanoku
273
28k
Balancing Empowerment & Direction
lara
6
1.4k
Google's AI Overviews - The New Search
badams
0
1.7k
Believing is Seeing
oripsolob
1
280
[RailsConf 2023] Rails as a piece of cake
palkan
59
7.2k