Grafana Loki: 1 year later

Presentation deck for follow up Loki talk given from DevOpsDaysIndia 2019

Transcript

1. Loki: 1 year later DevOpsDays India 2019 Sandeep Sukhani
2. Sandeep Sukhani Software Engineer @ Grafana Labs Previously: Freelancing, Vaultize Twitter: @sukhanisandeep Email: sandeep.sukhani@grafana.com
4. Layout • Quick Loki Intro • New Features • Optimizations • Demo • Running Loki in Production • Community Support & Future
5. # Intro
6. 03/18 Project started 12/18 Launched at KubeCon 12/18 #1 on HN for ~12hrs! 03/19 Labels from logs 04/19 Lazy Queriers; LogQL filtering 05/19 Live Tailing 09/19 7k GitHub stars https://github.com/grafana/loki Loki is a horizontally-scalable, highly-available, multitenant log aggregation system inspired by Prometheus.
7. Logging architecture {job=”app1”} {job=”app2”} Node Logging agent Logging service Logging datasource
8. Logging architecture {job=”app1”} {job=”app2”} Node Promtail Loki Logging datasource
9. Loki: Architecture Your jobs Distributor Ingester Index Chunks Querier
10. # New Features
11. Structured Logging • Pipeline • Stages Example: {"log":"some log message","stream":"stderr","time":"2019-04-30T02:12:41.8443515Z"}
12. LogQL • Log Stream Selector ◦ {app=”foo”, namespace=”dev”} ◦ {foo=~”.+bar”} • Filter Expression ◦ {app=”foo”, namespace=”dev”} |= “error” ◦ {app=”foo”, namespace=”dev”} |= “error” |= “timeout” ◦ {app=”foo”, namespace=”dev”} |= “error” != “timeout” • Aggregation operators ◦ rate({app=”foo”, namespace=”dev”} |= “error” [5m]) ◦ count_over_time({app=”foo”, namespace=”dev”} |= "error" [5m])
13. More features... • Live Tailing • Retention • Docker Driver • Canary • Many more...
14. # Optimizations Stats from internal Loki deployment: • ~17 MB/s log ingestion • Upto 100K entries per chunk • Upto 600KB chunk size • Upto 80K chunks fetched per query Areas of improvements • Memory leaks • Batch Processing & Memory Pools • Benchmarking • Monitoring
15. # Demo
16. # Running Loki in Production • Deployment Modes ◦ Micro-service vs Monolith • Deployment Options ◦ Binary ◦ Docker ◦ Helm ◦ ksonnet … • Scaling
17. # Community Support & Future • Governance • Community Calls • Releases • New upcoming features • GA
18. Resources • https://grafana.com/categories/loki/ • https://github.com/grafana/loki/tree/master/docs • http://slack.grafana.com/ • lokiproject@googlegroups.com
19. Thanks! Questions?