Analytics on your laptop with ClickHouse Local

Although ClickHouse is usually used for large-scale data analytics with lots of concurrent users, we can also use it to run analytics from our laptop with ClickHouse local. In this talk I'll give an introduction to ClickHouse and its use cases, before showing how to analyse data both on my machine and from the internet if the WiFi treats us well!

https://www.meetup.com/uk-open-source-data-infrastructure-meetup/events/297395569/

Transcript

1. Analytics on your laptop with ClickHouse Local Mark Needham 6th December 2023
2. Table of contents What is ClickHouse? 01 Ad Hoc Analysis vs Queries at Scale 02 Demos 03 2
3. What is ClickHouse? Open Source Developed since 2009 OSS 2016 31k+ Github stars 1k+ contributors 500+ releases Column-Oriented Distributed OLAP Database Files per column Vectorized query execution Optimised for aggregations Sorting and indexing Background merges Replication Sharding Multi-master Cross-region Analytics use cases Aggregations Visualizations Mostly immutable data
4. Row Oriented vs Column Oriented location ts temperature wind_speed humidity Aberystwyth 2022-01-01 00:00:00 14 21 79 Blackpool 2022-01-01 00:20:00 13 9 82 location Aberystwyth Blackpool temperature 14 13 humidity 79 82 ts 2022-01-01 00:00:00 2022-01-01 00:20:00 wind_speed 21 9 Row Oriented Column Oriented
5. Vectorised Query Execution Process rows sequentially Process chunks of values
7. How do we use OLAP databases like ClickHouse? 7
8. Ad Hoc Analysis vs Queries at scale 8
9. Ad Hoc Analysis vs Queries at scale 9
10. Flavours of ClickHouse 10 ClickHouse Server ClickHouse Local chdb
11. Flavours of ClickHouse 11 ClickHouse Server ClickHouse Local chdb We can also use ClickHouse over here.
12. 🎉 Demo Time 🎉 12
13. 13 curl https://clickhouse.com/ | sh
14. 14 Demo 1: Mid Journey Metadata
15. 15 Demo 2: Wikimedia Stream
16. Questions 16 uk.linkedin.com/in/markhneedham learndatawithmark.com youtube.com/@clickhousedb clickhouse.com/docs