Upgrade to Pro — share decks privately, control downloads, hide ads and more …
Sign up for free

Fast In-memory Analytics for Retail Data with C...

Sponsored · Your Podcast. Everywhere. Effortlessly. Share. Educate. Inspire. Entertain. You do you. We'll handle the rest. →
Avatar for ernestoarbitrio ernestoarbitrio
April 09, 2017
Technology
81
0

Fast In-memory Analytics for Retail Data with Columnar Databases

Avatar for ernestoarbitrio

ernestoarbitrio

April 09, 2017

More Decks by ernestoarbitrio

See All by ernestoarbitrio
Enable effective Observability with Python
Avatar for ernestoarbitrio pamaron
0
150
PyConZA 2022 Best practices for good(ish) and clean(ish) code
Avatar for ernestoarbitrio pamaron
0
130
PyCon Italia 2022 Best practices for good(ish) and clean(ish) code
Avatar for ernestoarbitrio pamaron
0
310
Bokeh: Using python for interactive data visualization
Avatar for ernestoarbitrio pamaron
1
180
Keystroke Behavioural Analysis For Fraud Detection: Deep Learning as-a-service Infrastructure
Avatar for ernestoarbitrio pamaron
0
69
Indexing and search tons of data with ElasticSearch and Django
Avatar for ernestoarbitrio pamaron
0
430
Interactive plot with django and highchart JS (without JS)
Avatar for ernestoarbitrio pamaron
0
410

Other Decks in Technology

See All in Technology
Claude Code本は、どのように執筆チームで書かれたか
Avatar for Oikon oikon48
0
230
Snowflake Horizon Catalog と Apache Iceberg で作る オープンなデータ基盤
Avatar for キタガワ kitagawaz
0
450
2026-10-01_MagicPod_QAハーネスエンジニアリングとQA組織の未来像
Avatar for 西田泰明 ynisqa1988
1
540
分析の民主化を支えるメタデータ整備の実践
Avatar for KAKEHASHI kakehashi
PRO
1
630
使いこなすために知っておきたい Azure SRE Agent アンチパターン
Avatar for Toru Makabe torumakabe
2
400
自分で立ててみるLLMサービス
Avatar for 世良泰明 y_sera15
0
130
Codex概要
Avatar for Y.Miyado ymiya55
0
440
実体験から学ぶ分析エージェントの開発と運⽤
Avatar for Recruit recruitengineers
PRO
1
310
オブザーバビリティを高める AI エージェント体験を考える / Designing AI Agent Experiences That Enhance Observability
Avatar for Kento Kimura aoto
PRO
2
310
Incremental HTTP
Avatar for kazuho kazuho
5
2.1k
BedrockとLambdaで作る リアルタイム進行型推理ゲーム
Avatar for kawai kawametho
0
190
プロダクト価値を、 チームが使える判断軸に変える
Avatar for viviON vivion
0
130

Featured

See All Featured
Breaking role norms: Why Content Design is so much more than writing copy - Taylor Woolridge
Avatar for UX Y'all uxyall
1
440
SEO in 2025: How to Prepare for the Future of Search
Avatar for Michael King ipullrank
3
3.9k
HU Berlin: Industrial-Strength Natural Language Processing with spaCy and Prodigy
Avatar for Ines Montani inesmontani
PRO
0
740
Getting science done with accelerated Python computing platforms
Avatar for Jacob Tomlinson jacobtomlinson
2
520
So, you think you're a good person
Avatar for Per Axbom axbom
PRO
2
2.2k
The World Runs on Bad Software
Avatar for Brandon Keepers bkeepers
PRO
72
12k
Designing for Performance
Avatar for Lara Hogan lara
611
70k
Fireside Chat
Avatar for paigeccino paigeccino
43
4.1k
CSS Pre-Processors: Stylus, Less & Sass
Avatar for Bermon Painter bermonpainter
360
31k
Bootstrapping a Software Product
Avatar for Garrett Dimon garrettdimon
PRO
306
120k
Primal Persuasion: How to Engage the Brain for Learning That Lasts
Avatar for Mike Taylor tmiket
0
490
How to build an LLM SEO readiness audit: a practical framework
Avatar for Nick Samuel nmsamuel
2
930

Transcript

  1. Fast In-memory Analytics for Retail Data with Columnar Databases Ernesto

    Arbitrio - Valerio Maggio
 arbitrio | [email protected] Florence April 6, 2017

  2. Retail Data • Overview of data we have • granularity

    • refresh/update rate • Quantity and storage required (space) • services developed around these data

  3. “Materialized Views” • Description of what they are (non-technical) •

    Some examples of Analytics we do on this data

  4. The Problem! ~1 TByte Data We need OLAP Performance:
 75M

    rows -> 5hours

  5. The Solution! Use a Column-oriented Database
 (i.e. Just swap Rows

    with Columns) Chuck Norris Test 
 Passed!
  6. None

  7. Query

  8. None

  9. Thank you get in touch @__pamaron__ @leriomaggio