Upgrade to Pro — share decks privately, control downloads, hide ads and more …
Sign up for free

Fast In-memory Analytics for Retail Data with C...

Sponsored · Your Podcast. Everywhere. Effortlessly. Share. Educate. Inspire. Entertain. You do you. We'll handle the rest. →
Avatar for ernestoarbitrio ernestoarbitrio
April 09, 2017
Technology
81
0

Fast In-memory Analytics for Retail Data with Columnar Databases

Avatar for ernestoarbitrio

ernestoarbitrio

April 09, 2017

More Decks by ernestoarbitrio

See All by ernestoarbitrio
Enable effective Observability with Python
Avatar for ernestoarbitrio pamaron
0
150
PyConZA 2022 Best practices for good(ish) and clean(ish) code
Avatar for ernestoarbitrio pamaron
0
140
PyCon Italia 2022 Best practices for good(ish) and clean(ish) code
Avatar for ernestoarbitrio pamaron
0
310
Bokeh: Using python for interactive data visualization
Avatar for ernestoarbitrio pamaron
1
180
Keystroke Behavioural Analysis For Fraud Detection: Deep Learning as-a-service Infrastructure
Avatar for ernestoarbitrio pamaron
0
74
Indexing and search tons of data with ElasticSearch and Django
Avatar for ernestoarbitrio pamaron
0
430
Interactive plot with django and highchart JS (without JS)
Avatar for ernestoarbitrio pamaron
0
410

Other Decks in Technology

See All in Technology
Content Mapper APIの応用例～CSS Modules、言語ファイル～
Avatar for uhyo uhyo
2
620
Software Engineering in an AI-Driven World
Avatar for Erik Jhordan Rey erikjhordan_rey
0
130
自律的なチームを作るためにTechPMがやらないこと
Avatar for Naoki Yoshitake ny7760
1
520
HQ駆動開発で最高のAI-Contextを作ろう
Avatar for SansanTech sansantech
PRO
1
110
現場を動かすAIエージェント#2_製造業現場でのAI活用から見た、ハマる罠と実践知
Avatar for KintoTech_Dev kintotechdev
2
180
令和の今、あらためて IAM を考える。アクセスキーを「無くせない現実」との向き合い方
Avatar for kazzpapa3 kazzpapa3
0
370
TSKaigi Sendai 2026 - tsgo時代のTypeScript Playgroundはどう動くか
Avatar for teamLab teamlab
PRO
0
110
[JAWS Festa 2026]一番いい仕事は、請求書に現れない / jawsfesta2026
Avatar for sh_fk2 sh_fk2
2
250
AIに任せられるFlutterコードベースを作る 〜仕様をコードで表し、ハーネスで守る〜
Avatar for Yohei Maeda myohei
1
650
AI AgentによるEmbedded SREの取り組み
Avatar for norimichi.osanai tgidgd
1
350
cdkd (CDK Direct)
Avatar for k.goto gotok365
4
260
re:Invent2026 事前勉強会 歴史と愉しみ方10分LT編
Avatar for T.Atsumi toshi_atsumi
0
150

Featured

See All Featured
Leading Effective Engineering Teams in the AI Era
Avatar for Addy Osmani addyosmani
9
2.8k
Bash Introduction
Avatar for André Augusto Costa Santos 62gerente
615
220k
Between Models and Reality
Avatar for mayunak mayunak
4
560
[Rails World 2023 - Day 1 Closing Keynote] - The Magic of Rails
Avatar for Eileen M. Uchitelle eileencodes
38
3.1k
Introduction to Domain-Driven Design and Collaborative software design
Avatar for Kenny Baas-Schwegler baasie
1
1.1k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
Avatar for mongodb mongodb
50
10k
Java REST API Framework Comparison - PWX 2021
Avatar for Matt Raible mraible
34
9.8k
Chasing Engaging Ingredients in Design
Avatar for Sebastian Deterding codingconduct
0
390
Testing 201, or: Great Expectations
Avatar for Joseph Mastey jmmastey
46
8.4k
How GitHub (no longer) Works
Avatar for Zach Holman holman
316
150k
Docker and Python
Avatar for Tania Allard trallard
47
4.3k
The agentic SEO stack - context over prompts
Avatar for schlessera schlessera
0
1k

Transcript

  1. Fast In-memory Analytics for Retail Data with Columnar Databases Ernesto

    Arbitrio - Valerio Maggio
 arbitrio | [email protected] Florence April 6, 2017

  2. Retail Data • Overview of data we have • granularity

    • refresh/update rate • Quantity and storage required (space) • services developed around these data

  3. “Materialized Views” • Description of what they are (non-technical) •

    Some examples of Analytics we do on this data

  4. The Problem! ~1 TByte Data We need OLAP Performance:
 75M

    rows -> 5hours

  5. The Solution! Use a Column-oriented Database
 (i.e. Just swap Rows

    with Columns) Chuck Norris Test 
 Passed!
  6. None

  7. Query

  8. None

  9. Thank you get in touch @__pamaron__ @leriomaggio