$30 off During Our Annual Pro Sale. View Details »

Fast In-memory Analytics for Retail Data with C...

Avatar for ernestoarbitrio ernestoarbitrio
April 09, 2017
Technology
0
70

Fast In-memory Analytics for Retail Data with Columnar Databases

Avatar for ernestoarbitrio

ernestoarbitrio

April 09, 2017
Tweet

More Decks by ernestoarbitrio

See All by ernestoarbitrio
Enable effective Observability with Python
Avatar for ernestoarbitrio pamaron
0
130
PyConZA 2022 Best practices for good(ish) and clean(ish) code
Avatar for ernestoarbitrio pamaron
0
110
PyCon Italia 2022 Best practices for good(ish) and clean(ish) code
Avatar for ernestoarbitrio pamaron
0
250
Bokeh: Using python for interactive data visualization
Avatar for ernestoarbitrio pamaron
1
170
Keystroke Behavioural Analysis For Fraud Detection: Deep Learning as-a-service Infrastructure
Avatar for ernestoarbitrio pamaron
0
61
Indexing and search tons of data with ElasticSearch and Django
Avatar for ernestoarbitrio pamaron
0
410
Interactive plot with django and highchart JS (without JS)
Avatar for ernestoarbitrio pamaron
0
360

Other Decks in Technology

See All in Technology
一億総業務改善を支える社内AIエージェント基盤の要諦
Avatar for Yuku Kotani yukukotani
7
2.3k
セキュリティAIエージェントの現在と未来 / PSS #2 Takumi Session
Avatar for GMO Flatt Security flatt_security
1
130
Capture Checking / Separation Checking 入門
Avatar for Rikito Taniguchi tanishiking
0
110
Bill One 開発エンジニア 紹介資料
Avatar for Sansan, Inc. sansan33
PRO
4
15k
生成AIシステムとAIエージェントに関する性能や安全性の評価
Avatar for shibuiwilliam shibuiwilliam
2
300
MAP-7thplaceSolution
Avatar for yukichi0403 yukichi0403
2
230
小規模チームによる衛星管制システムの開発とスケーラビリティの実現
Avatar for Takahiro Miyoshi sankichi92
0
170
都市スケールAR制作で気をつけること
Avatar for segur segur
0
210
re:Invent2025とAWS Builder Cards Resilience Expansionのご紹介
Avatar for Tsuwa61 tsuwa61
1
130
LangChain v1.0にトライ～ AIエージェントアプリの移行（v0.3 → v1.0） ～
Avatar for コロッケそば happysamurai294
0
140
useEffectってなんで非推奨みたいなこと言われてるの？
Avatar for マグロ隊長kinTV maguroalternative
9
5.9k
IPv6-mostly field report from RubyKaigi 2026
Avatar for Sorah Fukumori sorah
0
240

Featured

See All Featured
Into the Great Unknown - MozCon
Avatar for Noah Learner thekraken
40
2.2k
Making Projects Easy
Avatar for Brett Harned brettharned
120
6.5k
Building Adaptive Systems
Avatar for Chris Keathley keathley
44
2.8k
Dealing with People You Can't Stand - Big Design 2015
Avatar for Cassini Nazir cassininazir
367
27k
[Rails World 2023 - Day 1 Closing Keynote] - The Magic of Rails
Avatar for Eileen M. Uchitelle eileencodes
37
2.6k
It's Worth the Effort
Avatar for 3n 3n
187
29k
Build your cross-platform service in a week with App Engine
Avatar for Jose L jlugia
234
18k
Done Done
Avatar for chrislema chrislema
186
16k
10 Git Anti Patterns You Should be Aware of
Avatar for Lemi Orhan Ergin lemiorhan
PRO
659
61k
Bootstrapping a Software Product
Avatar for Garrett Dimon garrettdimon
PRO
307
110k
Building a Scalable Design System with Sketch
Avatar for Laura Van Doore lauravandoore
463
34k
What’s in a name? Adding method to the madness
Avatar for Product Marketing Alliance productmarketing
PRO
24
3.8k

Transcript

  1. Fast In-memory Analytics for Retail Data with Columnar Databases Ernesto

    Arbitrio - Valerio Maggio
 arbitrio | [email protected] Florence April 6, 2017

  2. Retail Data • Overview of data we have • granularity

    • refresh/update rate • Quantity and storage required (space) • services developed around these data

  3. “Materialized Views” • Description of what they are (non-technical) •

    Some examples of Analytics we do on this data

  4. The Problem! ~1 TByte Data We need OLAP Performance:
 75M

    rows -> 5hours

  5. The Solution! Use a Column-oriented Database
 (i.e. Just swap Rows

    with Columns) Chuck Norris Test 
 Passed!
  6. None

  7. Query

  8. None

  9. Thank you get in touch @__pamaron__ @leriomaggio