Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Fast In-memory Analytics for Retail Data with C...

ernestoarbitrio
April 09, 2017
Technology
0
65

Fast In-memory Analytics for Retail Data with Columnar Databases

ernestoarbitrio

April 09, 2017
Tweet

More Decks by ernestoarbitrio

See All by ernestoarbitrio
Enable effective Observability with Python
pamaron
0
110
PyConZA 2022 Best practices for good(ish) and clean(ish) code
pamaron
0
87
PyCon Italia 2022 Best practices for good(ish) and clean(ish) code
pamaron
0
220
Bokeh: Using python for interactive data visualization
pamaron
1
150
Keystroke Behavioural Analysis For Fraud Detection: Deep Learning as-a-service Infrastructure
pamaron
0
47
Indexing and search tons of data with ElasticSearch and Django
pamaron
0
350
Interactive plot with django and highchart JS (without JS)
pamaron
0
320

Other Decks in Technology

See All in Technology
Docker Desktop で Docker を始めよう
zembutsu
PRO
0
180
コロプラのオンボーディングを採用から語りたい
colopl
5
1.3k
三菱電機で社内コミュニティを立ち上げた話
kurebayashi
1
360
AWSの生成AIサービス Amazon Bedrock入門！（2025年1月版）
minorun365
PRO
7
470
CDKのコードレビューを楽にするパッケージcdk-mentorを作ってみた/cdk-mentor
tomoki10
0
210
ABWGのRe:Cap!
hm5ug
1
120
ドメイン駆動設計の実践により事業の成長スピードと保守性を両立するショッピングクーポン
lycorptech_jp
PRO
13
2.3k
カップ麺の待ち時間(3分)でわかるPartyRockアップデート
ryutakondo
0
140
機械学習を「社会実装」するということ 2025年版 / Social Implementation of Machine Learning 2025 Version
moepy_stats
5
1.3k
[IBM TechXchange Dojo]Watson Discoveryとwatsonx.aiでRAGを実現!座学①
siyuanzh09
0
110
【JAWS-UG大阪 reInvent reCap LT大会 サンバが始まったら強制終了】“1分”で初めてのソロ参戦reInventを数字で振り返りながら反省する
ttelltte
0
140
.NET 最新アップデート ～ AI とクラウド時代のアプリモダナイゼーション
chack411
0
200

Featured

See All Featured
Fireside Chat
paigeccino
34
3.1k
The World Runs on Bad Software
bkeepers
PRO
66
11k
The Art of Programming - Codeland 2020
erikaheidi
53
13k
Designing for Performance
lara
604
68k
Distributed Sagas: A Protocol for Coordinating Microservices
caitiem20
330
21k
The Power of CSS Pseudo Elements
geoffreycrofte
74
5.4k
Performance Is Good for Brains [We Love Speed 2024]
tammyeverts
7
570
The Language of Interfaces
destraynor
155
24k
Navigating Team Friction
lara
183
15k
Embracing the Ebb and Flow
colly
84
4.5k
Product Roadmaps are Hard
iamctodd
PRO
50
11k
The Success of Rails: Ensuring Growth for the Next 100 Years
eileencodes
44
7k

Transcript

  1. Fast In-memory Analytics for Retail Data with Columnar Databases Ernesto

    Arbitrio - Valerio Maggio
 arbitrio | [email protected] Florence April 6, 2017

  2. Retail Data • Overview of data we have • granularity

    • refresh/update rate • Quantity and storage required (space) • services developed around these data

  3. “Materialized Views” • Description of what they are (non-technical) •

    Some examples of Analytics we do on this data

  4. The Problem! ~1 TByte Data We need OLAP Performance:
 75M

    rows -> 5hours

  5. The Solution! Use a Column-oriented Database
 (i.e. Just swap Rows

    with Columns) Chuck Norris Test 
 Passed!
  6. None

  7. Query

  8. None

  9. Thank you get in touch @__pamaron__ @leriomaggio