Fast In-memory Analytics for Retail Data with C...

ernestoarbitrio

April 09, 2017

65

Fast In-memory Analytics for Retail Data with Columnar Databases

ernestoarbitrio

April 09, 2017

Tweet

More Decks by ernestoarbitrio

See All by ernestoarbitrio

Enable effective Observability with Python

0

120

PyConZA 2022 Best practices for good(ish) and clean(ish) code

0

93

PyCon Italia 2022 Best practices for good(ish) and clean(ish) code

0

230

Bokeh: Using python for interactive data visualization

1

150

Keystroke Behavioural Analysis For Fraud Detection: Deep Learning as-a-service Infrastructure

0

56

Indexing and search tons of data with ElasticSearch and Django

0

380

Interactive plot with django and highchart JS (without JS)

0

330

Other Decks in Technology

See All in Technology

ソフトウェア開発現代史: "LeanとDevOpsの科学"の「科学」とは何か？ - DORA Report 10年の変遷を追って - #DevOpsDaysTokyo

0

370

Creating Awesome Change in SmartNews

1

270

彩の国で始めよう。おっさんエンジニアから共有したい、当たり前のことを当たり前にする技術

0

140

SmartHR プロダクトエンジニア求人ガイド_2025 / PdE job guide 2025

0

110

バクラクの認証基盤の成長と現在地 / bakuraku-authn-platform

1

340

CloudWatch 大好きなSAが語る CloudWatch キホンのキ

0

170

IVRyにおけるNLP活用と NLP2025の関連論文紹介

0

190

Рекомендации с нуля: как мы в Lamoda превратили главную страницу в ключевую точку входа для персонализированного шоппинга. Данил Комаров, Data Scientist, Lamoda Tech

0

710

大AI時代で輝くために今こそドメインにディープダイブしよう / Deep Dive into Domain in AI-Agent-Era

1

360

技術者はかっこいいものだ！！～キルラキルから学んだエンジニアの生き方～

2

260

SDカードフォレンジック

1

600

The Tale of Leo: Brave Lion and Curious Little Bug

1

120

Featured

See All Featured

Mobile First: as difficult as doing things right

223

9.6k

Code Reviewing Like a Champion

522

40k

Build your cross-platform service in a week with App Engine

229

18k

Put a Button on it: Removing Barriers to Going Fast.

60

3.8k

No one is an island. Learnings from fostering a developers community.

21

3.2k

Typedesign – Prime Four

41

2.6k

4 Signs Your Business is Dying

183

22k

Six Lessons from altMBA

27

3.7k

Chrome DevTools: State of the Union 2024 - Debugging React & Beyond

5

550

Building Adaptive Systems

41

2.5k

The Cult of Friendly URLs

78

6.3k

Practical Tips for Bootstrapping Information Extraction Pipelines

19

1.1k

Transcript

Fast In-memory Analytics for Retail Data with Columnar Databases Ernesto
Arbitrio - Valerio Maggio  arbitrio | vmaggio@fbk.eu Florence April 6, 2017
Retail Data • Overview of data we have • granularity
• refresh/update rate • Quantity and storage required (space) • services developed around these data
“Materialized Views” • Description of what they are (non-technical) •
Some examples of Analytics we do on this data
The Problem! ~1 TByte Data We need OLAP Performance:  75M
rows -> 5hours
The Solution! Use a Column-oriented Database  (i.e. Just swap Rows
with Columns) Chuck Norris Test   Passed!
None
Query
None
Thank you get in touch @__pamaron__ @leriomaggio