Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Serverless Data Processing
Search
Sponsored
·
SiteGround - Reliable hosting with speed, security, and support you can count on.
→
Victor Wibisono
May 31, 2018
Technology
0
100
Serverless Data Processing
Victor Wibisono
May 31, 2018
Tweet
Share
More Decks by Victor Wibisono
See All by Victor Wibisono
Predictive Maintenance Pipeline using Kafka Connect, Streams and KSQL
devacto
1
1.9k
Other Decks in Technology
See All in Technology
こんなところでも(地味に)活躍するImage Modeさんを知ってるかい?- Image Mode for OpenShift -
tsukaman
0
120
【5分でわかる】セーフィー エンジニア向け会社紹介
safie_recruit
0
42k
Data Hubグループ 紹介資料
sansan33
PRO
0
2.7k
Context Engineeringの取り組み
nutslove
0
310
広告の効果検証を題材にした因果推論の精度検証について
zozotech
PRO
0
140
名刺メーカーDevグループ 紹介資料
sansan33
PRO
0
1k
ブロックテーマでサイトをリニューアルした話 / 2026-01-31 Kansai WordPress Meetup
torounit
0
460
顧客との商談議事録をみんなで読んで顧客解像度を上げよう
shibayu36
0
200
Deno・Bunの標準機能やElysiaJSを使ったWebSocketサーバー実装 / ラーメン屋を貸し切ってLT会! IoTLT 2026新年会
you
PRO
0
300
生成AIを活用した音声文字起こしシステムの2つの構築パターンについて
miu_crescent
PRO
1
160
Context Engineeringが企業で不可欠になる理由
hirosatogamo
PRO
3
510
GitHub Issue Templates + Coding Agentで簡単みんなでIaC/Easy IaC for Everyone with GitHub Issue Templates + Coding Agent
aeonpeople
1
200
Featured
See All Featured
Leading Effective Engineering Teams in the AI Era
addyosmani
9
1.6k
KATA
mclloyd
PRO
34
15k
So, you think you're a good person
axbom
PRO
2
1.9k
How to audit for AI Accessibility on your Front & Back End
davetheseo
0
180
エンジニアに許された特別な時間の終わり
watany
106
230k
Avoiding the “Bad Training, Faster” Trap in the Age of AI
tmiket
0
72
Redefining SEO in the New Era of Traffic Generation
szymonslowik
1
210
HDC tutorial
michielstock
1
370
Exploring anti-patterns in Rails
aemeredith
2
250
How To Stay Up To Date on Web Technology
chriscoyier
791
250k
The Director’s Chair: Orchestrating AI for Truly Effective Learning
tmiket
1
96
Why You Should Never Use an ORM
jnunemaker
PRO
61
9.7k
Transcript
Serverless Data Processing
Contents • What it is and why • Architecture •
Demo
Serverless?
Serverless is about focusing your efforts on what provides value
to users.
No servers?
None
None
https://serverless.com/learn/
Data processing?
None
None
None
Architecture
None
• Infinitely scalable • 99.9999999% data durability • Pay-per-use, no
pre- provisioning
AWS Glue • Spark-as-a-service • No cluster management • Pay-per-use,
no pre-provisioning • Services include: data crawling, cataloging (Hive metastore)
AWS Athena • Pay-per-query • No pre-provisioning • Infinitely scalable
https://blog.panoply.io/an-amazonian-battle-comparing-athena-and-redshift
None
Learn more...
https://unnik.s3.amazonaws.com/public-files/unnik-lab-guides/aws-summit-2018/datalake/unnik-aws-summit-2018-datalake-demo.html
Demo