Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Grill the data 2022 - The unsung hero behind Bestimate: data platform
Search
Karn Wong
October 01, 2022
Technology
0
9
Grill the data 2022 - The unsung hero behind Bestimate: data platform
Karn Wong
October 01, 2022
Tweet
Share
More Decks by Karn Wong
See All by Karn Wong
Python Developer Day Thailand 2024 - How to Bootstrap a Python Project
kahnwong
0
5
WTM IWD 2024 - Friendly shell environment setup
kahnwong
0
5
GitHub Universe After Party Thailand 2023 - Faster deployments with multi-stage build caching
kahnwong
0
5
Database Query Optimization
kahnwong
0
2
Intro to spatial data
kahnwong
0
3
Other Decks in Technology
See All in Technology
web-application-security
matsuihidetoshi
1
200
【SORACOM UG 東海】あらゆるモノがつながる社会へ、IoT と SORACOM
soracom
PRO
1
160
R3のコードから見る実践LINQ実装最適化・コンカレントプログラミング実例
neuecc
3
3.2k
コードや知識を組み込む / Incorporate Code and knowledge
ks91
PRO
0
150
【NW X Security JAWS#3】L3-4:AWS環境のIPv6移行に向けて知っておきたいこと
shotashiratori
1
710
IaCジェネレーターとBedrockで詳細設計書を生成してみた
tsukasa_ishimaru
4
930
「見せ球」「作って終わり」のLLM機能卒業のために
ryokaneoka0406
0
130
BPStudyの200回を中心にIT業界を振り返る。そしてこれから
haru860
3
430
Building a RAG-poweredAI chat appwith Python and VS Code
pamelafox
0
170
Handling focus in 2024
tahia910
0
390
LayerXにおけるLLMプロダクト開発の今までとこれから
layerx
PRO
4
800
今年のRubyKaigiはProfiler Year🤘
osyoyu
0
490
Featured
See All Featured
A Modern Web Designer's Workflow
chriscoyier
689
190k
A Tale of Four Properties
chriscoyier
153
22k
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
panda_program
66
14k
Music & Morning Musume
bryan
41
5.6k
For a Future-Friendly Web
brad_frost
172
9k
Six Lessons from altMBA
skipperchong
22
3k
WebSockets: Embracing the real-time Web
robhawkes
59
7k
Faster Mobile Websites
deanohume
300
30k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
rmw
26
2.3k
Building Better People: How to give real-time feedback that sticks.
wjessup
356
18k
Practical Orchestrator
shlominoach
183
9.7k
No one is an island. Learnings from fostering a developers community.
thoeni
16
2.1k
Transcript
The unsung hero behind Bestimate: data platform Grill the data
2022
➔ Who is Baania? ➔ What is Bestimate? ➔ What
data platform is right for Bestimate? ➔ What components do we need? Agenda
Intro We are a proptech company 🏡 😎 Our goal
is to provide data-centric solutions to all parties in Thailand’s property industry Marketplace Data Center Home Flipping
Intro
None
None
None
Why we need data platform? Project vs product development in
a nutshell 🥜 🐿 01 | Add new columns 02 | Update feature engineering transformations 03 | Roll out new model version 04 | Oops I made a mistake, how do I roll back?
Data platform 101 • Automated workflows • Maintainability • Collaboration
Data lake 01 • Unlimited storage • Big data friendly
• Cheaper than maintaining a database • Single source of truth Image: AWS
Data catalog 02 • Find which tables have attributes you
want! • Yay data lineage 😄 Image: Amundsen Image: Marquez
Task orchestrator 03 • Say goodbye to running stuff manually!
• Not enough RAM? Cloud compute to the rescue! • Status reports are bae Image: Fivetran
Model registry 04 Image: Databricks
CI/CD 05 Image: Squadcast
Monitoring 06 Image: Banzai Cloud
Wrap up Data platform: • Reduces onboarding time to develop
features • Enables fast updates and deployment • Provides service status monitoring • Leaves trails for auditing
We are hiring! https://baaniathailand.com/career/
Thank you! Karn Wong Head of Platform Engineering at Baania
@kahnwong