Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Grill the data 2022 - The unsung hero behind Be...
Search
Karn Wong
October 01, 2022
Technology
0
31
Grill the data 2022 - The unsung hero behind Bestimate: data platform
Karn Wong
October 01, 2022
Tweet
Share
More Decks by Karn Wong
See All by Karn Wong
Technologista 2024 - Rust for Data - What Works and What Doesn't
kahnwong
0
84
HashiCorp User Group Thailand Meetup - Self-hosting Kubernetes at Home with Terraform
kahnwong
0
61
HashiCorp User Hub Thailand #2 - Simplify Proxmox VM Management with Terraform
kahnwong
0
56
Python Developer Day Thailand 2024 - How to Bootstrap a Python Project
kahnwong
0
100
WTM IWD 2024 - Friendly shell environment setup
kahnwong
0
30
GitHub Universe After Party Thailand 2023 - Faster deployments with multi-stage build caching
kahnwong
0
30
Database Query Optimization
kahnwong
0
18
Intro to spatial data
kahnwong
0
23
Other Decks in Technology
See All in Technology
Turing × atmaCup #18 - 1st Place Solution
hakubishin3
0
470
OpenAIの蒸留機能(Model Distillation)を使用して運用中のLLMのコストを削減する取り組み
pharma_x_tech
4
540
ずっと昔に Star をつけたはずの思い出せない GitHub リポジトリを見つけたい!
rokuosan
0
150
継続的にアウトカムを生み出し ビジネスにつなげる、 戦略と運営に対するタイミーのQUEST(探求)
zigorou
0
510
サーバレスアプリ開発者向けアップデートをキャッチアップしてきた #AWSreInvent #regrowth_fuk
drumnistnakano
0
190
【re:Invent 2024 アプデ】 Prompt Routing の紹介
champ
0
140
How to be an AWS Community Builder | 君もAWS Community Builderになろう!〜2024 冬 CB募集直前対策編?!〜
coosuke
PRO
2
2.8k
Wvlet: A New Flow-Style Query Language For Functional Data Modeling and Interactive Data Analysis - Trino Summit 2024
xerial
1
110
KnowledgeBaseDocuments APIでベクトルインデックス管理を自動化する
iidaxs
1
250
LINEヤフーのフロントエンド組織・体制の紹介【24年12月】
lycorp_recruit_jp
0
530
AWS re:Invent 2024で発表された コードを書く開発者向け機能について
maruto
0
180
バクラクのドキュメント解析技術と実データにおける課題 / layerx-ccc-winter-2024
shimacos
2
1k
Featured
See All Featured
Reflections from 52 weeks, 52 projects
jeffersonlam
347
20k
Mobile First: as difficult as doing things right
swwweet
222
9k
GitHub's CSS Performance
jonrohan
1030
460k
Fantastic passwords and where to find them - at NoRuKo
philnash
50
2.9k
Writing Fast Ruby
sferik
628
61k
Automating Front-end Workflow
addyosmani
1366
200k
The Straight Up "How To Draw Better" Workshop
denniskardys
232
140k
Gamification - CAS2011
davidbonilla
80
5.1k
Distributed Sagas: A Protocol for Coordinating Microservices
caitiem20
330
21k
Principles of Awesome APIs and How to Build Them.
keavy
126
17k
Adopting Sorbet at Scale
ufuk
73
9.1k
Evolution of real-time – Irina Nazarova, EuRuKo, 2024
irinanazarova
5
440
Transcript
The unsung hero behind Bestimate: data platform Grill the data
2022
➔ Who is Baania? ➔ What is Bestimate? ➔ What
data platform is right for Bestimate? ➔ What components do we need? Agenda
Intro We are a proptech company 🏡 😎 Our goal
is to provide data-centric solutions to all parties in Thailand’s property industry Marketplace Data Center Home Flipping
Intro
None
None
None
Why we need data platform? Project vs product development in
a nutshell 🥜 🐿 01 | Add new columns 02 | Update feature engineering transformations 03 | Roll out new model version 04 | Oops I made a mistake, how do I roll back?
Data platform 101 • Automated workflows • Maintainability • Collaboration
Data lake 01 • Unlimited storage • Big data friendly
• Cheaper than maintaining a database • Single source of truth Image: AWS
Data catalog 02 • Find which tables have attributes you
want! • Yay data lineage 😄 Image: Amundsen Image: Marquez
Task orchestrator 03 • Say goodbye to running stuff manually!
• Not enough RAM? Cloud compute to the rescue! • Status reports are bae Image: Fivetran
Model registry 04 Image: Databricks
CI/CD 05 Image: Squadcast
Monitoring 06 Image: Banzai Cloud
Wrap up Data platform: • Reduces onboarding time to develop
features • Enables fast updates and deployment • Provides service status monitoring • Leaves trails for auditing
We are hiring! https://baaniathailand.com/career/
Thank you! Karn Wong Head of Platform Engineering at Baania
@kahnwong