Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
Microservices - War Stories
Search
Alex Van Boxel
June 13, 2018
Technology
94
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
Microservices - War Stories
Some stories and things to be careful about when moving to microservices
Alex Van Boxel
June 13, 2018
Transcript
50 slides
Shop smart, feel great Microservices War Stories
Big Data/Cloud Architect @ vente-exclusive.com Google Developer Expert - follow
@alexvb Alex Van Boxel
The views and opinions expressed in this talk are those
of the authors and do not necessarily reflect the official position of Vente-Exclusive or Google
Monolith - ETL Data Lake Production database Reporting database BigQuery
Cloud Pub/Sub Nightly table transfers SparkPost ADYEN App Engine App Engine Cloud Storage Channel interactions (CAL events) Payments E-mail .Net Applications Tableau Server Microsoft Excel Cloud Dataflow Cloud Dataflow Cloud Dataflow
Why?
the people behind the lines People
People For a lot of people : new tech stack
People Multi Repo
People Multi Datastore
People Multi Language
People Developer Experience
People Bootstrapping
People Enable developers with Proxied Kubernetes Namespaces
People Enable developers with Proxied Local Development
People Cool Stackdriver Stuff
People
do's, don't and the complexity Patterns and Technology
Patterns and Technology Kubernetes Engine
Patterns and Technology CI/CD pipeline > start early
Patterns and Technology Don't take the slogan "It should be
rebuild in a few days" as a guideline!
Patterns and Technology Embrace eventual consistency, go async
Patterns and Technology 99,999 %
Patterns and Technology No Hard Dependencies on External services
Patterns and Technology Be careful with single point of failure
Patterns and Technology Scaling, easy right?
Patterns and Technology Kubernetes knots and bolts ( resource limits
)
let's at least agree that Contracts and Conventions
Contracts and Conventions Make convention and stick with it
Contracts and Conventions boreporting-api
Contracts and Conventions boreporting-api
Contracts and Conventions tableauauth-api
Contracts and Conventions Contracts First? well...
Contracts and Conventions gRPC
Contracts and Conventions gRPC + HTTP Gateway
my reliable site Operations and SRE
Operations and SRE Logging
Operations and SRE Logging Tracing
Operations and SRE
Operations and SRE Logging Tracing Monitoring
Operations and SRE
Operations and SRE SRE
starting over, make it count Opportunities
Opportunities Streaming operational data to the data lake
Opportunities Angular Front-end MongoDB Databases Angular Back-Office Microservices .Net Event
sourcing Cloud Pub/Sub Cloud Bigtable Client events -- clickstream (sessions) -- interesting business events DATA microservices Python / GO DATA microservices Python / GO SparkPost ADYEN External events Cloud Pub/Sub Payments E-mail MS SQL IMS, Area51 Entity builder + KPI calculation DataFlow streaming BigQuery Events processing Dataflow streaming Production data -- not accessible outside IT -- splitted per microservice Reporting data -- real-time! -- full change history -- self-service BI -- excel report generation -- permission based -- GDPR! -- SaaS -- Standard SQL language -- High-availability -- low-latency -- real-time -- PaaS -- backup + history Elasticsearch elastic.io managed -- search (backoffice only atm) -- future: site search Website backoffice PHOTON
Opportunities Data Lake
Opportunities Data Lake enables Ops
Opportunities Data Lake for GDPR compliance Forseti Security
Opportunities Security Forseti Security Istio
Opportunities Make it Count
Shop smart, feel great THANK YOU twitter @alexvb
More Decks by Alex Van Boxel
See All by Alex Van Boxel
Pragmatic streaming, beaming to BigQuery
alexvanboxel
0
64
Moving to Microservices @vex
alexvanboxel
0
130
Introduction to Service Mesh using Istio on K8S
alexvanboxel
0
100
Other Decks in Technology
See All in Technology
AWS Blocksで AIエージェント作れるの知ってます?
kmiya84377
1
170
AWS Client VPNの設定でハマったポイントとその過程での気づき
amarelo_n24
1
440
OpenTelemetryで変わった 新時代のCloudWatchメトリクス監視
tsukuboshi
0
500
社内アプリ基盤「Quartz」による、 非エンジニアとAIに本番デプロイを 任せても壊れないプラットフォームの設計
staka121
PRO
1
230
Platform Engineering をベースとした Agentic Software Factory の実践
110y
3
970
Amazon EFS のマルウェアスキャンをClamAV で自前実装したら苦労した話
mtmtfactory01
0
110
信頼性を犠牲にせず、PR マージからデプロイまで人の介入を完全にゼロにするまでの道のり
knwoop
4
2.1k
Dark Web - Como o Cibercrime Opera na Internet
nicholsjasper
0
110
Context parameters で作る!はじめての型クラス
kworkdev
PRO
1
180
New Relicのアラート対応をClaude Codeで自動修正するワークフローを作った話
manabuseki
2
630
みん強Lightning! データ基盤ひとりでできるかな
endonanana
0
190
AIエージェントのアーキテクチャ設計
nsatoh
0
540
Featured
See All Featured
技術選定の審美眼(2025年版) / Understanding the Spiral of Technologies 2025 edition
twada
PRO
121
130k
Responsive Adventures: Dirty Tricks From The Dark Corners of Front-End
smashingmag
254
23k
Skip the Path - Find Your Career Trail
mkilby
1
300
Jamie Indigo - Trashchat’s Guide to Black Boxes: Technical SEO Tactics for LLMs
techseoconnect
PRO
0
760
We Have a Design System, Now What?
morganepeng
55
8.4k
Lessons Learnt from Crawling 1000+ Websites
charlesmeaden
PRO
1
1.8k
CSS Pre-Processors: Stylus, Less & Sass
bermonpainter
360
31k
HDC tutorial
michielstock
2
1k
Connecting the Dots Between Site Speed, User Experience & Your Business [WebExpo 2025]
tammyeverts
11
1.1k
Why Mistakes Are the Best Teachers: Turning Failure into a Pathway for Growth
auna
0
370
RailsConf 2023
tenderlove
30
1.6k
The Pragmatic Product Professional
lauravandoore
37
7.5k