Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Stripe CTF 3.0 - Follow Up
Search
Bogdan Gaza
July 01, 2014
Programming
1
120
Stripe CTF 3.0 - Follow Up
From BigData Meetup #4 - Timisoara, June 2014
Bogdan Gaza
July 01, 2014
Tweet
Share
More Decks by Bogdan Gaza
See All by Bogdan Gaza
Continuous delivery pipelines using Python and Docker
hurrycane
1
490
RailsGirls Timisoara - Web Applications
hurrycane
2
63
Real time webapps using python
hurrycane
3
170
Other Decks in Programming
See All in Programming
Djangoアプリケーション 運用のリアル 〜問題発生から可視化、最適化への道〜 #pyconshizu
kashewnuts
1
270
LINE messaging APIを使ってGoogleカレンダーと連携した予約ツールを作ってみた
takumakoike
0
120
責務と認知負荷を整える! 抽象レベルを意識した関心の分離
yahiru
8
1.4k
技術を改善し続ける
gumioji
0
130
メンテが命: PHPフレームワークのコンテナ化とアップグレード戦略
shunta27
0
310
バッチを作らなきゃとなったときに考えること
irof
2
530
負債になりにくいCSSをデザイナとつくるには?
fsubal
10
2.6k
XStateを用いた堅牢なReact Components設計~複雑なClient Stateをシンプルに~ @React Tokyo ミートアップ #2
kfurusho
1
990
CloudNativePGを布教したい
nnaka2992
0
120
Serverless Rust: Your Low-Risk Entry Point to Rust in Production (and the benefits are huge)
lmammino
1
160
Learning Kotlin with detekt
inouehi
1
140
Boos Performance and Developer Productivity with Jakarta EE 11
ivargrimstad
0
430
Featured
See All Featured
How to Think Like a Performance Engineer
csswizardry
22
1.4k
Designing on Purpose - Digital PM Summit 2013
jponch
117
7.1k
CSS Pre-Processors: Stylus, Less & Sass
bermonpainter
356
29k
Embracing the Ebb and Flow
colly
84
4.6k
Done Done
chrislema
182
16k
Six Lessons from altMBA
skipperchong
27
3.6k
Optimising Largest Contentful Paint
csswizardry
34
3.1k
Git: the NoSQL Database
bkeepers
PRO
427
65k
Measuring & Analyzing Core Web Vitals
bluesmoon
6
260
Art, The Web, and Tiny UX
lynnandtonic
298
20k
[RailsConf 2023 Opening Keynote] The Magic of Rails
eileencodes
28
9.3k
Speed Design
sergeychernyshev
27
810
Transcript
A distributed systems challenge: Stripe CTF Bogdan Gâza Big Data
#5 Bogdan Gâza
Big Data #5 Bogdan Gâza $whoami
Big Data #5 Bogdan Gâza
Big Data #5 Bogdan Gâza Level 0 The mysterious program
Big Data #5 Bogdan Gâza
Big Data #5 Bogdan Gâza Different hash: open addressing v
hash(V) hash(X) x
Big Data #5 Bogdan Gâza Bloom filters N hash functions
k1 k2 k3 kn probabilistic fals positives / no fals negatives
Big Data #5 Bogdan Gâza Level 1 Gitcoins
Big Data #5 Bogdan Gâza Level 1 Gitcoins
Big Data #5 Bogdan Gâza
Big Data #5 Bogdan Gâza SHA1 - ridiculous parallel bash:
400 Hash/s stripe go miners: 1.9 MHash/s gpu: 1-2 GHash/s
Big Data #5 Bogdan Gâza Level 2 DDos Defense
Big Data #5 Bogdan Gâza Proxy Node Node Node
Big Data #5 Bogdan Gâza Load balancing algorithm 4 req
/ ip request requests < 25 ms apart Solution
Big Data #5 Bogdan Gâza Level 3 Instant code search
Big Data #5 Bogdan Gâza LB Indexer Indexer Indexer 4
minutes to index 4 nodes with 500MB of RAM Scala Latency based scoring To pass the level < 0.15s / query Around 100M words Arbitrary substring
Big Data #5 Bogdan Gâza Twitter Stack: finagle / twitter
server Problem
Big Data #5 Bogdan Gâza
Big Data #5 Bogdan Gâza 1st approach: inverted index vs
substring search Solution Trie vs substring search marisa / patricia Trie / radix tree / suffix tree vs substring search DAWG vs substring search Sharding
Big Data #5 Bogdan Gâza Level 4 SQLCluster
Big Data #5 Bogdan Gâza SQLite SQLite SQLite SQLite SQLite
SQLite Unreliable network ! octopus octopus simulates: netsplit / lagsplit / SPOF
Big Data #5 Bogdan Gâza Consensus Reliability in the presence
of faulty processes examples: who can commit to the DB who is the leader state machine replication
Big Data #5 Bogdan Gâza ZAB - High performance broadcast
in primary backup systems - 2011 RAFT - Understandable consensus algorithm - 2013 Paxos - Part-time parliament - Laslie Lamport ‘90 Consensus
Big Data #5 Bogdan Gâza ZAB - High performance broadcast
in primary backup systems - 2011 RAFT - Understandable consensus algorithm - 2013 Paxos - Part-time parliament - Laslie Lamport ‘90 Consensus
Big Data #5 Bogdan Gâza
Big Data #5 Bogdan Gâza
Big Data #5 Bogdan Gâza
Big Data #5 Bogdan Gâza Thanks!