Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Stripe CTF 3.0 - Follow Up
Search
Bogdan Gaza
July 01, 2014
Programming
1
110
Stripe CTF 3.0 - Follow Up
From BigData Meetup #4 - Timisoara, June 2014
Bogdan Gaza
July 01, 2014
Tweet
Share
More Decks by Bogdan Gaza
See All by Bogdan Gaza
Continuous delivery pipelines using Python and Docker
hurrycane
1
480
RailsGirls Timisoara - Web Applications
hurrycane
2
56
Real time webapps using python
hurrycane
3
170
Other Decks in Programming
See All in Programming
Ruby on Fails - effective error handling with Rails conventions
talyssonoc
0
210
AmperとFleetを使ったAndroidアプリ
yoppie
0
280
検証も兼ねて個人開発でHonoとかと向き合った話
hanetsuki
1
1.4k
Build Apps for iOS, Android & Desktop in 100% Kotlin With Compose Multiplatform (mDevCamp 2024)
zsmb
0
480
禅の心を手に入れよ
eltociear
1
430
AWS CDKコントリビュートTIPS / aws-cdk-contribution-tips
gotok365
4
550
Elm Form Validation
bkuhlmann
0
520
Node.js v22 で変わること
yosuke_furukawa
PRO
12
4.1k
Behind VS Code Extensions for JavaScript / TypeScript Linnting and Formatting
unvalley
6
1.3k
仕様と実装で学ぶOpenTelemetry
drumato
1
140
if constexpr文はテンプレート世界のラムダ式である
faithandbrave
3
710
Domain-Driven Transformation
hschwentner
2
1.5k
Featured
See All Featured
Rebuilding a faster, lazier Slack
samanthasiow
74
8.3k
Easily Structure & Communicate Ideas using Wireframe
afnizarnur
188
16k
Music & Morning Musume
bryan
41
5.6k
Design and Strategy: How to Deal with People Who Don’t "Get" Design
morganepeng
117
18k
Why You Should Never Use an ORM
jnunemaker
PRO
51
8.7k
Rails Girls Zürich Keynote
gr2m
91
13k
We Have a Design System, Now What?
morganepeng
43
6.8k
ReactJS: Keep Simple. Everything can be a component!
pedronauck
660
120k
Six Lessons from altMBA
skipperchong
22
3k
The Pragmatic Product Professional
lauravandoore
26
5.8k
Java REST API Framework Comparison - PWX 2021
mraible
PRO
18
7k
Intergalactic Javascript Robots from Outer Space
tanoku
266
26k
Transcript
A distributed systems challenge: Stripe CTF Bogdan Gâza Big Data
#5 Bogdan Gâza
Big Data #5 Bogdan Gâza $whoami
Big Data #5 Bogdan Gâza
Big Data #5 Bogdan Gâza Level 0 The mysterious program
Big Data #5 Bogdan Gâza
Big Data #5 Bogdan Gâza Different hash: open addressing v
hash(V) hash(X) x
Big Data #5 Bogdan Gâza Bloom filters N hash functions
k1 k2 k3 kn probabilistic fals positives / no fals negatives
Big Data #5 Bogdan Gâza Level 1 Gitcoins
Big Data #5 Bogdan Gâza Level 1 Gitcoins
Big Data #5 Bogdan Gâza
Big Data #5 Bogdan Gâza SHA1 - ridiculous parallel bash:
400 Hash/s stripe go miners: 1.9 MHash/s gpu: 1-2 GHash/s
Big Data #5 Bogdan Gâza Level 2 DDos Defense
Big Data #5 Bogdan Gâza Proxy Node Node Node
Big Data #5 Bogdan Gâza Load balancing algorithm 4 req
/ ip request requests < 25 ms apart Solution
Big Data #5 Bogdan Gâza Level 3 Instant code search
Big Data #5 Bogdan Gâza LB Indexer Indexer Indexer 4
minutes to index 4 nodes with 500MB of RAM Scala Latency based scoring To pass the level < 0.15s / query Around 100M words Arbitrary substring
Big Data #5 Bogdan Gâza Twitter Stack: finagle / twitter
server Problem
Big Data #5 Bogdan Gâza
Big Data #5 Bogdan Gâza 1st approach: inverted index vs
substring search Solution Trie vs substring search marisa / patricia Trie / radix tree / suffix tree vs substring search DAWG vs substring search Sharding
Big Data #5 Bogdan Gâza Level 4 SQLCluster
Big Data #5 Bogdan Gâza SQLite SQLite SQLite SQLite SQLite
SQLite Unreliable network ! octopus octopus simulates: netsplit / lagsplit / SPOF
Big Data #5 Bogdan Gâza Consensus Reliability in the presence
of faulty processes examples: who can commit to the DB who is the leader state machine replication
Big Data #5 Bogdan Gâza ZAB - High performance broadcast
in primary backup systems - 2011 RAFT - Understandable consensus algorithm - 2013 Paxos - Part-time parliament - Laslie Lamport ‘90 Consensus
Big Data #5 Bogdan Gâza ZAB - High performance broadcast
in primary backup systems - 2011 RAFT - Understandable consensus algorithm - 2013 Paxos - Part-time parliament - Laslie Lamport ‘90 Consensus
Big Data #5 Bogdan Gâza
Big Data #5 Bogdan Gâza
Big Data #5 Bogdan Gâza
Big Data #5 Bogdan Gâza Thanks!