Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Chasing the Elephant
Search
Theo Hultberg
August 15, 2013
Programming
0
92
Chasing the Elephant
JRubyConfEU 2013
Theo Hultberg
August 15, 2013
Tweet
Share
More Decks by Theo Hultberg
See All by Theo Hultberg
Datalakes at AWS Summit Stockholm 2018
iconara
0
95
Building a CQL driver
iconara
0
57
Learning to Build Distributed Systems the Hard Way
iconara
1
140
Learning to Build Distributed Systems the Hard Way
iconara
2
210
Learning to Build Distributed Systems the Hard Way
iconara
3
5.1k
Concurrency and Distributed Systems in JRuby
iconara
3
660
A Guide to the Post Relational Revolution
iconara
4
5.4k
Standing on the Shoulders of Giants with JRuby
iconara
4
160
Shortcuts Around the Mistakes I've Made Scaling MongoDB
iconara
4
170
Other Decks in Programming
See All in Programming
What Spring Developers Should Know About Jakarta EE
ivargrimstad
0
120
The Past, Present, and Future of Enterprise Java
ivargrimstad
0
120
AI Coding Meetup #3 - 導入セッション / ai-coding-meetup-3
izumin5210
0
3.3k
私達はmodernize packageに夢を見るか feat. go/analysis, go/ast / Go Conference 2025
kaorumuta
2
570
その面倒な作業、「Dart」にやらせませんか? Flutter開発者のための業務効率化
yordgenome03
1
130
非同期jobをtransaction内で 呼ぶなよ!絶対に呼ぶなよ!
alstrocrack
0
930
Server Side Kotlin Meetup vol.16: 内部動作を理解して ハイパフォーマンスなサーバサイド Kotlin アプリケーションを書こう
ternbusty
3
190
登壇は dynamic! な営みである / speech is dynamic
da1chi
0
340
品質ワークショップをやってみた
nealle
0
270
CSC305 Lecture 04
javiergs
PRO
0
270
CSC305 Lecture 06
javiergs
PRO
0
230
そのpreloadは必要?見過ごされたpreloadが技術的負債として爆発した日
mugitti9
2
3.4k
Featured
See All Featured
Building a Scalable Design System with Sketch
lauravandoore
463
33k
Product Roadmaps are Hard
iamctodd
PRO
54
11k
Why You Should Never Use an ORM
jnunemaker
PRO
59
9.6k
Mobile First: as difficult as doing things right
swwweet
224
10k
Imperfection Machines: The Place of Print at Facebook
scottboms
269
13k
Building an army of robots
kneath
306
46k
The Cult of Friendly URLs
andyhume
79
6.6k
How to train your dragon (web standard)
notwaldorf
97
6.3k
Producing Creativity
orderedlist
PRO
347
40k
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
kevinliebholz
35
6.1k
A Modern Web Designer's Workflow
chriscoyier
697
190k
Into the Great Unknown - MozCon
thekraken
40
2.1k
Transcript
@iconara CHASING THE ELEPHANT
Theo / @iconara
chief architect at BURT
big data analytics with JRuby
RUBY
RUBY
RUBY JRUBY
JRUBY IS AWESOME BECAUSE RUBY IS GREAT, AND THE JVM
IS GREAT
hot_bunnies, eurydice, multimeter, mikka, msgpack-jruby
None
HADOOP
JRUBY SUPERCOMPUTING 40 TiB data, 120 EC2 cc2.8xlarge, 1920 cores,
7260 GiB RAM
JAVA ALL THE WAY DOWN
HADOOP STREAMING Wukong, Dumbo
RUBYDOOP rubydoop.org + =
None
None
main()
Class.forName("...")
Class.forName("...")
None
module WordCount class Mapper def map(key, value, context) value.to_s.downcase.split.each do
|word| key = Hadoop::Io::Text.new(word) value = Hadoop::Io::IntWritable.new(1) context.write(key, value) end end end end
RUBYDOOP IS LOW LEVEL I would love to see someone
write something like Scalding or Cascading on top of it
RUBYDOOP rubydoop.org
RUBYDOOP rubydoop.org v1.1.0
KTHXBAI @iconara github.com/iconara architecturalatrocities.com burtcorp.com