Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Chasing the Elephant
Search
Theo Hultberg
August 15, 2013
Programming
0
76
Chasing the Elephant
JRubyConfEU 2013
Theo Hultberg
August 15, 2013
Tweet
Share
More Decks by Theo Hultberg
See All by Theo Hultberg
Datalakes at AWS Summit Stockholm 2018
iconara
0
73
Building a CQL driver
iconara
0
49
Learning to Build Distributed Systems the Hard Way
iconara
1
140
Learning to Build Distributed Systems the Hard Way
iconara
2
200
Learning to Build Distributed Systems the Hard Way
iconara
3
5.1k
Concurrency and Distributed Systems in JRuby
iconara
3
620
A Guide to the Post Relational Revolution
iconara
4
5.4k
Standing on the Shoulders of Giants with JRuby
iconara
4
150
Shortcuts Around the Mistakes I've Made Scaling MongoDB
iconara
4
160
Other Decks in Programming
See All in Programming
ts-morphを使ってコードリプレイスとASTへのハードルを下げる!
nyawach
5
340
Improved REXML XML parsing performance using StringScanner
naitoh
0
120
Jetpack Composeとデザインシステム
rmakiyama
0
250
ペパボOpenTelemetry革命
pyama86
2
1.3k
The Design of Everyday APIs - PyCon 2024
roguelynn
1
290
Good first issues of TypeProf
mame
4
1.1k
freeeのエンジニアが 就活で出そうな コーディングテストを 解説してみる
freee
1
190
Findy - エンジニア向け会社紹介 / Findy Letter for Engineers
findyinc
2
75k
2024 コーディング研修
ckazu
2
690
TypeScriptで使いやすいOpenAPIの書き方
yukimochi_dwango
1
1k
GoでParserを書く
karupanerura
3
460
Amazon Aurora Serverless v2が意外と高かった話と、AWS Database Migration Serviceの話
satoshi256kbyte
1
110
Featured
See All Featured
Design and Strategy: How to Deal with People Who Don’t "Get" Design
morganepeng
117
18k
Reflections from 52 weeks, 52 projects
jeffersonlam
345
19k
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
eileencodes
126
32k
ピンチをチャンスに:未来をつくるプロダクトロードマップ #pmconf2020
aki_iinuma
84
45k
Helping Users Find Their Own Way: Creating Modern Search Experiences
danielanewman
21
2k
How GitHub Uses GitHub to Build GitHub
holman
468
290k
Into the Great Unknown - MozCon
thekraken
15
1.1k
A Tale of Four Properties
chriscoyier
153
22k
ParisWeb 2013: Learning to Love: Crash Course in Emotional UX Design
dotmariusz
104
6.7k
Fashionably flexible responsive web design (full day workshop)
malarkey
398
65k
Intergalactic Javascript Robots from Outer Space
tanoku
266
26k
Producing Creativity
orderedlist
PRO
338
39k
Transcript
@iconara CHASING THE ELEPHANT
Theo / @iconara
chief architect at BURT
big data analytics with JRuby
RUBY
RUBY
RUBY JRUBY
JRUBY IS AWESOME BECAUSE RUBY IS GREAT, AND THE JVM
IS GREAT
hot_bunnies, eurydice, multimeter, mikka, msgpack-jruby
None
HADOOP
JRUBY SUPERCOMPUTING 40 TiB data, 120 EC2 cc2.8xlarge, 1920 cores,
7260 GiB RAM
JAVA ALL THE WAY DOWN
HADOOP STREAMING Wukong, Dumbo
RUBYDOOP rubydoop.org + =
None
None
main()
Class.forName("...")
Class.forName("...")
None
module WordCount class Mapper def map(key, value, context) value.to_s.downcase.split.each do
|word| key = Hadoop::Io::Text.new(word) value = Hadoop::Io::IntWritable.new(1) context.write(key, value) end end end end
RUBYDOOP IS LOW LEVEL I would love to see someone
write something like Scalding or Cascading on top of it
RUBYDOOP rubydoop.org
RUBYDOOP rubydoop.org v1.1.0
KTHXBAI @iconara github.com/iconara architecturalatrocities.com burtcorp.com