Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Chasing the Elephant

Avatar for Theo Hultberg Theo Hultberg
August 15, 2013
Programming
0
87

Chasing the Elephant

JRubyConfEU 2013
Avatar for Theo Hultberg

Theo Hultberg

August 15, 2013
Tweet

More Decks by Theo Hultberg

See All by Theo Hultberg
Datalakes at AWS Summit Stockholm 2018
Avatar for Theo Hultberg iconara
0
89
Building a CQL driver
Avatar for Theo Hultberg iconara
0
51
Learning to Build Distributed Systems the Hard Way
Avatar for Theo Hultberg iconara
1
140
Learning to Build Distributed Systems the Hard Way
Avatar for Theo Hultberg iconara
2
200
Learning to Build Distributed Systems the Hard Way 
Avatar for Theo Hultberg iconara
3
5.1k
Concurrency and Distributed Systems in JRuby
Avatar for Theo Hultberg iconara
3
640
A Guide to the Post Relational Revolution
Avatar for Theo Hultberg iconara
4
5.4k
Standing on the Shoulders of Giants with JRuby
Avatar for Theo Hultberg iconara
4
150
Shortcuts Around the Mistakes I've Made Scaling MongoDB
Avatar for Theo Hultberg iconara
4
160

Other Decks in Programming

See All in Programming
TypeScript エンジニアが Android 開発の世界に飛び込んだ話
Avatar for Yui Sakamoto yuisakamoto
4
220
開発者フレンドリーで顧客も満足？Platformの秘密
Avatar for ALGO ARTIS algoartis
0
250
M5UnitUnified 最新動向 2025/05
Avatar for GOB gob
0
150
2025年のz-index設計を考える
Avatar for TAK tak_dcxi
13
5k
JAWS DAYS 2025 re_Cheers: WEB
Avatar for komakichi komakichi
0
130
Rubyの!メソッドをちゃんと理解する
Avatar for Yuto Urushima alstrocrack
2
380
Modern Angular with Signals and Signal Store: New Rules for Your Architecture @jax2025 in Mainz, Germany
Avatar for Manfred Steyer manfredsteyer
PRO
0
110
Live Coding: Migrating an Application to Signals
Avatar for Manfred Steyer manfredsteyer
PRO
0
130
The New Developer Workflow: How AI Transforms Ideas into Code
Avatar for Daniel Sogl danielsogl
0
150
Duke on CRaC with Jakarta EE
Avatar for ivargrimstad ivargrimstad
1
380
はじめてのPDFKit.pdf
Avatar for shoma.kato shomakato
0
110
Designing Your Organization's Test Pyramid ( #scrumniigata )
Avatar for teyamagu teyamagu
PRO
5
1.7k

Featured

See All Featured
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
Avatar for Rebecca Miller-Webster rmw
34
3k
Site-Speed That Sticks
Avatar for Harry Roberts csswizardry
6
570
XXLCSS - How to scale CSS and keep your sanity
Avatar for Zaharenia Atzitzikaki sugarenia
248
1.3M
jQuery: Nuts, Bolts and Bling
Avatar for Doug Neiner dougneiner
63
7.7k
The Straight Up "How To Draw Better" Workshop
Avatar for Dennis Kardys denniskardys
233
140k
Agile that works and the tools we love
Avatar for Rasmus Luckow-Nielsen rasmusluckow
329
21k
Rebuilding a faster, lazier Slack
Avatar for samanthasiow samanthasiow
81
9k
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
Avatar for Sam Stephenson sstephenson
160
15k
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
Avatar for Joe Casabona jcasabona
32
2.3k
Save Time (by Creating Custom Rails Generators)
Avatar for Garrett Dimon garrettdimon
PRO
31
1.2k
The World Runs on Bad Software
Avatar for Brandon Keepers bkeepers
PRO
68
11k
Being A Developer After 40
Avatar for Adrian Kosmaczewski akosma
91
590k

Transcript

  1. @iconara CHASING THE ELEPHANT

  2. Theo / @iconara

  3. chief architect at BURT

  4. big data analytics with JRuby

  5. RUBY

  6. RUBY

  7. RUBY JRUBY

  8. JRUBY IS AWESOME BECAUSE RUBY IS GREAT, AND THE JVM

    IS GREAT

  9. hot_bunnies, eurydice, multimeter, mikka, msgpack-jruby

  10. None

  11. HADOOP

  12. JRUBY SUPERCOMPUTING 40 TiB data, 120 EC2 cc2.8xlarge, 1920 cores,

    7260 GiB RAM

  13. JAVA ALL THE WAY DOWN

  14. HADOOP STREAMING Wukong, Dumbo

  15. RUBYDOOP rubydoop.org + =

  16. None
  17. None

  18. main()

  19. Class.forName("...")

  20. Class.forName("...")

  21. None

  22. module WordCount class Mapper def map(key, value, context) value.to_s.downcase.split.each do

    |word| key = Hadoop::Io::Text.new(word) value = Hadoop::Io::IntWritable.new(1) context.write(key, value) end end end end

  23. RUBYDOOP IS LOW LEVEL I would love to see someone

    write something like Scalding or Cascading on top of it

  24. RUBYDOOP rubydoop.org

  25. RUBYDOOP rubydoop.org v1.1.0

  26. KTHXBAI @iconara github.com/iconara architecturalatrocities.com burtcorp.com