Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Chasing the Elephant

Avatar for Theo Hultberg Theo Hultberg
August 15, 2013
Programming
0
92

Chasing the Elephant

JRubyConfEU 2013

Avatar for Theo Hultberg

Theo Hultberg

August 15, 2013
Tweet

More Decks by Theo Hultberg

See All by Theo Hultberg
Datalakes at AWS Summit Stockholm 2018
Avatar for Theo Hultberg iconara
0
94
Building a CQL driver
Avatar for Theo Hultberg iconara
0
57
Learning to Build Distributed Systems the Hard Way
Avatar for Theo Hultberg iconara
1
140
Learning to Build Distributed Systems the Hard Way
Avatar for Theo Hultberg iconara
2
210
Learning to Build Distributed Systems the Hard Way 
Avatar for Theo Hultberg iconara
3
5.1k
Concurrency and Distributed Systems in JRuby
Avatar for Theo Hultberg iconara
3
660
A Guide to the Post Relational Revolution
Avatar for Theo Hultberg iconara
4
5.4k
Standing on the Shoulders of Giants with JRuby
Avatar for Theo Hultberg iconara
4
160
Shortcuts Around the Mistakes I've Made Scaling MongoDB
Avatar for Theo Hultberg iconara
4
170

Other Decks in Programming

See All in Programming
DockerからECSへ 〜 AWSの海に出る前に知っておきたいこと 〜
Avatar for Itaru Ota ota1022
5
1.9k
Oracle Database Technology Night 92 Database Connection control FAN-AC
Avatar for oracle4engineer oracle4engineer
PRO
1
400
オープンセミナー2025@広島 「君はどこで動かすか？」 アンケート結果
Avatar for Satoshi Kaneyasu satoshi256kbyte
0
240
Vue・React マルチプロダクト開発を支える Vite
Avatar for ANDPAD inc andpad
0
110
Ruby×iOSアプリ開発 ~共に歩んだエコシステムの物語~
Avatar for Tomoki Kobayashi temoki
0
230
2025 年のコーディングエージェントの現在地とエンジニアの仕事の変化について
Avatar for azukiazusa azukiazusa1
17
8.8k
react-callを使ってダイヤログをいろんなとこで再利用しよう！
Avatar for shinaps shinaps
1
150
Jakarta EE Core Profile and Helidon - Speed, Simplicity, and AI Integration
Avatar for ivargrimstad ivargrimstad
0
340
テストカバレッジ100%を10年続けて得られた学びと品質
Avatar for もっち mottyzzz
2
470
レガシープロジェクトで最大限AIの恩恵を受けられるようClaude Codeを利用する
Avatar for tk1351 tk1351
4
1.6k
アプリの "かわいい" を支えるアニメーションツールRiveについて
Avatar for 上ちょ / uetyo uetyo
0
170
個人軟體時代
Avatar for Ethan Huang ethanhuang13
0
310

Featured

See All Featured
Docker and Python
Avatar for Tania Allard trallard
45
3.5k
A better future with KSS
Avatar for Kyle Neath kneath
239
17k
JavaScript: Past, Present, and Future - NDC Porto 2020
Avatar for David Neal reverentgeek
51
5.6k
How STYLIGHT went responsive
Avatar for nonsquared nonsquared
100
5.8k
Dealing with People You Can't Stand - Big Design 2015
Avatar for Cassini Nazir cassininazir
367
27k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
Avatar for mongodb mongodb
48
9.7k
We Have a Design System, Now What?
Avatar for Morgane Peng morganepeng
53
7.8k
Raft: Consensus for Rubyists
Avatar for Patrick Van Stee vanstee
140
7.1k
Let's Do A Bunch of Simple Stuff to Make Websites Faster
Avatar for Chris Coyier chriscoyier
507
140k
What's in a price? How to price your products and services
Avatar for Michael Herold michaelherold
246
12k
Build your cross-platform service in a week with App Engine
Avatar for Jose L jlugia
231
18k
Fireside Chat
Avatar for paigeccino paigeccino
39
3.6k

Transcript

  1. @iconara CHASING THE ELEPHANT

  2. Theo / @iconara

  3. chief architect at BURT

  4. big data analytics with JRuby

  5. RUBY

  6. RUBY

  7. RUBY JRUBY

  8. JRUBY IS AWESOME BECAUSE RUBY IS GREAT, AND THE JVM

    IS GREAT

  9. hot_bunnies, eurydice, multimeter, mikka, msgpack-jruby

  10. None

  11. HADOOP

  12. JRUBY SUPERCOMPUTING 40 TiB data, 120 EC2 cc2.8xlarge, 1920 cores,

    7260 GiB RAM

  13. JAVA ALL THE WAY DOWN

  14. HADOOP STREAMING Wukong, Dumbo

  15. RUBYDOOP rubydoop.org + =

  16. None
  17. None

  18. main()

  19. Class.forName("...")

  20. Class.forName("...")

  21. None

  22. module WordCount class Mapper def map(key, value, context) value.to_s.downcase.split.each do

    |word| key = Hadoop::Io::Text.new(word) value = Hadoop::Io::IntWritable.new(1) context.write(key, value) end end end end

  23. RUBYDOOP IS LOW LEVEL I would love to see someone

    write something like Scalding or Cascading on top of it

  24. RUBYDOOP rubydoop.org

  25. RUBYDOOP rubydoop.org v1.1.0

  26. KTHXBAI @iconara github.com/iconara architecturalatrocities.com burtcorp.com