Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Chasing the Elephant

Avatar for Theo Hultberg Theo Hultberg
August 15, 2013
Programming
100
0

Chasing the Elephant

JRubyConfEU 2013

Avatar for Theo Hultberg

Theo Hultberg

August 15, 2013

More Decks by Theo Hultberg

See All by Theo Hultberg
Datalakes at AWS Summit Stockholm 2018
Avatar for Theo Hultberg iconara
0
100
Building a CQL driver
Avatar for Theo Hultberg iconara
0
85
Learning to Build Distributed Systems the Hard Way
Avatar for Theo Hultberg iconara
1
150
Learning to Build Distributed Systems the Hard Way
Avatar for Theo Hultberg iconara
2
230
Learning to Build Distributed Systems the Hard Way 
Avatar for Theo Hultberg iconara
3
5.2k
Concurrency and Distributed Systems in JRuby
Avatar for Theo Hultberg iconara
3
700
A Guide to the Post Relational Revolution
Avatar for Theo Hultberg iconara
4
5.4k
Standing on the Shoulders of Giants with JRuby
Avatar for Theo Hultberg iconara
4
180
Shortcuts Around the Mistakes I've Made Scaling MongoDB
Avatar for Theo Hultberg iconara
4
170

Other Decks in Programming

See All in Programming
AIキャラアプリkaiwaの低遅延音声通話基盤をどう作ったか - AWS Gravitonで支える低遅延・低コストAI Agent基盤
Avatar for 最上土川 mogamit
0
110
ADKを使って簡単にAIエージェントを作ってみよう
Avatar for K1mu21 k1mu21
0
280
ローカルLLMでどこまでコードが書けるか -拡張版 /　How much code can be written on a local LLM Extended
Avatar for Naoki Kishida kishida
12
4.4k
任せる範囲はこう広がった / How the Scope of AI Delegation Has Expanded
Avatar for nrs nrslib
0
150
[2026年度第1回ORセミナー] 計画最適化ベンチャーと競技プログラミング人材
Avatar for terry-u16 terryu16
0
270
JavaDoc 再入門
Avatar for nagise nagise
1
420
Spring Security 実践 ─ GraphQL APIで実務に役立つ 認証・認可 を学ぶ
Avatar for Wagyu wagyu
0
260
さぁV100、メモリをお食べ・・・
Avatar for nilpe nilpe
0
160
Spec Driven Development | AI Summit Lisbon
Avatar for Daniel Sogl danielsogl
PRO
0
210
不変条件と整合性境界—ビジネスが決める設計判断と実現パターン / Invariants and Consistency Boundaries
Avatar for nrs nrslib
14
5.9k
Language Server 使ってる？ 〜VSCode と Zed の場合〜 / Are you using a Language Server? ~For VS Code and Zed~
Avatar for NAGATA Hiroaki handlename
0
810
なぜ型を書くのか？ TSKaigi2026で改めて考える #tskaigi_smarthr
Avatar for Takuma Kajikawa kajitack
0
170

Featured

See All Featured
16th Malabo Montpellier Forum Presentation
Avatar for AKADEMIYA2063 akademiya2063
PRO
0
150
Producing Creativity
Avatar for Steve Smith orderedlist
PRO
348
40k
Mozcon NYC 2025: Stop Losing SEO Traffic
Avatar for Sam Torres samtorres
1
260
The agentic SEO stack - context over prompts
Avatar for schlessera schlessera
0
830
世界の人気アプリ100個を分析して見えたペイウォール設計の心得
Avatar for Akihiro Kokubo akihiro_kokubo
PRO
72
40k
The Cost Of JavaScript in 2023
Avatar for Addy Osmani addyosmani
55
10k
JAMstack: Web Apps at Ludicrous Speed - All Things Open 2022
Avatar for David Neal reverentgeek
1
480
brightonSEO & MeasureFest 2025 - Christian Goodrich - Winning strategies for Black Friday CRO & PPC
Avatar for Christian Goodrich cargoodrich
3
740
Agile Leadership in an Agile Organization
Avatar for Dr. Kim W Petersen kimpetersen
PRO
0
170
The Art of Programming - Codeland 2020
Avatar for Erika Heidi erikaheidi
57
14k
ピンチをチャンスに：未来をつくるプロダクトロードマップ #pmconf2020
Avatar for Aki / @LoveIdahoBurger aki_iinuma
128
56k
The Cult of Friendly URLs
Avatar for Andy Hume andyhume
79
6.9k

Transcript

  1. @iconara CHASING THE ELEPHANT

  2. Theo / @iconara

  3. chief architect at BURT

  4. big data analytics with JRuby

  5. RUBY

  6. RUBY

  7. RUBY JRUBY

  8. JRUBY IS AWESOME BECAUSE RUBY IS GREAT, AND THE JVM

    IS GREAT

  9. hot_bunnies, eurydice, multimeter, mikka, msgpack-jruby

  10. None

  11. HADOOP

  12. JRUBY SUPERCOMPUTING 40 TiB data, 120 EC2 cc2.8xlarge, 1920 cores,

    7260 GiB RAM

  13. JAVA ALL THE WAY DOWN

  14. HADOOP STREAMING Wukong, Dumbo

  15. RUBYDOOP rubydoop.org + =

  16. None
  17. None

  18. main()

  19. Class.forName("...")

  20. Class.forName("...")

  21. None

  22. module WordCount class Mapper def map(key, value, context) value.to_s.downcase.split.each do

    |word| key = Hadoop::Io::Text.new(word) value = Hadoop::Io::IntWritable.new(1) context.write(key, value) end end end end

  23. RUBYDOOP IS LOW LEVEL I would love to see someone

    write something like Scalding or Cascading on top of it

  24. RUBYDOOP rubydoop.org

  25. RUBYDOOP rubydoop.org v1.1.0

  26. KTHXBAI @iconara github.com/iconara architecturalatrocities.com burtcorp.com