Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Chasing the Elephant

Avatar for Theo Hultberg Theo Hultberg
August 15, 2013
Programming
100
0

Chasing the Elephant

JRubyConfEU 2013

Avatar for Theo Hultberg

Theo Hultberg

August 15, 2013

More Decks by Theo Hultberg

See All by Theo Hultberg
Datalakes at AWS Summit Stockholm 2018
Avatar for Theo Hultberg iconara
0
100
Building a CQL driver
Avatar for Theo Hultberg iconara
0
77
Learning to Build Distributed Systems the Hard Way
Avatar for Theo Hultberg iconara
1
150
Learning to Build Distributed Systems the Hard Way
Avatar for Theo Hultberg iconara
2
220
Learning to Build Distributed Systems the Hard Way 
Avatar for Theo Hultberg iconara
3
5.2k
Concurrency and Distributed Systems in JRuby
Avatar for Theo Hultberg iconara
3
690
A Guide to the Post Relational Revolution
Avatar for Theo Hultberg iconara
4
5.4k
Standing on the Shoulders of Giants with JRuby
Avatar for Theo Hultberg iconara
4
170
Shortcuts Around the Mistakes I've Made Scaling MongoDB
Avatar for Theo Hultberg iconara
4
170

Other Decks in Programming

See All in Programming
「Linuxサーバー構築標準教科書」を読んでみた #ツナギメオフライン.7
Avatar for akase244 akase244
0
1.4k
Structured Concurrency, Scoped Values and Joiners in the JDK 25 26 27
Avatar for José josepaumard
1
140
Spec Driven Development | AI Summit Vilnius
Avatar for Daniel Sogl danielsogl
PRO
1
140
From Formal Specification to Property Based Test
Avatar for Masato Ohba ohbarye
0
710
サプライチェーン攻撃対策「層を重ねて落ちない壁」を10日間で組み上げた話 #TechLeadConf2026
Avatar for Kashun Yoshida kashewnuts
1
200
Augmenting AI with the Power of Jakarta EE
Avatar for ivargrimstad ivargrimstad
0
160
検索設計から
推論設計への重心移動と
Recall-First Retrieval
Avatar for po3rin po3rin
5
1.5k
AIと共に生きる技術選定 2026
Avatar for Sugar Sato sgash708
0
120
ローカルLLMでどこまでコードが書けるか / How much code can be written on a local LLM
Avatar for Naoki Kishida kishida
2
300
2026年のソフトウェア開発を考える（2026/05版） / Software Engineering Scrum Fest Niigata 2026 Edition
Avatar for Takuto Wada twada
PRO
21
11k
Building on Bluesky's AT Protocol with Ruby
Avatar for Kuba Suder mackuba
0
100
The Past, Present, and Future of Enterprise Java
Avatar for ivargrimstad ivargrimstad
0
490

Featured

See All Featured
Why You Should Never Use an ORM
Avatar for John Nunemaker jnunemaker
PRO
61
9.8k
SEO Brein meetup: CTRL+C is not how to scale international SEO
Avatar for Linda Hogenes lindahogenes
1
2.6k
HTML-Aware ERB: The Path to Reactive Rendering @ RubyCon 2026, Rimini, Italy
Avatar for Marco Roth marcoroth
1
28
The Success of Rails: Ensuring Growth for the Next 100 Years
Avatar for Eileen M. Uchitelle eileencodes
47
8.1k
How to build an LLM SEO readiness audit: a practical framework
Avatar for Nick Samuel nmsamuel
1
730
The #1 spot is gone: here's how to win anyway
Avatar for Tamara Novitovic tamaranovitovic
2
1k
How to Align SEO within the Product Triangle To Get 
Buy-In & Support - #RIMC
Avatar for Aleyda Solis aleyda
2
1.5k
Navigating Algorithm Shifts & AI Overviews - #SMXNext
Avatar for Aleyda Solis aleyda
1
1.2k
The Illustrated Guide to Node.js - THAT Conference 2024
Avatar for David Neal reverentgeek
1
340
GraphQLとの向き合い方2022年版
Avatar for Yosuke Kurami quramy
50
15k
Marketing to machines
Avatar for Jono Alderson jonoalderson
1
5.2k
Java REST API Framework Comparison - PWX 2021
Avatar for Matt Raible mraible
34
9.3k

Transcript

  1. @iconara CHASING THE ELEPHANT

  2. Theo / @iconara

  3. chief architect at BURT

  4. big data analytics with JRuby

  5. RUBY

  6. RUBY

  7. RUBY JRUBY

  8. JRUBY IS AWESOME BECAUSE RUBY IS GREAT, AND THE JVM

    IS GREAT

  9. hot_bunnies, eurydice, multimeter, mikka, msgpack-jruby

  10. None

  11. HADOOP

  12. JRUBY SUPERCOMPUTING 40 TiB data, 120 EC2 cc2.8xlarge, 1920 cores,

    7260 GiB RAM

  13. JAVA ALL THE WAY DOWN

  14. HADOOP STREAMING Wukong, Dumbo

  15. RUBYDOOP rubydoop.org + =

  16. None
  17. None

  18. main()

  19. Class.forName("...")

  20. Class.forName("...")

  21. None

  22. module WordCount class Mapper def map(key, value, context) value.to_s.downcase.split.each do

    |word| key = Hadoop::Io::Text.new(word) value = Hadoop::Io::IntWritable.new(1) context.write(key, value) end end end end

  23. RUBYDOOP IS LOW LEVEL I would love to see someone

    write something like Scalding or Cascading on top of it

  24. RUBYDOOP rubydoop.org

  25. RUBYDOOP rubydoop.org v1.1.0

  26. KTHXBAI @iconara github.com/iconara architecturalatrocities.com burtcorp.com