Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Chasing the Elephant

Sponsored · Ship Features Fearlessly Turn features on and off without deploys. Used by thousands of Ruby developers. →
Avatar for Theo Hultberg Theo Hultberg
August 15, 2013
Programming
0
100

Chasing the Elephant

JRubyConfEU 2013

Avatar for Theo Hultberg

Theo Hultberg

August 15, 2013
Tweet

More Decks by Theo Hultberg

See All by Theo Hultberg
Datalakes at AWS Summit Stockholm 2018
Avatar for Theo Hultberg iconara
0
99
Building a CQL driver
Avatar for Theo Hultberg iconara
0
73
Learning to Build Distributed Systems the Hard Way
Avatar for Theo Hultberg iconara
1
150
Learning to Build Distributed Systems the Hard Way
Avatar for Theo Hultberg iconara
2
220
Learning to Build Distributed Systems the Hard Way 
Avatar for Theo Hultberg iconara
3
5.2k
Concurrency and Distributed Systems in JRuby
Avatar for Theo Hultberg iconara
3
690
A Guide to the Post Relational Revolution
Avatar for Theo Hultberg iconara
4
5.4k
Standing on the Shoulders of Giants with JRuby
Avatar for Theo Hultberg iconara
4
170
Shortcuts Around the Mistakes I've Made Scaling MongoDB
Avatar for Theo Hultberg iconara
4
170

Other Decks in Programming

See All in Programming
24時間止められないシステムを守る-医療ITにおけるランサムウェア対策の実際
Avatar for kouki.miura koukimiura
1
120
AIと一緒にレガシーに向き合ってみた
Avatar for nyafunta9858 nyafunta9858
0
250
余白を設計しフロントエンド開発を 加速させる
Avatar for karacoro / からころ tsukuha
7
2.1k
Claude Codeと2つの巻き戻し戦略 / Two Rewind Strategies with Claude Code
Avatar for 果物リン fruitriin
0
140
React Native × React Router v7 API通信の共通化で考えるべきこと
Avatar for Suguru Ohki suguruooki
0
100
AI によるインシデント初動調査の自動化を行う AI インシデントコマンダーを作った話
Avatar for azukiazusa azukiazusa1
1
750
登壇資料を作る時に意識していること #登壇資料_findy
Avatar for konifar konifar
4
1.6k
CSC307 Lecture 03
Avatar for Javier Gonzalez-Sanchez javiergs
PRO
1
490
生成AIを活用したソフトウェア開発ライフサイクル変革の現在値
Avatar for Hiroyuki Mori hiroyukimori
PRO
0
100
それ、本当に安全？ ファイルアップロードで見落としがちなセキュリティリスクと対策
Avatar for ikechi penpeen
7
4k
CSC307 Lecture 01
Avatar for Javier Gonzalez-Sanchez javiergs
PRO
0
690
AI Schema Enrichment for your Oracle AI Database
Avatar for thatjeffsmith thatjeffsmith
0
330

Featured

See All Featured
Jamie Indigo - Trashchat’s Guide to Black Boxes: Technical SEO Tactics for LLMs
Avatar for Tech SEO Connect techseoconnect
PRO
0
65
[RailsConf 2023] Rails as a piece of cake
Avatar for Vladimir Dementyev palkan
59
6.3k
Save Time (by Creating Custom Rails Generators)
Avatar for Garrett Dimon garrettdimon
PRO
32
2.1k
Performance Is Good for Brains [We Love Speed 2024]
Avatar for Tammy Everts tammyeverts
12
1.4k
Responsive Adventures: Dirty Tricks From The Dark Corners of Front-End
Avatar for Vitaly Friedman smashingmag
254
22k
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
Avatar for Sam Stephenson sstephenson
162
16k
Building Flexible Design Systems
Avatar for Yesenia Perez-Cruz yeseniaperezcruz
330
40k
The Power of CSS Pseudo Elements
Avatar for Geoffrey Crofte geoffreycrofte
80
6.2k
Collaborative Software Design: How to facilitate domain modelling decisions
Avatar for Kenny Baas-Schwegler baasie
0
140
We Have a Design System, Now What?
Avatar for Morgane Peng morganepeng
54
8k
Optimising Largest Contentful Paint
Avatar for Harry Roberts csswizardry
37
3.6k
ReactJS: Keep Simple. Everything can be a component!
Avatar for Pedro Nauck pedronauck
666
130k

Transcript

  1. @iconara CHASING THE ELEPHANT

  2. Theo / @iconara

  3. chief architect at BURT

  4. big data analytics with JRuby

  5. RUBY

  6. RUBY

  7. RUBY JRUBY

  8. JRUBY IS AWESOME BECAUSE RUBY IS GREAT, AND THE JVM

    IS GREAT

  9. hot_bunnies, eurydice, multimeter, mikka, msgpack-jruby

  10. None

  11. HADOOP

  12. JRUBY SUPERCOMPUTING 40 TiB data, 120 EC2 cc2.8xlarge, 1920 cores,

    7260 GiB RAM

  13. JAVA ALL THE WAY DOWN

  14. HADOOP STREAMING Wukong, Dumbo

  15. RUBYDOOP rubydoop.org + =

  16. None
  17. None

  18. main()

  19. Class.forName("...")

  20. Class.forName("...")

  21. None

  22. module WordCount class Mapper def map(key, value, context) value.to_s.downcase.split.each do

    |word| key = Hadoop::Io::Text.new(word) value = Hadoop::Io::IntWritable.new(1) context.write(key, value) end end end end

  23. RUBYDOOP IS LOW LEVEL I would love to see someone

    write something like Scalding or Cascading on top of it

  24. RUBYDOOP rubydoop.org

  25. RUBYDOOP rubydoop.org v1.1.0

  26. KTHXBAI @iconara github.com/iconara architecturalatrocities.com burtcorp.com