Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
A whirlwind tour through Lingual: ANSI SQL for Apache Hadoop
Search
André Kelpe
November 14, 2013
Programming
1
180
A whirlwind tour through Lingual: ANSI SQL for Apache Hadoop
Slides from my #devoxx 2013 talk about Cascading Lingual
André Kelpe
November 14, 2013
Tweet
Share
More Decks by André Kelpe
See All by André Kelpe
Cascading 3 and beyond
fs111
0
150
The Cascading (big) data application framework
fs111
1
220
SELECT ALL THE THINGS - Cascading Lingual, ANSI SQL for Apache Hadoop
fs111
0
190
Tor for everyone!
fs111
0
160
Large scale graph processing with apache giraph
fs111
2
5.3k
Other Decks in Programming
See All in Programming
TDDと今まで
kanayannet
0
140
C# 大統一理論推進委員会 会員のための Unity Package Manager プロジェクト構成案
monry
PRO
0
580
OpenAPI を守るのは難しい
ohmori_yusuke
1
140
デザインシステムで Tailwind CSSとCSS in JSに分散投資をしたら良かった話
fsubal
14
3.3k
Laravel標準バリデーションでできること
hmb_ok
2
360
PHPでOfficeファイルを取り扱う! PHP Officeライブラリを プロダクトに組み込んだ話
hirobe1999
0
840
どうしてこうなった命名集 ~🔥編~ / OOC 2024 LT
pictiny
4
2.8k
SwiftUI, Jetpack Composeの導入で変化した「家族アルバム みてね」のアプリ開発体験
hicka04
6
400
DDD, necessary but insufficient: physical design principles for microservices
cer
PRO
0
2.2k
IntelliJ IDEA を知らなかった 自分に教えたい小ネタ集 / IntelliJ IDEA Hints for My Past Self
mackey0225
3
170
品質が高いコードって何?Rev2.1
ickx
1
490
クソコード動画『カプセル化 Mk-II』 で考える 上手くカプセル化できない理由 / encapsulation2
minodriven
11
7.9k
Featured
See All Featured
Designing for Performance
lara
601
67k
Faster Mobile Websites
deanohume
296
30k
Fontdeck: Realign not Redesign
paulrobertlloyd
75
4.8k
Designing Experiences People Love
moore
135
23k
Learning to Love Humans: Emotional Interface Design
aarron
266
39k
Why You Should Never Use an ORM
jnunemaker
PRO
50
8.6k
How to Ace a Technical Interview
jacobian
272
22k
A better future with KSS
kneath
230
16k
Typedesign – Prime Four
hannesfritz
36
2k
Side Projects
sachag
451
41k
The Cult of Friendly URLs
andyhume
73
5.6k
Testing 201, or: Great Expectations
jmmastey
27
6.3k
Transcript
@fs111 #DV13 #lingual A whirlwind tour through Lingual: ANSI SQL
for Apache Hadoop André Kelpe concurrentinc.com
@fs111 #DV13 #lingual Speaker André Kelpe Software Engineer at Concurrent
The company behind Cascading and Lingual concurrentinc.com / @concurrent
[email protected]
@fs111
@fs111 #DV13 #lingual Agenda Cascading and Lingual Lingual: design goals
Lingual: features Demo: Lingual in action Q&A
@fs111 #DV13 #lingual Cascading http://cascading.org
@fs111 #DV13 #lingual Cascading terminology Taps are sources and sinks
for data Schemes represent the format of the data Pipes are connecting Taps
@fs111 #DV13 #lingual Cascading terminology Tuples flow through Pipes Fields
describe the Tuples Operations are executed on Tuples in TupleStreams Flows get scheduled and executed
@fs111 #DV13 #lingual Not just Java!
@fs111 #DV13 #lingual Scalding Scala DSL on top of Cascading
Developed by twitter https://github.com/twitter/scalding/
@fs111 #DV13 #lingual Cascalog Clojure DSL on top of Cascading
Inspired by datalog https://github.com/nathanmarz/cascalog
@fs111 #DV13 #lingual ANSI SQL via Lingual http://www.cascading.org/lingual/
@fs111 #DV13 #lingual Lingual – design goals 1/3 Immediate Data
Access SQL access via Shell or JDBC driver
@fs111 #DV13 #lingual Lingual – design goals 2/3 Simplify SQL
Migration move SQL workflows on your Hadoop Cluster via Cascading flows or JDBC driver
@fs111 #DV13 #lingual Lingual – design goals 3/3 Simplify System
& Data Integration Read and write from hdfs, jdbc, memcached, HBase, redshift...
@fs111 #DV13 #lingual Lingual – ANSI SQL on Cascading http://www.cascading.org/lingual/
@fs111 #DV13 #lingual Lingual and Cascading are about batch processing
large amounts of data
@fs111 #DV13 #lingual Demo
@fs111 #DV13 #lingual Lingual – ANSI SQL on Cascading http://www.cascading.org/lingual/
@fs111 #DV13 #lingual Q&A @fs111 / http://concurrentinc.com http://cascading.org/lingual
@fs111 #DV13 #lingual Link collection http://www.cascading.org/lingual/ http://www.cascading.org/ http://docs.cascading.org/lingual/1.0/ https://github.com/Cascading/ http://concurrentinc.com
https://groups.google.com/forum/#!forum/lingual-user https://groups.google.com/forum/#!forum/cascading-user http://docs.cascading.org/impatient/ https://github.com/Cascading/vagrant-cascading-hadoop-cluster