Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
A whirlwind tour through Lingual: ANSI SQL for ...
Search
André Kelpe
November 14, 2013
Programming
1
190
A whirlwind tour through Lingual: ANSI SQL for Apache Hadoop
Slides from my #devoxx 2013 talk about Cascading Lingual
André Kelpe
November 14, 2013
Tweet
Share
More Decks by André Kelpe
See All by André Kelpe
Cascading 3 and beyond
fs111
0
170
The Cascading (big) data application framework
fs111
1
230
SELECT ALL THE THINGS - Cascading Lingual, ANSI SQL for Apache Hadoop
fs111
0
200
Tor for everyone!
fs111
0
190
Large scale graph processing with apache giraph
fs111
2
5.5k
Other Decks in Programming
See All in Programming
Advanced Micro Frontends: Multi Version/ Framework Scenarios @WAD 2025, Berlin
manfredsteyer
PRO
0
410
Streamlitで実現できるようになったこと、実現してくれたこと
ayumu_yamaguchi
2
140
NEWT Backend Evolution
xpromx
1
140
The Niche of CDK Grant オブジェクトって何者?/the-niche-of-cdk-what-isgrant-object
hassaku63
1
640
AWS Summit Japan 2024と2025の比較/はじめてのKiro、今あなたは岐路に立つ
satoshi256kbyte
1
200
ISUCON研修おかわり会 講義スライド
arfes0e2b3c
1
470
レトロゲームから学ぶ通信技術の歴史
kimkim0106
0
120
Jakarta EE Meets AI
ivargrimstad
0
140
Vibe Codingの幻想を超えて-生成AIを現場で使えるようにするまでの泥臭い話.ai
fumiyakume
16
8.5k
High-Level Programming Languages in AI Era -Human Thought and Mind-
hayat01sh1da
PRO
0
910
「テストは愚直&&網羅的に書くほどよい」という誤解 / Test Smarter, Not Harder
munetoshi
1
210
20250708_JAWS_opscdk
takuyay0ne
2
130
Featured
See All Featured
The Art of Programming - Codeland 2020
erikaheidi
54
13k
Scaling GitHub
holman
460
140k
Embracing the Ebb and Flow
colly
86
4.8k
Keith and Marios Guide to Fast Websites
keithpitt
411
22k
Measuring & Analyzing Core Web Vitals
bluesmoon
7
520
Mobile First: as difficult as doing things right
swwweet
223
9.7k
Speed Design
sergeychernyshev
32
1k
Producing Creativity
orderedlist
PRO
346
40k
Building a Modern Day E-commerce SEO Strategy
aleyda
42
7.4k
Code Reviewing Like a Champion
maltzj
524
40k
Bash Introduction
62gerente
613
210k
Imperfection Machines: The Place of Print at Facebook
scottboms
267
13k
Transcript
@fs111 #DV13 #lingual A whirlwind tour through Lingual: ANSI SQL
for Apache Hadoop André Kelpe concurrentinc.com
@fs111 #DV13 #lingual Speaker André Kelpe Software Engineer at Concurrent
The company behind Cascading and Lingual concurrentinc.com / @concurrent
[email protected]
@fs111
@fs111 #DV13 #lingual Agenda Cascading and Lingual Lingual: design goals
Lingual: features Demo: Lingual in action Q&A
@fs111 #DV13 #lingual Cascading http://cascading.org
@fs111 #DV13 #lingual Cascading terminology Taps are sources and sinks
for data Schemes represent the format of the data Pipes are connecting Taps
@fs111 #DV13 #lingual Cascading terminology Tuples flow through Pipes Fields
describe the Tuples Operations are executed on Tuples in TupleStreams Flows get scheduled and executed
@fs111 #DV13 #lingual Not just Java!
@fs111 #DV13 #lingual Scalding Scala DSL on top of Cascading
Developed by twitter https://github.com/twitter/scalding/
@fs111 #DV13 #lingual Cascalog Clojure DSL on top of Cascading
Inspired by datalog https://github.com/nathanmarz/cascalog
@fs111 #DV13 #lingual ANSI SQL via Lingual http://www.cascading.org/lingual/
@fs111 #DV13 #lingual Lingual – design goals 1/3 Immediate Data
Access SQL access via Shell or JDBC driver
@fs111 #DV13 #lingual Lingual – design goals 2/3 Simplify SQL
Migration move SQL workflows on your Hadoop Cluster via Cascading flows or JDBC driver
@fs111 #DV13 #lingual Lingual – design goals 3/3 Simplify System
& Data Integration Read and write from hdfs, jdbc, memcached, HBase, redshift...
@fs111 #DV13 #lingual Lingual – ANSI SQL on Cascading http://www.cascading.org/lingual/
@fs111 #DV13 #lingual Lingual and Cascading are about batch processing
large amounts of data
@fs111 #DV13 #lingual Demo
@fs111 #DV13 #lingual Lingual – ANSI SQL on Cascading http://www.cascading.org/lingual/
@fs111 #DV13 #lingual Q&A @fs111 / http://concurrentinc.com http://cascading.org/lingual
@fs111 #DV13 #lingual Link collection http://www.cascading.org/lingual/ http://www.cascading.org/ http://docs.cascading.org/lingual/1.0/ https://github.com/Cascading/ http://concurrentinc.com
https://groups.google.com/forum/#!forum/lingual-user https://groups.google.com/forum/#!forum/cascading-user http://docs.cascading.org/impatient/ https://github.com/Cascading/vagrant-cascading-hadoop-cluster