Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
A whirlwind tour through Lingual: ANSI SQL for ...
Search
André Kelpe
November 14, 2013
Programming
1
190
A whirlwind tour through Lingual: ANSI SQL for Apache Hadoop
Slides from my #devoxx 2013 talk about Cascading Lingual
André Kelpe
November 14, 2013
Tweet
Share
More Decks by André Kelpe
See All by André Kelpe
Cascading 3 and beyond
fs111
0
180
The Cascading (big) data application framework
fs111
1
240
SELECT ALL THE THINGS - Cascading Lingual, ANSI SQL for Apache Hadoop
fs111
0
200
Tor for everyone!
fs111
0
190
Large scale graph processing with apache giraph
fs111
2
5.5k
Other Decks in Programming
See All in Programming
uniqueパッケージの内部実装を支えるweak pointerの話
magavel
0
1k
CSC509 Lecture 06
javiergs
PRO
0
260
Writing Better Go: Lessons from 10 Code Reviews
konradreiche
0
1.3k
スマホから Youtube Shortsを見られないようにする
lemolatoon
27
33k
その面倒な作業、「Dart」にやらせませんか? Flutter開発者のための業務効率化
yordgenome03
1
130
ソフトウェア設計の実践的な考え方
masuda220
PRO
4
600
monorepo の Go テストをはやくした〜い!~最小の依存解決への道のり~ / faster-testing-of-monorepos
convto
2
500
詳しくない分野でのVibe Codingで困ったことと学び/vibe-coding-in-unfamiliar-area
shibayu36
3
5.1k
コードとあなたと私の距離 / The Distance Between Code, You, and I
hiro_y
0
170
Go Conference 2025: Goで体感するMultipath TCP ― Go 1.24 時代の MPTCP Listener を理解する
takehaya
9
1.7k
Server Side Kotlin Meetup vol.16: 内部動作を理解して ハイパフォーマンスなサーバサイド Kotlin アプリケーションを書こう
ternbusty
3
210
CSC509 Lecture 05
javiergs
PRO
0
300
Featured
See All Featured
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
kevinliebholz
35
6.1k
Bootstrapping a Software Product
garrettdimon
PRO
307
110k
Automating Front-end Workflow
addyosmani
1371
200k
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
marcduiker
34
2.3k
Measuring & Analyzing Core Web Vitals
bluesmoon
9
620
The MySQL Ecosystem @ GitHub 2015
samlambert
251
13k
Into the Great Unknown - MozCon
thekraken
40
2.1k
Learning to Love Humans: Emotional Interface Design
aarron
274
41k
Rails Girls Zürich Keynote
gr2m
95
14k
Distributed Sagas: A Protocol for Coordinating Microservices
caitiem20
333
22k
Docker and Python
trallard
46
3.6k
Principles of Awesome APIs and How to Build Them.
keavy
127
17k
Transcript
@fs111 #DV13 #lingual A whirlwind tour through Lingual: ANSI SQL
for Apache Hadoop André Kelpe concurrentinc.com
@fs111 #DV13 #lingual Speaker André Kelpe Software Engineer at Concurrent
The company behind Cascading and Lingual concurrentinc.com / @concurrent
[email protected]
@fs111
@fs111 #DV13 #lingual Agenda Cascading and Lingual Lingual: design goals
Lingual: features Demo: Lingual in action Q&A
@fs111 #DV13 #lingual Cascading http://cascading.org
@fs111 #DV13 #lingual Cascading terminology Taps are sources and sinks
for data Schemes represent the format of the data Pipes are connecting Taps
@fs111 #DV13 #lingual Cascading terminology Tuples flow through Pipes Fields
describe the Tuples Operations are executed on Tuples in TupleStreams Flows get scheduled and executed
@fs111 #DV13 #lingual Not just Java!
@fs111 #DV13 #lingual Scalding Scala DSL on top of Cascading
Developed by twitter https://github.com/twitter/scalding/
@fs111 #DV13 #lingual Cascalog Clojure DSL on top of Cascading
Inspired by datalog https://github.com/nathanmarz/cascalog
@fs111 #DV13 #lingual ANSI SQL via Lingual http://www.cascading.org/lingual/
@fs111 #DV13 #lingual Lingual – design goals 1/3 Immediate Data
Access SQL access via Shell or JDBC driver
@fs111 #DV13 #lingual Lingual – design goals 2/3 Simplify SQL
Migration move SQL workflows on your Hadoop Cluster via Cascading flows or JDBC driver
@fs111 #DV13 #lingual Lingual – design goals 3/3 Simplify System
& Data Integration Read and write from hdfs, jdbc, memcached, HBase, redshift...
@fs111 #DV13 #lingual Lingual – ANSI SQL on Cascading http://www.cascading.org/lingual/
@fs111 #DV13 #lingual Lingual and Cascading are about batch processing
large amounts of data
@fs111 #DV13 #lingual Demo
@fs111 #DV13 #lingual Lingual – ANSI SQL on Cascading http://www.cascading.org/lingual/
@fs111 #DV13 #lingual Q&A @fs111 / http://concurrentinc.com http://cascading.org/lingual
@fs111 #DV13 #lingual Link collection http://www.cascading.org/lingual/ http://www.cascading.org/ http://docs.cascading.org/lingual/1.0/ https://github.com/Cascading/ http://concurrentinc.com
https://groups.google.com/forum/#!forum/lingual-user https://groups.google.com/forum/#!forum/cascading-user http://docs.cascading.org/impatient/ https://github.com/Cascading/vagrant-cascading-hadoop-cluster