Upgrade to Pro — share decks privately, control downloads, hide ads and more …

A whirlwind tour through Lingual: ANSI SQL for ...

Avatar for André Kelpe André Kelpe
November 14, 2013
Programming
1
200

A whirlwind tour through Lingual: ANSI SQL for Apache Hadoop

Slides from my #devoxx 2013 talk about Cascading Lingual

Avatar for André Kelpe

André Kelpe

November 14, 2013
Tweet

More Decks by André Kelpe

See All by André Kelpe
Cascading 3 and beyond
Avatar for André Kelpe fs111
0
180
The Cascading (big) data application framework
Avatar for André Kelpe fs111
1
240
SELECT ALL THE THINGS - Cascading Lingual, ANSI SQL for Apache Hadoop
Avatar for André Kelpe fs111
0
210
Tor for everyone!
Avatar for André Kelpe fs111
0
200
Large scale graph processing with apache giraph
Avatar for André Kelpe fs111
2
5.5k

Other Decks in Programming

See All in Programming
2026年は Rust 置き換えが流行る！ / 20260220-niigata-5min-tech
Avatar for girigiribauer girigiribauer
0
220
RAGでハマりがちな"Excelの罠"を、データの構造化で突破する
Avatar for harumi harumiweb
9
2.4k
CSC307 Lecture 15
Avatar for Javier Gonzalez-Sanchez javiergs
PRO
0
220
手戻りゼロ？ Spec Driven Developmentとは@KAG AI week
Avatar for Tomoki Hirai tmhirai
1
160
AIとペアプロして処理時間を97%削減した話 #pyconshizu
Avatar for Kashun Yoshida kashewnuts
1
190
The Ralph Wiggum Loop: First Principles of Autonomous Development
Avatar for Ryuichiro Semba sembayui
0
3.7k
Event Storming
Avatar for Henning Schwentner hschwentner
3
1.3k
ベクトル検索のフィルタを用いた機械学習モデルとの統合 / python-meetup-fukuoka-06-vector-attr
Avatar for monochromegane monochromegane
2
300
RubyとGoでゼロから作る証券システム： 高信頼性が求められるシステムのコードの外側にある設計と運用のリアル
Avatar for free_world21 free_world21
0
200
The Past, Present, and Future of Enterprise Java
Avatar for ivargrimstad ivargrimstad
0
390
CDIの誤解しがちな仕様とその対処TIPS
Avatar for futokiyo futokiyo
0
160
AIに仕事を丸投げしたら、本当に楽になれるのか
Avatar for ディップ株式会社 dip_tech
PRO
0
180

Featured

See All Featured
ピンチをチャンスに：未来をつくるプロダクトロードマップ #pmconf2020
Avatar for Aki / @LoveIdahoBurger aki_iinuma
128
55k
AI Search: Implications for SEO and How to Move Forward - #ShenzhenSEOConference
Avatar for Aleyda Solis aleyda
1
1.1k
GitHub's CSS Performance
Avatar for Jon Rohan jonrohan
1032
470k
Organizational Design Perspectives: An Ontology of Organizational Design Elements
Avatar for Dr. Kim W Petersen kimpetersen
PRO
1
620
Money Talks: Using Revenue to Get Sh*t Done
Avatar for Nikki Halliwell nikkihalliwell
0
170
The Psychology of Web Performance [Beyond Tellerrand 2023]
Avatar for Tammy Everts tammyeverts
49
3.3k
Marketing Yourself as an Engineer | Alaka | Gurzu
Avatar for Gurzu gurzu
0
140
The Organizational Zoo: Understanding Human Behavior Agility Through Metaphoric Constructive Conversations (based on the works of Arthur Shelley, Ph.D)
Avatar for Dr. Kim W Petersen kimpetersen
PRO
0
260
A brief & incomplete history of 
UX Design for the World Wide Web: 1989–2019
Avatar for Jason CranfordTeague jct
1
310
Unsuck your backbone
Avatar for Amy Palamountain ammeep
672
58k
The Spectacular Lies of Maps
Avatar for Per Axbom axbom
PRO
1
580
16th Malabo Montpellier Forum Presentation
Avatar for AKADEMIYA2063 akademiya2063
PRO
0
63

Transcript

  1. @fs111 #DV13 #lingual A whirlwind tour through Lingual: ANSI SQL

    for Apache Hadoop André Kelpe concurrentinc.com

  2. @fs111 #DV13 #lingual Speaker André Kelpe Software Engineer at Concurrent

    The company behind Cascading and Lingual concurrentinc.com / @concurrent [email protected] @fs111

  3. @fs111 #DV13 #lingual Agenda Cascading and Lingual Lingual: design goals

    Lingual: features Demo: Lingual in action Q&A

  4. @fs111 #DV13 #lingual Cascading http://cascading.org

  5. @fs111 #DV13 #lingual Cascading terminology Taps are sources and sinks

    for data Schemes represent the format of the data Pipes are connecting Taps

  6. @fs111 #DV13 #lingual Cascading terminology Tuples flow through Pipes Fields

    describe the Tuples Operations are executed on Tuples in TupleStreams Flows get scheduled and executed

  7. @fs111 #DV13 #lingual Not just Java!

  8. @fs111 #DV13 #lingual Scalding Scala DSL on top of Cascading

    Developed by twitter https://github.com/twitter/scalding/

  9. @fs111 #DV13 #lingual Cascalog Clojure DSL on top of Cascading

    Inspired by datalog https://github.com/nathanmarz/cascalog

  10. @fs111 #DV13 #lingual ANSI SQL via Lingual http://www.cascading.org/lingual/

  11. @fs111 #DV13 #lingual Lingual – design goals 1/3 Immediate Data

    Access SQL access via Shell or JDBC driver

  12. @fs111 #DV13 #lingual Lingual – design goals 2/3 Simplify SQL

    Migration move SQL workflows on your Hadoop Cluster via Cascading flows or JDBC driver

  13. @fs111 #DV13 #lingual Lingual – design goals 3/3 Simplify System

    & Data Integration Read and write from hdfs, jdbc, memcached, HBase, redshift...

  14. @fs111 #DV13 #lingual Lingual – ANSI SQL on Cascading http://www.cascading.org/lingual/

  15. @fs111 #DV13 #lingual Lingual and Cascading are about batch processing

    large amounts of data

  16. @fs111 #DV13 #lingual Demo

  17. @fs111 #DV13 #lingual Lingual – ANSI SQL on Cascading http://www.cascading.org/lingual/

  18. @fs111 #DV13 #lingual Q&A @fs111 / http://concurrentinc.com http://cascading.org/lingual

  19. @fs111 #DV13 #lingual Link collection http://www.cascading.org/lingual/ http://www.cascading.org/ http://docs.cascading.org/lingual/1.0/ https://github.com/Cascading/ http://concurrentinc.com

    https://groups.google.com/forum/#!forum/lingual-user https://groups.google.com/forum/#!forum/cascading-user http://docs.cascading.org/impatient/ https://github.com/Cascading/vagrant-cascading-hadoop-cluster