Berlin Buzzwords 2012: Introduction to Cascalog

These are the slides for my talk "Introduction to Cascalog: Functional Data Processing for Hadoop". http://berlinbuzzwords.de/sessions/introducing-cascalog-functional-data-processing-hadoop

The talk features a live demonstration of Cascalog. Check out the video on Vimeo: https://vimeo.com/album/1978224/video/43804713

Transcript

1. Introduction to Cascalog Stefan Hübner, Nokia Berlin Berlin Buzzwords 2012
2. Nokia Maps • Address & POI Search • Category Search • Nearby Recommendations
3. Hadoop • Batch Processing • (Very) Large Scale • Distributed Filesystem • Parallel Computation • Fault-Tolerant
4. Hadoop • Batch Processing • (Very) Large Scale • Distributed Filesystem • Parallel Computation • Fault-Tolerant
5. Hadoop MapReduce API • Tedious and verbose • Hard to test • Hard to refactor
6. • Tedious and verbose • Hard to test • Hard to refactor Hadoop MapReduce API
7. Pig and Hive • Define their own query language • Custom operations in Java, Python, ... • Non-intuitive integration
8. (())
9. Cascalog Cascalog Cascading Hadoop Abstraction Variables and logic Tuples, data workflows Key/value pairs, simple aggregation slide (c) Nathan Marz, reproduced with permission
10. Thank you! Stefan Hübner, @sthuebner http://knowyourmeme.com/memes/cereal-guy