An introduction to zeppelin

A introduction to zeppelin, what does it do and what is it used for ? How can it be used with Spark ?

http://www.semtech-solutions.co.nz

http://www.amazon.com/Michael-Frampton/e/B00NIQDOOM/ref=dp_byline_cont_book_1

https://nz.linkedin.com/pub/mike-frampton/20/630/385

Transcript

1. Apache Zeppelin • What is Zeppelin ? • How does it work • How can it be used • Available interpreters • Major uses ? • See zeppelin.incubator.apache.org • Books www.semtech-solutions.co.nz info@semtech-solutions.co.nz
2. Zeppelin – What is it ? • Data visualisation • Notebook based • Aids collaboration • Open sourced – Apache 2 license • Has many interpreters • Many display options • Is extensible www.semtech-solutions.co.nz info@semtech-solutions.co.nz
3. Zeppelin – How does it work ? • Collaborative notebooks to access data • Select interpreter to manipulate data – i.e. Spark SQL • Use visualisation options to present data • Create reports and dashboards • Share dashboards to the web / customers www.semtech-solutions.co.nz info@semtech-solutions.co.nz
4. Zeppelin – How can it be used ? • Select data from the file system / HDFS • Use Spark + NoSQL connector • Collaborate, share notebook session • Use Markdown for session comments • Filter data via interpreters i.e Scala , SQL • Visualise data with graphs, reports, dashboards • Share results www.semtech-solutions.co.nz info@semtech-solutions.co.nz
5. Zeppelin – Interpreters • Cassandra • Elasticsearch • Flink • Geode • Hive • Ignite • Lens • Markdown • Postgresql, Hawq • Scalding www.semtech-solutions.co.nz info@semtech-solutions.co.nz • Shell • Spark • Tajo • Build your own !
6. Zeppelin – Major uses ? • Who are the major users ? – Databricks – Big data stack developers – Hortonworks • Data investigation, discovery and sharing • Extensible – Add your own interpreters – Add your own graphs www.semtech-solutions.co.nz info@semtech-solutions.co.nz
7. Zeppelin – Example - SQL with variable shows pie chart www.semtech-solutions.co.nz info@semtech-solutions.co.nz
8. Zeppelin – Example - SQL with variable shows bar chart www.semtech-solutions.co.nz info@semtech-solutions.co.nz
9. Available Books • See “Big Data Made Easy” – Apress / Springer Jan 2015 • See “Mastering Apache Spark” – Packt Oct 2015 www.semtech-solutions.co.nz info@semtech-solutions.co.nz
10. Contact Us • Feel free to contact us at – www.semtech-solutions.co.nz – info@semtech-solutions.co.nz • We offer IT project consultancy • We are happy to hear about your problems • You can just pay for those hours that you need • To solve your problems