An introduction to Apache Tinkerpop

A introduction to Apache Tinkerpop, what does it do and what is it used for ? How does it work ?

Transcript

1. Apache Tinkerpop • What is Tinkerpop ? • What can it do ? • Why am I interested ? • Uses Gremlin • Implementations • Define Graphs • Traverse Graphs • Architecture • Books www.semtech-solutions.co.nz info@semtech-solutions.co.nz
2. Tinkerpop – What is it ? • A Graph storage and processing system • Currently under Apache incubation ( 2015 ) • Sub system for graph based apps i.e. Titan • Has Tinkerpop3 Structure API – Graph, Element, Property • Has Tinkerpop3 Process API – TraversalSource, GraphComputer www.semtech-solutions.co.nz info@semtech-solutions.co.nz
3. Tinkerpop – What can it do ? • See tinkerpop.incubator.apache.org • Graph based processing for graph based systems • Has graph interaction via – OLTP ( online transaction processing ) – OLAP ( online analytical processing ) • Has GraphComputer for vertex programming • Gremlin server access by – Gremlin console – REST API – Java www.semtech-solutions.co.nz info@semtech-solutions.co.nz
4. Tinkerpop – Why am I interested ? • Apache Titan will use Tinkerpop – For graph storage and processing • Titan 0.9x should be Apache Spark Enabled • Means that hopefully ( perhaps soon ? ) – Titan can be used for graph storage – With Apache Spark graphX – Means • Graph storage – Hbase / Cassandra • Plus Graph processing • All graph based at big data range www.semtech-solutions.co.nz info@semtech-solutions.co.nz
5. Tinkerpop – Uses Gremlin • Tinkerpop3 uses the Gremlin groovy language for – For Graph Mutation – For Graph Traversal • Gremlin is a graph based language • Provides Gremlin Server for – Metrics i.e. Graphite – Monitoring – i.e. Ganglia www.semtech-solutions.co.nz info@semtech-solutions.co.nz
6. Tinkerpop – Implementations ? • Which systems have used Tinkerpop ? – Elastic-gremlin – Hadoop (Giraph) – Apache Spark – Sqlg – Tinkergraph – Titan www.semtech-solutions.co.nz info@semtech-solutions.co.nz
7. Tinkerpop – Define Graphs www.semtech-solutions.co.nz info@semtech-solutions.co.nz
8. Tinkerpop – Traverse Graphs www.semtech-solutions.co.nz info@semtech-solutions.co.nz
9. Tinkerpop – Architecture www.semtech-solutions.co.nz info@semtech-solutions.co.nz
10. Available Books • See our Hadoop book from Apress / Springer – “Big Data Made Easy” • Look out for our Apache Spark based book – from Packt in 2015 www.semtech-solutions.co.nz info@semtech-solutions.co.nz
11. Contact Us • Feel free to contact us at – www.semtech-solutions.co.nz – info@semtech-solutions.co.nz • We offer IT project consultancy • We are happy to hear about your problems • You can just pay for those hours that you need • To solve your problems