Jennifer Reif

Learn about what a graph database is, how the property graph model is constructed, how to write statements in the Cypher query language, and what Neo4j is. Session also includes information on the Paradise Papers data set and provides queries and steps to accessing and exploring the data for yourself to discover your own interesting connections!

Transcript

1. Neo4j Graph Database and the Paradise Papers Jennifer Reif Neo4j @JMHReif
2. Who Am I? • Developer Relations Engineer for Neo4j • Continuous learner • Conference speaker • Hobbies: cat, coffee, traveling
3. What is a Graph Database?
4. Chart Graph
5. Database - specifically graph • Database: a structured set of data held in a computer, especially one that is accessible in various ways. • Relational? NoSQL? Graph? • Graph database: uses graph structures for semantic queries with nodes, edges and properties to represent and store data.
6. Whiteboard Friendliness Easy to design and model direct representation of the model
7. Whiteboard friendliness
8. The Matrix Cloud Atlas Tom Hanks ACTED_IN Lana Wachowski DIRECTED DIRECTED Hugo Weaving ACTED_IN ACTED_IN Whiteboard friendliness
9. name: Tom Hanks born: 1956 title: Cloud Atlas released: 2012 title: The Matrix released: 1999 name: Lana Wachowski born: 1965 ACTED_IN roles: Zachry ACTED_IN roles: Bill Smoke DIRECTED DIRECTED ACTED_IN roles: Agent Smith name: Hugo Weaving born: 1960 Person Movie Movie Person Director Actor Person Actor Whiteboard friendliness
10. Whiteboard friendliness
11. The property graph model
12. Fundamental Components • Nodes • Relationships • Properties • Labels
13. Car Property Graph Model Components Nodes • Represent the objects in the graph • Can be labeled Person Person
14. Car DRIVES Property Graph Model Components Nodes • Represent the objects in the graph • Can be labeled Relationships • Relate nodes by type and direction LOVES LOVES LIVES WITH OW NS Person Person
15. Car DRIVES name: “Dan” born: May 29, 1970 twitter: “@dan” name: “Ann” born: Dec 5, 1975 since: Jan 10, 2011 brand: “Volvo” model: “V70” Property Graph Model Components Nodes • Represent the objects in the graph • Can be labeled Relationships • Relate nodes by type and direction Properties • Name-value pairs that can go on nodes and relationships. LOVES LOVES LIVES WITH OW NS Person Person
16. Neo4j is a Graph Database
17. Neo4j Fast Reliable No size limit Binary & HTTP protocol ACID transactions 2-4 M
 ops/s per core Clustering scale & HA Official Drivers Neo4j is a database
18. Neo4j Native GraphDB Cypher Query Language Developer Workbench Extensible Procedures & Functions Schema Free Property Graph Model Graph Visualization Graph Storage Neo4j is a graph database
19. Neo4j in Essence….
23. http://www.opencypher.org/
26. openCypher http://www.opencypher.org/
27. https://arxiv.org/pdf/1004.1001.pdf
28. Cypher Query Language…. SQL for graphs
29. Cypher: Powerful and Expressive CREATE (:Person { name:“Dan”}) -[:LOVES]-> (:Person { name:“Ann”}) LOVES Dan Ann LABEL PROPERTY NODE NODE LABEL PROPERTY
30. Offshore Leaks: Graph Databases For Investigative Journalism Panama Papers Paradise Papers
31. Almost 200 journalists Based in 65 countries “Our aim is to bring journalists from different countries together in teams - eliminating rivalry and promoting collaboration. Together, we aim to be the world’s best cross-border investigative team.” — icij.org/about
32. https://offshoreleaks.icij.org/pages/database
33. Common Use Case • Real time recommendations • Fraud Detection • Network & IT Management • Social Networks • Bill of Materials • Knowledge Graphs • Master Data Management • Access Management • Microservices Analysis • IoT • ...
34. Neo4j Mission Statement To help the world make sense of data
37. https://www.govtrack.us/developers bills.csv committees.csv votes.csv
38. SELECT l.name, c.jurisdiction FROM legislators l LEFT JOIN committee c ON c.member_ID=l.thomasID WHERE c.thomasID = “HSAP”
39. SQL ER Diagrams
40. Relational Versus Graph Models Relational Model Graph Model KNOWS KNOWS KNOWS ANDREAS TOBIAS MICA DELIA Person Friend Person-Friend ANDREAS DELIA TOBIAS MICA
41. Graph Database Relational Database A way of representing data
42. https://offshoreleaks.icij.org/pages/database
44. Breakdown of 2.6 TB
45. ICIJ’s Extract Tool • Content extraction from documents • Apache Tika • Redis job queue • Parallel, distributed • Writes to Solr, CSV https://github.com/ICIJ/extract
46. Offshore Leaks Neo4j Data Model
48. Paradise Papers Leak • 1.4TB (13.4 million documents) • Appleby law firm • 19 corporate registries "This leak is important because it's the high end of town. People may have dismissed the Mossack Fonseca leaks as they were rogue players who would take any client. Most of the offshore world is not like that at all. Here you have the gold- plated company.” — Gerard Ryle, ICIJ http://www.bbc.com/news/world-41880153
49. https://www.forbes.com/sites/niallmccarthy/2017/11/06/the-scale-of-the-paradise-papers-leak-infographic/#64dd59276a76
50. http://www.bbc.com/news/world-us-canada-41876939 https://www.icij.org/investigations/paradise-papers/ us-president-donald-trumps-influencers/ What came out of Paradise Papers….
51. https://www.icij.org/investigations/paradise-papers/us-president-donald-trumps-influencers/
52. https://offshoreleaks.icij.org/pages/database Find your own connections….
53. https://offshoreleaks.icij.org/pages/database Neo4j Sandbox Guide:
54. Shortest Path From Queen Of England To Rex Tillerson?
55. All Shortest Paths From Queen Of England To Rex Tillerson?
56. Most Popular Offshore Jurisdictions
57. Most Popular Offshore Jurisdictions By Officer Location
59. http://homesoftherich.net/2014/08/billionaire-sheldon-adelsons-44000-square-foot-las-vegas-mega-mansion/ Address Data
60. Geocoding Addresses http://www.lyonwj.com/2017/11/28/geocoding-paradise-papers-neo4j-spatial-visualization/
61. Geocoding Addresses http://www.lyonwj.com/2017/11/28/geocoding-paradise-papers-neo4j-spatial-visualization/
62. Geocoding Addresses http://www.lyonwj.com/2017/11/28/geocoding-paradise-papers-neo4j-spatial-visualization/
63. http://www.lyonwj.com/2017/11/28/geocoding-paradise-papers-neo4j-spatial-visualization/
64. http://www.lyonwj.com/pp-viz/heatmap/
65. http://www.lyonwj.com/pp-viz/heatmap/
66. http://www.lyonwj.com/2017/11/28/geocoding-paradise-papers-neo4j-spatial-visualization/
67. http://www.lyonwj.com/2017/11/28/geocoding-paradise-papers-neo4j-spatial-visualization/ Paradise Papers vs Panama Papers
68. Make Sense Of Data neo4jsandbox.com
69. Neo4j Desktop For ICIJ https://offshoreleaks.icij.org/pages/database
71. (you)-[:HAVE]->(questions)<-[:ANSWERS]-(jennifer) @JMHReif jennifer.reif@neo4j.com