Import ViennaJS group data from meetup.com into Neo4j

Transcript

1. Using Neo4j with node Importing viennajs data from meetup.com to Neo4j github.com/thomasfr fritztho@gmail.com @thomasfr
2. Who am i
4. • Thomas Fritz (Fritz is my family name :) )
5. • Thomas Fritz (Fritz is my family name :) )
6. • Thomas Fritz (Fritz is my family name :) ) • Worked for several Internet / Web companies in the past
7. • Thomas Fritz (Fritz is my family name :) ) • Worked for several Internet / Web companies in the past • Did PHP, Java, JavaScript (Browser and node.js), RDBMS, Triple/Quad Stores, redis, Mongo and Neo4J,…
8. • Thomas Fritz (Fritz is my family name :) ) • Worked for several Internet / Web companies in the past • Did PHP, Java, JavaScript (Browser and node.js), RDBMS, Triple/Quad Stores, redis, Mongo and Neo4J,… • Occasionally co-organizer
10. Graph Intro
11. What is NOT a graph
13. • This is a diagram or chart
14. • This is a diagram or chart • Maybe a graphic
15. • This is a diagram or chart • Maybe a graphic • But not a graph
16. • This is a diagram or chart • Maybe a graphic • But not a graph Ham Hamster
17. What is a graph
18. Hi my name is Leonhard Euler I had a problem with some bridges. 7 bridges to be correct. I wanted to find a walk through the city that would cross each bridge once and only once.
23. Modern Graphs
24. • Google Knowledge Graph Modern Graphs
25. Modern Graphs
26. • Facebook OpenGraph Modern Graphs
27. Graphs in
28. Graphs in Neo4j
29. Graphs in Neo4j • Property Graph Data Model
30. Graphs in Neo4j • Property Graph Data Model • Node
31. Graphs in Neo4j • Property Graph Data Model • Node
32. Graphs in Neo4j • Property Graph Data Model • Node • with optional Labels
33. Graphs in Neo4j • Property Graph Data Model • Node • with optional Labels Label
34. Graphs in Neo4j • Property Graph Data Model • Node • with optional Labels • Relationship Label
35. Graphs in Neo4j • Property Graph Data Model • Node • with optional Labels • Relationship • is directed Label
36. Graphs in Neo4j • Property Graph Data Model • Node • with optional Labels • Relationship • is directed Label
37. Graphs in Neo4j • Property Graph Data Model • Node • with optional Labels • Relationship • is directed • has a type identifier Label
38. Graphs in Neo4j • Property Graph Data Model • Node • with optional Labels • Relationship • is directed • has a type identifier type Label
39. Graphs in Neo4j • Property Graph Data Model • Node • with optional Labels • Relationship • is directed • has a type identifier • Properties type Label
40. Graphs in Neo4j • Property Graph Data Model • Node • with optional Labels • Relationship • is directed • has a type identifier • Properties name: Foo city: Vienna type Label
43. name: Vienna
44. name: Vienna
45. name: Vienna name: Austria
46. name: Vienna name: Austria
47. name: Vienna name: Austria locatedIn
48. name: Vienna name: Austria locatedIn
49. name: Vienna name: Austria locatedIn name: Europe
50. name: Vienna name: Austria locatedIn name: Europe
51. name: Vienna name: Austria locatedIn name: Europe locatedIn
52. name: Vienna name: Austria locatedIn name: Europe locatedIn
53. name: Vienna name: Austria locatedIn name: Europe locatedIn name: Thomas Fritz
54. name: Vienna name: Austria locatedIn name: Europe locatedIn name: Thomas Fritz
55. name: Vienna name: Austria locatedIn name: Europe livesIn locatedIn name: Thomas Fritz
56. name: Vienna name: Austria locatedIn name: Europe livesIn locatedIn name: Thomas Fritz City
57. name: Vienna name: Austria locatedIn name: Europe livesIn locatedIn name: Thomas Fritz City Country
58. name: Vienna name: Austria locatedIn name: Europe livesIn locatedIn name: Thomas Fritz City Country Continent
59. name: Vienna name: Austria locatedIn name: Europe livesIn locatedIn name: Thomas Fritz City Country Continent Person
61. • aaaaannnnndddddd…
62. • aaaaannnnndddddd… • Neo4j is written in Java
65. Bullshit?
66. NO
67. ViennaJS data on meetup.com
68. 1. Draw the data model on meetup.com
71. Group
72. name: ViennaJS Group
73. name: ViennaJS Group
74. locatedIn name: ViennaJS Group
75. locatedIn name: ViennaJS Group
76. locatedIn name: ViennaJS City Group
77. locatedIn name: ViennaJS name: Vienna City Group
78. locatedIn name: ViennaJS name: Vienna City Group
79. locatedIn name: ViennaJS name: Vienna City Group User
80. locatedIn name: ViennaJS name: Vienna name: Thomas Fritz City Group User
81. locatedIn name: ViennaJS name: Vienna name: Thomas Fritz City Group User
82. locatedIn name: ViennaJS name: Vienna name: Thomas Fritz memberOf City Group User
83. locatedIn name: ViennaJS name: Vienna name: Thomas Fritz memberOf City Group User
84. locatedIn name: ViennaJS name: Vienna name: Thomas Fritz memberOf City Group User Topic
85. locatedIn name: ViennaJS name: Vienna name: Thomas Fritz memberOf City Group User Topic name: JavaScript
86. locatedIn name: ViennaJS name: Vienna name: Thomas Fritz memberOf City Group User Topic name: JavaScript
87. locatedIn name: ViennaJS name: Vienna name: Thomas Fritz memberOf interestedIn City Group User Topic name: JavaScript
88. locatedIn name: ViennaJS name: Vienna name: Thomas Fritz memberOf interestedIn City Group User Topic name: JavaScript
89. locatedIn name: ViennaJS name: Vienna name: Thomas Fritz memberOf interestedIn isAbout City Group User Topic name: JavaScript
90. locatedIn name: ViennaJS name: Vienna name: Thomas Fritz memberOf interestedIn isAbout City Group User Topic name: JavaScript
91. locatedIn name: ViennaJS name: Vienna name: Thomas Fritz memberOf interestedIn isAbout City Group Meetup User Topic name: JavaScript
92. locatedIn name: ViennaJS name: Vienna name: Thomas Fritz memberOf interestedIn name: Monthly Meetup isAbout City Group Meetup User Topic name: JavaScript
93. locatedIn name: ViennaJS name: Vienna name: Thomas Fritz memberOf interestedIn name: Monthly Meetup date: 27.11.2013 isAbout City Group Meetup User Topic name: JavaScript
94. locatedIn name: ViennaJS name: Vienna name: Thomas Fritz memberOf interestedIn name: Monthly Meetup date: 27.11.2013 isAbout City Group Meetup User Topic name: JavaScript
95. locatedIn name: ViennaJS name: Vienna name: Thomas Fritz memberOf interestedIn name: Monthly Meetup date: 27.11.2013 hostedBy isAbout City Group Meetup User Topic name: JavaScript
96. locatedIn name: ViennaJS name: Vienna name: Thomas Fritz memberOf interestedIn name: Monthly Meetup date: 27.11.2013 hostedBy isAbout City Group Meetup User Topic name: JavaScript
97. locatedIn name: ViennaJS name: Vienna name: Thomas Fritz memberOf interestedIn name: Monthly Meetup date: 27.11.2013 hostedBy isAbout City Group Venue Meetup User Topic name: JavaScript
98. locatedIn name: ViennaJS name: Vienna name: Thomas Fritz memberOf interestedIn name: Monthly Meetup date: 27.11.2013 hostedBy name: Sektor5 isAbout City Group Venue Meetup User Topic name: JavaScript
99. locatedIn name: ViennaJS name: Vienna name: Thomas Fritz memberOf interestedIn name: Monthly Meetup date: 27.11.2013 hostedBy name: Sektor5 isAbout City Group Venue Meetup User Topic name: JavaScript
100. locatedIn name: ViennaJS name: Vienna name: Thomas Fritz memberOf interestedIn name: Monthly Meetup date: 27.11.2013 hostedBy name: Sektor5 takesPlaceAt isAbout City Group Venue Meetup User Topic name: JavaScript
101. locatedIn name: ViennaJS name: Vienna name: Thomas Fritz memberOf interestedIn name: Monthly Meetup date: 27.11.2013 hostedBy name: Sektor5 takesPlaceAt isAbout City Group Venue Meetup User Topic name: JavaScript
102. locatedIn name: ViennaJS name: Vienna name: Thomas Fritz memberOf interestedIn name: Monthly Meetup date: 27.11.2013 hostedBy name: Sektor5 takesPlaceAt isAbout locatedIn City Group Venue Meetup User Topic name: JavaScript
103. locatedIn name: ViennaJS name: Vienna name: Thomas Fritz memberOf interestedIn name: Monthly Meetup date: 27.11.2013 hostedBy name: Sektor5 takesPlaceAt isAbout locatedIn City Group Venue Meetup User Topic name: JavaScript
104. locatedIn name: ViennaJS name: Vienna name: Thomas Fritz memberOf interestedIn name: Monthly Meetup date: 27.11.2013 hostedBy name: Sektor5 takesPlaceAt isAbout locatedIn isAttending City Group Venue Meetup User Topic name: JavaScript
105. locatedIn name: ViennaJS name: Vienna name: Thomas Fritz memberOf interestedIn name: Monthly Meetup date: 27.11.2013 hostedBy name: Sektor5 takesPlaceAt isAbout locatedIn isAttending City Group Venue Meetup User Topic name: JavaScript
106. locatedIn name: ViennaJS name: Vienna name: Thomas Fritz memberOf interestedIn name: Monthly Meetup date: 27.11.2013 hostedBy name: Sektor5 takesPlaceAt isAbout locatedIn isAttending City Group Venue Meetup User Topic name: JavaScript
107. locatedIn name: ViennaJS name: Vienna name: Thomas Fritz memberOf interestedIn name: Monthly Meetup date: 27.11.2013 hostedBy name: Sektor5 takesPlaceAt isAbout locatedIn isAttending City Group Venue Meetup User Topic name: JavaScript
108. locatedIn name: ViennaJS name: Vienna name: Thomas Fritz memberOf interestedIn name: Monthly Meetup date: 27.11.2013 hostedBy name: Sektor5 takesPlaceAt isAbout locatedIn isAttending City Group Venue Meetup User Topic name: JavaScript Node
109. locatedIn name: ViennaJS name: Vienna name: Thomas Fritz memberOf interestedIn name: Monthly Meetup date: 27.11.2013 hostedBy name: Sektor5 takesPlaceAt isAbout locatedIn isAttending City Group Venue Meetup User Topic name: JavaScript name: ViennaJS Node
110. locatedIn name: ViennaJS name: Vienna name: Thomas Fritz memberOf interestedIn name: Monthly Meetup date: 27.11.2013 hostedBy name: Sektor5 takesPlaceAt isAbout locatedIn isAttending City Group Venue Meetup User Topic name: JavaScript name: ViennaJS Node Properties
111. locatedIn name: ViennaJS name: Vienna name: Thomas Fritz memberOf interestedIn name: Monthly Meetup date: 27.11.2013 hostedBy name: Sektor5 takesPlaceAt isAbout locatedIn isAttending City Group Venue Meetup User Topic name: JavaScript locatedIn name: ViennaJS Node Properties
112. locatedIn name: ViennaJS name: Vienna name: Thomas Fritz memberOf interestedIn name: Monthly Meetup date: 27.11.2013 hostedBy name: Sektor5 takesPlaceAt isAbout locatedIn isAttending City Group Venue Meetup User Topic name: JavaScript locatedIn name: ViennaJS Node Properties Relation
113. locatedIn name: ViennaJS name: Vienna name: Thomas Fritz memberOf interestedIn name: Monthly Meetup date: 27.11.2013 hostedBy name: Sektor5 takesPlaceAt isAbout locatedIn isAttending City Group Venue Meetup User Topic name: JavaScript locatedIn name: ViennaJS Group Node Properties Relation
114. locatedIn name: ViennaJS name: Vienna name: Thomas Fritz memberOf interestedIn name: Monthly Meetup date: 27.11.2013 hostedBy name: Sektor5 takesPlaceAt isAbout locatedIn isAttending City Group Venue Meetup User Topic name: JavaScript locatedIn name: ViennaJS Group Node Properties Relation Label
116. • Export Data from meetup (https://github.com/thomasfr/ ViennaJS/blob/master/meetup-import.coffee)
117. • Export Data from meetup (https://github.com/thomasfr/ ViennaJS/blob/master/meetup-import.coffee) • Import Data into Neo4j
118. • Export Data from meetup (https://github.com/thomasfr/ ViennaJS/blob/master/meetup-import.coffee) • Import Data into Neo4j • Batch Importer
119. • Export Data from meetup (https://github.com/thomasfr/ ViennaJS/blob/master/meetup-import.coffee) • Import Data into Neo4j • Batch Importer • better and faster for huge amount of data
120. • Export Data from meetup (https://github.com/thomasfr/ ViennaJS/blob/master/meetup-import.coffee) • Import Data into Neo4j • Batch Importer • better and faster for huge amount of data • N-Triples like notation
121. • Export Data from meetup (https://github.com/thomasfr/ ViennaJS/blob/master/meetup-import.coffee) • Import Data into Neo4j • Batch Importer • better and faster for huge amount of data • N-Triples like notation • Query Language —> Cypher
122. Cypher or learn how to draw ascii art
123. Cypher • SQL and SparQL inspired • Full CRUD • Create, Read, Update, Delete • Manage indexes manually
124. What it looks like
125. What it looks like locatedIn name: ViennaJS name: Vienna City Group
126. What it looks like locatedIn name: ViennaJS name: Vienna (node1:Group)-[relation:locatedIn]->(node2:City) City Group
127. What it looks like locatedIn name: ViennaJS name: Vienna (node1:Group)-[relation:locatedIn]->(node2:City) City Group (n1:Group{name:“ViennaJS“)-[r:locatedIn]->(n2:City{name:“Vienna“})
128. What it looks like locatedIn name: ViennaJS name: Vienna (node1:Group)-[relation:locatedIn]->(node2:City) City Group (n1:Group{name:“ViennaJS“)-[r:locatedIn]->(n2:City{name:“Vienna“}) MATCH (group:Group)-[r:locatedIn]->(vienna:City{name:“Vienna“}) RETURN group.name, group.description, group.lon, group.lat, vienna.name
129. Live Demo
130. Thank you