Big Data - Introducing Neo4J

Presentation given by Jim Webber at recent 'Big Data Bash' in Belfast, introducing graph-based databases and Neo4J (See http://instil.co/2012/08/21/big-data-bash/)

Transcript

1. Introducing Neo4j Dr. Jim Webber Chief Scientist, Neo Technology @jimwebber
3. http://slantmagazine.com/film/review/saturday-night- fever/4210
4. http://freenewfoundlandlabrador.blogspot.com/2011/07/nl-fisheries-500-years-o
5. http://www.oopsla.org/oopsla2008/
6. http://uncyclopedia.wikia.com/wiki/File:Square-
7. http://www.telegraph.co.uk/finance/newsbysector/industry/8470355/The-fall-and-rise-of-the-British-car-
8. http://www.answers.com/topic/margaret-thatcher-large-
9. Bomb the argies! Crush the miners! Defy Europe! I’m CEO, bitch! http://www.answers.com/topic/margaret-thatcher-large-
10. http://www.themoviedb.org/movie/
11. http://www.themoviedb.org/movie/
12. http://iremedy.net/blog/2010/05/your-office-without-
14. Share everything! Privacy schmivacy! Social graph! I’m CEO, bitch!
16. http://www.flickr.com/photos/crazyneighborlady/3552
17. http://gallery.nen.gov.uk/
18. http://www.xtranormal.com/watch/6995033/mongo-db-
19. complexity = f(size, connectedness, uniformity)
23. from
24. stole from
25. stole from enemy
26. stole from enemy enemy
27. stole from enemy enemy enemy
28. stole from enemy enemy companio n companio n enemy
29. stole from loves loves enemy enemy companio n companio n enemy
30. stole from loves loves enemy enemy Victory of the Daleks appeared in appeared in companio n companio n enemy
31. stole from loves loves enemy enemy A Good Man Goes to War appeared in appeared in appeared in appeared in Victory of the Daleks appeared in appeared in companio n companio n enemy
32. Neo4j: Creating Nodes GraphDatabaseService db = new EmbeddedGraphDatabase("/tmp/neo");
33. Neo4j: Creating Nodes GraphDatabaseService db = new EmbeddedGraphDatabase("/tmp/neo"); Transaction tx = db.beginTx();
34. Neo4j: Creating Nodes GraphDatabaseService db = new EmbeddedGraphDatabase("/tmp/neo"); Transaction tx = db.beginTx(); try {
35. Neo4j: Creating Nodes GraphDatabaseService db = new EmbeddedGraphDatabase("/tmp/neo"); Transaction tx = db.beginTx(); try { Node theDoctor = db.createNode();
36. Neo4j: Creating Nodes GraphDatabaseService db = new EmbeddedGraphDatabase("/tmp/neo"); Transaction tx = db.beginTx(); try { Node theDoctor = db.createNode(); theDoctor.setProperty("name", "the Doctor");
37. Neo4j: Creating Nodes GraphDatabaseService db = new EmbeddedGraphDatabase("/tmp/neo"); Transaction tx = db.beginTx(); try { Node theDoctor = db.createNode(); theDoctor.setProperty("name", "the Doctor"); tx.success();
38. Neo4j: Creating Nodes GraphDatabaseService db = new EmbeddedGraphDatabase("/tmp/neo"); Transaction tx = db.beginTx(); try { Node theDoctor = db.createNode(); theDoctor.setProperty("name", "the Doctor"); tx.success(); } finally {
39. Neo4j: Creating Nodes GraphDatabaseService db = new EmbeddedGraphDatabase("/tmp/neo"); Transaction tx = db.beginTx(); try { Node theDoctor = db.createNode(); theDoctor.setProperty("name", "the Doctor"); tx.success(); } finally { tx.finish();
40. Neo4j: Creating Nodes GraphDatabaseService db = new EmbeddedGraphDatabase("/tmp/neo"); Transaction tx = db.beginTx(); try { Node theDoctor = db.createNode(); theDoctor.setProperty("name", "the Doctor"); tx.success(); } finally { tx.finish(); }
42. Neo4j: Creating Relationships Transaction tx = db.beginTx(); try { Node theDoctor = db.createNode(); theDoctor.setProperty("name", "The Doctor"); Node susan = db.createNode(); susan.setProperty("firstname", "Susan"); susan.setProperty("lastname", "Campbell"); susan.createRelationshipTo(theDoctor, COMPANION_OF)); tx.success(); } finally { tx.finish(); }
43. HIPSTER DEVS, Y U NO LIKE
44. Cypher – A Humane “Query” Language // Create a simple graph CREATE doctor = { character : 'Doctor' }, master = { character : 'Master' }, (doctor)<-[e:ENEMY_OF]-(master)
45. Cypher – A Humane “Query” Language // Create a simple graph CREATE doctor = { character : 'Doctor' }, master = { character : 'Master' }, (doctor)<-[e:ENEMY_OF]-(master) // Add some data into it
46. Cypher – A Humane “Query” Language // Create a simple graph CREATE doctor = { character : 'Doctor' }, master = { character : 'Master' }, (doctor)<-[e:ENEMY_OF]-(master) // Add some data into it SET doctor.awesomeness = 11
47. Cypher – A Humane “Query” Language // Create a simple graph CREATE doctor = { character : 'Doctor' }, master = { character : 'Master' }, (doctor)<-[e:ENEMY_OF]-(master) // Add some data into it SET doctor.awesomeness = 11 SET master.niceness = “very”
48. Cypher – A Humane “Query” Language // Create a simple graph CREATE doctor = { character : 'Doctor' }, master = { character : 'Master' }, (doctor)<-[e:ENEMY_OF]-(master) // Add some data into it SET doctor.awesomeness = 11 SET master.niceness = “very” SET e.weight = 100
49. Cypher – A Humane “Query” Language // Create a simple graph CREATE doctor = { character : 'Doctor' }, master = { character : 'Master' }, (doctor)<-[e:ENEMY_OF]-(master) // Add some data into it SET doctor.awesomeness = 11 SET master.niceness = “very” SET e.weight = 100
50. Cypher – A Humane “Query” Language // Create a simple graph CREATE doctor = { character : 'Doctor' }, master = { character : 'Master' }, (doctor)<-[e:ENEMY_OF]-(master) // Add some data into it SET doctor.awesomeness = 11 SET master.niceness = “very” SET e.weight = 100
51. Cypher – A Humane “Query” Language // Create a simple graph CREATE doctor = { character : 'Doctor' }, master = { character : 'Master' }, (doctor)<-[e:ENEMY_OF]-(master) // Add some data into it SET doctor.awesomeness = 11 SET master.niceness = “very” SET e.weight = 100 // Ooops!
52. Cypher – A Humane “Query” Language // Create a simple graph CREATE doctor = { character : 'Doctor' }, master = { character : 'Master' }, (doctor)<-[e:ENEMY_OF]-(master) // Add some data into it SET doctor.awesomeness = 11 SET master.niceness = “very” SET e.weight = 100 // Ooops! DELETE master.niceness
53. Cypher – A Humane “Query” Language // Create a simple graph CREATE doctor = { character : 'Doctor' }, master = { character : 'Master' }, (doctor)<-[e:ENEMY_OF]-(master) // Add some data into it SET doctor.awesomeness = 11 SET master.niceness = “very” SET e.weight = 100 // Ooops! DELETE master.niceness SET master.nastiness = “100%”
55. character: Doctor actor: ??? episode: ??? title: ??? species: Cyberman ASCII Art Queries!
56. character: Doctor actor: ??? episode: ??? title: ??? species: Cyberman -[:PLAYED]-> -[:APPEARED_IN]-> <-[:APPEARED_IN]- ASCII Art Queries!
57. -[:PLAYED]-> -[:APPEARED_IN]-> <-[:APPEARED_IN]- ASCII Art Queries!
58. -[:PLAYED]-> -[:APPEARED_IN]-> <-[:APPEARED_IN]- ASCII Art Queries! (Doctor) (Actor) (Episode) (Cyberman)
59. ASCII Art Queries! match (doctor)<-[:PLAYED]-(actor) -[:APPEARED_IN]->(ep) <-[:APPEARED_IN]-(cybermen)
60. Full Cypher Query
61. Full Cypher Query start doctor=node:characters(character='Doctor'), cybermen=node:species(species='Cyberman')
62. Full Cypher Query start doctor=node:characters(character='Doctor'), cybermen=node:species(species='Cyberman')
63. Full Cypher Query start doctor=node:characters(character='Doctor'), cybermen=node:species(species='Cyberman') match (doctor)<-[:PLAYED]-(actor) -[:APPEARED_IN]->(ep) <-[:APPEARED_IN]-(cybermen)
64. Full Cypher Query start doctor=node:characters(character='Doctor'), cybermen=node:species(species='Cyberman') match (doctor)<-[:PLAYED]-(actor) -[:APPEARED_IN]->(ep) <-[:APPEARED_IN]-(cybermen)
65. Full Cypher Query start doctor=node:characters(character='Doctor'), cybermen=node:species(species='Cyberman') match (doctor)<-[:PLAYED]-(actor) -[:APPEARED_IN]->(ep) <-[:APPEARED_IN]-(cybermen) where ep.title and ep.episode
66. Full Cypher Query start doctor=node:characters(character='Doctor'), cybermen=node:species(species='Cyberman') match (doctor)<-[:PLAYED]-(actor) -[:APPEARED_IN]->(ep) <-[:APPEARED_IN]-(cybermen) where ep.title and ep.episode
67. Full Cypher Query start doctor=node:characters(character='Doctor'), cybermen=node:species(species='Cyberman') match (doctor)<-[:PLAYED]-(actor) -[:APPEARED_IN]->(ep) <-[:APPEARED_IN]-(cybermen) where ep.title and ep.episode return ep.title, actor.actor
70. HTTP + Cold cache
71. • Adobe Creative Cloud – Gazillions of social – Single large global cluster • Thingdom – Node.js, Neo4j – Now acquired by FiftyThree • Cisco network management – Nuff said • And now… Bingo Friendzy – Facebook gaming app from Gamesys
73. Thanks for Web: http:// neo4j.org