Event Store Launch

Transcript

1. The Event Store 17th September 2012 Release! Skills Matter, London
2. Agenda •  Demo •  How to interact with the Event Store •  Internal architecture, decisions made •  Something else… •  Summary •  Questions
3. DEMO TIME!
4. There are only 24 bytes of mutable data in the Event Store
5. There are only 24 BYTES of mutable data in the Event Store
6. Transaction File All data goes into a constantly appending file.
7. Transaction File Last Disk Flush
8. Transaction File Last Disk Flush Last Indexed
9. Transaction File The file is built up of many smaller chunks of files.
10. Transaction File Chunk 1 Chunk 0
11. Transaction File Chunk 1 (1MB) Chunk 3 (1MB) Chunk 2 (1MB)
12. Scavenge 7 6 5 4 3 2 1 0 Index has (1,2,7) deleted Scavenge 6 5 4 3 0 6 à 4 5 à 3 4 à 2 3 à 1 0 à 0
13. Transaction File Chunk 1 (1MB) Chunk 3 (1MB) Chunk 2 (1MB) Chunk 1a (1MB-) (items removed)
14. Transaction File Chunk 3 (1MB) Chunk 2 (1MB) Chunk 1a (1MB-) (items removed)
15. TF Scavenge TF Chunks are immutable once written.
16. TF Scavenge Allows indexes and data storage to be scavenged separately.
17. Indexes There is only one index in the Event Store.
18. Indexes Entries in index are 20 bytes each. (so 1 billion items is 20GB!)
19. Memtable 1 (up to 1M)
20. Memtable 1 (up to 1M) Ptable 1 (1M) Last Disk Write
21. Memtable 1 (up to 1M) PTable 1 (1M) Last Disk Write
22. PTable 01 (1M)
23. PTable 02 (1M) PTable 01 (1M)
24. PTable 03 (1M) PTable 02 (1M) PTable 01 (1M)
25. Merge
26. PTable 11 (4M)
27. PTable 11 (4M) PTable 01 (1M)
28. PTable 11 (4M) PTable 01 (1M) PTable 02 (1M)
29. PTable 03 (1M) PTable 11 (4M) PTable 01 (1M) PTable 02 (1M)
30. Merge
31. PTable 11 (4M) PTable 12 (4M)
32. PTable 11 (4M) PTable 01 (1M) PTable 12 (4M)
33. PTable 11 (4M) PTable 01 (1M) PTable 02 (1M) PTable 12 (4M)
34. PTable 03 (1M) PTable 11 (4M) PTable 01 (1M) PTable 02 (1M) PTable 12 (4M)
35. Indexes Indexes are immutable!
36. Indexes Reads have no locks!
37. No toasting of drives!
38. Simple When you look at what you have done and think “Wow, it’s really simple” you have probably done something right.
39. Benchmarks! All benchmarks should be taken lightly for any system. Usually they are biased!
40. Benchmarks! •  Have indexed over 1B items with log(n) performance
41. Benchmarks! •  Have indexed over 1B items with log(n) performance •  Writes! 15,000+/sec over TCP
42. Benchmarks! •  Have indexed over 1B items with log(n) performance •  Writes! 15,000+/sec over TCP •  Reads! 50,000+/sec over TCP
43. Pure async is good.
44. You can do a lot on one thread.
45. Immutability is good.
46. WAT?
47. There is an entire query language!
48. Projections Handle( Handle( Handle(state, Created), Deactivated), Closed)
49. Projections State, Event à State
50. Projections from_all().when( AccountCreated: function(state,event) { state.Name = event.CustomerName; state.Balance = 0; }, TransactionOccurred: function(state,event) { state.Balance += event.value; } );
51. Projections fromAll() fromStream(x,y,z) foreach(account)
52. Projection Indexes Link Link Link Link
53. Projection Indexes from_all().when_any( function(state, event) { emit(‘/streams/’ + event.Type, link_to(event)); } );
54. DEMO TIME!
55. Questions?
56. THANKS!
57. Coming 31st October
58. ONE YEAR FREE SUPPORT On all appliances ordered before 31st October!