Couchbase Mobile Architecture

Presentation from the Couchbase Conference, Sept. 2013.

An overview of the architectural components of Couchbase Lite and the Sync Gateway, and how data flows through them during replication.

Transcript

2. Couchbase  Mobile Technical  Architecture Jens  Al4e jens@couchbase.com
3. High-­‐Level  View
4. High-­‐Level  View                      My  Super  App Couchbase  Lite
5. High-­‐Level  View                      My  Super  App Couchbase  Lite My  Awesome Data  Center Couchbase  Server
6. High-­‐Level  View                      My  Super  App Couchbase  Lite My  Awesome Data  Center Couchbase  Server Sync  Gateway
7. High-­‐Level  View                      My  Super  App Couchbase  Lite My  Awesome Data  Center Couchbase  Server Sync  Gateway
8. Couchbase  Lite  Components Key-­‐Value JSON   Storage Sync   Engine Map/Reduce View  Indexer Query  Engine ApplicaOon  API
9. Couchbase  Lite  Components Key-­‐Value JSON   Storage Sync   Engine Map/Reduce View  Indexer Query  Engine ApplicaOon  API
10. Couchbase  Lite  Components Key-­‐Value JSON   Storage Sync   Engine Map/Reduce View  Indexer Query  Engine ApplicaOon  API
11. Couchbase  Lite  Components Key-­‐Value JSON   Storage Sync   Engine Map/Reduce View  Indexer Query  Engine ApplicaOon  API
12. Couchbase  Lite  Components Key-­‐Value JSON   Storage Sync   Engine Map/Reduce View  Indexer Query  Engine ApplicaOon  API
13. Couchbase  Lite  Components Key-­‐Value JSON   Storage Sync   Engine Map/Reduce View  Indexer Query  Engine ApplicaOon  API
14. Sync  Gateway  Components Sync REST  API Couchbase   Smart  Client Revision/ Conflict   Management AuthenOcaOon App’s  Sync   FuncOon Channel   Change   Tracking External  Auth   Services to  client to  Couchbase  Server
15. Sync  Gateway:  Incoming  Changes Sync REST  API AuthenOcaOon External  Auth   Services
16. Sync  Gateway:  Incoming  Changes Sync REST  API AuthenOcaOon External  Auth   Services • Pushes  changes  from  client: • POST  /db/_revs_diff • POST  /db/_bulk_docs
17. Sync  Gateway:  Incoming  Changes Sync REST  API AuthenOcaOon External  Auth   Services • HTTP  Basic  (over  SSL),  or • Session  cookie
18. Sync  Gateway:  Incoming  Changes Sync REST  API AuthenOcaOon External  Auth   Services • Facebook • Persona  (email-­‐based) • Custom • LDAP,  etc.  *
19. Sync  Gateway:  App  Logic  &  Storage Couchbase   Smart  Client Revision/ Conflict   Management App’s  Sync   FuncOon to  Couchbase  Server AuthenOcaOon
20. Sync  Gateway:  App  Logic  &  Storage Couchbase   Smart  Client Revision/ Conflict   Management App’s  Sync   FuncOon to  Couchbase  Server function(doc,  oldDoc)  { … requireUser(oldDoc.owner); … channel(doc.channel); … access(doc.members,  doc.roomID); } AuthenOcaOon
21. Sync  Gateway:  App  Logic  &  Storage Couchbase   Smart  Client Revision/ Conflict   Management App’s  Sync   FuncOon to  Couchbase  Server function(doc,  oldDoc)  { … requireUser(oldDoc.owner); … channel(doc.channel); … access(doc.members,  doc.roomID); } validaOon AuthenOcaOon
22. Sync  Gateway:  App  Logic  &  Storage Couchbase   Smart  Client Revision/ Conflict   Management App’s  Sync   FuncOon to  Couchbase  Server function(doc,  oldDoc)  { … requireUser(oldDoc.owner); … channel(doc.channel); … access(doc.members,  doc.roomID); } rouOng AuthenOcaOon
23. Sync  Gateway:  App  Logic  &  Storage Couchbase   Smart  Client Revision/ Conflict   Management App’s  Sync   FuncOon to  Couchbase  Server function(doc,  oldDoc)  { … requireUser(oldDoc.owner); … channel(doc.channel); … access(doc.members,  doc.roomID); } access  ctrl AuthenOcaOon
24. Sync  Gateway:  App  Logic  &  Storage Couchbase   Smart  Client Revision/ Conflict   Management App’s  Sync   FuncOon to  Couchbase  Server AuthenOcaOon
25. Sync  Gateway:  App  Logic  &  Storage Couchbase   Smart  Client Revision/ Conflict   Management App’s  Sync   FuncOon to  Couchbase  Server rev 1 rev 2 rev 3a rev 3b AuthenOcaOon
26. Sync  Gateway:  App  Logic  &  Storage Couchbase   Smart  Client Revision/ Conflict   Management App’s  Sync   FuncOon to  Couchbase  Server AuthenOcaOon
27. ¿“Channels”?
28. Jens’  phone Anil’s  phone Proj2 Press   Release
29. What  Channels  Are  For Jens’  phone Anil’s  phone Proj2 Press   Release
30. What  Channels  Are  For proj1 proj2 public sales_Q1 jens Jens’  phone Anil’s  phone Proj2 Press   Release
31. What  Channels  Are  For proj1 proj2 public sales_Q1 jens Jens’  phone Anil’s  phone Proj2 Press   Release
32. What  Channels  Are  For App’s  Sync   FuncOon proj1 proj2 public sales_Q1 jens Jens’  phone Anil’s  phone Proj2 Press   Release
33. What  Channels  Are  For App’s  Sync   FuncOon public proj2 proj1 proj2 public sales_Q1 jens Jens’  phone Anil’s  phone Proj2 Press   Release
34. What  Channels  Are  For App’s  Sync   FuncOon public proj2 proj1 proj2 public sales_Q1 jens Jens’  phone Anil’s  phone Proj2 Press   Release function(doc,  oldDoc)  { channel(doc.projectID); if  (doc.accessLevel  <  1)    channel(“public”); ... }
35. What  Channels  Are  For App’s  Sync   FuncOon public proj2 proj1 proj2 public sales_Q1 jens Jens’  phone Anil’s  phone Proj2 Press   Release
36. What  Channels  Are  For App’s  Sync   FuncOon public proj2 proj1 proj2 public sales_Q1 jens Jens’  phone Anil’s  phone Proj2 Press   Release
37. What  Channels  Are  For App’s  Sync   FuncOon public proj2 proj1 proj2 public sales_Q1 jens Jens’  phone Anil’s  phone Proj2 Press   Release
38. Sync  Gateway  Components Sync REST  API Couchbase   Smart  Client Revision/ Conflict   Management AuthenOcaOon App’s  Sync   FuncOon Channel   Change   Tracking TAP  feed  from  server
39. Sync  Gateway  Components Sync REST  API Couchbase   Smart  Client Revision/ Conflict   Management AuthenOcaOon App’s  Sync   FuncOon Channel   Change   Tracking TAP  feed  from  server
40. Sync  Gateway  Components Sync REST  API Couchbase   Smart  Client Revision/ Conflict   Management AuthenOcaOon App’s  Sync   FuncOon Channel   Change   Tracking TAP  feed  from  server
41. Sync  Gateway  Components Sync REST  API Couchbase   Smart  Client Revision/ Conflict   Management AuthenOcaOon App’s  Sync   FuncOon Channel   Change   Tracking TAP  feed  from  server
42. Sync  Gateway  Components Sync REST  API Couchbase   Smart  Client Revision/ Conflict   Management AuthenOcaOon App’s  Sync   FuncOon Channel   Change   Tracking TAP  feed  from  server ZOMG SERVER PUSH!!
43. docs.couchbase.com/couchbase-­‐lite/cbl-­‐concepts/ docs.couchbase.com/sync-­‐gateway/ Jens  Al4e jens@couchbase.com
44. docs.couchbase.com/couchbase-­‐lite/cbl-­‐concepts/ docs.couchbase.com/sync-­‐gateway/ Jens  Al4e jens@couchbase.com
45. Custom  User  AuthenOcaOon Sync  Gateway Session  Key   Generator Custom  App  Server Couchbase  Lite LDAP,  etc. Auth Auth Back
46. Custom  User  AuthenOcaOon Sync  Gateway Session  Key   Generator Custom  App  Server Couchbase  Lite LDAP,  etc. Auth Auth Back
47. Custom  User  AuthenOcaOon Sync  Gateway Session  Key   Generator Custom  App  Server Couchbase  Lite LDAP,  etc. Auth Auth Back
48. Custom  User  AuthenOcaOon Sync  Gateway Session  Key   Generator Custom  App  Server Couchbase  Lite LDAP,  etc. Auth Auth Back
49. Custom  User  AuthenOcaOon Sync  Gateway Session  Key   Generator Custom  App  Server Couchbase  Lite LDAP,  etc. Auth Auth Back
50. Custom  User  AuthenOcaOon Sync  Gateway Session  Key   Generator Custom  App  Server Couchbase  Lite LDAP,  etc. Auth Auth Back
51. Custom  User  AuthenOcaOon Sync  Gateway Session  Key   Generator Custom  App  Server Couchbase  Lite LDAP,  etc. Auth Auth Back
52. Custom  User  AuthenOcaOon Sync  Gateway Session  Key   Generator Custom  App  Server Couchbase  Lite LDAP,  etc. Auth Auth Back
53. Custom  User  AuthenOcaOon Sync  Gateway Session  Key   Generator Custom  App  Server Couchbase  Lite LDAP,  etc. Auth Auth Back
54. Data  Model  Differences Couchbase  Lite  /  Couchbase  Server • All  docs  are  JSON;  no  binary  opOon • But  you  get  ahachments  (binary,  typed,  unlimited  size) • Revision  IDs  (_rev  field) ­ Revision  ID  matching  (MVCC)  instead  of  CAS ­ Mandatory,  not  opKonal • Revision  tree ­ Conflicts  cause  document  history  to  branch • No  counters  (INC/DEC  operaOons) • Views  never  fall  behind