Introducing Apache CouchDB 2.0 at ApacheCon

Apache CouchDB is a document database featuring an HTTP API, JSON documents, and peer-to-peer replication. Take a tour of the upcoming features and improvements in Apache CouchDB 2.0 including clustering capabilities for horizontal scalability and a declarative MongoDB-style ad hoc querying system. This talk should be of interest to you whether you're new to Apache CouchDB or an experienced Apache CouchDB developer.

Transcript

1. ApacheCon
   Bradley Holt, Developer Advocate
   Friday, May 13, 2016
   Introducing Apache CouchDB 2.0
   @BradleyHolt
   

   View Slide

2. @BradleyHolt
   

   View Slide

3. View Slide

4. IBM Cloud Data Services
   Open for Data
   A comprehensive por.olio of open source data services
   

   View Slide

5. What is Apache CouchDB?
   

   View Slide

6. Document Database
   Apache CouchDB is a JSON document database
   

   View Slide

7. HTTP API
   Apache CouchDB is accessed through an HTTP API
   @BradleyHolt
   GET /
   GET /db/doc
   POST /db
   DELETE /db/doc
   PUT /db/doc
   PUT /db
   

   View Slide

8. Peer-to-Peer Replication
   @BradleyHolt
   Cloudant Sync
   CouchDB PouchDB
   CouchDB Replication Protocol
   CouchDB
   

   View Slide

9. What's new in CouchDB 2.0?
   

   View Slide

10. View Slide

11. View Slide

12. CouchDB 1.x: Standalone
    @BradleyHolt
    CouchDB
    

    View Slide

13. CouchDB 2.0: Clusterered
    @BradleyHolt
    CouchDB
    node1
    CouchDB
    node2
    CouchDB
    node3
    haproxy
    

    View Slide

14. Shards and Replicas
    §  q=8
    –  Number of shards
    –  One or more shards per node
    –  Cannot have more nodes than shards
    §  r=2
    –  Read quorum
    §  w=2
    –  Write quorum
    §  n=3
    –  Number of replicas of every document
    @BradleyHolt
    CouchDB
    node1
    CouchDB
    node2
    CouchDB
    node3
    

    View Slide

15. Mango
    §  Declarative indexes
    §  MongoDB-style query language
    §  You can still use map/reduce views
    @BradleyHolt
    

    View Slide

16. couch_peruser
    @BradleyHolt
    userdb-51d055
    userdb-d76846
    userdb-905cec
    userdb-adc95b
    userdb-c082f2
    userdb-730bba
    userdb-c3d3e5
    userdb-da
    userdb-a1ec1f
    db-85bcfe
    userdb-85a327
    userdb-9b9aba
    

    View Slide

17. View Slide

18. What else is new?
    §  Improved database compaction
    §  Faster index updates
    §  New _bulk_get endpoint for
    optimized replication
    §  View-based filters in _changes feed
    §  Filter _changes feed with _doc_ids
    §  _all_docs and _changes will
    support attachments=true
    @BradleyHolt
    

    View Slide

19. CouchDB 2.0 Developer Preview
    

    View Slide

20. View Slide

21. View Slide

22. View Slide

23. View Slide

24. View Slide

25. Apache CouchDB 2.0 Sandbox Cluster
    Try Apache CouchDB 2.0 on an IBM Cloudant sandbox cluster
    @BradleyHolt
    

    View Slide

26. http-console
    

    View Slide

27. http-console
    $ npm install http-console -g!
    $ http-console 127.0.0.1:5984!
    > http-console 0.6.3!
    > Welcome, enter .help if you're lost.!
    > Connecting to 127.0.0.1 on port 5984.!
    @BradleyHolt
    https://github.com/cloudhead/http-console
    

    View Slide

28. http-console
    http://127.0.0.1:5984/> GET /!
    HTTP/1.1 200 OK!
    Content-Type: text/plain; charset=utf-8!
    !
    {!
    couchdb: 'Welcome',!
    version: '9afa6a0',!
    vendor: { name: 'The Apache Software Foundation' }!
    }
    @BradleyHolt
    https://github.com/cloudhead/http-console
    

    View Slide

29. http-console
    http://127.0.0.1:5984/> .q
    @BradleyHolt
    https://github.com/cloudhead/http-console
    

    View Slide

30. http-console
    $ http-console https://bradley-holt.cloudant.com!
    > http-console 0.6.3!
    > Welcome, enter .help if you're lost.!
    > Connecting to bradley-holt.cloudant.com on port 443.!
    @BradleyHolt
    https://github.com/cloudhead/http-console
    

    View Slide

31. http-console
    https://bradley-holt.cloudant.com:443/> GET /!
    HTTP/1.1 200 OK!
    Content-Type: application/json!
    !
    {!
    couchdb: 'Welcome',!
    version: '9d28c57',!
    vendor: {!
    name: 'IBM Cloudant',!
    version: '5331',!
    variant: 'paas'!
    },!
    features: [ 'geo' ]!
    }!
    @BradleyHolt
    https://github.com/cloudhead/http-console
    

    View Slide

32. http-console
    https://bradley-holt.cloudant.com:443/> .q
    @BradleyHolt
    https://github.com/cloudhead/http-console
    

    View Slide

33. Exploring the CouchDB API
    

    View Slide

34. Connecting to CouchDB 2.0
    $ http-console root:passw0rd@127.0.0.1:5984 --json!
    > http-console 0.6.3!
    > Welcome, enter .help if you're lost.!
    > Connecting to 127.0.0.1 on port 5984.!
    @BradleyHolt
    

    View Slide

35. Connecting to IBM Cloudant
    $ http-console https://bradley-holt:passw0rd@bradley-holt.cloudant.com --json!
    > http-console 0.6.3!
    > Welcome, enter .help if you're lost.!
    > Connecting to bradley-holt.cloudant.com on port 443.!
    @BradleyHolt
    

    View Slide

36. Request Headers
    /> .headers!
    Accept: application/json!
    Content-Type: application/json!
    Authorization: Basic cm9vdDorMi95N3Y2aA==!
    Host: 127.0.0.1!
    @BradleyHolt
    

    View Slide

37. PUT a Database
    /> PUT /kittens!
    ... !
    HTTP/1.1 201 Created!
    Content-Type: application/json!
    Location: http://127.0.0.1/kittens!
    !
    { ok: true }!
    @BradleyHolt
    

    View Slide

38. PUT a Database Again
    /> PUT /kittens!
    ... !
    HTTP/1.1 412 Precondition Failed!
    Content-Type: application/json!
    !
    { error: 'file_exists', reason: 'The database could not be created, the file
    already exists.' }!
    @BradleyHolt
    

    View Slide

39. POST a Document
    /> /kittens!
    @BradleyHolt
    

    View Slide

40. POST a Document
    /kittens> POST /!
    ... { "_id": "mittens", "age_weeks": 10, "weight_kilograms": 0.997 }!
    HTTP/1.1 201 Created!
    Content-Type: application/json!
    Location: http://127.0.0.1/kittens/mittens!
    !
    {!
    ok: true,!
    id: 'mittens',!
    rev: '1-e665a40d9ea9711c983e907f0b0b6e8a'!
    }!
    @BradleyHolt
    

    View Slide

41. GET All Documents
    /kittens> GET /_all_docs!
    HTTP/1.1 200 OK!
    Content-Type: application/json!
    Etag: "92afa0f309a9fd9f140cd31ff5000b5c"!
    !
    {!
    total_rows: 1,!
    offset: 0,!
    rows: [!
    {!
    id: 'mittens',!
    key: 'mittens',!
    value: { rev: '1-e665a40d9ea9711c983e907f0b0b6e8a' }!
    }!
    ]!
    }!
    @BradleyHolt
    

    View Slide

42. GET a Document
    /kittens> GET /mittens!
    HTTP/1.1 200 OK!
    Content-Type: application/json!
    Etag: "1-e665a40d9ea9711c983e907f0b0b6e8a"!
    !
    {!
    _id: 'mittens',!
    _rev: '1-e665a40d9ea9711c983e907f0b0b6e8a',!
    age_weeks: 10,!
    weight_kilograms: 0.997!
    }!
    @BradleyHolt
    

    View Slide

43. PUT an Attachment
    /kittens> .headers!
    Accept: application/json!
    Content-Type: application/json!
    Authorization: Basic cm9vdDorMi95N3Y2aA==!
    Host: 127.0.0.1!
    /kittens> Content-Type: image/gif!
    @BradleyHolt
    

    View Slide

44. PUT an Attachment
    /kittens> PUT /mittens/photo?rev=1-e665a40d9ea9711c983e907f0b0b6e8a!
    ... R0lGODlhAQABAIAAAP///wAAACwAAAAAAQABAAACAkQBADs=!
    HTTP/1.1 201 Created!
    Content-Type: application/json!
    Location: http://127.0.0.1/kittens/mittens/photo!
    !
    {!
    ok: true,!
    id: 'mittens',!
    rev: '2-d858e51453a5785bafe517b7eddc5a98'!
    }!
    /kittens> Content-Type: application/json!
    @BradleyHolt
    

    View Slide

45. GET an Attachment
    /kittens> GET /mittens/photo!
    HTTP/1.1 200 OK!
    Content-Type: image/gif!
    Etag: "UsqjdPnY6ApD2ENFOglFHg=="!
    !
    R0lGODlhAQABAIAAAP///wAAACwAAAAAAQABAAACAkQBADs=!
    @BradleyHolt
    

    View Slide

46. Conditional Caching
    /kittens> If-None-Match: "UsqjdPnY6ApD2ENFOglFHg=="!
    /kittens> GET /mittens/photo!
    HTTP/1.1 304 Not Modified!
    !
    /kittens> If-None-Match:!
    @BradleyHolt
    

    View Slide

47. DELETE a Document
    /kittens> DELETE /mittens!
    HTTP/1.1 409 Conflict!
    Content-Type: application/json!
    !
    { error: 'conflict', reason: 'Document update conflict.' }!
    @BradleyHolt
    

    View Slide

48. DELETE a Document
    /kittens> HEAD /mittens!
    HTTP/1.1 200 OK!
    Etag: "2-d858e51453a5785bafe517b7eddc5a98"!
    !
    @BradleyHolt
    

    View Slide

49. DELETE a Document
    /kittens> If-Match: "2-d858e51453a5785bafe517b7eddc5a98"!
    /kittens> DELETE /mittens!
    HTTP/1.1 200 OK!
    Content-Type: application/json!
    !
    {!
    ok: true,!
    id: 'mittens',!
    rev: '3-d0780627ddff7a7f536fe273100cec41'!
    }!
    /kittens> If-Match:!
    @BradleyHolt
    

    View Slide

50. Replication
    /kittens> ..!
    /> DELETE /kittens!
    HTTP/1.1 200 OK!
    Content-Type: application/json!
    !
    { ok: true }!
    @BradleyHolt
    

    View Slide

51. Replication
    /> POST /_replicate!
    ... { "create_target": true, "source": "https://bradley-holt.cloudant.com/
    kittens", "target": "kittens" }!
    HTTP/1.1 200 OK!
    Content-Type: application/json!
    !
    {!
    ok: true,!
    session_id: '9f7bd286a0001ece5bf0bf65dd83c5ab',!
    source_last_seq: '5-
    g1AAAAFDeJzLYWBgYMlgTmGQT0lKzi9KdUhJMtVLykxPyilN1UvOyS9NScwr0ctLLckBKmRKZEiy___
    _f1YiA6oWQ9xakhyAZFI9SFcGcyJzLpDHbplmZmxkaULYBKIdlscCJBkagBTQov2kuA-
    i8wBEJ9iNTGA3mhoampmnGBA2JQsA1LtoyA',!
    …!
    }!
    @BradleyHolt
    

    View Slide

52. View Slide

53. Mango
    /> /kittens!
    @BradleyHolt
    

    View Slide

54. Mango
    /kittens> POST /_index!
    ... { "index": { "fields": [ "age_weeks", "weight_kilograms" ] } }!
    HTTP/1.1 200 OK!
    Content-Type: application/json!
    !
    {!
    result: 'created',!
    id: '_design/e19dde7f518129a966ebe072edc66be88d54e694',!
    name: 'e19dde7f518129a966ebe072edc66be88d54e694'!
    }!
    @BradleyHolt
    

    View Slide

55. @BradleyHolt
    

    View Slide

56. Mango
    /kittens> POST /_find!
    ... { "selector": { "age_weeks": { "$gte": 7, "$lte": 10 } }, "fields":
    [ "_id", "age_weeks" ] }!
    HTTP/1.1 200 OK!
    Content-Type: application/json!
    !
    {!
    docs: [!
    { _id: 'tiger', age_weeks: 7 },!
    { _id: 'daisy', age_weeks: 9 },!
    { _id: 'mittens', age_weeks: 10 }!
    ]!
    }!
    @BradleyHolt
    

    View Slide

57. @BradleyHolt
    

    View Slide

58. @BradleyHolt
    

    View Slide

59. @BradleyHolt
    

    View Slide

60. Mango
    /kittens> POST /_find!
    ... { "selector": { "age_weeks": { "$gte": 0 }, "weight_kilograms": { "$gte":
    0.5, "$lte": 1 } }, "fields": [ "_id", "weight_kilograms" ] }!
    HTTP/1.1 200 OK!
    Content-Type: application/json!
    !
    {!
    docs: [!
    { _id: 'tiger', weight_kilograms: 0.726 },!
    { _id: 'daisy', weight_kilograms: 0.816 },!
    { _id: 'mittens', weight_kilograms: 0.997 }!
    ]!
    }!
    @BradleyHolt
    

    View Slide

61. @BradleyHolt
    

    View Slide

62. @BradleyHolt
    

    View Slide

63. @BradleyHolt
    

    View Slide

64. Contributing
    

    View Slide

65. View Slide

66. View Slide

67. Offline Camp
    June 24th - 26th, Catskill Mountains
    

    View Slide

68. offlinefirst.org/camp
    

    View Slide

69. Image Credits
    §  paper by malik, on Flickr
    §  person by Tim Morgan, on Flickr
    §  database by Tim Morgan, on Flickr
    §  gear by Tim Morgan, on Flickr
    §  Mango with section on a white background by bangdoll, on Flickr
    @BradleyHolt
    

    View Slide

70. Questions?
    @BradleyHolt
    

    View Slide