Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Consistency & Elasticsearch

Elasticsearch Inc
November 04, 2013
Technology
2
1.2k

Consistency & Elasticsearch

Fun with working around eventual consistency!

Elasticsearch Inc

November 04, 2013
Tweet

More Decks by Elasticsearch Inc

See All by Elasticsearch Inc
OSCON: Scaling a distributed engineering team from 50-250
elasticsearch
13
1.3k
Stuff a Search Engine Can Do
elasticsearch
17
1.6k
Using Elastic to monitor anything
elasticsearch
3
1.5k
Log all the things!
elasticsearch
4
1k
Why Elastic? @ 50th Vinitaly 2016
elasticsearch
5
1.9k
What's New In Elasticland?
elasticsearch
3
760
Kibana, Timelion, Graph Meetup
elasticsearch
3
740
Elastic for Time Series Data and Predictive Analytics
elasticsearch
4
2.8k
Elastic 2.0
elasticsearch
1
700

Other Decks in Technology

See All in Technology
けっきょくmROS 2ってなんなのか？
takasehideki
0
200
Digital campaign
bau
0
200
aws-vault を使った セキュアなアクセスキー管理 / Manage AWS Access Key More Securely By Using aws-vault
kizashi1122
0
130
[DroidKaigi 2022] 詳解Google Playの新しい定期購入 ~オファーの活用や実装例を添えて~
syarihu
0
100
Practices of an Engineering Manager: Working in The Read World
koic
6
1.7k
C言語を知らない人がびっくりしそうなC言語の特徴
sat
PRO
0
170
[PHP Conference Japan 2022] スケールアウト可能なマネージドデータベースサービスTiDB Cloudのご紹介
pingcap0315
0
180
一休. com/Yahoo!トラベルのNuxt3移行における開発プロセス
sugitat
4
3.6k
Renewal of UIT INSIDE beyonds native app and web
line_developers
PRO
1
110
JaSST Review 22 Introduction / JaSST Review'22 内容紹介
nihonbuson
0
170
今から始める Amplify Studio #stapy
tacck
0
290
PHPerが再利用可能な情報提供でオフショア先とコード品質向上に取り組む / PHPer try improve the code quality
ykanoh
0
380

Featured

See All Featured
Debugging Ruby Performance
tmm1
66
11k
Principles of Awesome APIs and How to Build Them.
keavy
114
15k
Art, The Web, and Tiny UX
lynnandtonic
281
18k
The Success of Rails: Ensuring Growth for the Next 100 Years
eileencodes
20
4.1k
Mobile First: as difficult as doing things right
swwweet
213
7.6k
Thoughts on Productivity
jonyablonski
46
2.5k
Designing the Hi-DPI Web
ddemaree
273
32k
Git: the NoSQL Database
bkeepers
PRO
417
59k
The MySQL Ecosystem @ GitHub 2015
samlambert
239
11k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
stephaniewalter
270
12k
Clear Off the Table
cherdarchuk
79
290k
4 Signs Your Business is Dying
shpigford
169
20k

Transcript

  1. Elasticsearch & Data Consistency @drewr Tuesday, November 5, 13

  2. Search Tuesday, November 5, 13

  3. Data Tuesday, November 5, 13

  4. Fast Tuesday, November 5, 13

  5. Distributed Tuesday, November 5, 13

  6. Tuesday, November 5, 13

  7. Tuesday, November 5, 13

  8. Tuesday, November 5, 13

  9. Tuesday, November 5, 13

  10. Tuesday, November 5, 13

  11. Tuesday, November 5, 13

  12. Tuesday, November 5, 13

  13. Tuesday, November 5, 13

  14. Tuesday, November 5, 13

  15. Tuesday, November 5, 13

  16. Tuesday, November 5, 13

  17. Tuesday, November 5, 13

  18. Tuesday, November 5, 13

  19. Tuesday, November 5, 13

  20. Tuesday, November 5, 13

  21. P R R P Tuesday, November 5, 13

  22. Requests Tuesday, November 5, 13

  23. Tuesday, November 5, 13

  24. Tuesday, November 5, 13

  25. Tuesday, November 5, 13

  26. Tuesday, November 5, 13

  27. ? ? ? ? Tuesday, November 5, 13

  28. Consistency Tuesday, November 5, 13

  29. PUT /foo/t/one { "age": 35, "bio": "Some long text", "name":

    "Foo" } Tuesday, November 5, 13

  30. Update http://www.elasticsearch.org/guide/reference/api/update/ Tuesday, November 5, 13

  31. POST /foo/t/one/_update { "doc": { "name": "Bar" } } Tuesday,

    November 5, 13

  32. POST /foo/t/one/_update { "params": { "ageinc": 1 }, "script": "ctx._source.age

    += ageinc" } Tuesday, November 5, 13

  33. PUT /foo/t/one { "age": 36, "bio": "Some long text", "name":

    "Bar" } Tuesday, November 5, 13

  34. A write is a write... Tuesday, November 5, 13

  35. { "_id": "one", "_index": "foo", "_type": "t", "_version": 1, "ok":

    true } Tuesday, November 5, 13

  36. { "_id": "one", "_index": "foo", "_type": "t", "_version": 1, "ok":

    true } Tuesday, November 5, 13

  37. PUT /foo/t/one { "age": 36, "bio": "Some long text", "name":

    "Baz" } Tuesday, November 5, 13

  38. { "_id": "one", "_index": "foo", "_type": "t", "_version": 2, "ok":

    true } Tuesday, November 5, 13

  39. PUT /foo/t/one?version=1 { "age": 36, "bio": "Some long text", "name":

    "Baz" } Tuesday, November 5, 13

  40. { "error": "VersionConflict... current [2], provided [1]]", "status": 409 }

    Tuesday, November 5, 13

  41. PUT /foo/t/one?version=2 { "age": 36, "bio": "Some long text", "name":

    "Baz" } Tuesday, November 5, 13

  42. { "_id": "one", "_index": "foo", "_type": "t", "_version": 3, "ok":

    true } Tuesday, November 5, 13

  43. GET/Search Tuesday, November 5, 13

  44. PUT /foo/t/one?version=3&refresh=true { "age": 36, "bio": "Some long text", "name":

    "Quux" } Tuesday, November 5, 13

  45. { "_id": "one", "_index": "foo", "_type": "t", "_version": 4, "ok":

    true } Tuesday, November 5, 13

  46. ?consistency=... Tuesday, November 5, 13

  47. ?replication=... Tuesday, November 5, 13

  48. Case Study Tuesday, November 5, 13

  49. Tuesday, November 5, 13

  50. Tuesday, November 5, 13

  51. No New Deployment Tuesday, November 5, 13

  52. No New Deployment Consume perf loss OK Tuesday, November 5,

    13

  53. No New Deployment Consume perf loss OK Don’t really care

    about AMQP Tuesday, November 5, 13

  54. Rabbit Elasticsearch Exchange Index Queue Type Routing key ? Tuesday,

    November 5, 13

  55. news.politics.uk news.sports news.politics.usa news.* trade.dow trade.nasdaq Tuesday, November 5, 13

  56. Search! Tuesday, November 5, 13

  57. POST /exch/test.foo { "op": "frob", "thing": "/over/there" } Publish... Tuesday,

    November 5, 13

  58. GET /exch/test.foo/_search { "query": { "bool": { "must": [ {

    "constant_score": { "filter": { "missing": { "existence": true, "field": "__q_status", "null_value": true } } } }, { "prefix": { "_type": "test.foo" } } ] } }, "size": 1, "sort": [ { "__q_control": { "order": "desc" } } ] } Consume... Tuesday, November 5, 13

  59. PUT /exch/test.foo/UN1QU3ID?version=1&refresh=true { ... "__q_status": "unack" } Consume... Tuesday, November

    5, 13

  60. PUT /exch/test.foo/UN1QU3ID?version=2&refresh=true { ... "__q_status": "ack" } Finish up... Tuesday,

    November 5, 13

  61. Performance Tuesday, November 5, 13

  62. Conclusion Tuesday, November 5, 13