Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Consistency & Elasticsearch

Avatar for Elasticsearch Inc Elasticsearch Inc
November 04, 2013
Technology
2
1.2k

Consistency & Elasticsearch

Fun with working around eventual consistency!

Avatar for Elasticsearch Inc

Elasticsearch Inc

November 04, 2013
Tweet

More Decks by Elasticsearch Inc

See All by Elasticsearch Inc
OSCON: Scaling a distributed engineering team from 50-250
Avatar for Elasticsearch Inc elasticsearch
13
1.5k
Stuff a Search Engine Can Do
Avatar for Elasticsearch Inc elasticsearch
17
1.7k
Using Elastic to monitor anything
Avatar for Elasticsearch Inc elasticsearch
3
1.5k
Log all the things!
Avatar for Elasticsearch Inc elasticsearch
4
1.2k
Why Elastic? @ 50th Vinitaly 2016
Avatar for Elasticsearch Inc elasticsearch
5
2k
What's New In Elasticland?
Avatar for Elasticsearch Inc elasticsearch
3
960
Kibana, Timelion, Graph Meetup
Avatar for Elasticsearch Inc elasticsearch
3
800
Elastic for Time Series Data and Predictive Analytics
Avatar for Elasticsearch Inc elasticsearch
4
3.1k
Elastic 2.0
Avatar for Elasticsearch Inc elasticsearch
1
750

Other Decks in Technology

See All in Technology
Sansan BIが実践する AI on BI とセマンティックレイヤー / data_summit_findy
Avatar for Sansan R&D sansan_randd
0
120
MCP サーバーの基礎から実践レベルの知識まで
Avatar for azukiazusa azukiazusa1
26
13k
嗚呼、当時の本番環境の状態で AI Agentを再評価したいなぁ...
Avatar for po3rin po3rin
0
310
【AWS reInvent 2025 関西組 事前勉強会】re:Inventの“感動と興奮”を思い出してモチベ爆上げしたいです
Avatar for Toshiki Terai ttelltte
0
120
Snowflake Marketplaceには”PODB”という便利なオープンデータがあってAI Ready対応してるらしいよ/the-snowflake-marketplace-has-a-useful-open-data-source-called-PODB-that-is-apparently-AI-ready
Avatar for shinyaa31 shinyaa31
0
260
AIとの協業で実現！レガシーコードをKotlinらしく生まれ変わらせる実践ガイド
Avatar for ZOZO Developers zozotech
PRO
2
380
AWS IAM Identity Centerによる権限設定をグラフ構造で可視化＋グラフRAGへの挑戦
Avatar for Yuta Kimi ykimi
2
620
龍昌餃子で理解するWebサーバーの並行処理モデル - 東葛.dev #9
Avatar for Koji NAKAMURA kozy4324
1
140
re:Inventに行きたい　いつか行きたい　行けるようにできることは？
Avatar for Yuuki Yamashita yama3133
0
120
累計5000万DLサービスの裏側 – LINEマンガのKotlinで挑む大規模 Server-side ETLの最適化
Avatar for LINE Digital Frontier - TECH ldf_tech
0
210
ピープルウエア x スタートアップ
Avatar for operandoOS operando
3
3.8k
設計は最強のプロンプト - AI時代に武器にすべきスキルとは？-
Avatar for Ken'ichirou Kimura kenichirokimura
1
290

Featured

See All Featured
Easily Structure & Communicate Ideas using Wireframe
Avatar for Afnizar Nur Ghifari afnizarnur
194
16k
Build The Right Thing And Hit Your Dates
Avatar for Maggie C. maggiecrowley
38
2.9k
Optimising Largest Contentful Paint
Avatar for Harry Roberts csswizardry
37
3.5k
Building a Modern Day 
E-commerce SEO Strategy
Avatar for Aleyda Solis aleyda
45
8k
YesSQL, Process and Tooling at Scale
Avatar for Rocio Delgado rocio
174
15k
A Tale of Four Properties
Avatar for Chris Coyier chriscoyier
161
23k
Building Applications with DynamoDB
Avatar for Matt Wood mza
96
6.7k
Stop Working from a Prison Cell
Avatar for Chris Michel hatefulcrawdad
272
21k
For a Future-Friendly Web
Avatar for Brad Frost brad_frost
180
10k
Being A Developer After 40
Avatar for Adrian Kosmaczewski akosma
91
590k
Rails Girls Zürich Keynote
Avatar for Gregor Martynus gr2m
95
14k
Automating Front-end Workflow
Avatar for Addy Osmani addyosmani
1371
200k

Transcript

  1. Elasticsearch & Data Consistency @drewr Tuesday, November 5, 13

  2. Search Tuesday, November 5, 13

  3. Data Tuesday, November 5, 13

  4. Fast Tuesday, November 5, 13

  5. Distributed Tuesday, November 5, 13

  6. Tuesday, November 5, 13

  7. Tuesday, November 5, 13

  8. Tuesday, November 5, 13

  9. Tuesday, November 5, 13

  10. Tuesday, November 5, 13

  11. Tuesday, November 5, 13

  12. Tuesday, November 5, 13

  13. Tuesday, November 5, 13

  14. Tuesday, November 5, 13

  15. Tuesday, November 5, 13

  16. Tuesday, November 5, 13

  17. Tuesday, November 5, 13

  18. Tuesday, November 5, 13

  19. Tuesday, November 5, 13

  20. Tuesday, November 5, 13

  21. P R R P Tuesday, November 5, 13

  22. Requests Tuesday, November 5, 13

  23. Tuesday, November 5, 13

  24. Tuesday, November 5, 13

  25. Tuesday, November 5, 13

  26. Tuesday, November 5, 13

  27. ? ? ? ? Tuesday, November 5, 13

  28. Consistency Tuesday, November 5, 13

  29. PUT /foo/t/one { "age": 35, "bio": "Some long text", "name":

    "Foo" } Tuesday, November 5, 13

  30. Update http://www.elasticsearch.org/guide/reference/api/update/ Tuesday, November 5, 13

  31. POST /foo/t/one/_update { "doc": { "name": "Bar" } } Tuesday,

    November 5, 13

  32. POST /foo/t/one/_update { "params": { "ageinc": 1 }, "script": "ctx._source.age

    += ageinc" } Tuesday, November 5, 13

  33. PUT /foo/t/one { "age": 36, "bio": "Some long text", "name":

    "Bar" } Tuesday, November 5, 13

  34. A write is a write... Tuesday, November 5, 13

  35. { "_id": "one", "_index": "foo", "_type": "t", "_version": 1, "ok":

    true } Tuesday, November 5, 13

  36. { "_id": "one", "_index": "foo", "_type": "t", "_version": 1, "ok":

    true } Tuesday, November 5, 13

  37. PUT /foo/t/one { "age": 36, "bio": "Some long text", "name":

    "Baz" } Tuesday, November 5, 13

  38. { "_id": "one", "_index": "foo", "_type": "t", "_version": 2, "ok":

    true } Tuesday, November 5, 13

  39. PUT /foo/t/one?version=1 { "age": 36, "bio": "Some long text", "name":

    "Baz" } Tuesday, November 5, 13

  40. { "error": "VersionConflict... current [2], provided [1]]", "status": 409 }

    Tuesday, November 5, 13

  41. PUT /foo/t/one?version=2 { "age": 36, "bio": "Some long text", "name":

    "Baz" } Tuesday, November 5, 13

  42. { "_id": "one", "_index": "foo", "_type": "t", "_version": 3, "ok":

    true } Tuesday, November 5, 13

  43. GET/Search Tuesday, November 5, 13

  44. PUT /foo/t/one?version=3&refresh=true { "age": 36, "bio": "Some long text", "name":

    "Quux" } Tuesday, November 5, 13

  45. { "_id": "one", "_index": "foo", "_type": "t", "_version": 4, "ok":

    true } Tuesday, November 5, 13

  46. ?consistency=... Tuesday, November 5, 13

  47. ?replication=... Tuesday, November 5, 13

  48. Case Study Tuesday, November 5, 13

  49. Tuesday, November 5, 13

  50. Tuesday, November 5, 13

  51. No New Deployment Tuesday, November 5, 13

  52. No New Deployment Consume perf loss OK Tuesday, November 5,

    13

  53. No New Deployment Consume perf loss OK Don’t really care

    about AMQP Tuesday, November 5, 13

  54. Rabbit Elasticsearch Exchange Index Queue Type Routing key ? Tuesday,

    November 5, 13

  55. news.politics.uk news.sports news.politics.usa news.* trade.dow trade.nasdaq Tuesday, November 5, 13

  56. Search! Tuesday, November 5, 13

  57. POST /exch/test.foo { "op": "frob", "thing": "/over/there" } Publish... Tuesday,

    November 5, 13

  58. GET /exch/test.foo/_search { "query": { "bool": { "must": [ {

    "constant_score": { "filter": { "missing": { "existence": true, "field": "__q_status", "null_value": true } } } }, { "prefix": { "_type": "test.foo" } } ] } }, "size": 1, "sort": [ { "__q_control": { "order": "desc" } } ] } Consume... Tuesday, November 5, 13

  59. PUT /exch/test.foo/UN1QU3ID?version=1&refresh=true { ... "__q_status": "unack" } Consume... Tuesday, November

    5, 13

  60. PUT /exch/test.foo/UN1QU3ID?version=2&refresh=true { ... "__q_status": "ack" } Finish up... Tuesday,

    November 5, 13

  61. Performance Tuesday, November 5, 13

  62. Conclusion Tuesday, November 5, 13