Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Elasticsearch x AutoScaling

mats
June 02, 2015

Elasticsearch x AutoScaling

第10回elasticsearch勉強会で使用した資料です。

mats

June 02, 2015
Tweet

More Decks by mats

Other Decks in Technology

Transcript

  1. elasticsearchͷ࢖ΘΕํ ໿̐ԯͷϢχʔΫIDʹର༷ͯ͠ʑͳଐੑ৘ใΛ෇༩ • Ӿཡཤྺʹجͮ͘Ωʔϫʔυ • ֤ϝσΟΞΑΓఏڙ͞ΕΔηάϝϯτ • User Agent •

    ΞΫηεݩIPʹجͮ͘ॅॴ΍اۀ৘ใ ೚ҙͷ৚݅ͰIDΛߜΓࠐΉͨΊʹɺɹɹɹɹɹɹɹɹɹɹɹɹΛ ར༻͍ͯ͠·͢ɻ  
  2. શମߏ੒ • શͯAWS؀ڥ • Cluster: 1, Type: 1, Node: 86

    • master: 3 (master:true, data: false) • data: 80 (master:false, data:true) • searcher: 2 (master:false, data: false) • indexer: 1 (master:false, data: false)ɹ˞όονॲཧ • version: 1.3.8 → 1.5.2 (5/26Ξοϓσʔτ)
  3. Cluster Size • Shard਺ = Node਺ ʹݻఆͯ͠ݕূ • 10 ʙ

    200 ͱ୆਺Λมߋ͠ɺԠ౴࣌ؒΛൺֱ • ʙ100୆Ґ·Ͱ͸୆਺ʹԠͯ͡ύϑΥʔϚϯε͕޲্ • 200୆ن໛Ͱ͸AggregationͷύϑΥʔϚϯε͕ྼԽ →ɹूܭ݁ՌͷϚʔδίετͷ૿Ճʁ • σʔλ༰ྔΛՃຯ͠ɺ80୆Ͱελʔτ
  4. Shard • Node਺ = 80 ʹݻఆͯ͠ݕূʢc3.largeʣ (1) shard: 40, replica:

    1 ʢshard/node = 0.5ʣ (2) shard: 80, reprica: 1 ʢshard/node = 1ʣ (3) shard: 160, replica:1 ʢshard/node = 2ʣ • shard/node ͕̍Λ௒͑Δͱܹ͘͠ύϑΥʔϚϯε͕ྼԽ ※ shard/nodeͰ͸ͳ͘ɺshard/cpuͷํ͕ॏཁ͔΋͠Εͳ͍ɾɾ