サーバレス時代におけるヘテロジニアス時系列データベースアーキテクチャ / HeteroTSDB

サーバレス時代におけるヘテロジニアス時系列データベースアーキテクチャ / HeteroTSDB

第2回ウェブシステムアーキテクチャ研究会

Tweet

Transcript

  1. 6.

    ࣌ܥྻDBͷ࣮૷ํࣜ - ಺෦DBMSํࣜ • ࣌ܥྻσʔλϕʔεʹ࠷దԽ͞ΕͨΤϯδϯΛ࣮૷ • ੑೳͱσʔλอଘޮ཰͸Α͍܏޲͕͋Δ • ҰํͰɺ෼ࢄγεςϜͱͯ͠ͷ৴པੑʹ͍ͭͯɺ࣮ݧஈ ֊Ͱ͋Δ͜ͱ΋ଟ͍

    • GraphiteɺInfluxDBɺPrometheusͳͲ [4]: Jensen, Søren Kejser, et al. "Time Series Management Systems: A Survey." IEEE Transactions on Knowledge and Data Engineering, vol.29, no.11, 2017, pp. 2581-2600. [5]: B. Mitschang et al. "Survey and Comparison of Open Source Time Series Databases.", In Proceedings of Database Systems for Business, Technology, and Web, 2017
  2. 7.

    ࣌ܥྻDBͷ࣮૷ํࣜ - ֎෦DBMSํࣜ • ൚༻DBMS্ͷΞϓϦέʔγϣϯͱ࣮ͯ͠૷ • ෼ࢄγεςϜͱͯ͠ͷ৴པੑʹؔΘΔ࣮૷͕੒ख़͍ͯ͠ Δ܏޲͕͋Δ • ੑೳͱޮ཰͸಺෦DBMSํࣜʹྼΔ܏޲͕͋Δ

    • OpenTSDB(HBase)ɺKairosDB(Cassandra)ͳͲ [4]: Jensen, Søren Kejser, et al. "Time Series Management Systems: A Survey." IEEE Transactions on Knowledge and Data Engineering, vol.29, no.11, 2017, pp. 2581-2600. [5]: B. Mitschang et al. "Survey and Comparison of Open Source Time Series Databases.", In Proceedings of Database Systems for Business, Technology, and Web, 2017
  3. 11.

    ΞʔΩςΫνϟͷཁ݅ • (a) ࣌ܥྻσʔλʹର͢Δߴ͍ॻ͖ࠐΈεέʔϧΞ΢τੑ • (b) ߴՄ༻ੑ • (c) ॻ͖ࠐΈI/Oͱσʔλอ࣋ͷͦΕͧΕʹ͍ͭͯɺߴ͍ίϯ

    ϐϡʔςΟϯάϦιʔεޮ཰ • (d) ϦιʔεͷϓϩϏδϣχϯά͓Αͼނো࣌ͷ෮چͷ༰қ͞ • (e) ݕূ͓Αͼ։ൃͷ༰қ͞
  4. 12.

    ಈ࡞ϑϩʔ ϝοηʔδ ϒϩʔΧʔ write path ΠϯϝϞϦ ,74 Φϯ44% ,74 Φϯ)%%

    ,74 SFBEFS OPEF read path XSJUFS OPEF flush flush
  5. 13.

    σʔλߏ଄ • KVSؒͰͷσʔλ੔߹ੑΛ͍͔ʹ୲อ͢Δ͔ • KVS্ͰҎԼͷ2఺Λୡ੒͠ɺղܾ͢Δ • (1) ࣌ܥྻσʔλͷ΂͖౳ॻ͖ࠐΈ • (2)

    Valueʹؚ·ΕΔσʔλϙΠϯτ਺ͷ࠷େ஋Λ੍ޚ • (1) ͸ϋογϡϚοϓʹΑΓ࣮ݱ • (2) ͸ղ૾౓ΞϥΠϯϝϯτͱλΠϜ΢Οϯυ΢ʹΑΓ࣮ݱ
  6. 17.
  7. 18.

    ߏ੒ਤ ,JOFTJT 4USFBNT write path 3FEJT $MVTUFS %ZOBNP%# 4 SFBEFS

    read path -BNCEB flush flush [2]: ࣌ܥྻσʔλϕʔεͱ͍͏֓೦ΛΫϥ΢υͷٕͰ࠶ߏங͢Δ http://blog.yuuk.io/entry/the-rebuild-of-tsdb-on-cloud, 2017, AWS Summit Tokyo
  8. 21.