Elasticsearchのマネージドサービスを比較してみた MasterCloud #9 / 20180123

Transcript

1. 2018/01/23 MasterCloud #9 ৽य़Ϋϥ΢υLTେձ ϰΝϧݚڀॴ ؙࢁͻ͔Δ Elasticsearchͷ ϚωʔδυαʔϏεΛൺֱͯ͠Έͨ
2. ؙࢁͻ͔Δ גࣜձࣾϰΝϧݚڀॴ ςΫχΧϧΤόϯδΣϦετ ਆಸ઒ݝ૬໛ݪࢢࡏॅ IJLBSVNBSVZBNB !NBSVZBNBIJBLSV IUUQIJJJJJJJIJLBSVIBUFOBEJBSZDPN Profile
3. ৐׵Ҋ಺ͷձࣾͰ͢ • 40೥Ҏ্ଓ͘ITاۀ • ࠃ಺ॳͷ৐׵Ҋ಺ιϑτ“Ӻ͢ͺ͋ͱ” • ܦ࿏୳ࡧΤϯδϯΛ׆༻ͯ͠
 ࣄۀΛల։
4. Ӻ͢ͺ͋ͱͷػೳ • Ӻɺ࿏ઢσʔλ • ܦ࿏୳ࡧ • ࣌ࠁද • ӡߦ৘ใ ৐׵Ҋ಺ͷWebAPI ʰӺ͢ͺ͋ͱwebαʔϏεʱ
6. ɾϰΝϧݚڀॴ ɾMobingi ɾHANDS LAB ςοΫΠϕϯτ։࠵͠·̇͢ https://connpass.com/event/76519/ ʲ એ఻ ʳ
7. Elastic Cloud Amazon ES Elasticsearchͷ
 ϚωʔδυαʔϏε
8. Elastic Cloud Amazon ES Elasticsearchͷ
 ϚωʔδυαʔϏε Կ͕ҧ͏ΜͩΖ͏ʁ
9. ࠓ೔ͷ࿩ Ӻ͢ͺ͋ͱwebαʔϏεͷΞΫηεϩάΛՄࢹԽ͢Δʹ͋ͨΓ ElasticsearchͷϚωʔδυαʔϏεΛௐࠪͨ݁͠Ռͱ
 ݱࡏͷ༷ࢠΛ͓࿩͠͠·͢
10. ͳͥElasticsearchͷ
 ϚωʔδυαʔϏεΛٻΊ͍ͯͨͷ͔ • ো֐ରԠ΍ސ٬αϙʔτରԠͷͨΊʹ
 Ӻ͢ͺ͋ͱwebαʔϏεͷELBϩάΛՄࢹԽ͍ͨ͠ • KibanaͰՄࢹԽͰ͖Δ͠Elasticsearchྑͦ͞͏ • ElasticsearchΛEC2ʹཱͯͯࣗ෼ͨͪͰӡ༻͢Δͷ͸໘౗
11. ฐࣾͷঢ়گ AWSͷར༻ଟΊ Ӻ͢ͺ͋ͱwebαʔϏε΋ྫ֎ʹ΋Εͣɺ
 ଟ͘ͷAWS੡඼Ͱߏ੒
 ཁٻࣄ߲ ࿙Εͳ͘ɺμϒΓͳ͘ϩά͕ूܭͰ͖Δ͜ͱ
 ҆৺ɺ҆શʹϩά͕ूܭͰ͖Δ؀ڥͰ͋Δ͜ͱ
 ϩάαΠζ͕େ͖͘ͳͬͯ΋໰୊ͳ͘ରԠͰ͖Δ͜ͱ ӡ༻ʹख͕͔͔ؒΒͳ͍͜ͱ ঢ়گ੔ཧ
12. ൺֱͯ͠Έͨ
13. Elastic Cloud Amazon ES • Elastic͕ఏڙ͢Δ ElasticsearchͷϚωʔδυ αʔϏε • GUIʹΑΔ؆୯ૢ࡞ͰΫϥε λ࡞੒ • AWS·ͨ͸GCP͕બ୒Մೳ • Kibanaɺͦͷଞଟ਺ͷϓϥά Πϯ͕ඪ४૷උ • ৗʹ࠷৽ͷιϑτ΢ΣΞ͕ར ༻Մೳ • ೥ؒܖ໿Ͱ15%ׂҾ • AWS͕ఏڙ͢Δ ElasticsearchͷϚωʔδυ αʔϏε • Ϛωδϝϯτίϯιʔϧ΍ cliܦ༝ͰΫϥελ࡞੒ • CloudWatchʹΑΔϞχλ Ϧϯά • IAMϙϦγʔʹΑΔΞΫη ε੍ޚ • VPC಺ʹ࡞੒Մೳ
14. Elastic Cloud Amazon ES • Elastic͕ఏڙ͢Δ ElasticsearchͷϚωʔδυ αʔϏε • GUIʹΑΔ؆୯ૢ࡞ͰΫϥε λ࡞੒ • AWS·ͨ͸GCP͕બ୒Մೳ • Kibanaɺͦͷଞଟ਺ͷϓϥά Πϯ͕ඪ४૷උ • ৗʹ࠷৽ͷιϑτ΢ΣΞ͕ར ༻Մೳ • ೥ؒܖ໿Ͱ15%ׂҾ • AWS͕ఏڙ͢Δ ElasticsearchͷϚωʔδυ αʔϏε • Ϛωδϝϯτίϯιʔϧ΍ cliܦ༝ͰΫϥελ࡞੒ • CloudWatchʹΑΔϞχλ Ϧϯά • IAMϙϦγʔʹΑΔΞΫη ε੍ޚ • VPC಺ʹ࡞੒Մೳ ྆ํͱ΋ ཁٻࣄ߲͸ຬ͍ͨͯ͠Δɾɾɾ
15. ࢖ͬͯΈͨ
16. AWS੡඼ͱͷ਌࿨ੑ͕ߴ͍ Amazon ES • CloudWatchͱAmazon SNSͰ؆୯Ξϥʔτઃఆ • IAMʹΑΔࡉ͔͍ΞΫηε੍ޚ • VPCͷରԠ • Kinesisͱͷ࿈ܞʢKinesis Data Firehoseʣ
17. Elasticsearchͷ͖Ίࡉ΍͔ͳ࢖͍উख͕ചΓͷ Elastic Cloud • ࠷৽όʔδϣϯͷରԠεϐʔυ
 (ϦϦʔε೔͔Βར༻Մೳ) • X-Packͷඪ४౥ࡌ • ؅ཧը໘ͰΫϥελબ୒͢Δͱଈ࠲ʹར༻ྉ͕ۚදࣔ • ΫϥελͷόʔδϣϯΞοϓ͕༰қ
18. Elastic Cloud Amazon ES ௐࠪͨ݁͠Ռ
19. Elastic Cloud Amazon ES ௐࠪͨ݁͠Ռ ࠾༻!!
20. Elastic Cloud ࠾༻ཧ༝ • ElasticsearchࣗମͷREST API͕༏Ε͍ͯΔͨΊɺ AWS੡඼ͱͷ࿈ܞ͸ͦ͜·Ͱؾʹ͠ͳ͍ • ຊՈ͕ఏڙ͍ͯ͠Δ҆৺ײ
21. s3 lambda lambda lambda Elastic Cloud kinesis S3ͷϙετΛτϦ Ψʔʹlambda͕ൃՐ ϩάΛkinesisʹૹ৴ όοϑΝͱͯ͠ kinesisʹϩάσʔλ ΛҰ࣌อ؅ kinesisͷσʔλΛॱ࣍ Elasticsearchʹ
 Πϯϙʔτ ༰ྔઅ໿ͷͨΊ 7೔લͷϩάΛফڈ
22. 1೥࢖ͬͨײ૝ • զʑ͕΍Γ͔ͨͬͨ͜ͱ͸࣮ݱͰ͖ͯΔ • ӡ༻ָ • ো֐ରԠͷεϐʔυΞοϓ • ͨ·ʹlambdaͰΤϥʔग़Δ͚Ͳɺ҆ఆ͍ͯ͠Δ • ຊ൪ՔಇதʹElasticsearchͷόʔδϣϯΞοϓΛ
 ߦͳͬͨࡍ΋ɺಛผΊΜͲ͍͘͞࡞ۀ͸ൃੜͤͣ
 εϜʔζʹ࡞ۀ׬ྃ
23. ·ͱΊ • ElasticsearchͷϚωʔδυαʔϏεΛ
 ൺֱͯ͠Έͨ • ಉ͡ͳΑ͏ͰɺͦΕͧΕಛ௃͕͋Δ • ࠓճ͸Elastic CloudΛબ୒͚ͨ͠Ͳɺ
 ਖ਼௚ɺͲͪΒΛબ୒ͯ͠΋ɺར༻ʹ͸
 ਃ͠෼ͳ͔ͬͨͱࢥ͏
24. Έͳ͞Μʹฉ͖͍ͨ͜ͱ • ΋͠ߏ੒Λݟ௚͢ͱͨ͠Β • ࠷దͳߏ੒͸Ͳ͏ͳΔͩΖ͏ʁ • αʔϏεͷબఆํ๏ͬͯͲ͏ͯ͠·͔͢ʁ
25. ͓ΘΓ