Let's visualize your Spring Cloud Applications! #jsug #springday

Let’s Visualize Your  Spring Cloud Applications! #sd2016r26 Shin Tanimoto  Acroquest
Technology Co., LTD

Copyright © Acroquest Technology Co., Ltd. All rights reserved. ࣗݾ঺հ
2 • ୩ຊ ৺ (Shin Tanimoto) - Acroquest Technologyגࣜձࣾ - ιϦϡʔγϣϯΞʔΩςΫτ - JavaOne / SpringOneεϐʔΧʔ - JJUG / ؔδϟό - Twitter : @cero_t (೔ຊޠ) - Facebook : shin.tanimoto (ӳޠ)

© Acroquest Technology Co., Ltd. All rights reserved. 2. ՄࢹԽʹ࢖͏πʔϧ܈ ຊ೔঺հ͢Δπʔϧ܈ αʔϏεؒͷґଘੑΛՄࢹԽ Spring Cloud Sleuth + Zipkin  ϩάϑΝΠϧΛՄࢹԽ Elasticsearch + Logstash + Kibana + Filebeat  αʔό΍ϓϩηεͷঢ়ଶΛՄࢹԽ Elasticsearch + Kibana + Metricbeat 14

© Acroquest Technology Co., Ltd. All rights reserved. 3. αʔϏεґଘੑͷՄࢹԽ Spring Cloud Sleuth + ZipkinͰαʔϏεґଘੑΛՄࢹԽ Spring Cloud Sleuthͱ͸ʁ Distributed Tracing ෳ਺αʔόΛލ͕ΔϦΫΤετʹڞ௨ͷIDΛৼͬͯ  ʢHTTP/AMQPϔομͳͲͰ఻೻ͤ͞ͳ͕Βʣ  ॲཧΛ௥੻Ͱ͖ΔΑ͏ʹ͢Δ࢓૊Έ  Zipkinͱ͸ʁ Distributed Tracing Visualization ෳ਺αʔόΛލ͕ΔϦΫΤετΛՄࢹԽ͢Δ 25

© Acroquest Technology Co., Ltd. All rights reserved. 3. αʔϏεґଘੑͷՄࢹԽ Spring Cloud Sleuth + ZipkinͷΠϝʔδ 27 Microservice1 Microservice2 Zipkin Server HTTP Zipkin UI Server SleuthΛ࢖ͬͯ  ݺͼग़͠৘ใΛ  zipkinʹૹΔ ஝ੵ ՄࢹԽ

© Acroquest Technology Co., Ltd. All rights reserved. 3. αʔϏεґଘੑͷՄࢹԽ Spring Cloud Sleuth + Zipkinͷద༻ Spring Cloud Sleuth ϚΠΫϩαʔϏεͷpom.xmlͷdependenciesʹ  ʮspring-cloud-starter-zipkinʯΛ௥Ճ ίʔυͷมߋ͸Ұ੾ͳ͠ Zipkin ৽نϓϩδΣΫτΛ࡞ͬͯpom.xmlʹ  ʮzipkin-serverʯͱʮzipkin-autoconﬁgure-uiʯΛ௥Ճ MainΫϥεΛҰͭ࡞Δ 28

© Acroquest Technology Co., Ltd. All rights reserved. 3. αʔϏεґଘੑͷՄࢹԽ Zipkinαʔόͷ։ൃ 29 @SpringBootApplication @EnableZipkinServer public class ZipkinApplication { public static void main(String[] args) { SpringApplication.run(ZipkinApplication.class, args); } }

© Acroquest Technology Co., Ltd. All rights reserved. 3. αʔϏεґଘੑͷՄࢹԽ Spring Cloud Sleuth + ZipkinͷΠϝʔδ 30 Microservice1 Microservice2 Zipkin Server HTTP Zipkin UI Server Zipkin Client   (spring-cloud-starter-zipkin) Zipkin UI (zipkin-autoconfigure-ui)  Zipkin Server (zipkin-server)

© Acroquest Technology Co., Ltd. All rights reserved. 4. ϩάͷՄࢹԽ ԿͷͨΊʹ΍Δͷʁ ΞϓϦέʔγϣϯϩάͷՄࢹԽ γεςϜ͕҆ఆՔಇ͍ͯ͠Δ͔ͷ೺Ѳ ૝ఆ͠ͳ͍໰୊͕ى͖͍ͯͳ͍͔ʁ ΞΫηεϩάͷՄࢹԽ ద੾ʹϨεϙϯεΛฦ͍ͤͯΔ͔Ͳ͏͔ͷ೺Ѳ HTTPεςʔλεͷ400൪୆ɺ500൪୆͕ൃੜ͍ͯ͠ͳ͍͔ʁ ϨεϙϯελΠϜ͕େ͖͘ͳ͍ͬͯͳ͍͔ʁ ٸܹͳΞΫηε૿ͳͲ͕ى͖͍ͯͳ͍͔ͷ೺Ѳ SNS΍χϡʔεαΠτͳͲͰऔΓ্͛ΒΕͨʁ ߈ܸΛड͚ͨʁ 38

© Acroquest Technology Co., Ltd. All rights reserved. 4. ϩάͷՄࢹԽ ElasticελοΫͰϩάΛՄࢹԽ Elasticsearch ෼ࢄશจݕࡧΤϯδϯɻϩάσʔλΛ஝ੵ͢Δ Kibana ՄࢹԽ༻ͷUI Filebeat σʔλసૹπʔϧͰ͋ΔBeatsγϦʔζͷҰͭɻ ϑΝΠϧΛಡΈࠐΈɺLogstashʹసૹ͢Δɻ Logstash σʔλͷՃ޻ɾసૹπʔϧ Filebeat͔ΒσʔλΛड͚औΓɺՃ޻ͯ͠ɺElasticsearchʹసૹ͢Δ 39

© Acroquest Technology Co., Ltd. All rights reserved. 4. ϩάͷՄࢹԽ Ͱ΋ͳͥElasticsearchͳͷʁ ElasticελοΫʹΑΔɺऩूɾՃ޻ɾ஝ੵɾՄࢹԽͷҰ؏ੑ πʔϧͷ૊Έ߹ΘͤΛ໎Θͳ͍͍ͯ͘ Elasticsearchͷෳࡶͳ৚݅ͰϑΟϧλΛֻ͚ͨ͏͑ͰͷՄࢹԽͳͲ΋༰қ ʮϩάऩूͱՄࢹԽʯΛ໨తͱͨ͠৔߹ɺOSSͰ͸ଞͷબ୒ࢶ͕΄΅ͳ͍ʢ঎༻ ੡඼Ͱ͸SplunkͳͲ͋Γʣ ʮ࣌ܥྻͷ਺஋σʔλʯΛѻ͏੡඼͸͍͔ͭ͋͘Δ͕ɺϩάͦͷ΋ͷΛѻ͑ Δ΋ͷ͸΄ͱΜͲͳ͍ AWSͷCloud Watch LogsͳͲ΋ϩάΛऩू͢Δ͕ɺෳࡶͳϑΟϧλͳͲ͸ֻ ͚ΒΕͳ͍ 45

© Acroquest Technology Co., Ltd. All rights reserved. 4. ϩάͷՄࢹԽ Ͱ΋ͳͥElasticsearchͳͷʁ ʮ͋ͱ͔Βʯूܭ࣠Λม͑ΒΕΔڧ͞ ࣌ܥྻͷ਺஋σʔλΛه࿥͢ΔϝτϦΫεπʔϧͰ͸ɺͨͱ͑͹ޙ͔Βʮಛఆͷ ஍Ҭ͔ΒͷΞΫηεʯ͚ͩʹߜͬͨ෼ੳͳͲ͕೉͍͠ ࣄલʹܾΊͨ஋Λ஝ੵ͢Δ͜ͱ͕ओ໨తͳͷͰ ϩάϑΝΠϧΛ௚઀ղੳ͢ΔπʔϧͰɺςϥόΠτڃͷղੳΛ͢Δ͜ͱ͸ࠔ೉ɻ ElasticsearchͳΒݕࡧͷߴ଎͞ͱ͍͏๫ྗΛ׆͔ͯ͠ɺूܭ࣠Λม͑ͳ͕Βߴ଎ ʹݕࡧ͕Ͱ͖Δɻ    ͭ·Γɺ͍ͬͨΜࡶʹϩάΛElasticsearchʹೖΕ͓͍ͯͯɺ  ޙ͔ΒܾΊͨ࣠Ͱ෼ੳ͢Δɺͱ͍͏ΞδϦςΟͷߴ͍ରԠ͕औΓ΍͍͢ 46

© Acroquest Technology Co., Ltd. All rights reserved. 5. γεςϜϦιʔεͷՄࢹԽ ԿͷͨΊʹ΍Δͷʁ γεςϜ͕҆ఆՔಇ͍ͯ͠Δ͔ͷ೺Ѳ CPU࢖༻཰͕ߴಅ͍ͯ͠ͳ͍͔ʁ ϝϞϦ͕ϦʔΫ͍ͯ͠ͳ͍͔ʁ σΟεΫͷ࢒༰ྔ͕ރׇͯ͠ɺγεςϜఀࢭੇલʹͳ͍ͬͯͳ͍͔ʁ     ਖ਼ຯͷ࿩ɺ͜Ε͸օ͞Μɺ΍͍ͬͯΔͱࢥ͍·͢ɻ  ZabbixɺMackerelɺDataDogɺCloud WatchͳͲɺ  ྑ͍πʔϧ͸ଟ਺͋Γ·͢ɻ 49

© Acroquest Technology Co., Ltd. All rights reserved. 5. γεςϜϦιʔεͷՄࢹԽ ElasticελοΫͰϩάΛՄࢹԽ Elasticsearch ෼ࢄશจݕࡧΤϯδϯɻϩάσʔλΛ஝ੵ͢Δɻ͖ͬ͞આ໌͠·ͨ͠ɻ Kibana ՄࢹԽ༻ͷUIɻ͖ͬ͞આ໌͠·ͨ͠ɻ Metricbeat Ϧιʔε৘ใͷऩूπʔϧɻ Ϧιʔε৘ใΛಡΈऔͬͯɺLogstashʹసૹ͢Δɻ MySQL΍PostgreSQLɺRedisɺnginxͳͲͷϛυϧ΢ΣΞͷAPIΛୟ͍ͯ ৘ใΛऩू͢Δػೳ΋͋Δʢࠓճ͸આ໌͠ͳ͍Αʣ 52

© Acroquest Technology Co., Ltd. All rights reserved. 6. ՄࢹԽͱKafka KafkaΛ༻͍ͨγεςϜͷ҆ఆԽ Apache Kafkaͱ͸ ͻͱ͜ͱͰݴ͏ʮΩϡʔͷΑ͏ͳ΋ͷʯ ͨͩ͠աڈ1िؒ෼ʢσϑΥϧτઃఆʣͷσʔλΛอ͓࣋ͯ͠Γɺ  ͍ͭͰ΋࠶ૹՄೳ ࢖͍ํ ϚΠΫϩαʔϏε͔ΒZipkinͷؒʹKafkaΛڬΉ BeatsͱLogtash΍ElasticsearchͷؒʹKafkaΛڬΉ 66

© Acroquest Technology Co., Ltd. All rights reserved. 6. ՄࢹԽͱKafka Spring Cloud Sleuth + ZipkinͷΠϝʔδ 69 Microservice1 Microservice2 Zipkin Server Zipkin UI  Server Kafka spring-cloud-sleuth-stream  spring-cloud-stream-binder-kafka zipkin-autoconfigure-ui  spring-cloud-sleuth-zipkin-stream  spring-cloud-stream-binder-kafka

© Acroquest Technology Co., Ltd. All rights reserved. 6. ՄࢹԽͱKafka Spring Cloud Sleuth + ZipkinͷΠϝʔδ 70 Name artifactId Log HTTP Kafka Sleuth spring-cloud-starter-sleuth Service Sleuth Stream spring-cloud-sleuth-stream Service Zipkin Client spring-cloud-starter-zipkin Service Zipkin Stream spring-cloud-sleuth-zipkin-stream Zipkin Zipkin UI spring-boot-starter  zipkin-autoconfigure-ui Zipkin Zipkin Zipkin Server spring-boot-starter  zipkin-server Zipkin Stream Kafka spring-cloud-stream-binder-kafka Both

© Acroquest Technology Co., Ltd. All rights reserved. 6. ՄࢹԽͱKafka ͳͥKafkaΛ࢖͏ͷ͔ʁ େྔͷΞΫηεʹΑΔՄࢹԽγεςϜશମͷఀࢭΛ๷͙ Elasticsearch΍Logstash͕աෛՙʹΑΓఀࢭ͢Δ ͦͷؒʹདྷͨϝοηʔδ͕ফࣦͯ͠͠·͏͜ͱΛ๷͙ LogstashͷઃఆΛमਖ਼ͨ͠ޙʹɺ࠶ૹͰ͖Δ Logstashͷઃఆʹϛε͕͋Γɺύʔεʹࣦഊͯ͠͠·ͬͯ΋ɺ  ઃఆΛ௚ͨ͠͏͑ͰKafka͔ΒऔΓ௚ͤ͹ਖ਼͘͠గਖ਼Ͱ͖Δ ཁ͢ΔʹՄࢹԽγεςϜͷ҆ఆԽ ՄࢹԽͷॏཁੑ͕௿͍৔߹͸ɺผʹͳͯ͘΋ྑ͍ ηΩϡϦςΟ༻్ͰՄࢹԽ͢Δ৔߹ͳͲ͸ɺͥͻೖΕ͍ͨΑͶʁ 73

© Acroquest Technology Co., Ltd. All rights reserved. 6. ՄࢹԽͱKafka Spring Cloud Streamͷྑ͍ྫͱ΋ݴ͑Δ Spring Cloud Stream͸ɺҰݟ͢Ε͹ʮࣗ෼ʹ͸͋·Γؔ܎ͷͳ͍΋ͷʯͱ ଊ͑ͯ͠·͍͕ͪ Ͱ΋ࠓճͷՄࢹԽ͸ɺ׬શʹSpring Cloud Streamͱಉ͡ྲྀΕʹͳΔ ʮ͜ͷαʔϏεʗϛυϧ΢ΣΞΛࢭΊͯ΋ɺϝοηʔδΛܽམͤ͞Δ͜ͱͳ ͘ॲཧͰ͖Δ͔ʁʯͱ͍͏ࢹ఺Ͱߟ͑Ε͹ɺSpring Cloud StreamͷϝϦοτ ͕·ͨݟ͑ͯ͘Δ ༨ஊ͚ͩͲɺBeatsͱLogstashͷؒ͸όοΫϓϨογϟʔܕͷಠࣗϓϩ τίϧͳͷͰɺ͜͜Λਅ݋ʹߟ͑ΔͱɺόοΫϓϨογϟʔͷϝϦοτ ΋·ͨݟ͑ͯ͘Δɻͦͷ࿩͸·͍ͨͣΕʂ 74

© Acroquest Technology Co., Ltd. All rights reserved. ·ͱΊ Devܥ͸Spring Cloud Sleuth + ZipkinʹΑΔ  αʔϏεґଘੑͷՄࢹԽΛ͙͢΍Δ΂͖ Opsܥ͸ElasticελοΫΛ࢖ͬͯϩάͷՄࢹԽΛ  ͙͢΍Δ΂͖ ো֐΍γεςϜఀࢭ͕ى͖Δ͜ͱେલఏͱͯ͠ɺ  KafkaΛ༻͍ͨ҆ఆԽΛݕ౼͢Ε͹ɺ  ؾ͍ͮͨΒSpring Cloud Stream΍όοΫϓϨογϟʔͷ  ϝϦοτ͕෼͔ΔΑ͏ʹͳΔΑʂ 76

Let's visualize your Spring Cloud Applications! #jsug #springday

Let's visualize your Spring Cloud Applications! #jsug #springday

More Decks by Shin Tanimoto

Other Decks in Programming

Featured

Transcript