Spring Cloud Sleuth + Zipkin  with Elasticsearch #zipkin_jp

Slide 1

Slide 1 text

Spring Cloud Sleuth + Zipkin  with Elasticsearch Shin Tanimoto  Acroquest Technology Co., LTD

Slide 2

Slide 2 text

Copyright © Acroquest Technology Co., Ltd. All rights reserved. ࣗݾ঺հ 2 • ୩ຊ ৺ (Shin Tanimoto) - Acroquest Technologyגࣜձࣾ - ࠷ۙ͸Elasticsearchؔ܎ͷ࢓ࣄ - ೔ຊJavaϢʔβʔάϧʔϓ - JavaOne / SpringOneεϐʔΧʔ - Twitter : @cero_t - Facebook : shin.tanimoto

Slide 3

Slide 3 text

Slide 4

Slide 4 text

Slide 5

Slide 5 text

Slide 6

Slide 6 text

Slide 7

Slide 7 text

Slide 8

Slide 8 text

Slide 9

Slide 9 text

Slide 10

Slide 10 text

Copyright © Acroquest Technology Co., Ltd. All rights reserved. Copyright © Acroquest Technology Co., Ltd. All rights reserved. 1. ϚΠΫϩαʔϏε։ൃͷۤ೰ JAR Hell͔ΒService Hell΁ αʔϏεͷ਺͕૿େ͢Δ͜ͱͰ  αʔϏεಉ࢜ͷґଘؔ܎͕෼͔Βͳ͘ͳΔ ͜ͷαʔϏεΛվम͢ΔͱͲ͜ʹӨڹ͢Δʁ ͍·ى͖ͨΤϥʔ͸Ͳ͕͜ݪҼͳͷʁ ͦ΋ͦ΋࢖ΘΕͯͳ͍αʔϏε͸ͳ͍ͷʁ 10

Slide 11

Slide 11 text

Copyright © Acroquest Technology Co., Ltd. All rights reserved. Copyright © Acroquest Technology Co., Ltd. All rights reserved. 1. ϚΠΫϩαʔϏε։ൃͷۤ೰ ӡ༻ऀͩͬͯࠔΔ ؂ࢹ͢΂͖αʔό΍ϓϩηεͷ਺͕ଟ͍ ͢΂ͯͷαʔόͷσΟεΫ΍ϝϞϦ͸େৎ෉ʁ 1000ݸͷϓϩηε͸͢΂ͯਖ਼ৗʹಈ͍͍ͯΔʁ ϩάϑΝΠϧ͕෼ࢄͯ͠͠·͏ ͍·ى͖ͨΤϥʔΛௐ΂ΔͨΊʹɺ  ͲͷϩάϑΝΠϧΛݟΕ͹͍͍ͷʁ 11

Slide 12

Slide 12 text

Copyright © Acroquest Technology Co., Ltd. All rights reserved. Copyright © Acroquest Technology Co., Ltd. All rights reserved. 1. ϚΠΫϩαʔϏε։ൃͷۤ೰ 12 ཱ৔ʹΑͬͯۤ೰͸ҟͳΔ͕  ͍ͣΕʹͤΑαʔϏε͚ͩͰͳ͘  αʔό΍ϩά͕૿͑ͨ͜ͱͰ  ݟΔ΂͖΋ͷ͕൥ࡶԽ͢Δ

Slide 13

Slide 13 text

Slide 14

Slide 14 text

Slide 15

Slide 15 text

Copyright © Acroquest Technology Co., Ltd. All rights reserved. Copyright © Acroquest Technology Co., Ltd. All rights reserved. 2. ՄࢹԽʹ࢖͏πʔϧ܈ ͨͱ͑͹͜͏͍͏πʔϧ܈ αʔϏεؒͷґଘੑΛՄࢹԽʢࠓ೔࿩͢΍ͭʣ Elasticsearch + Spring Cloud Sleuth + Zipkin  ϩάϑΝΠϧΛՄࢹԽʢࠓ೔͸࿩͞ͳ͍΍ͭʣ Elasticsearch + Logstash + Kibana + Filebeat  αʔό΍ϓϩηεͷঢ়ଶΛՄࢹԽʢࠓ೔͸࿩͞ͳ͍΍ͭʣ Elasticsearch + Kibana + Metricbeat 15

Slide 16

Slide 16 text

Slide 17

Slide 17 text

Slide 18

Slide 18 text

Slide 19

Slide 19 text

Copyright © Acroquest Technology Co., Ltd. All rights reserved. Copyright © Acroquest Technology Co., Ltd. All rights reserved. 3. αʔϏεґଘੑͷՄࢹԽ ԿͷͨΊʹ΍Δͷʁ αʔϏεͷվम࣌ʹɺͦͷӨڹൣғΛ֬ೝ͍ͨ͠ Τϥʔ͕ൃੜͨ͠ࡍʹɺ֬ೝ͢΂͖ൣғΛಛఆ͍ͨ͠ ΋͠ɺ࣮ࡍʹ͸࢖ΘΕ͍ͯͳ͍αʔϏε͕͋Ε͹ఀࢭ ͍ͨ͠    → ओʹ։ൃऀ޲͚ͷՄࢹԽͰ͋Δ 19

Slide 20

Slide 20 text

Copyright © Acroquest Technology Co., Ltd. All rights reserved. Copyright © Acroquest Technology Co., Ltd. All rights reserved. 3. αʔϏεґଘੑͷՄࢹԽ Spring Cloud Sleuth + ZipkinͰαʔϏεґଘੑΛՄࢹԽ Spring Cloud Sleuthͱ͸ʁ Distributed Tracing ෳ਺αʔόΛލ͕ΔϦΫΤετʹڞ௨ͷIDΛৼͬͯ  ʢHTTP/AMQPϔομͳͲͰ఻೻ͤ͞ͳ͕Βʣ  ॲཧΛ௥੻Ͱ͖ΔΑ͏ʹ͢Δ࢓૊Έ  Zipkinͱ͸ʁ Distributed Tracing Visualization ෳ਺αʔόΛލ͕ΔϦΫΤετΛՄࢹԽ͢Δ 20

Slide 21

Slide 21 text

Slide 22

Slide 22 text

Slide 23

Slide 23 text

Copyright © Acroquest Technology Co., Ltd. All rights reserved. Copyright © Acroquest Technology Co., Ltd. All rights reserved. 3. αʔϏεґଘੑͷՄࢹԽ Spring Cloud Sleuth + Zipkinͷద༻ Spring Cloud Sleuth ϚΠΫϩαʔϏεͷpom.xmlͷdependenciesʹ  ʮspring-cloud-starter-zipkinʯΛ௥Ճ ίʔυͷมߋ͸Ұ੾ͳ͠ Zipkin ৽نϓϩδΣΫτΛ࡞ͬͯpom.xmlʹ  ʮzipkin-serverʯͱʮzipkin-autoconﬁgure-uiʯΛ௥Ճ MainΫϥεΛҰͭ࡞Δ 23

Slide 24

Slide 24 text

Copyright © Acroquest Technology Co., Ltd. All rights reserved. Copyright © Acroquest Technology Co., Ltd. All rights reserved. 3. αʔϏεґଘੑͷՄࢹԽ Zipkinαʔόͷ։ൃ 24 @SpringBootApplication @EnableZipkinServer public class ZipkinApplication { public static void main(String[] args) { SpringApplication.run(ZipkinApplication.class, args); } }

Slide 25

Slide 25 text

Copyright © Acroquest Technology Co., Ltd. All rights reserved. Copyright © Acroquest Technology Co., Ltd. All rights reserved. 3. αʔϏεґଘੑͷՄࢹԽ Spring Cloud Sleuth + ZipkinͷΠϝʔδ 25 Microservice1 Microservice2 Zipkin Server HTTP Zipkin UI Server Zipkin Client   (spring-cloud-starter-zipkin) Zipkin UI (zipkin-autoconfigure-ui)  Zipkin Server (zipkin-server)

Slide 26

Slide 26 text

Slide 27

Slide 27 text

Slide 28

Slide 28 text

Copyright © Acroquest Technology Co., Ltd. All rights reserved. Copyright © Acroquest Technology Co., Ltd. All rights reserved. 3. αʔϏεґଘੑͷՄࢹԽ ΋͏গ͠৴པੑͷߴ͍ऩू 28 Microservice1 Microservice2 Zipkin Server Zipkin UI  Server Kafka

Slide 29

Slide 29 text

Copyright © Acroquest Technology Co., Ltd. All rights reserved. Copyright © Acroquest Technology Co., Ltd. All rights reserved. 3. αʔϏεґଘੑͷՄࢹԽ ΋͏গ͠৴པੑͷߴ͍ऩू 29 Microservice1 Microservice2 Zipkin Server Zipkin UI  Server Kafka spring-cloud-sleuth-stream  spring-cloud-stream-binder-kafka zipkin-autoconfigure-ui  spring-cloud-sleuth-zipkin-stream  spring-cloud-stream-binder-kafka

Slide 30

Slide 30 text

Copyright © Acroquest Technology Co., Ltd. All rights reserved. Copyright © Acroquest Technology Co., Ltd. All rights reserved. 3. αʔϏεґଘੑͷՄࢹԽ Spring Cloud Sleuth + ZipkinͷΠϝʔδ 30 Name artifactId Log HTTP Kafka Sleuth spring-cloud-starter-sleuth Service Sleuth Stream spring-cloud-sleuth-stream Service Zipkin Client spring-cloud-starter-zipkin Service Zipkin Stream spring-cloud-sleuth-zipkin-stream Zipkin Zipkin UI spring-boot-starter  zipkin-autoconfigure-ui Zipkin Zipkin Zipkin Server spring-boot-starter  zipkin-server Zipkin Stream Kafka spring-cloud-stream-binder-kafka Both

Slide 31

Slide 31 text

Slide 32

Slide 32 text

Slide 33

Slide 33 text

Copyright © Acroquest Technology Co., Ltd. All rights reserved. Copyright © Acroquest Technology Co., Ltd. All rights reserved. 4. ElasticsearchʹΑΔӬଓԽ 33 όοΫΤϯυ͸in-memoryҎ֎ʹ  MySQLɺCassandra  ElasticsearchͳͲ͕બ΂Δ͚Ͳ

Slide 34

Slide 34 text

Copyright © Acroquest Technology Co., Ltd. All rights reserved. Copyright © Acroquest Technology Co., Ltd. All rights reserved. 4. ElasticsearchʹΑΔӬଓԽ 34 όοΫΤϯυΛ  Elasticsearchʹ͢Ε͹  Kibanaͱ͔ͰՄࢹԽͰ͖Μ͡ΌͶʁ

Slide 35

Slide 35 text

Copyright © Acroquest Technology Co., Ltd. All rights reserved. Copyright © Acroquest Technology Co., Ltd. All rights reserved. 4. ElasticsearchʹΑΔӬଓԽ ElasticsearchʹΑΔZipkinͷӬଓԽ ґଘϥΠϒϥϦͷ௥Ճ zipkinϓϩδΣΫτͷpom.xmlͷdependenciesʹ  ʮzipkin-autoconﬁgure-storage-elasticsearch-httpʯΛ௥Ճ -elasticsearch-aws͸Amazon ESઐ༻ʢͨͿΜʣ zipkinϓϩδΣΫτͷapplication.ymlʹ  ʮzipkin.storage.type: elasticsearchʯΛ௥Ճ 35

Slide 36

Slide 36 text

Slide 37

Slide 37 text

Slide 38

Slide 38 text

Copyright © Acroquest Technology Co., Ltd. All rights reserved. Copyright © Acroquest Technology Co., Ltd. All rights reserved. 4. ElasticsearchʹΑΔӬଓԽ 38 ࠓޙʹظ଴ɾɾɾʁ Zipkin v2 span model #939 https://github.com/openzipkin/zipkin/issues/939

Slide 39

Slide 39 text

Slide 40

Slide 40 text

Copyright © Acroquest Technology Co., Ltd. All rights reserved. Copyright © Acroquest Technology Co., Ltd. All rights reserved. ·ͱΊ Spring BootͰ։ൃ͍ͯ͠Δօ͞Μ͸  Spring Cloud SleuthͱZipkinʹΑΔ  αʔϏεґଘੑͷՄࢹԽ͸͙͢Ͱ͖ΔΑ  ElasticsearchʹσʔλΛอଘ͢Δ͜ͱ΋Ͱ͖Δ͚Ͳ  ՄࢹԽ͢Δʹ͸ͪΐͬͱ·ͩਏ͍͔ͳ  ͪͳΈʹো֐΍γεςϜఀࢭ͕ى͖Δ͜ͱେલఏͱͯ͠ɺ  KafkaΛ༻͍ͨ҆ఆԽΛݕ౼͢Ε͹ɺؾ͍ͮͨΒSpring Cloud Stream΍  όοΫϓϨογϟʔͷϝϦοτ͕෼͔ΔΑ͏ʹͳΔΑʂ  ʢݸਓͷײ૝Ͱ͢ʣ 40

Slide 41

Slide 41 text