Google Cloud Next 2019 わくわく報告会 / Google Cloud Next 2019 WakuWaku Report

https://mercaridev.connpass.com/event/125881/

Transcript

1. Google Cloud Next 2019 Θ͍Θ͍ใࠂձ In Mercari Θ͔Ί ·͞ͻΖ
2. Θ͔Ί ·͞ͻΖ @v vakame Masahiro Wakame Go GraphQL TypeScript AppEngine
3. US ڧߦ܉ •04/06 from HND to SFO •04/09-11 Cloud Next •04/11-12 from SFO to HDN •04/14 ٕज़ॻయ6 (27Kmา͍ͨ) •04/17 ࠓ೔ʂʂ ·ͩ࣌ࠩϘέͯΔ
4. ࠓճͷײ૝ (1/3) •ΞϓϦدΓ։ൃऀతʹ͸NOT FUN •※ AppEngine/SE ͳਓؒͰ͢ •Anthosʹ࢝·ΓEnterpriseܥͷ࿩୊ଟ͠ •Google͕Cloudࢢ৔ຊؾͰऔΓʹདྷͨײ
5. ࠓճͷײ૝ (2/3) •Kubernetes͔Β͸ಀ͛ΒΕͳ͍…ʂ •͋Δఔ౓֮ޛܾΊΔඞཁ͕͋Γͦ͏ •͋ͱ1-2೥ఔ౓͸ಀ͛ΒΕΔؾ΋͢Δ •ฐࣾʹ͸SREνʔϜ͕ډͯΑ͔ͬͨ
6. ࠓճͷײ૝ (3/3) •Kubernetesͷcluester࠶࡞੒͔Β΋… •ಀΕͳ͍֮ޛΛͨ͠΄͏͕޾ͤʁ •Traffic Director… Istio… etc?
7. ࠓճͷײ૝ (4/3) •AppEngine͸ࢮͳΜ͞…ʂ •Cloud Run ͍͢͝Αͦ͞͏Ͱ͢Ͷ •2nd genͷҙຯ߹͍มΘ͖ͬͯͨ •ͬͯࢠݘࣂͬͯΔແ৬͕ݴͬͯͨ
8. Spanner Internals ࠓ೔ͷຊ୊Ͱ͢ https://gist.github.com/vvakame/fd8e3e7b0ee430e9e62e83a500fd355f
9. Spanner Internals Part 1: What Makes Spanner Tick? Spanner Internals Part 2: How GCP Builds Global Meta-Data and Scalable Data Backends on Spanner ࠷ۙɺࣾͰSpanner͕ ϗοτͩͬͨͷͰ… https://cloud.withgoogle.com/next/sf/sessions?session=DBS304 https://cloud.withgoogle.com/next/sf/sessions?session=DBS306
10. Spannerͱ͸ʁ •Relational DBͱಉ͡semantics •Schemas, ACID, Transactions, SQL •Horizontal Scale •Scale out Ͱ͖Δʂ •MySQLͱ͔͸Ͱ͖ͳ͍…
11. Ͳ͏΍ͬͯʁ •PaxosΞϧΰϦζϜ •෼ࢄ߹ҙͷͨΊͷϓϩτίϧ •͙͙Εʂ(Θ͔Δ͚ͲΘ͔Βͳ͍ •TrueTime API •TxOpsͷॱং෇͚͕Մೳʹ
12. TrueTime? https://youtu.be/nvlt0dA7rsQ?t=860
13. TrueTime? •࠷৽ͷߏ੒ͷ঺հ •1ϥοΫʹ4αʔό •2αʔό → GPSΛ࢖ͬͨ࣌ࠁಉظ •2αʔό → ݪࢠ࣌ܭΛ࢖ͬͨ࣌ࠁಉظ •2ͭͷݪࢠ࣌ܭͷϒϥϯυ͸෼͚Δ
14. TrueTime? •TrueTimeΛ࢖͏ͱૢ࡞ͷॱ൪͕Ұҙʹ •௨৴ແ͠ʹͰ͖Δ͜ͱ΋ଟ͍ •ৄ͘͠͸͙͙Εʂ
15. Read, Write https://youtu.be/nvlt0dA7rsQ?t=977
16. ࢼ࡞൛Spanner •3-4ݸ͘Β͍ࢼ࡞Λ࡞ͬͨΒ͍͠ •2-3೥͔͔ͬͨ •৭ʑͳϛεΛͨ͠… •࠶ؼతͳσΟϨΫτϦͷαϙʔτͱ͔ •࣌ؒܦաͰղܾ͠Α͏ͱͨ͠Γͱ͔
17. ϑΝΠϧγεςϜͷ࿩ •ColossusͱBigtable্ʹߏங •File Systemͱಠཱ͍ͯ͠Δ •ϑΝΠϧ؅ཧ΍Hot spot໰୊͸੾Γ཭͠ ͯߟ͑Δ͜ͱ͕Ͱ͖ΔΒ͍͠ SpannerʹHot spot໰୊͕ͳ͍Θ͚Ͱ͸ͳ͍
18. ҆ఆੑͷ࿩ʁ •ׂͱΈΜͳΑ͘ಈ͘ •TrueTime΋৺഑Λਧ͖ඈ͹ͨ͠ •Paxos΋ૉ௚ʹΑ͘ಈ͘ •CAPఆཧ •͋Δ͚Ͳਓੜͷେ൒͸͏·͍͘͘
19. ConsistencyͷͭΒΈ •Eventual consitencyਏ͘ͳ͍ʁ •Strong consistency͸ਓੜ͕๛͔ʹͳΔ •͋ʔͦΕΊͬͪΌΘʔ͔ʔΔʔ •୯७ʹߟ͑Δ͜ͱ͕ݮΔ •ίʔυॻ͘ྔ΋ݮΔ
20. SQL͍͍ΑͶ… •ॊೈ •ܕ͕͋Δʂ •΍ͬͺΓSchema͕͋Δͷͬͯਆ΍ͳ
21. ୭͕࢖ͬͯΔͷ •Merpay͕࢖ͬͯΔΑʂ •…͸ஔ͍ͱ͍ͯ •Google͕ΨϯΨϯ࢖ͬͯΔΑʂ •୅දࣄྫͱͯ͠GCSͰͷ࿩͕ΨοπϦ
22. Googleͱಉ͡΋ͷʁ •͍͍ͩͨಉ͡ •ಉ͡Πϯϑϥ… •ಉ͡όΠφϦ…
23. Googleͱಉ͡΋ͷʁ •ҟͳΔ •ΞΫηεύε •ηΩϡϦςΟ, ίϯϓϥ •༻ޠ • Cloud Spanner nodes →
 ɹSpanner Servers • Cloud Spanner instance configurations →
 ɹSpanner configurations
24. GCSͷ࿩ •GCSͷmetadataͷ؅ཧ͸͢΂ͯSpanner •SpannerʹΑΔϝϦοτͷ࿩ͨ͘͞Μ •Multi regionͳҰ؏ੑ •Strongly consistent listings
25. GCSͷ࿩ https://youtu.be/zy-rcR4MoN4?t=604
26. GCSͷ࿩ https://youtu.be/zy-rcR4MoN4?t=834
27. GCSͷ࿩ https://youtu.be/zy-rcR4MoN4?t=1936
28. མͪึर͍ •Spannerͷྺ࢙ https://youtu.be/nvlt0dA7rsQ?t=1601
29. References •https://bit.ly/2KLGqIB •https://bit.ly/2wvMFWt •http://bit.ly/2vaskps •http://bit.ly/2IDjgl0