よく聞くけど使ったことないソフトウェアNo.1 KafkaとSnowflake

Slide 1

Slide 1 text

Α͘ฉ͚͘Ͳ࢖ͬͨ͜ͱແ͍ι ϑτ΢ΣΞ/P ,BGLB ͱ 4OPXGMBLF ͪΎΒσʔλ $50ඛপ ༤ଠ $IVSB%"5"JOD

Slide 2

Slide 2 text

$IVSB%"5"JOD ࣗݾ঺հ ΦϑϥΠϯͷ࢟

Slide 3

Slide 3 text

ΦϯϥΠϯͷ࢟ $IVSB%"5"JOD

Slide 4

Slide 4 text

$IVSB%"5"JOD

Slide 5

Slide 5 text

$IVSB%"5"JOD ࣗݾ঺հ ͪΎΒσʔλ$50 %"56.456%*0ࣥߦ໾һ 4OPXGMBLFͷ%BUB)FSPPG5IF :FBS 4OPX7JMMBHFͷଜ௕ ͜ͷࢠ͸ Ζ͋ͪΌΜ

Slide 6

Slide 6 text

$IVSB%"5"JOD ͪΎΒσʔλ$50 %"56.456%*0ࣥߦ໾һ 4OPXGMBLFͷ%BUB)FSPPG5IF :FBS 4OPX7JMMBHFͷଜ௕ ͜ͷࢠ͸ Ζ͋ͪΌΜ ͘͘͞͞ ΍͍ͬͯͧ͘ʂ

Slide 7

Slide 7 text

,BGLBฉ͍ͨ͜ͱ͋Γ·͔͢ʁ $IVSB%"5"JOD

Slide 8

Slide 8 text

$IVSB%"5"JOD "QBDIF,BGLB͸ɺ෼ࢄܕΠϕϯτε τΞ͓ΑͼετϦʔϜॲཧϓϥοτ ϑΥʔϜͰ͋Δɻ"QBDIFιϑτ ΢ΣΞࡒஂ͕؅ཧ͢ΔΦʔϓϯιʔ εͷγεςϜͰɺ+BWBͱ4DBMBΛ༻ ͍࣮ͯ૷͞Ε͍ͯΔɻ

Slide 9

Slide 9 text

$IVSB%"5"JOD ,BGLBͷΞʔΩςΫνϟ #SPLFSDMVTUFS ;PP,FFQFSDMVTUFS ΞϓϦέʔγϣϯ 1VCMJTIFS ΞϓϦέʔγϣϯ 4VCTDSJCFS ,BGLB1SPEVDFS ˞ॻ͖ࠐΈϥΠϒϥϦ ,BGLB$POTVNFS ˞ಡΈࠐΈϥΠϒϥϦ #SPLFS #SPLFS #SPLFS 5PQJD 1BSUJUJPO 1BSUJUJPO 1BSUJUJPO 1BSUJUJPO 1BSUJUJPO 1BSUJUJPO ;PP,FFQFS ;PP,FFQFS ;PP,FFQFS • ,BGLB͸ෳ਺#SPLFSͰΫϥελߏ ੒ɺΫϥελ৘ใ͸;PP,FFQFS ͕࣋ͪɺ#SPLFSͷ୆͕Ϧʔμʔ ͱͳΓΫϥελ؅ཧ • ,BGLBͷϝοηʔδ͸ΩʔόϦϡʔ ܗࣜͷ3FDPSEͱݺ͹Εɺͭͷ 5PQJD͸ෳ਺ͷ#SPLFSʹ෼ࢄ͞Εͨ 1BSUJUJPOͰߏ੒ɺ5PQJD΁ͷ3FDPSE ͷಡΈॻ͖Λ1BSUJUJPO୯ҐͰ෼ࢄฒ ྻԽ͢Δ͜ͱͰߴ଎ͳॲཧΛ࣮ݱ

Slide 10

Slide 10 text

ετϦʔϛϯάͰσʔλΛ౤ೖ͢ΔͳΒ,BGLB Α͋͘Δ͋ΔͰ͢ $IVSB%"5"JOD

Slide 11

Slide 11 text

େྔͷσʔλΛ౤ೖͯ͠෼ੳ͢ΔͳΒ 0-"1ܕͷ%#͕ඞཁͰ͢ΑͶʁ ʢ࠷ۙ͸)5"1΋͋Δ͚Ͳʣ $IVSB%"5"JOD

Slide 12

Slide 12 text

0-"1ͱ͍͑͹ࠓ͸4OPXGMBLFͱ#JH2VFSZ͕࠷ڧ $IVSB%"5"JOD

Slide 13

Slide 13 text

ࠓ೔ͷຊ୊ͷ4OPXGMBLFͱ,BGLB $IVSB%"5"JOD

Slide 14

Slide 14 text

$IVSB%"5"JOD 4OPXGMBLFͷ,BGLB$POOFDUFS͸ํࣜ͋Δ ,BGLB5PQJD 1BSUJUJPO 1BSUJUJPO 1BSUJUJPO 1BSUJUJPO ,BGLB$POOFDUFS QPMM ˞IUUQTEPDTTOPXGMBLFDPNFOVTFSHVJEFEBUBMPBETOPXQJQFTUSFBNJOHLBGLBهࡌͷਤΛݩʹ୯७Խͯ͠࡞ਤ͠·ͨ͠ 4OPXGMBLF *OUFSOBM4UBHF 4 +40/'JMF 5BCMF 4OPXQJQF 4OPXQJQF 4OPXQJQF 4USFBNJOH ,BGLB5PQJD 1BSUJUJPO 1BSUJUJPO 1BSUJUJPO 1BSUJUJPO ,BGLB$POOFDUFS QPMM 4OPXGMBLF 5BCMF $IBOOOFM $IBOOOFM $IBOOOFM $IBOOOFM • 4OPXQJQF ্ ͸ɺ,BGDB$POOFDUFSͰσʔλΛड͚ͯɺ4΁ϑΝΠϧΛ165ɺͦͷޙ4OPXQJQFͱ͍͏ σʔλऔΓࠐΈϓϩάϥϜΛ3&45"1*Ͱىಈ͢ΔͷͰɺ෼஗Ε͘Β͍ͰऔΓࠐ·ΕΔɺ͢ͳΘͪϨΠς ϯγେ͖Ί • 4OPXQJQF4USFBNJOH Լ ͸ɺ,BGLB$POOFDUFSͰड͚ͯ1BSUJPOͱಉ͡਺ͷ$IBOOFMͰฒྻऔΓࠐΈΛߦ͏ ͷͰϨΠςϯγ͸ඵ୯ҐͰύϑΥʔϚϯε΋ߴ͍ʢ(#Tͱ͔ग़ΔΒ͍͠Αʣ • අ༻తʹ͸࣌ؒҐͰສߦྲྀ͠ࠐΜͰɺυϧ͘Β͍ͩΑ ˞1BSUJUJPOͱ$IBOOOFM͸ ͔͜͜Βࠨ͸ετϦʔϛϯά ͔͜͜Βӈ͸ϚΠΫϩόον

Slide 15

Slide 15 text

• (FUUJOH4UBSUFEXJUI4OPXQJQF4USFBNJOHBOE"NB[PO.4, • IUUQTRVJDLTUBSUTTOPXGMBLFDPNHVJEFHFUUJOH@TUBSUFE@XJUI@TOPXQJQF@TUSFBNJOH@BXT@ NTLJOEFYIUNM $IVSB%"5"JOD 2VJDL4UBSU΋͋Δ͔ΒνϟϨϯδͯ͠ΈͯͶ

Slide 16

Slide 16 text

ͪͳΈʹ࠷ۙ͸͞Βʹ ετϦʔϛϯάͷϋʔυϧ͕Լ͕ͬͨ $IVSB%"5"JOD

Slide 17

Slide 17 text

,JOFTJT%BUB'JSFIPTF ,BGLB͡Όͳ͍Α ͷ 4OPXGMBLF4OPXQJQF4USFBNJOHରԠ $IVSB%"5"JOD

Slide 18

Slide 18 text

$IVSB%"5"JOD %BUB'JSFIPTFͷ4OPXQJQF4USFNJOHରԠͷൃද ౦ژʜͳ͍ͩͱʁ

Slide 19

Slide 19 text

$IVSB%"5"JOD ͱ͜Ζ͕ɺ͖ͬ͞ݟͨΒ Ωςλʔʔ

Slide 20

Slide 20 text

$IVSB%"5"JOD • (FUUJOH4UBSUFEXJUI4OPXGMBLFBOE"NB[PO%BUB'JSFIPTF • IUUQTRVJDLTUBSUTTOPXGMBLFDPNHVJEFHFUUJOH@TUBSUFE@XJUI@TOPXGMBLF@BOE@BXT@LEGJO EFYIUNM 2VJDL4UBSU΋Ͱ͍ͯΔ

Slide 21

Slide 21 text

࠷ޙʹ $IVSB%"5"JOD

Slide 22

Slide 22 text

$IVSB%"5"JOD ͪΎΒσʔλͷએ఻ίʔφʔ