Fukuoka.go#22

Fukuoka.go#22のLTで使用したSlideです！

Transcript

1. ó¸ý¹òŸ~±~ k^ïV÷¸ó¸ó Î~fï1ó¸ý¹~¹ôüù|rv²Vq~y2ùq|t}Ï y»ClickHouse 1r¹¶»m~'o”{ÿßy»¿Ÿ{t÷ßz V÷¸ó¸ówy2÷ü¿V÷~õzÿýg²Ÿ1¿õöz½ úõü·÷ó²t}Ïu{vOut2 2025/8/7 ClickHouse Masato Suzuki
2. AWS x~fuöó~ÿ÷ü¿V÷1AI o²k~üùûx ClickHouse 1ú²û¿´
   ÷ü¿ ¶·²ÿ¶¹1ÿ»ng1ó¸ý¹ ´óöú¸·ó¹1øÿ1or AI ½úõü·÷ó{zq»´þùü·÷ó ²òŸy»sx²oöxwv1AWS x 5 ~—~fuö³ùüüü·÷óY} (SCA) ²2024 ~12 oý}w~w2s¼{¸º1zûùAWS ~]rz´ óõùNwClickHouse ~¿ŸV÷ý?²g/Ö{ow}~y2 AWS µüó¹x~·ü
   ü¹z³~ Amazon S3, EC2, EKS, Bedrock zy1AWS ~‰µüó¹xClickHouse ²} \w1÷ü¿
   ´÷ù´ó²W2ç[~AWS ¸³·¹ö
   {¹
   üº{ }¿±~y2 wRöz¹Áüùóúö³x
   õ¹üþó¹ AWS ~÷ßzú½ü¹²oy»sxw1÷ü¿ß~ßò{÷ß{ÿß2 ߉{ßxvú½ü¹²ãw1ú¿
   ´ø~÷ü¿V÷w²/¯w ¿Ÿ
   õ¹üþó¹²ßÿw~y2 ]rz»½õúö³xï¼g AWS ~Àýü
   û´óõù|óßy»¿þ~»½õúö³xï¼g~N w1ÿó·÷ó¿úö³»ûzV÷ôÛ²ëû2÷ü¿~Ûyg²úß w1ÛÛwÛo²µýüøw~y2 MPPO,CPPO,AOO {¸»ó¸ý¹³~ _öçzûùx~Y}²tvt~y|1AWS þüÁóø÷üü¹}u w~×_²ÝŸwvzº~y2q_øù´²û³o_PoC ³MP ?Ý|/® öz×_~m¼xzsvt~y2 AWS x~³~{¸º1ClickHouse ÷ü¿V÷~ÿýg²u¹{ßr1zûù~ó¸ý¹rÿ²?{µýüø
3. ClickHouse t}Ï #1 OSS OLAP ÷ü¿ùü¹ m}øó÷~O 40,000+ GitHub Stars ¿t/²» 200,000+ ³ÿõûö³ñóðü ^}o~Ÿ~…{¹oc
4. ó¸ý¹²òŸu{»" k^ï¸ó¸ó" # Î~fï1ó¸ý¹~¹ôüù|rv²Vq~y2o }~Û~Õ¼_my{ö}w~y2 ù|t}Ïy»ClickHouse 1r¹¶»m~' o”{ÿßy»¿Ÿ{t÷ßzV÷¸ó¸ówy2 ÷ü¿V÷~^}{¿}²²¹y1k^ï~ö¿þ ý¸ü²‰z÷ü¿¹ø²1²wV÷ü´ôü xwvošq~y2 ClickHouse ~gýÿÞz}3 t~{g²¿{Ïx»x F1 þ·ó~¸vzòŸ ú²û¿´ð÷vý?w1û[O~o}~Û ²µýüø2×z¿¸ú²/ÿw}ÿ² ßw~y2 /ßøùó¿~¸vzß /ß÷ü¿²w~w1¿Ÿ÷v2u?U¯ ~÷ü¿w²wRözñõ¹üþó¹²ý cw~y2 Þûg~r»¸ó¸ó ç[·¹öð{<¸ó¸ó~{ÿx=| ÿý2·üðü¹z}\w^/³¹ø²g /Ww~y2 Ÿt€qwz1/ûßw²w~wñõ¹üþó¹²òr{{z1y³z·¹öð{²ù\y»2s¼|ClickHouse ~ ¿šwy2
5. ú²û¿´ð × /ß÷ü¿ × ·¹öð³~~3 ï/ ú²û¿´ðg {ÿÿû[OwV÷ÿý öü¹±ü¹ÿß^ÝïgùW1IoT »óµ ü²ùüø1Ok}÷·¹öð1ú²û¿ ´ðÀó·õüüù /ß÷ü¿÷v {ÿÿuUþ²ûw֊ öü¹±ü¹ÿEC µ´øy_V÷1¯× _÷ÿ1ýÀV÷1ÿû¯×ñ¿üóV÷ ç[·¹öð³~ {ÿÿKafka, BI, JSON {sçÿ öü¹±ü¹ÿ÷Ÿÿöwõ1DWH Üß1 ç[V÷ÿö~¿ŸW1÷ü¿ü´¿}\ Þ~V÷ÿöx~ÿClickHouse ~{Og Þ~V÷ÿöw÷wt1 <Ÿu× Ýu× ÷ßg=²\f{ßÿ ýÕ ú²û¿´ð /ß÷ü¿ ÷ßg {ÿ Snowflake · ï ï DWH ߺ Elastic ï · · ýÀ{W ClickHouse ï ï ï ºüûù¶óÀü ClickHouse 1ú²û¿´ðV÷²1ýÀV÷²1÷ü¿¶·²ÿ¶¹²<yøw}»=/~øþ¢wy2
6. z|SaaS ßôüûµó÷úóÀ²¯v~{ÿ ³¹ø~óv SaaS ßôüû÷ü¿ß{ßxº¯_ÿ APM ´Vgøüü¹~¿»þ'¿þþzn Û©/z÷ü¿ß²or µó÷úóÀw߉z´óµ´ø²ßqz |¹³¹øgùW ¹Áüùóúö³xgý u~O<u?Uþ~ú¿¸¹ø/ ýÀ²yv ÷vy»~¯û÷ yß÷v{¸»î‘Õþ'V÷ŸþOO~ ú¹¿ ú²û¿´ð÷vý?~úß|݉ V÷~ïèg }Šö{ow~r»µó÷ûwy_þU² êãÿý \~~/ß´ùóøøV»nw²_Üz w {{Web ú¿¸¹ø´API ³üû{oû µó÷úóÀ~~Þx{ÿ ~Þ ®n ùo·úúº ùóððµó÷úóÀ /Ûr\wùóðð{ßÖÿÏÿ10%
   øùõ³ó¿ß|ÎnÿýzôÛ ¸ùüùü¹ ¸ùü´u~~{Yö{ßÖ _Ü}û²ÝŸy»÷ŸôÛ øüü¹ùü¹ øù󶿷÷ó[OwßÖÿ”ow½xu zt
   þ´¿ýµüó¹ôÛw~ÿí ûüûùü¹ URL 1ü¹ýó¹³üù{{ßxgþÞ} ßÖ {Û~݉ú¿¸¹ø~û}V÷
7. µó÷úóÀ~Ö}2 2 2 ݉zåy~o½ú¹¿ zz¸ùüñ¿üó|wku¼ztÿýg —oöz_Ü~}û|ö÷ ÿ—~øüóùV÷~þþOO öü¶ü_›~êãO¿ {Ûöü¶ü~ßyz¯×}²ÿíw}zt »ó·÷óy_~³óö½¹ømy ³ó÷ù´²ó¹x»½õúö³~ºÜ ÷ÿ‰þ²î{ztÿýg Ok²¿»¹~õí²¿“yú¹¿
8. yßßÖ~ûüº »½õúö³'Ok}÷ ç~WY´ÕøOk²}ûy»±{y´ ùóø~ß['ñÛV÷|ߘ ¿þz¯×V÷ öü¶ü¯×~ßyzvëxñ¿üó}û~ ±{y÷ü¿|߉ ×zžû}û Ýÿö÷z𰴗oöz_Ü~yoßö{ Û{yøüü¹|݉ gß³¹øû÷~ït¹øüü¸ÿClickHouse zy
   ~|{¸º1 <yß~´ùóø´ý°²ßcwv1¿þzßV÷{v=xtv²÷ ýüñ|ìou¼vt~y2
9. ClickHouse {¸»yßßÖ'V÷ ~{ÿ ¿Ÿw~ u]<u?]~w~÷w¹øüü¸ ³¹ø²Z ÷ü¿ß|[t{yûÿözWgU ¹øüü¸ ¿¸úñõ¹üþó¹ yß÷ü¿w²¿¸ú|¿Ÿÿû< uû
   WgU'´ó÷ó¿¹gùW{¸» }û÷ ÷ßz^/º÷·÷ó ¯¿ù¶ù´ºó÷üÿ¹w²Û ï{ëûÿý ClickPipes {¸»}[z÷ü¿×º¿ ¯×W ¹½üþ÷ßg JSON/TSV/CSV zy~ë°W'[ë °W÷ü¿{ÿß ×ö¹½üþ÷vwù5zýÀ_ ²µýüø
10. m}wÿClickHouse ~yßßÖoÏÏ ¯· »½õúö³ýÀÿSyslog, WAF, IDS ýÀzy
    ²yyvClickHouse { Ä SOX ÿß1O³¹ø÷ÿÿöxwvo ¿Ÿ¿¸úwÞûu{oV²sÿ{¿ÿÿý e ³þü¹ ÿû~r¹¶»¯×ÿ¿úó¿1}1ü/
    ²o¼z×ß Web ²¿»¹ýÀ1²÷ú´ùóø²Kafka }uwyßß[ u?Uü³üù²û[Ow֊'V÷w1ñü½úù´º{o ²üðm} ²üðÕ~y²¿·÷ó²ßÖwvðùó¹¿u´Ok¯ú~}û wßw/ ÿow/ ÷ü´ôü^gw~¯×ÿŸW ú²û¿´ð~÷ü´þU²V÷wv´ùóø¿u šï½óú² NetFlow/SFlow ÷ü¿²ClickHouse {׺¿1yß²ßc u~Gbps ~÷ü¿²ú²û¿´ð{÷v {ÛIP ~ñÛ}´wßwšïß~ÿŸW²sf{߯
11. SRE/ Ÿ~ÿöUqÿyßøüü¹ ßÖ²ü½ö¿ñó ër‰} OpenTelemetry Collector: T~øüü ¹/ ýÀ~}\ßÖ ClickPipes: Kafka, S3, PubSub zyx} [³~ ClickHouse: ¿w~'¿Ÿ¿¸ú~W gUDB HyperDX: õû¹¿ó¿ÿŸWUI ÿQickSight ´Grafana ²oÿ
    {ù Datadog {~º¯ë°{ß[{z1y ßøüü¹²ß[ uöo<u~V~øüü¹÷ü¿²O ³¹øwýc »¹¿ðV÷¿¸úwþ¯~ÿŸW x÷Ÿ|ÿý žû~of~yoßöV÷²ÏŸ{ tkú{ßý
12. y³zÿû{²¿´ó¿{óhw}»Oý¸ó¸ó ^/~÷ßg OSS ºü÷ó½ü¹xwv¯´óõù{^/ÿý Cloud þýü¸ùµüó¹xwvy€{{oŸÛ BYOC zûù~ôÛw¿ù¶ùµüó¹xwvÛo m~wöü¹±ü¹ m~ óhw}»o”Ï /ú POS V÷1ü¿þUV÷ ý° IoT ÷Ÿ1u~}÷ šï'¯ ýÀV÷1×_÷ÿ þüÁö³óÀ ûÿnÛ1öü¶ü¯×V÷ <_²wt{=|~~svtzv²1ClickHouse z¹÷mxwvy€{óh|ÿýwy2r¹¶»÷ü¿_ÿJSON, Parquet, Kafka, Fluentd
    {² ÿßwvt~y2
13. ùWzºö¶üðóúö³fu~øþ µó÷úóÀ~o·üó ³¹øv}|ówtôÛ /ß~\îú¿¸¹ø~÷Ÿ þUêã|oö~|\ yßßÖ~o·üó »½õúö³'÷ÿ‰þ|r»|\ zz¸ùü
    ¿üó~}û|߉ ¯×V÷'AI {¸»ÏßV÷ ÿ´öúóù²÷ýüñ ݉·¹öðyßßÖ /kö·¹öðµó÷úóÀ ³¹øgùWxÿŸg~o ºö¶ü
    óúö³<¿x»sx=|oîwy2µó÷úóÀxyßßÖ1}¼~¼~{g²vëw1ó¸ý¹ûüº{\¿{gùzfu²øþw ~w·v2 ~x±ÿClickHouse ÿk^ï~V÷¸ó¸ó 100x ÷vŸþUN ßg~V÷ÿöxwvu10 {¹u100 ]~¿ ŸW²ßÿ PB ÷ü¿÷vý? ú¿
    ´ø~÷ü¿w²¿t
    õ¹üþó¹ ²ýc 0 ç[·¹öðYö ç[´óõù²{wz|¹^/ÿý ClickHouse 1 Ÿvÿú²û¿´ð
    1 Ýv²ÿóó°÷ü¿
    1 @ ys{w²tz|»ÿ÷ßz³~
    1~u{k^ï~V÷¸ó¸ów y2 oo{zq»ClickHouse Cloud |/®}Ÿu¼vt»~AWS wîúü¸÷ó~wy2öùxu³~ó¸ý¹² _º1úN{®u{vOut2