Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Tips & Tricks about Apache Kafka in the Cloud f...
Search
Ricardo Ferreira
May 27, 2019
Programming
0
690
Tips & Tricks about Apache Kafka in the Cloud for Java Developers
Ricardo Ferreira
May 27, 2019
Tweet
Share
More Decks by Ricardo Ferreira
See All by Ricardo Ferreira
Elastic Community Conference CfP Clinic
riferrei
0
64
Criando Provedores Customizados para Terraform
riferrei
0
80
From Zero to Hero with Observability in Microservices
riferrei
0
110
Construíndo seu Primeiro Provider para Terraform
riferrei
2
530
Understanding Streaming Data and Analytics with Apache Kafka®
riferrei
1
540
Kafka Meetup from March 2020
riferrei
1
380
BU Talk Fev 2020
riferrei
0
160
Boston Meetup, Fev 2020
riferrei
0
56
Building Event Streaming Applications with Serverless Kafka
riferrei
1
470
Other Decks in Programming
See All in Programming
型付きアクターモデルがもたらす分散シミュレーションの未来
piyo7
0
810
XSLTで作るBrainfuck処理系
makki_d
0
210
deno-redisの紹介とJSRパッケージの運用について (toranoana.deno #21)
uki00a
0
150
コードの90%をAIが書く世界で何が待っているのか / What awaits us in a world where 90% of the code is written by AI
rkaga
46
31k
iOSアプリ開発で 関数型プログラミングを実現する The Composable Architectureの紹介
yimajo
2
210
C++20 射影変換
faithandbrave
0
530
童醫院敏捷轉型的實踐經驗
cclai999
0
190
なぜ「共通化」を考え、失敗を繰り返すのか
rinchoku
1
510
PHPでWebSocketサーバーを実装しよう2025
kubotak
0
160
AIエージェントはこう育てる - GitHub Copilot Agentとチームの共進化サイクル
koboriakira
0
380
技術同人誌をMCP Serverにしてみた
74th
1
360
Go1.25からのGOMAXPROCS
kuro_kurorrr
1
800
Featured
See All Featured
Understanding Cognitive Biases in Performance Measurement
bluesmoon
29
1.8k
The World Runs on Bad Software
bkeepers
PRO
69
11k
4 Signs Your Business is Dying
shpigford
184
22k
Helping Users Find Their Own Way: Creating Modern Search Experiences
danielanewman
29
2.7k
Product Roadmaps are Hard
iamctodd
PRO
54
11k
Done Done
chrislema
184
16k
Build your cross-platform service in a week with App Engine
jlugia
231
18k
XXLCSS - How to scale CSS and keep your sanity
sugarenia
248
1.3M
KATA
mclloyd
29
14k
Mobile First: as difficult as doing things right
swwweet
223
9.7k
Optimizing for Happiness
mojombo
379
70k
Fireside Chat
paigeccino
37
3.5k
Transcript
Ricardo Ferreira Developer Advocate
None
Can We Though? "Dude, you are embarrassing me in front
of the wizards…" SSH? Tunneling? VPC? Encryption? HPC? HA? RPO? RTO? Sizing? Existing Java Code? @riferrei #jbcn19
About Us: • Ricardo Ferreira ◦ Developer Advocate @ Confluent
◦ Ex-Oracle, Red Hat, IONA Tech ◦ Currently ~70% Dev, ~30 Ops ◦ https://riferrei.net • Echo Dot (Alexa) ◦ The voice behind Amazon ◦ Ex-Raspberry Pi, Terminator? @riferrei @alexa99
None
None
Apache Kafka Clusters are Not Easy to Manage!
Use Serverless Managed Services to Offload your Projects! @riferrei #jbcn19
Demo: Creating a cluster for a Java Application @riferrei #jbcn19
None
None
@riferrei #jbcn19 Applications VPC consumer_01 conusmer_02 consumer_03 topic_name_01 topic_name_02 topic_name_03
Schema Registry Apache Kafka Cluster VPC consumer_04
Watch Out for These Guys… @riferrei #jbcn19
@riferrei #jbcn19 On Premises topic_name_01 topic_name_02 topic_name_03 Confluent Replicator Schema
Registry topic_name_01 topic_name_02 topic_name_03 Schema Registry Public Cloud
Demo: Showing a Peered VPC in GCP @riferrei #jbcn19
None
None
Observability = Metrics + Logs + Distributed Tracing @riferrei #jbcn19
Why Distributed Tracing is Important? System IS NOT Working! System
IS Working! Time Spent with Troubleshooting: Days, Weeks or even Months! @riferrei #jbcn19
https://github.com/opentracing-contrib/java-kafka-client Apache Kafka Client + Spring Kafka + Kafka Streams
https://github.com/riferrei/jaeger-tracing-support Kafka Connect, REST Proxy, Schema Registry, KSQL @riferrei #jbcn19
None
@riferrei #jbcn19
Scan the barcode to create events @riferrei #jbcn19
https://github.com/riferrei/the-song-is Demo Source-Code @riferrei #jbcn19
None
None
https://github.com/confluentinc/ccloud-tools Terraform Scripts for Kafka Connect, REST Proxy, KSQL https://github.com/confluentinc/cp-ansible
Ansible Playbooks are also Available as Well! @riferrei #jbcn19
Free Books by Confluent
[email protected]
@riferrei #jbcn19 http://cnfl.io/slack
None