Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Everything you Wanted to Know about Apache Kafka But you Were Too Afraid to Ask!

Everything you Wanted to Know about Apache Kafka But you Were Too Afraid to Ask!

Ricardo Ferreira

July 22, 2019
Tweet

More Decks by Ricardo Ferreira

Other Decks in Programming

Transcript

  1. Join the Confluent Community Slack Subscribe to the Confluent blog

    cnfl.io/slack cnfl.io/read Welcome to the DURHAM, NC Apache Kafka® Meetup! 6:00pm Doors open 6:00pm - 6:30pm Pizza, Drinks and Networking 6:30pm - 7:00pm John turner, mediamath 7:00pm - 8:00pm Ricardo ferreira, confluent Apache, Apache Kafka, Kafka and the Kafka logo are trademarks of the Apache Software Foundation. The Apache Software Foundation has no affiliation with and does not endorse the materials provided at this event.
  2. @riferrei | #kafkameetup | @CONFLUENTINC Everything you wanted to know

    about kafka But you were too afraid to ask! @riferrei | #kafkameetup | @CONFLUENTINC
  3. About Us: • Ricardo Ferreira ❑ Developer Advocate @ Confluent

    ❑ Ex-Oracle, Red Hat, IONA Tech ❑ [email protected] ❑ https://riferrei.net • Alexa (amazon echo) ❑ The voice behind Amazon ❑ Ex-Raspberry Pi, Arduino ❑ She is a female in character! @riferrei @alexa99
  4. @riferrei | #kafkameetup | @CONFLUENTINC databases 30 years ago… Dude,

    you're embarrassing me in front of the wizards… Databases these days…
  5. @riferrei | #kafkameetup | @CONFLUENTINC How easy is to change

    a etl code because the data model changed?
  6. @riferrei | #kafkameetup | @CONFLUENTINC Databases to eliminate the need

    to process data! Database for large amounts of data!
  7. 26 ETL/Data Integration Messaging Batch Expensive Time Consuming Difficult to

    Scale No Persistence After Consumption No Replay Highly Scalable Durable Persistent Ordered Fast (Low Latency) What is happening in the world What happened in the world
  8. 27 ETL/Data Integration Messaging Batch Expensive Time Consuming Difficult to

    Scale No Persistence After Consumption No Replay Highly Scalable Durable Persistent Ordered Fast (Low Latency) What is happening in the world What happened in the world Highly Scalable Durable Persistent Ordered Fast (Low Latency) Event Streaming Thinking
  9. @riferrei | #kafkameetup | @CONFLUENTINC “The truth is the log.

    The database is a cache of a subset of the log.” — pat helland Immutability changes everything http://cidrdb.org/cidr2015/Papers/CIDR15_Paper16.pdf
  10. @riferrei | #kafkameetup | @CONFLUENTINC 01 Messaging done right 02

    Scalable data pipelines 03 Stream processing @riferrei | #kafkameetup | @CONFLUENTINC