Story tales and Legends about the Real Time company

Ed81876bf33da90cdae47ce9b8df056b?s=47 Loïc DIVAD
November 28, 2019

Story tales and Legends about the Real Time company

Ed81876bf33da90cdae47ce9b8df056b?s=128

Loïc DIVAD

November 28, 2019
Tweet

Transcript

  1. None
  2. None
  3. Apache Kafka Lover Loïc DIVAD

  4. Story Tale #0

  5. The unexpected digital business

  6. The unexpected digital business

  7. Event Stream Applications

  8. SINGLE EVENT CAN’T BE MODIFIED LINKED TO A SINGLE ACTION

    HAS A EVENT TIME Event Stream Applications
  9. EVENTS STATE Event Stream Applications

  10. In the previous episode: Big Data

  11. ??? 2004 MapReduce & GoogleFS Apache Hadoop 2008 Cloud Dataproc

    & Elastic Map Reduce 2016 2011 Big Data Distributions
  12. Story Tale #1

  13. What is the Lambda Architecture? WE ARE OUT OF TULIPS

    1X / J
  14. What is the Lambda Architecture? WE ARE OUT OF TULIPS

  15. The operational burden

  16. The λimitations • Schema evolution issues • Two styles of

    operations • Debugging is a mess • Alerting consistency • Double code debt THE TULIPS ARE BACK
  17. Standing on the shoulders of giants

  18. Story Tale #2

  19. Databases Message Queues

  20. Centralized Event Log YEP !! logisticS MARKETING LEGAL THERE IS

    A HUGE DEMAND FOR TULIPS
  21. Apache Kafka, Stream Data Platform Rock Star • • •

  22. Apache Kafka Community

  23. Story Tale #3

  24. Delivery semantics I’M NOT SURE IF WE “DOUBLED” OUR SALES

    THIS YEAR ... APPLICATION FAILURE RETRY
  25. Data loss APPLICATION REPLICATION ACKNOWLEDGEMENT HOW COULD YOU LOSE THE

    TRACK OF THIS TREE?… IT’S A SEKOYA
  26. Schema Evolution and Compatibility SCHEMA REGISTERY APPLICATION THIS TOPIC SHOULD

    CONTAIN USER INFORMATIONS, RIGHT?... RIGHT???
  27. Immutability and compliance 0 1 2 3 4 5 6

    7 8 0 1 2 3 4 5 6 7 8 Log Compaction Strategy
  28. Story Tale #127

  29. Why would the data be passive?

  30. Command Provider selection Command planning Order prioritization Software interaction

  31. Command Provider selection Command planning Order prioritization Software interaction

  32. The more software you have, the more digital you are

    you have to deal with software
  33. Digital business shines through interaction between their software!

  34. Beyond the real time goodies • Breaking silos • Streaming

    ETL • Continuous analytics • New reactive features • Augmented experiment
  35. Conclusion

  36. Merci

  37. Merci

  38. Pictures Photo by Janko Ferlic from Pexels Photo by Plush

    Design Studio on Unsplash Photo by Andrew Teoh on Unsplash Photo by Joey Kyber on Unsplash Photo by Ruchindra Gunasekara on Unsplash Photo by Jen Theodore on Unsplash Photo by Austin Distel on Unsplash Vidéo de Pixabay provenant de Pexels Photo by Maksym Kaharlytskyi on Unsplash Photo de Gratisography provenant de Pexels Photo de Matheus Bertelli provenant de Pexels Photo de Pixabay provenant de Pexels Photo by NeONBRAND on Unsplash Angry Cuddly Bear Free Photo — By Ryan McGuire
  39. Pictures Photo by Daniel Jensen on Unsplash Photo by Charles

    on Unsplash Photo by Kevin Horvat on Unsplash Photo by Blake Wisz on Unsplash Photo by Biel Morro on Unsplash Photo by Cindy Chan on Unsplash Photo by Debby Hudson on Unsplash Photo by Paolo Bendandi on Unsplash Photo by Sidney Pearce on Unsplash Photo by Daryan Shamkhali on Unsplash Drawings adapted from /xkcd.com, a work is licensed under a Creative Commons Attribution-NonCommercial 2.5 License… thank you guys!
  40. The very end

  41. If you need to cross the street, would you do

    it with information that is five minutes old?