Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Meeseeks-Final-Edit

Efec8ffb04df3ef79fc75bf37bd9a2c1?s=47 Gaurav
October 29, 2019

 Meeseeks-Final-Edit

Efec8ffb04df3ef79fc75bf37bd9a2c1?s=128

Gaurav

October 29, 2019
Tweet

Transcript

  1. None
  2. None
  3. VM: Virtual Machine. BM: Baremetal BCP: Business Continuity Program DC:

    Data-Center
  4. • • • ◦ ◦ ◦

  5. … • ◦ ◦ ◦ • ◦ ◦ ◦

  6. None
  7. None
  8. None
  9. None
  10. • ◦ ◦ ◦ ◦ • ◦ ◦ ◦ ▪

    ▪ ▪
  11. • • • •

  12. • • ◦ ◦ ◦

  13. • • •

  14. • • ◦

  15. • • • •

  16. • Graph of services across Flipkart. • Understands dependencies between

    services. • Enable org-wide scenarios like BCP • Rich querying on service topologies. • Intelligent cluster-recognition.
  17. • ◦ ◦ •

  18. • ◦ ◦ ◦ ◦ • ◦ ◦ ◦ ◦

  19. • • •

  20. • Enrichment of the data • Builds real-time service topology

    of Flipkart network. • Intelligent data-store cluster recognition. • Store in a graph DB.
  21. • Identify the services running on VMs using port scan.

    • Cluster data-stores on the basis of services running on VMs and network topology. • We cluster Hadoop, MySql, ElasticSearch, Redis, Aerospike, MongoDB and many more.
  22. None
  23. None
  24. None
  25. None
  26. Meeseeks Overlays • “Overlays” sprinkle additional information on the base

    service-graph layer. • Overlay definition - a set of possible annotations over the graph nodes and edges • Meeseeks provides APIs to ◦ Create / register custom overlay ◦ Annotate the base Meeseeks graph with custom overlay data ◦ Query based on the annotations
  27. Meeseeks Overlays’ Example • Data DR overlay ◦ Trigger an

    event to the Backup/DR infrastructure ◦ Validate schedules configured for recovery point objective etc. • BCP overlay ◦ Tag services with a certain “criticality level” and a recovery time objective for the same in case of a disaster ◦ Tag edges as “essential”, “optional” etc. ◦ Detect anomalies.
  28. Tag annotations on Services

  29. Tagged Services

  30. None
  31. Anomaly Detection

  32. Anomaly Detection Contd...

  33. Services Boot Order

  34. Meeseeks Journey So Far • • ◦ •

  35. contd.. • •

  36. Iftop • Couldn’t capture all the data packets, hence loss

    of information. • Compute resource consumption on each baremetal. Conntrack • Once deployed, no easy way to rollback without impacting the host machine. • Compute and memory resource consumption on baremetal.
  37. • ◦ ▪ ◦ ▪ • • •

  38. • • • • •

  39. Gaurav Sharma gaurav.ss@flipkart.com 9901429252