Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Kullect All The Things

Kullect All The Things

Tools and Metrics in a Kubernetes World

Felix Rodriguez

September 09, 2016
Tweet

Other Decks in Technology

Transcript

  1. Who Am I? • DevOps @ Vungle • Tools, Metrics

    / R&D • Golang Developer • Digital Nomad @feelobot
  2. Kubernetes • Build, Test, Deploy, & Push • Uniform scaling

    & monitoring • Cloud agnostic • HA Nodes • Secret management • Service discovery • Jobs & Daemons
  3. KubeMon (wip) • Heapster: Emits metrics using CAdvisor to various

    “sinks” • InfluxDB: Time series database to store metrics. • Grafana: Visualization tool • Kapacitor: Data processing & alerting • All dockerized and running in kube https://github.com/feelobot/kubemon heapster kapacitor
  4. Labelgun: • Dynamic Kube node tagging through AWS • Adds

    AWS metadata to Kube nodes • Easy node affinity • Simple to deploy • Easy to contribute https://github.com/Vungle/labelgun
  5. KubeWatcher • Watches your pods for state changes • Submits

    Changes as Datadog Events https://github.com/Vungle/kube-watcher
  6. Heapster • Developed by Kubernetes • Easy to Deploy •

    Multiple Sinks • Good Metric Coverage • Defined Schema • Required for Autoscaling in Kubernetes
  7. InfluxDB • Opensource • Written in Golang • One of

    the Default Sinks • Easy to Run • Easy to Query • Accepts multiple protocols • Great Compression • Offers hosted solution • Works well with Grafana • Super efficient
  8. Kullect (WIP) • Kapacitor UDF • Analyzes incoming resource usage

    and requests • Communicates with AWS API to determine current cluster cost • Detailed cost on a per container, pod, or service level. https://github.com/Vungle/kullect
  9. What is Next? • GCE and AWS support for hybrid

    cloud app invoicing • Downsampling via CQs • Email/Slack Reports • Kapacitor as a pod • Kullect as a container • Better algorithm to determine cost. • Differentiate between on-demand, reserved, and spot • Cost badges for Github