IBM Logging and Monitoring Service in IBM Bluemix

The Logging and Monitoring Service in IBM Bluemix provides Elasticsearch capability to containers and VMs in IBM Bluemix. We'll show the current service, talk about our experience scaling Elasticsearch to support cloud level scale, and show where we're headed in the future.

Transcript

1. ©2015 IBM Corporation 1 IBM Bluemix Logging and Monitoring Service Paul Tippett IBM Software Engineer and Technical Lead February 18, 2016
2. ©2015 IBM Corporation 2 IBM IBM 2 Bluemix Monitoring and Logging Service: Use Cases • What does the service do? • Provides access to monitoring and logging for your Bluemix applications, allowing quick debug and root cause analysis. • Who uses it? - Bluemix VM Service Customers - Bluemix Container Cloud Customers - Internal Infrastructure - Why Use it? - Minimal Setup to get both logging and monitoring function - Default Filters
3. ©2015 IBM Corporation 3 IBM Openstack Control Plane Virtual Machines on bare metal Elasticsearch Cluster Logstash Cluster Kafka Cluster Cloud-based services Metrics topic Logging topic Graphite Cluster Zookeeper Cluster Carbon Cache Cluster Containers Grafana Kibana Logs Ingestion Cluster Metrics Ingestion Cluster Load balancing IBM 3 Bluemix monitoring & logging service: Architecture
4. ©2015 IBM Corporation 4 IBM IBM 4 Bluemix Monitoring and Logging Service: Lessons Learned • The flow of incoming data never stops • Can’t easily predict the type of data • Must anticipate and adjust to varying amounts of load • Tuning Clusters for both 1000s of small clients and a few large clients is challenging • Need a common multi-tenancy model
5. ©2015 IBM Corporation 5 IBM IBM 5 Demos!
6. ©2015 IBM Corporation 6 IBM IBM 6 Thank You