From logging to monitoring to reactive insights

Transcript

1. From logging to monitoring to reactive insights Christian Schneider
2. Christian Schneider » For the last 6 years: Open Source Architect at Talend » Since October: Computer scientist at Adobe. » Apache member and committer » Twitter @schneider_chris » Website liquid-reality.de
3. What you will learn » Apache Karaf Decanter + Elastic Search + Kibana » Approaches for central monitoring and logging » Custom reactive processing to produce higher level informations
4. Basic logging in OSGi » Pax logging » Logback » Log4j2 Files
5. Monitoring Hawtio JVisualVM • Great tools • Developer focused • Production?
6. Production logging Central History Drill down Custom processing
7. ELK Stack Karaf Elastic Search + Kibana Logstash Server File Beat Metric Beat
8. Apache Decanter Karaf + Decanter Elastic Search + Kibana
9. Decanter architecture Collector Event Admin Appender
10. Apache Decanter Collectors • Pax-Logging • JMX • EventAdmin • Camel • ActiveMQ • ... Events Appenders • File • DB • Elastic Search • Kafka • JMS • ...
11. Decanter setup for single machine JMX Collector Log Collector Camel Collector Event Admin Elastic Search Appender
12. Decanter for multiple servers Server 1 + Decanter Server 2 + Decanter Kafka Cluster Kafka Cluster Elastic Search + Kibana Decanter
13. Decanter + logstash Server 1 Karaf Decanter Server 2 Spring boot Beats Kafka Cluster Kafka Cluster Elastic Search + Kibana Logstash Server Server 3 Tomcat Beats
14. CXF Message logging Client Server Request Out Request In Response Out Response In slf4j slf4j • Meta data as MDC properties • Message id and correlation id • Service name as logger name
15. Extending Decanter » Collectors » Appenders » Filter, Enrich Events » “Complex” Event Processing using Reactive Components
16. Event Processing use case » Compute “up time” of bundles by noting start and stop events and sending an event with the bundle runtime on stop » Alert when we we have more than x percent errors in logged CXF messages » Correlate request and response into one message sent through decanter » Only send aggregated events when your source produces Events very fast
17. Demo time Decanter in action
18. Thanks for your attention Questions?
19. Further reading Demo code Apache Karaf decanter CXF message logging Reactive Components