Visualizing Test Automation with ELK and Grafana

Joonsoo Lee (Joon) (LINE Plus / Q / QA Engineer)

https://tech-verse.me/ja/sessions/94
https://tech-verse.me/en/sessions/94
https://tech-verse.me/ko/sessions/94

Transcript

2. Test Automation
3. ===================================== Test Suite Total tests run: 5, Passes: 5, Failures: 0, Skips: 0 ===================================== Process finished with exit code 0
4. Waiting
5. Joonsoo, LEE QA Engineer at LINE + LINE Desktop in Q Automation Testing Like : Coffee and Desk-Interior Who am I?
6. Agenda - Overview - Observe a Problem - Action Items - What have been Improved - What have been Expanded
7. Overview
8. Overview Jenkins Filebeat Solution LOG Logstash Grafana Elasticsearch Slack Alert Alert
9. Overview
10. Overview
11. Problem
12. Services
13. Services
14. Services
15. Services
16. Test Jobs
17. Test Jobs Regression Test
18. Test Jobs Quick Test Regression Test
19. Test Jobs Quick Test Scheme Test Regression Test
20. Test Jobs Quick Test Scheme Test Regression Test Other
21. Test Jobs Quick Test Scheme Test Regression Test Other
22. Everyday write reports
23. Everyday write reports
24. Everyday write reports
25. Monitoring
26. Monitoring
27. Action Items
28. What should I do?
29. What should I do? Construct ELK Pipeline Pipeline
30. What should I do? Construct ELK Pipeline Define Log Fields Log Pipeline
31. What should I do? Construct ELK Pipeline Define Log Fields Develop ActionLog Script Log Logger Pipeline
32. What should I do? Construct ELK Pipeline Define Log Fields Develop ActionLog Script Create Dashboard Log Logger Dashboard Pipeline
33. What I consider?
34. What I consider? OpenSource
35. What I consider? OpenSource Flexibility
36. What I consider? OpenSource Flexibility Scalability
37. What is ELK Stack?
38. What is ELK Stack? Elasticsearch
39. What is ELK Stack? Elasticsearch Logstash LOG LOG LOG
40. What is ELK Stack? Elasticsearch Logstash Kibana LOG LOG LOG
41. Based Architect Logstash Elasticsearch LOG LOG LOG
42. Based Architect Logstash Beat Elasticsearch LOG LOG LOG
43. Heimdall Architect
44. Heimdall Architect Filebeat Filebeat Filebeat LOG LOG LOG
45. Heimdall Architect Logstash Filebeat Filebeat Filebeat LOG LOG LOG
46. Heimdall Architect Logstash Filebeat Filebeat Filebeat LOG LOG LOG
47. Heimdall Architect Logstash Elasticsearch Filebeat Filebeat Filebeat LOG LOG LOG
48. Define Log Fields
49. Action OSVersion ApplicationVersion ApplicationPhase DeviceName TestCaseName DeviceResolution TestResult ApplicationName TestEnvironment Exception LogLevel TestSuiteName TestServiceName TestStartDateTime TestEndDateTime ElapsedTime Define Log Fields
50. What is Logger?
51. What is Logger?
52. Develop ʮActionLogʯ
53. Develop ʮActionLogʯ Tap FindText EnterText TerminateApplication ActivateApplication FindImage InstallApplication Wait Press Pinch UninstallApplication
54. Develop ʮActionLogʯ Tap FindText EnterText TerminateApplication ActivateApplication FindImage InstallApplication Wait Press Pinch UninstallApplication LOG ActionLog.Script
55. Logs Execute Test
56. Logs Execute Test
57. What is Grafana?
58. What is Grafana? Grafana
59. What is Grafana? Grafana Source Data
60. What is Grafana? Grafana Source Data Chart, Graphs, Metric Dashboard
61. Heimdall Architect
62. Heimdall Architect Grafana Elasticsearch
63. Heimdall Architect Grafana Queries Elasticsearch
64. Heimdall Architect Grafana Queries Elasticsearch Chart, Graphs, Metric Dashboard
65. Dashboard
66. Dashboard
67. Dashboard
68. Improve
69. Improve
70. Improve Realtime
71. Improve Realtime Visualize
72. Improve Realtime Visualize Save Time
73. Expand
74. CI/CD and Notification
75. CI/CD and Notification Jenkins CI/CD
76. CI/CD and Notification Jenkins CI/CD Slack Notification
77. Whole Architect in Automation Test
78. Whole Architect in Automation Test Jenkins GitHub QA Engineer Automation Test Logging Platform (Heimdall) Elasticsearch Logstash LOG Filebeat Solution Filebeat LOG
79. Whole Architect in Automation Test Dashboard Jenkins GitHub QA Engineer Slack Grafana Automation Test Logging Platform (Heimdall) Elasticsearch Logstash LOG Filebeat Solution Filebeat LOG
80. Whole Architect in Automation Test Dashboard Jenkins GitHub QA Engineer Slack Grafana Automation Test Logging Platform (Heimdall) Elasticsearch Logstash LOG Filebeat Solution Filebeat LOG Users
81. Result Report
82. Result Report
83. Do not Give Up
84. Do not Give Up
85. Yoon, Sung Yong LINE Service Test3 / LINE Fukuoka - Test Cases develop for Services - Improve Logging Pipeline Chiu, Pokai LINE Service Test3 / LINE Fukuoka - Test Cases develop for Services Contributor
86. Thank you