Slide 1
Slide 1 text
No content
Slide 2
Slide 2 text
Test Automation
Slide 3
Slide 3 text
=====================================
Test Suite
Total tests run: 5, Passes: 5,
Failures: 0, Skips: 0
=====================================
Process finished with exit code 0
Slide 4
Slide 4 text
Waiting
Slide 5
Slide 5 text
Joonsoo, LEE
QA Engineer at LINE +
LINE Desktop in Q
Automation Testing
Like : Coffee and Desk-Interior
Who am I?
Slide 6
Slide 6 text
Agenda
- Overview
- Observe a Problem
- Action Items
- What have been Improved
- What have been Expanded
Slide 7
Slide 7 text
Overview
Slide 8
Slide 8 text
Overview
Jenkins
Filebeat
Solution
LOG
Logstash
Grafana Elasticsearch
Slack
Alert
Alert
Slide 9
Slide 9 text
Overview
Slide 10
Slide 10 text
Overview
Slide 11
Slide 11 text
Problem
Slide 12
Slide 12 text
Services
Slide 13
Slide 13 text
Services
Slide 14
Slide 14 text
Services
Slide 15
Slide 15 text
Services
Slide 16
Slide 16 text
Test Jobs
Slide 17
Slide 17 text
Test Jobs
Regression Test
Slide 18
Slide 18 text
Test Jobs
Quick Test
Regression Test
Slide 19
Slide 19 text
Test Jobs
Quick Test
Scheme Test
Regression Test
Slide 20
Slide 20 text
Test Jobs
Quick Test
Scheme Test
Regression Test
Other
Slide 21
Slide 21 text
Test Jobs
Quick Test
Scheme Test
Regression Test
Other
Slide 22
Slide 22 text
Everyday write reports
Slide 23
Slide 23 text
Everyday write reports
Slide 24
Slide 24 text
Everyday write reports
Slide 25
Slide 25 text
Monitoring
Slide 26
Slide 26 text
Monitoring
Slide 27
Slide 27 text
Action Items
Slide 28
Slide 28 text
What should I do?
Slide 29
Slide 29 text
What should I do?
Construct
ELK Pipeline
Pipeline
Slide 30
Slide 30 text
What should I do?
Construct
ELK Pipeline
Define
Log Fields
Log
Pipeline
Slide 31
Slide 31 text
What should I do?
Construct
ELK Pipeline
Define
Log Fields
Develop
ActionLog Script
Log Logger
Pipeline
Slide 32
Slide 32 text
What should I do?
Construct
ELK Pipeline
Define
Log Fields
Develop
ActionLog Script
Create
Dashboard
Log Logger Dashboard
Pipeline
Slide 33
Slide 33 text
What I consider?
Slide 34
Slide 34 text
What I consider?
OpenSource
Slide 35
Slide 35 text
What I consider?
OpenSource Flexibility
Slide 36
Slide 36 text
What I consider?
OpenSource Flexibility Scalability
Slide 37
Slide 37 text
What is ELK Stack?
Slide 38
Slide 38 text
What is ELK Stack?
Elasticsearch
Slide 39
Slide 39 text
What is ELK Stack?
Elasticsearch
Logstash
LOG
LOG
LOG
Slide 40
Slide 40 text
What is ELK Stack?
Elasticsearch
Logstash Kibana
LOG
LOG
LOG
Slide 41
Slide 41 text
Based Architect
Logstash Elasticsearch
LOG
LOG
LOG
Slide 42
Slide 42 text
Based Architect
Logstash
Beat Elasticsearch
LOG
LOG
LOG
Slide 43
Slide 43 text
Heimdall Architect
Slide 44
Slide 44 text
Heimdall Architect
Filebeat
Filebeat
Filebeat
LOG
LOG
LOG
Slide 45
Slide 45 text
Heimdall Architect
Logstash
Filebeat
Filebeat
Filebeat
LOG
LOG
LOG
Slide 46
Slide 46 text
Heimdall Architect
Logstash
Filebeat
Filebeat
Filebeat
LOG
LOG
LOG
Slide 47
Slide 47 text
Heimdall Architect
Logstash Elasticsearch
Filebeat
Filebeat
Filebeat
LOG
LOG
LOG
Slide 48
Slide 48 text
Define Log Fields
Slide 49
Slide 49 text
Action
OSVersion
ApplicationVersion
ApplicationPhase
DeviceName
TestCaseName DeviceResolution
TestResult
ApplicationName
TestEnvironment
Exception LogLevel
TestSuiteName
TestServiceName
TestStartDateTime
TestEndDateTime
ElapsedTime
Define Log Fields
Slide 50
Slide 50 text
What is Logger?
Slide 51
Slide 51 text
What is Logger?
Slide 52
Slide 52 text
Develop ʮActionLogʯ
Slide 53
Slide 53 text
Develop ʮActionLogʯ
Tap
FindText EnterText
TerminateApplication
ActivateApplication
FindImage
InstallApplication
Wait
Press
Pinch
UninstallApplication
Slide 54
Slide 54 text
Develop ʮActionLogʯ
Tap
FindText EnterText
TerminateApplication
ActivateApplication
FindImage
InstallApplication
Wait
Press
Pinch
UninstallApplication
LOG
ActionLog.Script
Slide 55
Slide 55 text
Logs Execute Test
Slide 56
Slide 56 text
Logs Execute Test
Slide 57
Slide 57 text
What is Grafana?
Slide 58
Slide 58 text
What is Grafana?
Grafana
Slide 59
Slide 59 text
What is Grafana?
Grafana
Source Data
Slide 60
Slide 60 text
What is Grafana?
Grafana
Source Data Chart, Graphs, Metric
Dashboard
Slide 61
Slide 61 text
Heimdall Architect
Slide 62
Slide 62 text
Heimdall Architect
Grafana
Elasticsearch
Slide 63
Slide 63 text
Heimdall Architect
Grafana
Queries
Elasticsearch
Slide 64
Slide 64 text
Heimdall Architect
Grafana
Queries
Elasticsearch Chart, Graphs, Metric
Dashboard
Slide 65
Slide 65 text
Dashboard
Slide 66
Slide 66 text
Dashboard
Slide 67
Slide 67 text
Dashboard
Slide 68
Slide 68 text
Improve
Slide 69
Slide 69 text
Improve
Slide 70
Slide 70 text
Improve
Realtime
Slide 71
Slide 71 text
Improve
Realtime Visualize
Slide 72
Slide 72 text
Improve
Realtime Visualize Save Time
Slide 73
Slide 73 text
Expand
Slide 74
Slide 74 text
CI/CD and Notification
Slide 75
Slide 75 text
CI/CD and Notification
Jenkins
CI/CD
Slide 76
Slide 76 text
CI/CD and Notification
Jenkins
CI/CD
Slack
Notification
Slide 77
Slide 77 text
Whole Architect in Automation Test
Slide 78
Slide 78 text
Whole Architect in Automation Test
Jenkins
GitHub
QA Engineer
Automation Test Logging Platform (Heimdall)
Elasticsearch
Logstash
LOG
Filebeat
Solution
Filebeat
LOG
Slide 79
Slide 79 text
Whole Architect in Automation Test
Dashboard
Jenkins
GitHub
QA Engineer
Slack
Grafana
Automation Test Logging Platform (Heimdall)
Elasticsearch
Logstash
LOG
Filebeat
Solution
Filebeat
LOG
Slide 80
Slide 80 text
Whole Architect in Automation Test
Dashboard
Jenkins
GitHub
QA Engineer
Slack
Grafana
Automation Test Logging Platform (Heimdall)
Elasticsearch
Logstash
LOG
Filebeat
Solution
Filebeat
LOG
Users
Slide 81
Slide 81 text
Result Report
Slide 82
Slide 82 text
Result Report
Slide 83
Slide 83 text
Do not Give Up
Slide 84
Slide 84 text
Do not Give Up
Slide 85
Slide 85 text
Yoon, Sung Yong
LINE Service Test3 / LINE Fukuoka
- Test Cases develop for Services
- Improve Logging Pipeline
Chiu, Pokai
LINE Service Test3 / LINE Fukuoka
- Test Cases develop for Services
Contributor
Slide 86
Slide 86 text
Thank you