AI for Testing - Speaker Deck

Slide 1

Slide 1 text

1 BUILD SOFTWARE TO TEST SOFTWARE QA Meetup BUILD SOFTWARE TO TEST SOFTWARE exactpro.com AI for Testing Head of Research, Exactpro Rostislav Yavorski 25 APRIL 2022 ONLINE | HATCH WORKS, COLOMBO 1

Slide 2

Slide 2 text

2 BUILD SOFTWARE TO TEST SOFTWARE QA Meetup Machine learning areas 2

Slide 3

Slide 3 text

3 BUILD SOFTWARE TO TEST SOFTWARE QA Meetup Machine learning areas 3

Slide 4

Slide 4 text

4 BUILD SOFTWARE TO TEST SOFTWARE QA Meetup Unsupervised Learning A machine learning technique in which the users do not need to supervise the model. It is a type of algorithm that learns patterns from untagged data: https://towardsdatascience.com/supervised-vs-unsupervised-learning-in-2-minutes-72dad148f242 4

Slide 5

Slide 5 text

5 BUILD SOFTWARE TO TEST SOFTWARE QA Meetup Unsupervised Learning applications ● Audience segmentation ● Customer service personalization ● Recommender Engines ● Anomaly detection ● Pattern recognition ● Inventory management https://towardsdatascience.com/supervised-vs-unsupervised-learning-in-2-minutes-72dad148f242 5

Slide 6

Slide 6 text

6 BUILD SOFTWARE TO TEST SOFTWARE QA Meetup Supervised Learning The algorithm uses labeled datasets to train how to classify data or predict outcomes accurately. It is a function that maps an input to an output based on example input-output pairs. https://www.guru99.com/supervised-vs-unsupervised-learning.html 6

Slide 7

Slide 7 text

7 BUILD SOFTWARE TO TEST SOFTWARE QA Meetup https://towardsdatascience.com/supervised-vs-unsupervised-learning-in-2-minutes-72dad148f242 7

Slide 8

Slide 8 text

8 BUILD SOFTWARE TO TEST SOFTWARE QA Meetup Supervised Learning applications Healthcare and medical diagnosis Predicting stock price Weather forecasting Text categorization Spam detection Face recognition https://www.guru99.com/supervised-vs-unsupervised-learning.html 8

Slide 9

Slide 9 text

9 BUILD SOFTWARE TO TEST SOFTWARE QA Meetup Reinforcement Learning Method based on rewarding desired behaviors and punishing undesired ones: https://vitalflux.com/reinforcement-learning-real-world-examples/ 9

Slide 10

Slide 10 text

10 BUILD SOFTWARE TO TEST SOFTWARE QA Meetup Reinforcement Learning applications Self-driving cars (autonomous vehicles) Industry automation and learning-based robots Natural language processing for chatbot dialogue Dynamic treatment regimes in chronic disease https://vitalflux.com/reinforcement-learning-real-world-examples/ 10

Slide 11

Slide 11 text

11 BUILD SOFTWARE TO TEST SOFTWARE QA Meetup 11

Slide 12

Slide 12 text

12 BUILD SOFTWARE TO TEST SOFTWARE QA Meetup Simplest to apply 12

Slide 13

Slide 13 text

13 BUILD SOFTWARE TO TEST SOFTWARE QA Meetup Requires data labeling 13

Slide 14

Slide 14 text

14 BUILD SOFTWARE TO TEST SOFTWARE QA Meetup Most advanced 14

Slide 15

Slide 15 text

15 BUILD SOFTWARE TO TEST SOFTWARE QA Meetup Applications to Software Testing 15

Slide 16

Slide 16 text

16 BUILD SOFTWARE TO TEST SOFTWARE QA Meetup #1. System anomaly detection An anomaly is something that diﬀers from a norm: ● a deviation ● an exception ● a rare occurrence or event that doesn’t ﬁt into the pattern ● anything that seems suspicious 16 https://jhui.github.io/2017/01/15/Machine-learning-anomaly/

Slide 17

Slide 17 text

17 BUILD SOFTWARE TO TEST SOFTWARE QA Meetup 17

Slide 18

Slide 18 text

18 BUILD SOFTWARE TO TEST SOFTWARE QA Meetup 18

Slide 19

Slide 19 text

19 BUILD SOFTWARE TO TEST SOFTWARE QA Meetup Unsupervised learning for anomaly detection ● A detection model is constructed using historical logs, which describe a variety of events of software systems. The model is used for: ○ detecting various types of system behavior anomalies ○ determining statistical load parameters ● Another way is to extract semantic information of log events. The anomalies are detected from the contextual information in the log sequences based on the importance of diﬀerent log events. 19

Slide 20

Slide 20 text

20 BUILD SOFTWARE TO TEST SOFTWARE QA Meetup 20 System performance testing

Slide 21

Slide 21 text

21 BUILD SOFTWARE TO TEST SOFTWARE QA Meetup #2. AI for bug reporting Report readability assessment Duplication detection Automatic fault localization Automated bug assignment Determining bug severity Bug ﬁxing time prediction 21 https://www.softwaretestinghelp.com/

Slide 22

Slide 22 text

22 BUILD SOFTWARE TO TEST SOFTWARE QA Meetup #3. AI for requirements text analysis Detect linguistic issues in requirements documents Evaluating the suﬃciency of information and spec completeness Automated test cases generation from requirements Extracting modeling concepts and constructing UML models Transforming natural language format into formal speciﬁcation 22 https://clockwise.software/blog/software-requirements-specification-document/

Slide 23

Slide 23 text

23 BUILD SOFTWARE TO TEST SOFTWARE QA Meetup #4. Tester’s virtual assistant What new errors appeared today? Are there any traces of recent bugs we ﬁxed? Especially, related to the issue we saw yesterday? When was the last major change in logs structure and characteristics? What applications logged an abnormal number of errors today? What kind of anomaly was detected in recent logs? 23 https://www.freepik.com/

Slide 24

Slide 24 text

24 BUILD SOFTWARE TO TEST SOFTWARE QA Meetup Thank You! 24