Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Поможет ли ISTQB AI Testing в обучении тестировщиков?

Поможет ли ISTQB AI Testing в обучении тестировщиков?

Иосиф Иткин
Генеральный директор и соучредитель компании Exactpro

«Мы обсудим, стоит ли применять новую ISTQB-программу профессиональной сертификации AI Testing в обучении тестировщиков, поговорим о ее основных преимуществах и недостатках, а также о том, кому программа будет полезна, а кому — не очень. Мы попытаемся оценить, актуальна ли программа для текущего уровня применения искусственного интеллекта (ИИ) и машинного обучения в тестировании, а также насколько эффективна она учит тестировать ИИ-системы».

2 декабря 2021
QA Meetup
---
Подписывайтесь на Exactpro в социальных сетях:

LinkedIn https://www.linkedin.com/company/exactpro-systems-llc
Twitter https://twitter.com/exactpro
Facebook https://www.facebook.com/exactpro/
Instagram https://www.instagram.com/exactpro/

Подписывайтесь на YouTube канал Exactpro http://www.youtube.com/c/ExactproVlog

5206c19df417b8876825b5561344c1a0?s=128

Exactpro
PRO

December 02, 2021
Tweet

Transcript

  1. exactpro.com 1 BUILD SOFTWARE TO TEST SOFTWARE Build Software to

    Test Software exactpro.com Поможет ли ISTQB AI Testing в обучении тестировщиков Иосиф Иткин CEO и сооснователь, Exactpro
  2. exactpro.com 2 BUILD SOFTWARE TO TEST SOFTWARE • Introduction •

    Exactpro Overview • Software Testing for Complex Intelligent Systems and Autonomous Vehicles • A4Q AI and Software Testing Certification • ISTQB Certified Tester - AI Testing (CT-AI) • Three Things Software Testers Can Learn from CT-AI Contents
  3. exactpro.com 3 BUILD SOFTWARE TO TEST SOFTWARE • https://www.linkedin.com/in/iosifitkin/ •

    Exactpro representative at the Zero Outage Industry Standard association • Head of LOST (Laboratory of Software Testing) at Tomsk Polytechnic University • Co-chair of FIX Trading Community MOST Working Group (Monitoring, Onboarding and Software Testing) • Co-founder of Tools & Methods of Program Analysis Conference • ISTQB CFTL, A4Q AI and Software Testing About me
  4. exactpro.com 4 BUILD SOFTWARE TO TEST SOFTWARE About Exactpro

  5. exactpro.com 5 BUILD SOFTWARE TO TEST SOFTWARE

  6. exactpro.com 6 BUILD SOFTWARE TO TEST SOFTWARE MANAGED SUPPORT SERVICES

    PROVIDER OF THE YEAR In this Risk.net interview, Alexey Zverev, Exactpro co-CEO and co-founder, talks about mitigating risks while driving innovation during the time of high volatility and explains what made Exactpro stand out among the contestants. Watch the interview with Risk.net via the QR code above.
  7. exactpro.com 7 BUILD SOFTWARE TO TEST SOFTWARE AI Testing Research

  8. exactpro.com 8 BUILD SOFTWARE TO TEST SOFTWARE Software Testing for

    Complex Intelligent Systems and Autonomous Vehicles Online Course Software testing for complex intelligent systems and autonomous vehicles - Playlist on the Exactpro YouTube channel Laboratory of Software Testing
  9. exactpro.com 9 BUILD SOFTWARE TO TEST SOFTWARE Software Testing for

    Complex Intelligent Systems and Autonomous Vehicles Online Course Software testing for complex intelligent systems and autonomous vehicles - Playlist on the Exactpro YouTube channel Laboratory of Software Testing
  10. exactpro.com 10 BUILD SOFTWARE TO TEST SOFTWARE Build Software to

    Test Software
  11. exactpro.com 11 BUILD SOFTWARE TO TEST SOFTWARE Laboratory of Software

    Testing
  12. exactpro.com 12 BUILD SOFTWARE TO TEST SOFTWARE A4Q AI and

    Software Testing https://www.alliance4qualification.info/a4q-ai-and-software-testing
  13. exactpro.com 13 BUILD SOFTWARE TO TEST SOFTWARE A4Q AI and

    Software Testing by Rex Black https://youtu.be/ki2fsH7Il8E 29 January 2020 https://rbcs-us.com/site/assets/files/3793/a4q_ai_and_software_tester_foundation_course_outline_v0_9.pdf
  14. exactpro.com 14 BUILD SOFTWARE TO TEST SOFTWARE A4Q AI and

    Software Testing https://youtu.be/KGVQVBdjvCU https://ru.exactpro.com/ideas/white-papers/a4qs-ai-and-software-testing-certification-explained
  15. exactpro.com 15 BUILD SOFTWARE TO TEST SOFTWARE ISTQB Certified Tester

    - AI Testing https://youtu.be/wdPe46Bns2o
  16. exactpro.com 16 BUILD SOFTWARE TO TEST SOFTWARE ISTQB Certified Tester

    - AI Testing
  17. exactpro.com 17 BUILD SOFTWARE TO TEST SOFTWARE ISTQB Certified Tester

    - AI Testing https://www.istqb.org/certification-path-root/ai-testing.html
  18. exactpro.com 18 BUILD SOFTWARE TO TEST SOFTWARE ISTQB Certified Tester

    - AI Testing https://www.istqb.org/certification-path-root/ai-testing.html
  19. exactpro.com 19 BUILD SOFTWARE TO TEST SOFTWARE Comparing ISTQB Foundation

    and A4Q AIST
  20. exactpro.com 20 BUILD SOFTWARE TO TEST SOFTWARE Comparing ISTQB CTFL,

    A4Q AIST and CT-AI
  21. exactpro.com 21 BUILD SOFTWARE TO TEST SOFTWARE Comparing A4Q AIST

    and CT-AI A4Q AIST Pages Hours 1. Key Aspects of Artificial Intelligence 15 6 2. Testing Artificial Intelligence Systems 19 6.5 3. Using AI to Support Testing 13 4.5 47 17
  22. exactpro.com 22 BUILD SOFTWARE TO TEST SOFTWARE ISTQB CT-AI Pages

    Hours 1. Introduction to AI 8 2 2. Quality Characteristics 5 2 3. Machine Learning 7 2.5 4. ML Data 7 4 5. ML Functional Metrics 5 2 6. ML Neural Networks and Testing 5 1 7. Testing AI-Based Systems 8 2 8. Testing AI-Specific Quality Characteristics 8 2.5 9. Methods and Techniques for the Testing of AI-Based Systems 8 4 10. Test Environments 3 0.5 11. Using AI in Testing 5 3 69 25.5
  23. exactpro.com 23 BUILD SOFTWARE TO TEST SOFTWARE ISTQB CT-AI Pages

    Hours 1. Introduction to AI 8 2 2. Quality Characteristics 5 2 3. Machine Learning 7 2.5 4. ML Data 7 4 5. ML Functional Metrics 5 2 6. ML Neural Networks and Testing 5 1 7. Testing AI-Based Systems 8 2 8. Testing AI-Specific Quality Characteristics 8 2.5 9. Methods and Techniques for the Testing of AI-Based Systems 8 4 10. Test Environments 3 0.5 11. Using AI in Testing 5 3 69 25.5 A4Q AIST Pages Hours 1. Key Aspects of Artificial Intelligence 15 6 2. Testing Artificial Intelligence Systems 19 6.5 3. Using AI to Support Testing 13 4.5 47 17
  24. exactpro.com 24 BUILD SOFTWARE TO TEST SOFTWARE A4Q AIST Pages

    Hours ISTQB CT-AI Pages Hours 1. Key Aspects of Artificial Intelligence 15 6 1. Introduction to AI 8 2 2. Testing Artificial Intelligence Systems 19 6.5 2. Quality Characteristics 5 2 2.1 General Problems with Testing AI Systems 8 3. Machine Learning 7 2.5 2.2 Machine Learning Model Training and Testing 2 4. ML Data 7 4 2.3 Test Environments 2 5. ML Functional Metrics 5 2 2.4 Strategies to Test AI-based Systems 5 6. ML Neural Networks and Testing 5 1 2.5 Metrics for Testing AI-based systems 2 7. Testing AI-Based Systems 8 2 3. Using AI to Support Testing 13 4.5 8. Testing AI-Specific Quality Characteristics 8 2.5 47 17 9. Methods and Techniques for the Testing of AI-Based Systems 8 4 10. Test Environments 3 0.5 11. Using AI in Testing 5 3 69 25.5
  25. exactpro.com 25 BUILD SOFTWARE TO TEST SOFTWARE ISTQB CT-AI Pages

    Hours 1. Introduction to AI 20 5.5 3. Machine Learning 6. ML Neural Networks and Testing 44 17 2. Quality Characteristics 5 2 4. ML Data 7 4 10. Test Environments 3 0.5 7. Testing AI-Based Systems 8 2 8. Testing AI-Specific Quality Characteristics 8 2.5 9. Methods and Techniques for the Testing of AI-Based Systems 8 4 5. ML Functional Metrics 5 2 11. Using AI in Testing 5 3 69 25.5 A4Q AIST Pages Hours 1. Key Aspects of Artificial Intelligence 15 6 2. Testing Artificial Intelligence Systems 19 6.5 2.1 General Problems with Testing AI Systems 8 2.2 Machine Learning Model Training and Testing 2 2.3 Test Environments 2 2.4 Strategies to Test AI-based Systems 5 2.5 Metrics for Testing AI-based systems 2 3. Using AI to Support Testing 13 4.5 47 17
  26. exactpro.com 26 BUILD SOFTWARE TO TEST SOFTWARE Three Things a

    Software Tester Can Learn • 1 • 2 • 3
  27. exactpro.com 27 BUILD SOFTWARE TO TEST SOFTWARE AI, Testing AI,

    AI Testing
  28. 28 Build Software to Test Software exactpro.com The SWIFT Hackathon

    2021 Delivering on the promise of AI Challenge 1: Enhancing the accuracy of anomaly detection in payments Challenge 2: Building ‘synthetic’ data-sets required for AI-based product development, whilst protecting privacy https://www.swift.com/news-events/news/swift-hackathon-2021-has-begun
  29. exactpro.com 29 BUILD SOFTWARE TO TEST SOFTWARE Confusion Matrix

  30. exactpro.com 30 BUILD SOFTWARE TO TEST SOFTWARE Complex Systems

  31. exactpro.com 31 BUILD SOFTWARE TO TEST SOFTWARE Challenges of Testing

    Self-Learning Systems • Unexpected change • Complex acceptance criteria • Insufficient testing time • Resource requirements • Insufficient specifications of operational environment • Complex test environment • Undesirable behavior modifications
  32. exactpro.com 32 BUILD SOFTWARE TO TEST SOFTWARE Data Quality Issues

  33. exactpro.com 33 BUILD SOFTWARE TO TEST SOFTWARE Test Oracle

  34. exactpro.com 34 BUILD SOFTWARE TO TEST SOFTWARE Software Testing is

    exploring software with the intent of finding bugs. Software Testing is an empirical technical investigation conducted to provide stakeholders with information about the quality of the product or service under test. Complex Systems
  35. exactpro.com 35 BUILD SOFTWARE TO TEST SOFTWARE Models Abstract Model

    = theory Concrete Description = data Software = object of study flow of information observe compare Abstract Model = design concept Concrete Description = specification Software = useful product flow of information design produce Software Testing Development The Antiparallel Structures of Software Testing and Development Software Testing vs Software Development
  36. exactpro.com 36 BUILD SOFTWARE TO TEST SOFTWARE Manual Using Tools

    Mechanization Automation A tool is an object used to extend the ability of an individual to modify features of the surrounding environment Automation is the technology by which a process or procedure is performed with minimal human assistance Test Automation
  37. exactpro.com 37 BUILD SOFTWARE TO TEST SOFTWARE NO AUTOMATION DRIVER

    ASSISTANCE PARTIAL AUTOMATION CONDITIONAL AUTOMATION HIGH AUTOMATION FULL AUTOMATION Steering and acceleration/ deceleration Monitoring of driving environment Fallback when automation fails Automated Control: Human driver monitors the road Automated driving system monitors the road SOME DRIVING MODES SOME DRIVING MODES SOME DRIVING MODES SOME DRIVING MODES 0 1 2 3 4 5 Human driver Automated system Autonomy
  38. exactpro.com 38 BUILD SOFTWARE TO TEST SOFTWARE Processes Platforms People

    Software Testing
  39. exactpro.com 39 BUILD SOFTWARE TO TEST SOFTWARE FOLLOW US ON

    SOCIAL MEDIA: @exactprosystems TO #th2net
  40. exactpro.com 40 BUILD SOFTWARE TO TEST SOFTWARE Thank You