Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Лекция 4 — «Основы тестирования программного обеспечения»

Лекция 4 — «Основы тестирования программного обеспечения»

Курс лекций «Тестирование сложных интеллектуальных систем и беспилотных автомобилей» знакомит вас с теоретическими основами тестирования автономных ИИ-систем.

Видео лекция доступна по ссылке: https://youtu.be/o3xOGsp3jo4

---
Подписывайтесь на Exactpro в социальных сетях:

LinkedIn https://www.linkedin.com/company/exactpro-systems-llc
Twitter https://twitter.com/exactpro
Facebook https://www.facebook.com/exactpro/
Instagram https://www.instagram.com/exactpro/

Подписывайтесь на YouTube канал Exactpro http://www.youtube.com/c/ExactproVlog

5206c19df417b8876825b5561344c1a0?s=128

Exactpro
PRO

March 12, 2021
Tweet

Transcript

  1. 1 Build Software to Test Software exactpro.com Лекция 4 Основы

    тестирования программного обеспечения Тестирование сложных интеллектуальных систем и беспилотных автомобилей Онлайн-курс
  2. 2 Build Software to Test Software exactpro.com Структура лекции Источники

    информации о тестировании Что такое тестирование Что такое качество, ошибки, дефекты, сбои Что не является тестированием: QA, unit testing, BDD, плохое тестирование Принципы и виды тестирования Задачи тестирования и что такое хорошее тестирование Составляющие тестирования: процессы, инструменты, люди Процесс тестирования: шаги и результаты Виноваты ли тестировщики в том, что сбои происходят при промышленной эксплуатации
  3. 3 Build Software to Test Software exactpro.com Exactpro Компания основана

    в день тестировщика, 9 сентября 2009 года Главный офис компании находится в Лондоне Москва Кострома Саратов Обнинск Тбилиси Лондон Нью-Йорк
  4. 4 Build Software to Test Software exactpro.com Чем мы занимаемся

    Exactpro специализируется на разработке и применении программного обеспечения для тестирования высоконагруженных рыночных инфраструктур и систем, работающих со всеми классами финансовых инструментов. Решения Exactpro используются в двадцати странах и во всех частях света, кроме Антарктики
  5. 5 Build Software to Test Software exactpro.com Источники информации о

    тестировании - Absence-of-errors fallacy and other principles of software testing. - Types and levels of software testing. - Understanding of test objectives and methodologies in different schools of thought in the software testing domain.
  6. 6 Build Software to Test Software exactpro.com Источники информации о

    тестировании https://www.developsense.com/blog/2010/05/testers-get-out-of-the-quality-assurance-business/
  7. 7 Build Software to Test Software exactpro.com Вывод скрола по

    ютьюб
  8. 8 Build Software to Test Software exactpro.com Источники информации о

    тестировании https://youtu.be/jZitXMQaXvE смотреть
  9. 9 Build Software to Test Software exactpro.com Источники информации о

    тестировании смотреть https://www.youtube.com/watch?v=aYXuK2do6FA
  10. 10 Build Software to Test Software exactpro.com Выводим привью дебатов

  11. 11 Build Software to Test Software exactpro.com Источники информации о

    тестировании https://ingophilipp.medium.com/excellent-software-testing-6e0fd8f3e11e
  12. 12 Build Software to Test Software exactpro.com Источники информации о

    тестировании http://testbase.ru/book-beginner Ольга Назина http://cartoontester.blogspot.com/ Andy Glover
  13. 13 Build Software to Test Software exactpro.com Определение тестирования •

    Тестирование – это добыча информации о качестве программного обеспечения • Тестирование – это боль • Тестирование – это непрестанное обучение • Тестирование – это процессы, инструменты, люди
  14. 14 Build Software to Test Software exactpro.com West World TEST

    WORLD: REBOOT
  15. 15 Build Software to Test Software exactpro.com Ray Dalio PAIN

    + REFLECTION = PROGRESS
  16. 16 Build Software to Test Software exactpro.com Ray Dalio

  17. 17 Build Software to Test Software exactpro.com Ray Dalio

  18. 18 Build Software to Test Software exactpro.com Примеры добычи информации

  19. 19 Build Software to Test Software exactpro.com Примеры добычи информации

  20. 20 Build Software to Test Software exactpro.com https://blogs.scientificamerican.com/observations/the-line-between-science-and-journalism-is-getting-blurry-again/

  21. 21 Build Software to Test Software exactpro.com Примеры добычи информации

  22. 22 Build Software to Test Software exactpro.com Примеры добычи информации

  23. 23 Build Software to Test Software exactpro.com Примеры добычи информации

    • https://blogs.scientificamerican.com/observations/the-line- between-science-and-journalism-is-getting-blurry-again/ • Journalism is communication of 'what's new'. A journalist is anyone who can say "I’m there, you’re not, let me tell you about it." • Science is communication of 'how the world works'. A scientist is anyone who can say "I understand something about the world, you don't, let me explain it to you". • Neither definition necessitates that what they say is True, just what they know to the best of their ability and understanding.
  24. 24 Build Software to Test Software exactpro.com Качество Quality is

    value to some person Quality is the degree to which a component or system satisfies the stated and implied needs of its various stakeholders Quality is inherently subjective. Different stakeholders will perceive the same product as having different levels of quality
  25. 25 Build Software to Test Software exactpro.com Что такое дефект

    Bug is a discrepancy between expectations and reality An attribute of a software product that reduces its value to a favored stakeholder or increases its value to a disfavored stakeholder May or may not be a coding error or a functional error Design errors are bugs too
  26. 26 Build Software to Test Software exactpro.com Что такое дефект

    Error – a human action that produces an incorrect result Defect – an imperfection or deficiency in a work product where it does not meet its requirements or specifications Failure – an event in which a component or system does not perform a required function within specified limits
  27. 27 Build Software to Test Software exactpro.com Что такое дефект

    65,586 м / час (~65.6 км/час) ошибка дефект сбой
  28. 28 Build Software to Test Software exactpro.com Что такое дефект

    65,586 м / час (~65.6 км/час) ошибка дефект сбой
  29. 29 Build Software to Test Software exactpro.com Что такое дефект

    Тормозной путь
  30. 30 Build Software to Test Software exactpro.com https://www.snopes.com/fact-check/cone-of-silence PASS FAIL

    PASS + = = = + +
  31. 31 Build Software to Test Software exactpro.com Что такое тестирование

    Software Testing is an • empirical • technical • investigation • conducted to provide stakeholders • with information • about the quality • of the product or service under test Software Testing is exploring software with the intent of finding bugs
  32. 32 Build Software to Test Software exactpro.com Software is eating

    the world смотреть
  33. 33 Build Software to Test Software exactpro.com Software is eating

    the world http://www3.weforum.org/docs/WEF_ The_Global_Risks_Report_2021.pdf
  34. 34 Build Software to Test Software exactpro.com Тестирование это информационный

    сервис
  35. 35 Build Software to Test Software exactpro.com Тестирование это не

    Quality Assurance Testers: Get Out of the Quality Assurance Business Quality Assurance Quality Control Testing Code review Unit testing Audit Process Improvements Change management Early reviews and testing
  36. 36 Build Software to Test Software exactpro.com Тестирование это не

    Quality Assurance Testers: Get Out of the Quality Assurance Business https://www.developsense.com/presentations/2010-06-TestersGetOutOfTheQABusiness.pdf
  37. 37 Build Software to Test Software exactpro.com Unit Testing Разработка

    модульных тестов, позволяющих изолировать отдельные части программы и проверить их работоспособность – Создание тестов, их выполнение и получение отчетов с использованием фреймворков с открытым кодом Pytest и PyUnit
  38. 38 Build Software to Test Software exactpro.com BDD Изучение методики

    разработки программного обеспечения Behavior Driven Development (BDD) Использование языка Gherkin в процессе определения требований, сценариев использования и приемочных испытаний
  39. 39 Build Software to Test Software exactpro.com Тестирование Не тестирование

  40. 40 Build Software to Test Software exactpro.com Примеры добычи информации

  41. 41 Build Software to Test Software exactpro.com Примеры добычи информации

  42. 42 Build Software to Test Software exactpro.com Примеры добычи информации

  43. 43 Build Software to Test Software exactpro.com Плохое тестирование

  44. 44 Build Software to Test Software exactpro.com Тестирование это не

    https://mrslavchev.com/2016/03/28/software-testing-not/
  45. 45 Build Software to Test Software exactpro.com

  46. 46 Build Software to Test Software exactpro.com Принципы тестирования Principle

    1: Testing shows the presence of defects, not their absence Principle 2: Exhaustive testing is impossible Principle 3: Early testing saves time and money Principle 4: Defects cluster together Principle 5: Beware of the pesticide paradox Principle 6: Testing is context dependent Principle 7: Absence-of-errors is a fallacy
  47. 47 Build Software to Test Software exactpro.com Testing shows the

    presence of defects, not their absence
  48. 48 Build Software to Test Software exactpro.com Exhaustive testing is

    impossible
  49. 49 Build Software to Test Software exactpro.com

  50. 50 Build Software to Test Software exactpro.com Симулятор дороги LGSVL

    - Introduction to the multi-agent road simulator developed by LG's Research and Development division based on the cross-platform environment for creating video games - Unity. - Overview of installation, launch, and user interface.
  51. 51 Build Software to Test Software exactpro.com Прицип Парето

  52. 52 Build Software to Test Software exactpro.com

  53. 53 Build Software to Test Software exactpro.com

  54. 54 Build Software to Test Software exactpro.com Context Driven Testing

    Consider: • Software development lifecycle model and project methodologies being used • Test levels and test types being considered • Product and project risks • Business domain • Operational constraints, including but not limited to: a. Budgets and resources b. Timescales c. Complexity d. Contractual and regulatory requirements • Organizational policies and practices • Required internal and external standards
  55. 55 Build Software to Test Software exactpro.com Context Driven Testing

    The Seven Basic Principles of the Context-Driven School 1. The value of any practice depends on its context. 2. There are good practices in context, but there are no best practices. 3. People, working together, are the most important part of any project’s context. 4. Projects unfold over time in ways that are often not predictable. 5. The product is a solution. If the problem isn’t solved, the product doesn’t work. 6. Good software testing is a challenging intellectual process. 7. Only through judgment and skill, exercised cooperatively throughout the entire project, are we able to do the right things at the right times to effectively test our products. https://context-driven-testing.com/
  56. 56 Build Software to Test Software exactpro.com

  57. 57 Build Software to Test Software exactpro.com Absence-of-errors is a

    fallacy
  58. 58 Build Software to Test Software exactpro.com Verification vs. Validation

    Verification – checks whether the system meets specified requirements Validation – checks whether the system will meet user and other stakeholder needs • https://techcrunch.com/2018/06/22/uber-safety-driver-of-fatal-self-driving-crash-was-watchin g-hulu-not-the-road • https://www.ntsb.gov/investigations/AccidentReports/Reports/HWY18MH010-prelim.pdf
  59. 59 Build Software to Test Software exactpro.com

  60. 60 Build Software to Test Software exactpro.com https://www.ntsb.gov/investigations/AccidentReports/Reports/HWY18MH010-prelim.pdf

  61. 61 Build Software to Test Software exactpro.com https://www.ntsb.gov/investigations/AccidentReports/Reports/HWY18MH010-prelim.pdf

  62. 62 Build Software to Test Software exactpro.com https://www.ntsb.gov/investigations/AccidentReports/Reports/HWY18MH010-prelim.pdf

  63. 63 Build Software to Test Software exactpro.com Виды тестирования •

    Тестирование функциональность – ЧТО • Тестирование характеристик – КАК • Тестирование с доступом к структуре – White Box
  64. 64 Build Software to Test Software exactpro.com Software Testing at

    the confluence Функциональное тестирование Нефункциональное тестирование
  65. 65 Build Software to Test Software exactpro.com black box testing

    vs. white box testing
  66. 66 Build Software to Test Software exactpro.com Составляющие тестирования

  67. 67 Build Software to Test Software exactpro.com Составляющие тестирования •

    Test planning – involves defining the objectives of testing and the approach for meeting those objectives within project constraints and contexts • Test monitoring and control – compares actual progress against the plan, takes actions which are necessary to meet the mission and objectives of the project, and/or adjust the plan • Test analysis – determines ‘what to test’ • Test design – addresses the question ‘how to test’ • Test implementation – asks ‘do we now have everything in place to run the tests? • Test execution – runs tests • Test completion – summarizes the results of testing
  68. 68 Build Software to Test Software exactpro.com Задачи тестирования •

    To prevent defects by evaluate work products such as requirements, user stories, design, and code • To verify whether all specified requirements have been fulfilled • To check whether the test object is complete and validate if it works as the users and other stakeholders expect • To build confidence in the level of quality of the test object • To find defects and failures thus reduce the level of risk of inadequate software quality • To provide sufficient information to stakeholders to allow them to make informed decisions, especially regarding the level of quality of the test object • To comply with contractual, legal, or regulatory requirements or standards, and/or to verify the test object’s compliance with such requirements or standards
  69. 69 Build Software to Test Software exactpro.com

  70. 70 Build Software to Test Software exactpro.com Плохое тестирование Доктор

    Фаучи
  71. 71 Build Software to Test Software exactpro.com Тестировщики vs. Активисты

  72. 72 Build Software to Test Software exactpro.com Задачи тестирования •

    To prevent defects by evaluate work products such as requirements, user stories, design, and code • To verify whether all specified requirements have been fulfilled • To check whether the test object is complete and validate if it works as the users and other stakeholders expect • To build confidence in the level of quality of the test object • To find defects and failures thus reduce the level of risk of inadequate software quality • To provide sufficient information to stakeholders to allow them to make informed decisions, especially regarding the level of quality of the test object • To comply with contractual, legal, or regulatory requirements or standards, and/or to verify the test object’s compliance with such requirements or standards
  73. 73 Build Software to Test Software exactpro.com 2021 IEEE Autonomous

    Driving AI Test Challenge http://av-test-challenge.org/
  74. 74 Build Software to Test Software exactpro.com Хорошее тестирование

  75. 75 Build Software to Test Software exactpro.com Составляющие тестирования

  76. 76 Build Software to Test Software exactpro.com Тестирование это не

    Quality Assurance Testers: Get Out of the Quality Assurance Business Quality Assurance Quality Control Testing Code review Unit testing Audit Process Improvements Change management Early reviews and testing
  77. 77 Build Software to Test Software exactpro.com Хорошее тестирование

  78. 78 Build Software to Test Software exactpro.com Хорошее тестирование

  79. 79 Build Software to Test Software exactpro.com Хорошее тестирование •

    Ownership – taking care of your company. Treat others the way you would like to be treated. Take responsibility for company's needs. Remember: responsibility is power. It is not granted. It is taken. Extreme ownership is the way to lead and win. • Deep Impact – exitus acta probat. The outcome justifies the effort. Make sure that your work results in a valuable contribution. If you want to go fast, go alone. If you want to go far, go together. Involve others to achieve scalability and increase the impact of our work. • Hard Work – no pain, no gain. Sometimes putting in long hours does not help achieve any result. We do not measure time spent in the office. Having said that, we've never observed extraordinary results without hard work and deliberate effort.
  80. 80 Build Software to Test Software exactpro.com • Learning –

    software testing is relentless learning. Change is the end result of all true learning. The beautiful thing about learning is that nobody can take it away from you. The Mistakes and problems are inevitable. However, it is unacceptable not to learn from them. The best way to learn something is to teach it. • Agility – the only constant is change. We embrace the values reflected in the Manifesto for Agile Software Development. Agility allows us to turn learning into action and action into change. From its inception, Exactpro has been able to adapt to change. It is important to keep this ability as we scale up our business. • Communication – the medium is the message. A relationship is based on communication. We need to make sure others understand us and we understand them. • Objectivity – you have nothing to fear from knowing the truth. It is at the core of our business. Our main service is to build software to test software and provide objective information about it to our clients. Our business benefits from openness. Everyone in our company has the right to understand what makes sense, and no one has the right to hold a critical opinion without speaking up. Хорошее тестирование
  81. 81 Build Software to Test Software exactpro.com Спасибо! Exactpro Systems

    Exactpro Vlog