Lecture 6: Reliability and safety

"Software Testing for Complex Intelligent Systems and Autonomous Vehicles" online course.

The lecture is available via the link: https://youtu.be/PEn6KGO8G9g
--
To learn more about Exactpro, visit our website https://exactpro.com/

Follow us on
LinkedIn https://www.linkedin.com/company/exactpro-systems-llc
Twitter https://twitter.com/exactpro
Facebook https://www.facebook.com/exactpro/
Instagram https://www.instagram.com/exactpro/
Vkontakte https://vk.com/exactpro_llc

Subscribe to Exactpro YouTube channel https://www.youtube.com/c/exactprosystems

Transcript

1. 1 Build Software to Test Software exactpro.com
   Lecture 6
   Reliability and Safety
   Software Testing for
   Complex Intelligent Systems
   and Autonomous Vehicles
   Online Course
   

   View Slide

2. 2 Build Software to Test Software exactpro.com
   What is Quality?
   

   View Slide

3. 3 Build Software to Test Software exactpro.com
   How to
   Assess and
   Measure
   Quality?
   

   View Slide

4. 4 Build Software to Test Software exactpro.com
   Quality Is ...
   The quality of a system is the degree to
   which the system satisfies the stated and
   implied needs of its various stakeholders,
   and thus provides value.
   https://www.personneltoday.com/
   

   View Slide

5. 5 Build Software to Test Software exactpro.com
   Who are
   Stakeholders?
   

   View Slide

6. 6 Build Software to Test Software exactpro.com
   Stakeholders are...
   ● Direct users interact with the software itself to solve
   problems
   ● Secondary users rely on the products of the
   software
   ● Beneficiaries are all the people affected by the
   software’s products
   Project build team
   ● Managers make final decisions about timeline,
   budget, and scope
   ● Project managers' goal is creating a good product
   and making clients happy
   ● Developers know which features are feasible
   ● Partners need to ensure compatibility with their
   systems
   Authorities
   ● Legal and regulatory bodies
   ● Shareholders and company owners
   https://www.personneltoday.com/
   

   View Slide

7. 7 Build Software to Test Software exactpro.com
   Quality
   Characteristics
   (stakeholders’
   requirements)
   

   View Slide

8. 8 Build Software to Test Software exactpro.com
   Quality Characteristics
   1. Functional Suitability
   2. Reliability
   3. Performance Efficiency
   4. Usability / Operability
   5. Security
   6. Compatibility
   7. Maintainability
   8. Portability
   The eight characteristics of software quality:
   

   View Slide

9. 9 Build Software to Test Software exactpro.com
   What Tests and Checks Can be Automated
   Object Management Group, Inc.
   The Consortium for Information & Software Quality (CISQ)
   

   View Slide

10. 10 Build Software to Test Software exactpro.com
    Quality Characteristics
    Object Management Group, Inc.
    The Consortium for Information & Software Quality (CISQ)
    

    View Slide

11. 11 Build Software to Test Software exactpro.com
    Quality Characteristics
    Object Management Group, Inc.
    The Consortium for Information & Software Quality (CISQ)
    

    View Slide

12. 12 Build Software to Test Software exactpro.com
    Quality Characteristics
    Object Management Group, Inc.
    The Consortium for Information & Software Quality (CISQ)
    

    View Slide

13. 13 Build Software to Test Software exactpro.com
    Quality Characteristics
    Object Management Group, Inc.
    The Consortium for Information & Software Quality (CISQ)
    

    View Slide

14. 14 Build Software to Test Software exactpro.com
    Quality Characteristics
    Object Management Group, Inc.
    The Consortium for Information & Software Quality (CISQ)
    

    View Slide

15. 15 Build Software to Test Software exactpro.com
    Quality Characteristics
    Object Management Group, Inc.
    The Consortium for Information & Software Quality (CISQ)
    

    View Slide

16. 16 Build Software to Test Software exactpro.com
    Quality Characteristics
    Object Management Group, Inc.
    The Consortium for Information & Software Quality (CISQ)
    

    View Slide

17. 17 Build Software to Test Software exactpro.com
    Quality Characteristics
    Object Management Group, Inc.
    The Consortium for Information & Software Quality (CISQ)
    

    View Slide

18. 18 Build Software to Test Software exactpro.com
    Risks
    

    View Slide

19. 19 Build Software to Test Software exactpro.com
    Analysis and
    Planning
    1. Stakeholders
    2. Objects to be protected (information,
    things, people, processes)
    3. Purpose of protection (confidentiality,
    integrity, availability)
    4. Potential vulnerabilities
    5. Threats
    6. Evaluation of likelihood of risk and
    possible damages (risk matrix)
    7. Measures to improve security
    (physical, technical, organizational)
    

    View Slide

20. 20 Build Software to Test Software exactpro.com
    Risk Matrix
    CONSEQUENCES
    LIKELIHOOD
    Almost Certain
    Likely
    Possible
    Unlikely
    Rare
    Marginal Minor Moderate Major Severe
    MEDIUM
    MEDIUM MEDIUM
    MEDIUM MEDIUM
    MEDIUM
    MEDIUM
    MEDIUM
    MEDIUM MEDIUM
    LOW
    LOW
    LOW LOW
    HIGH HIGH
    HIGH HIGH
    HIGH
    HIGH
    HIGH
    CRITICAL CRITICAL
    CRITICAL
    CRITICAL
    

    View Slide

21. 21 Build Software to Test Software exactpro.com
    Reliability
    Requirements
    

    View Slide

22. 22 Build Software to Test Software exactpro.com
    What is Reliability
    Reliability is how the system retains all the
    necessary characteristics over an extended
    period of time.
    Reliability is a complex property, which,
    depending on the purpose of the object and
    the conditions of its use may include resilience,
    durability, maintainability and persistence or
    certain combinations of these properties.
    

    View Slide

23. 23 Build Software to Test Software exactpro.com
    Robustness
    Robustness is performing
    correctly in every situation
    Robustness is the ability
    of a computer system to
    cope with errors during
    execution and cope with
    erroneous input
    

    View Slide

24. 24 Build Software to Test Software exactpro.com
    Robust
    Programming
    Principles
    ● Paranoia (they are out to
    get us)
    ● Stupidity (the user will mess
    everything up)
    ● Impossible is assumed to
    be “highly unlikely”
    

    View Slide

25. 25 Build Software to Test Software exactpro.com
    Software
    Engineer
    Ethics
    

    View Slide

26. 26 Build Software to Test Software exactpro.com
    Ethical
    Dilemmas
    ● Safety vs Experience
    ● Medical Assistance vs Limited
    Resources
    ● Sensitive Information: to Tell or not to
    Tell?
    ● Company Interests vs Employees’
    Interests
    ● Minimizing the damage in an accident
    

    View Slide

27. 27 Build Software to Test Software exactpro.com
    Computer
    Autonomy:
    from Device
    to Master
    1. Computer offers a complete set of action
    alternatives
    2. Computer narrows the selection down to
    a few choices
    3. Computer suggests a single action
    4. Computer executes that action if human
    approves
    5. Computer allows the human limited time
    to veto before automatic execution
    6. Computer executes automatically then
    informs the human
    7. Computer decides everything and acts
    autonomously, ignoring the human
    

    View Slide

28. 28 Build Software to Test Software exactpro.com
    Thank you!
    Join our Telegram chat, meet
    your peers, ask questions
    and get new software testing
    skills with Exactpro!
    Subscribe to our YouTube
    channel to see all the new
    videos!
    

    View Slide