Upgrade to Pro — share decks privately, control downloads, hide ads and more …

AccessibilityTesting

 AccessibilityTesting

South Bay Selenium Meetup at Intuit, Mountain View

Anil Suryanarayana

April 23, 2014
Tweet

Other Decks in Technology

Transcript

  1. Intuit Proprietary & Confidential Agenda – 45 minutes 1.  Introduction

    2.  Accessibility Testing a.  Selenium Accessibility Demo b.  Q&A 3.  A/B Testing a.  Selenium A/B Test Demo b.  Q&A 4.  Share out 20 minutes 20 minutes
  2. Intuit Proprietary & Confidential Introduction •  Small Business Marketing – QuickBooks

    – Payroll – Payments – QuickBooks Desktop – Intuit.com Homepage •  Quality Engineering Areas – Frontend – Backend – Desktop – Mobile – Performance – Online Acquisition – Analytics and SEO 3
  3. Intuit Proprietary & Confidential Accessibility Testing: Ground rules! •  In

    scope: – Rules for web accessibility compliance – Testing Intuit.com homepage – Selenium/Webdriver demo •  Out of scope: – Deep dive into Accessibility rules – Guidelines for developers – Not an accessibility 101 session 4
  4. Intuit Proprietary & Confidential What is Accessibility Making content accessible

    to a wider range of people with disabilities, including: •  Blindness or low vision •  Deafness or hearing loss •  Learning disabilities •  Cognitive limitations •  Limited movement •  Combination of these
  5. Intuit Proprietary & Confidential What is Accessibility Making content accessible

    to a wider range of people with disabilities, including: •  Blindness or low vision •  Deafness or hearing loss •  Learning disabilities •  Cognitive limitations •  Limited movement •  Combination of these What Why How
  6. Intuit Proprietary & Confidential Why make our sites accessible? Accessibility

    makes business sense •  Increased web use = increased market share •  SEO benefits from accessibility - focus on H1 tags, Title and descriptive links •  Increased usability for everyone, not just those with disabilities •  Public relations benefit – seen as socially responsible •  Reduced risks of legal action or negative image http://www.w3.org/WAI/Policy/#US What Why How
  7. Intuit Proprietary & Confidential How do we make our site

    accessible? •  The World Wide Web Consortium (W3C) has developed the Web Content Accessibility Guidelines (WCAG) 2.0 based on these principles: •  Perceivable •  Operable •  Understandable •  Robust 4 Principles from W3C 10 Rules for Accessibility 2 Test Strategies Selenium Automation What Why How
  8. Intuit Proprietary & Confidential Test Strategy Accessibility Testing Manual Testing

    Keyboard accessibility Voice over commands Skip Links Color perception, contrast ratio, flashing Selenium Automated Testing HTML tags Headers, Links, Buttons Accessible Text Assertions Forms, Tables
  9. Intuit Proprietary & Confidential Summary of Intuit’s top 10 rules

    1.  Alternative Text for Images 2.  Clear and Meaningful Link Text 3.  Accessible Forms 4.  Keyboard Accessibility 5.  H Tags and Skip Links 6.  Accessible Tables 7.  Closed Captioning for Multimedia 8.  Color Perception, Contrast Ratio, and Flashing 9.  Unique Title Tags for Pages and Frames 10.  Page Zoom
  10. Intuit Proprietary & Confidential Key Takeaways 1.  Accessibility compliance rules

    for webpage testing 2.  Selenium jar for accessibility testing - Github 3.  Ruby gem for accessibility testing – Github 15
  11. Intuit Proprietary & Confidential Agenda – 45 minutes 1.  Introduction

    2.  Accessibility Testing a.  Selenium Accessibility Demo b.  Q&A 3.  A/B Testing a.  Selenium A/B Test Demo b.  Q&A 4.  Share out 20 minutes 20 minutes
  12. Intuit Proprietary & Confidential A/B Testing: Ground Rules! •  In

    scope: – A/B Testing Intuit.com homepage – Selenium/Webdriver demo •  Out of scope: – Deep dive into A/B testing – How SiteSpect works – Details of in-house testing tool 19
  13. Intuit Proprietary & Confidential A/B testing •  A/B Testing – A

    simple way to test changes to a webpage against the current design and determine which ones produce positive results. •  A/B Testing impact on site Quality – Frequent changes to Webpages – Multiple campaigns and promos on webpages – Impact on test automation – Increased cost of maintaining a stable automation suite – Revenue Impact – Time to production 20
  14. Intuit Proprietary & Confidential What is SiteSpect 23 SiteSpect is

    a comprehensive optimization platform that enables you to conduct: • A/B and Multivariate Testing • Targeting & Personalization • Mobile Web and App • Front-End Optimization • Landing Page Optimization Intuit Case Study - SiteSpect http://www.sitespect.com/resources/case- studies/how-intuit-created-a-better- customer-experience-with-sitespect-by- improving
  15. Intuit Proprietary & Confidential Key Takeaways 1.  Overview of A/B

    testing in Intuit’s SBM team 2.  Integration with SiteSpect 3.  Automated A/B tests using Selenium 26
  16. Intuit Proprietary & Confidential Share out •  Selenium Meetup deck

    – A/B and Accessibility Testing •  Selenium Accessibility Testing – Github – https://github.com/neurites/seleniumAccessibility •  Ruby Accessibility Testing – Github – https://github.com/eveningsamurai/acop •  Intuit SiteSpect A/B Testing case study – http://www.sitespect.com/resources/case-studies/how-intuit- created-a-better-customer-experience-with-sitespect-by-improving •  How SiteSpect works – https://www.youtube.com/watch? v=5LDGfx22No4&feature=youtu.be 27
  17. Intuit Proprietary & Confidential References •  W3C - http://www.w3.org/WAI/ • 

    Web Accessibility share out - http://www.slideshare.net/joedolson/web-accessibility-a-shared-responsibility •  SiteSpect - http://www.sitespect.com/ •  Comcast - http://www.comcast.com/ •  Expedia - http://www.expedia.com/ •  Section 508 of the Rehabilitation Act of 1973 http://www.access-board.gov/sec508/508standards.htm •  Web Accessibility Standards http://www.wright.edu/web/access/standards_508.html •  WSU Web Accessibility Statement http://www.wright.edu/web/access/ •  WSU Web Accessibility Resources http://www.wright.edu/web/access/resources.html •  Web Accessibility Facts & Figures: Laws and Lawsuits http://www.wright.edu/web/access/laws.html •  Web Accessibility Facts & Figures: Statistics http://www.wright.edu/web/access/information.html 30
  18. Intuit Proprietary & Confidential Accessibility Statistics •  According to the

    new figures released by the Census Bureau on July 25, 2012, 56.7 million Americans (18.7% of the U.S. population) have some type of disability and out of this number, an estimated 38.3 million (12.6%) have a severe disability. •  Consider impairments that impact accessibility of online websites, applications, and documents. Number of people with specific impairments as follows: •  19.9 million (8.2%) have difficulty lifting or grasping. This could, for example impact their use of a mouse or keyboard. •  15.2 million (6.3%) have a cognitive, mental, or emotional impairment. •  8.1 million (3.3%) have a vision impairment. These people might rely on a screen magnifier or a screen reader, or might have a form of color blindness. •  7.6 million (3.1%) have a hearing impairment. They might rely on transcripts and / or captions for audio and video media. For more information, see the report "Americans with Disabilities: 2010," on the Census Bureau's website. http://www.census.gov/newsroom/releases/archives/facts_for_features_special_editions/cb12-ff16.html 31
  19. Intuit Proprietary & Confidential Accessibility: Testing tools 32 •  Firefox

    Accessibility Toolbar: http://bit.ly/ firefox-toolbar •  Internet Explorer Accessibility Toolbar: http://bit.ly/ie-toolbar •  WebAIM's WAVE tester: http:// wave.webaim.org •  Windows 'Ease of Access': http://bit.ly/ ease-of-access •  MacOS Accessibility: http://bit.ly/mac- access •  Firefox ColorZilla extension: http://bit.ly/ color-zilla •  Graybit.com: http://bit.ly/u12eSu •  Color contrast comparison tool: http:// bit.ly/color-compare •  Color contrast exploration tool: http:// bit.ly/color-explore •  ColorPic eyedrop tool: http://bit.ly/colorpic Screen reader tools (free) •  WebAnywhere: (web) - http://bit.ly/web- anywhere •  NVDA: (Windows) http://www.nvda- project.org/ •  VoiceOver: (Mac) – it's built in! Screen reader tools (not at all free) •  JAWS: http://bit.ly/jaws-reader •  Window-Eyes: http://bit.ly/rBlRYW •  Zoomtext: http://www.aisquared.com/ zoomtext/ Secondary Tools •  W3C HTML Validator: http:// validator.w3.org/ •  W3C CSS Validator: http://jigsaw.w3.org/ css-validator/ •  W3C Semantic Extractor: http://bit.ly/ vBKMyy •  HTML 5 Outline Generator: http://bit.ly/ w02s3J
  20. Intuit Proprietary & Confidential Accessibility: Incidence of Disability by Age

    33 Incidence of Disability by Age Reading, hearing and cognitive difficulties affect less than 5% of population under 55. Incidence increases with age: 10% of over 65s are affected, and more than 15% of over 75s are affected. Hearing and sight becomes poorer as people get older, but these same people often have large amounts of disposable income and leisure time. This presents particular challenges for web sites selling items which appeal to an older demographic, such as travel and cruises (source: census.gov & http://blog.powermapper.com/blog/post/Website- Accessibility-Disability-Statistics.aspx
  21. Intuit Proprietary & Confidential United Nations global demographic forecast -

    http://esa.un.org/unpp/ •  http://www.w3.org/WAI/presentations/ageing/waiage#demog 34
  22. Intuit Proprietary & Confidential Accessibility: Incidence of Key Disabilities 35

    compilation of disability statistics from government agencies and researchers in the US, UK and Canada. The statistics shown have most impact on website use, and help assess the impact of accessibility problems, in terms of numbers of people affected, and likely commercial impact.
  23. Intuit Proprietary & Confidential WPT(in QE Lab) Selenium Installation in

    QDC and QE Lab Jenkins Installation in Cloud9 SBM Quality Infrastructure Running Selenium Automation Send Report Back to Jenkins Running Perf Test Report Result back to CI QA/QE Jenkins Master (Performance and Functional Jenkins Slaves (Functional Automation) Jenkins Slave (Backend Automation & Unit Test) Jenkins Slaves for devint QDC Selenium Hub (Grid Agents Controller) Win7 Chrome (Grid Agents 1-2) Win7 IE9 (Grid Agents 1-2) Win7 IE8 (Grid Agents 1-2) Win7 Firefox (Grid Agents 1-2) Win8 IE 10 (Grid Agents 1-2) WPT FF Agent WPT IE8 Agent Various Env (DevInt, ATG, Showroom, Sitespect, Prod, QA, Perf, Stage) Running Functional Test -Schedule - Manual - Per Check- in WPT IE9 Agent Supplemental Selenium Hub Supplemental Selenium Grid in QE Lab for IE8 and IE9 WPT Server (wpt.intuit.co m) Dev-to- Deploy Slaves MVE & Perf Slaves SauceLab (in Progress)
  24. Intuit Proprietary & Confidential Accessibility: Section 508 What is Section

    508? •  Section 508 is the outgrowth of a portion of the Rehabilitation Act of 1973, which was amended in 1998. Specifically it created a set of specific functional and technical requirements which are applicable to electronic and information technology, such as software applications and operating systems, websites, telecommunications equipment, desktop and portable computers, video and multimedia, and self contained and stand-alone products, as well as information, documentation and support products. 38