Tracking your selenium tests

This the presentation that I did for London Selenium Meetup at Mozilla. I have shared the process of tracking our selenium tests. How did we started and where we are heading.

Transcript

1. Tracking your selenium tests Haroon Rasheed - Test Lead Automation @haroonzone
2. • Selenium Java Client Libraries • TestNG • Selenium Grid 1.0.8 • Jenkins & Anthill Pro • Web Driver / Selenium 2 • Watir-WebDriver • ReportNG • Maven
3. • Selenium Tests: 2086 • Pre-production environments • Limited production or service availability tests
4. When test fails... • When it started failing? • Does it fail consistently in an environment? • Does it fail for the same reason all the time?
5. Summary ####### % Tests passed (methods passed): 67.92% % Tests skipped: 22.64% % Tests failed: 9.43% ####### Raw figures ####### Total methods passed: 108.0 Total number tests skipped: 36.0 Total number tests failed: 15.0 Total time: 102838 seconds.
7. Shared Network Drive\\fileserver\ iexplore7-on- windows\ci\20091205\index.html
8. TestNG Listeners <listeners> <listener class-name="org.uncommons.reportng.HTMLReporter"/> <listener class-name="com.ft.testng.db.LogResultsToDatabaseTestListener"/> </listeners>
10. Cuanto & TestNG Listener (http://www.trackyourtests.com) <listeners> <listener class-name="com.ft.testng.db.CuantoListener"/> </listeners>
16. Splunk, Annotations and Test Listeners (JUnit, TestNG, Concordion, Spock) @UserStory("US1234") @Tags({"cms", "ft.com"}) @TestApproach(testDefined = Stage.BEFORE_DEVELOPMENT, testImplemented = Stage. AFTER_DEVELOPMENT, engagement = Involved.WHOLE_TEAM) @Customers("Joe Bloggs") @Testers({"John", "Rita"}) @Developers({"Alex", "Chris"}) @StoryScope(type = StoryType.NEW_FUNCTIONALITY, scope = Scope.PAYING_CUSTOMER)
17. Test Result as JSON to Splunk Logger
18. Q & A http://pragmaticqa.co.uk/blog/ https://github.com/haroonzone/cuanto-testng-listener haroon.rasheed@ft.com