EXTENT-2016: Realisation of a Collaborative Approach to Test Automation

EXTENT-2016: Software Testing & Trading Technology Trends
22 June, 2016, 10 Paternoster Square, London

Realisation of a Collaborative Approach to Test Automation
A case study in post-trade settlement and reconciliation at Clearstream
Duncan Brigginshaw, Co-Founder and Technical Director, Odin Technology Ltd

Would like to know more?
Visit our website: extentconf.com
Follow us:
https://www.linkedin.com/company/exactpro-systems-llc?trk=biz-companies-cym
https://twitter.com/exactpro
#extent2016
#exactpro

Transcript

1. Duncan Brigginshaw Co-Founder and Technical Director Odin Technology Ltd Realisation of a Collaborative Approach to Test Automation
2. Realisation of a Collaborative Approach to Test Automation www.odintech.com A case study in post-trade settlement and reconciliation at Clearstream Duncan Brigginshaw Co-Founder and Technical Director, Odin
3. www.odintech.com Agenda • Introduction • Background and Business drivers • Defining a collaborative approach to functional test automation • ClearstreamXact Portal and 1CSR Project • Lessons and Conclusions Duncan Brigginshaw Technical Director - Odin
4. www.odintech.com Introduction • Deutsche Börse AG • Diversified exchange organisation with wide range of products and services – Listing and Trading, Clearing, Post-Trading, Market- Data and Services • International Central Securities depository (ICSD) - Luxembourg • Post-Trade Infrastructure and Securities service provider • Central Securities Depository (CSD) – Frankfurt • QA Software Vendor • Providers of the Axe Enterprise Test Automation Platform
5. www.odintech.com Background and Business drivers Duncan Brigginshaw Technical Director - Odin • Functional GUI Automation key to achieving business goals • History: • Isolated GUI Automation in Business Units – Primarily HP Products – Technical in Nature • Centralised Automation framework developed in-house – Expensive to build and maintain – In-Flexible – Proprietary to HP – Not-Business Oriented • GUI Automation rates not inline with Business goals
6. A collaborative test automation approach www.odintech.com
7. www.odintech.com Stages Duncan Brigginshaw Technical Director - Odin • High Level Vision – Define a Collaborative Automation Methodology • “Involve Functional Analysts/Testers in Automation” • Requirements – Script-less business focussed automation architecture – Execution Tool Independent (HP + Selenium) – Future Proof – Compatible with current HP ALM Infrastructure • Process – Initial Research and RFP – Matrix Scoring on Requirements – Shortlisted Vendor Proof of Concept – Vendor Selection – Rollout Methodology Defined with Vendor Support – Initial project identified to prove and refine the approach
8. www.odintech.com Teams and Geography Business Units Technical Test and Tools Tool Vendors Functional Testers (Offshore) Application Development (Offshore) Functional Testers (Nearshore)
9. www.odintech.com • Functional Acceptance Criteria (FAC) • Test Cases • Test Design • Technical Tool Support • Supporting Tool Infrastructure Skill sets and Asset Focus
10. www.odintech.com Clear Matrix of Roles and Responsibilities
11. www.odintech.com HP ALM Central to Test Asset Mgmt. HP ALM Business Units Technical Test and Tools Functional Testers (Offshore) Functional Testers (Nearshore)
12. Business Units www.odintech.com Asset Creation • Functional Acceptance Criteria (FAC) + Test Case / Condition Design Excel Template • Import Creates linked Requirements and Tests in HP ALM automatically HP ALM Import
13. Technical Test and Tools www.odintech.com Asset Creation Technical Test Assets Creation Axe Automation Platform • Project Setup • Supporting Custom Code • Added to ALM Test Resources HP ALM HP UFT
14. www.odintech.com Asset Creation Functional Test Design / Definition Functional Testers (Offshore) Functional Testers (Nearshore) Axe Automation Platform • Test Design Steps and Automation Code generated automatically HP ALM
15. www.odintech.com Test Execution • Automated Tests Scheduled and Executed HP ALM • Results and Acceptance Criteria Coverage Captured HP UFT
16. The Initial Project: ClearstreamXact Web Portal www.odintech.com
17. www.odintech.com ClearstreamXact WebPortal Duncan Brigginshaw Technical Director - Odin • ClearstreamXact – Framework for access to Clearstream ICSD and CSD Services – Settlement, Cash Management, Asset Servicing, Collateral Management, Securities Lending, Fund Services • Xact Automated access • Xact Web Portal (GUI) • Clearstream Settlement and Reporting – TARGET2 and Global Securities – Instructions, Positions, Cash and Securities
18. www.odintech.com Project Snapshot Total 75% Manual Automation Functional Acceptance Criteria Automated Not Automated 64.4% of Target (45% of Total) U Completed 35% Not Completed Forecast Target
19. www.odintech.com Project Timeline & Progress Completed Not Automated Automated 64.4% Month 1 Month 2 Month 3 Month 4 Month 5
20. www.odintech.com Duncan Brigginshaw Technical Director - Odin • Application Build and Delivery – Daily Updates – Weekly Delivery • Testing – Subset of Tests Run Daily – Full Regression Pack of Tests run Weekly – 12hr Execution Across 12 Machines Application Build and Test Regime
21. www.odintech.com Lessons and Conclusions Duncan Brigginshaw Technical Director - Odin • Lessons Learned - Refinements: – Requirement for automated test failure triage process – Defect management for automation (separate to development) – Asset naming conventions needed early in the project – New functionality found more challenging for automation than regression • Collaboration was key in automation success • Important to define clear roles and responsibilities • Leveraging relevant skills and expertise in the appropriate Mix • Collaborative methodology and selected tooling is proving successful over manual testing and previous automation
22. Thank-you! odintech.com info@odintech.com