Upgrade to Pro — share decks privately, control downloads, hide ads and more …

EXTENT-2016: Realisation of a Collaborative Approach to Test Automation

EXTENT-2016: Realisation of a Collaborative Approach to Test Automation

EXTENT-2016: Software Testing & Trading Technology Trends
22 June, 2016, 10 Paternoster Square, London

Realisation of a Collaborative Approach to Test Automation
A case study in post-trade settlement and reconciliation at Clearstream
Duncan Brigginshaw, Co-Founder and Technical Director, Odin Technology Ltd

Would like to know more?
Visit our website: extentconf.com
Follow us:
https://www.linkedin.com/company/exactpro-systems-llc?trk=biz-companies-cym
https://twitter.com/exactpro
#extent2016
#exactpro

Exactpro

June 27, 2016
Tweet

More Decks by Exactpro

Other Decks in Technology

Transcript

  1. Realisation of a Collaborative Approach to Test Automation www.odintech.com A

    case study in post-trade settlement and reconciliation at Clearstream Duncan Brigginshaw Co-Founder and Technical Director, Odin
  2. www.odintech.com Agenda • Introduction • Background and Business drivers •

    Defining a collaborative approach to functional test automation • ClearstreamXact Portal and 1CSR Project • Lessons and Conclusions Duncan Brigginshaw Technical Director - Odin
  3. www.odintech.com Introduction • Deutsche Börse AG • Diversified exchange organisation

    with wide range of products and services – Listing and Trading, Clearing, Post-Trading, Market- Data and Services • International Central Securities depository (ICSD) - Luxembourg • Post-Trade Infrastructure and Securities service provider • Central Securities Depository (CSD) – Frankfurt • QA Software Vendor • Providers of the Axe Enterprise Test Automation Platform
  4. www.odintech.com Background and Business drivers Duncan Brigginshaw Technical Director -

    Odin • Functional GUI Automation key to achieving business goals • History: • Isolated GUI Automation in Business Units – Primarily HP Products – Technical in Nature • Centralised Automation framework developed in-house – Expensive to build and maintain – In-Flexible – Proprietary to HP – Not-Business Oriented • GUI Automation rates not inline with Business goals
  5. www.odintech.com Stages Duncan Brigginshaw Technical Director - Odin • High

    Level Vision – Define a Collaborative Automation Methodology • “Involve Functional Analysts/Testers in Automation” • Requirements – Script-less business focussed automation architecture – Execution Tool Independent (HP + Selenium) – Future Proof – Compatible with current HP ALM Infrastructure • Process – Initial Research and RFP – Matrix Scoring on Requirements – Shortlisted Vendor Proof of Concept – Vendor Selection – Rollout Methodology Defined with Vendor Support – Initial project identified to prove and refine the approach
  6. www.odintech.com Teams and Geography Business Units Technical Test and Tools

    Tool Vendors Functional Testers (Offshore) Application Development (Offshore) Functional Testers (Nearshore)
  7. www.odintech.com • Functional Acceptance Criteria (FAC) • Test Cases •

    Test Design • Technical Tool Support • Supporting Tool Infrastructure Skill sets and Asset Focus
  8. www.odintech.com HP ALM Central to Test Asset Mgmt. HP ALM

    Business Units Technical Test and Tools Functional Testers (Offshore) Functional Testers (Nearshore)
  9. Business Units www.odintech.com Asset Creation • Functional Acceptance Criteria (FAC)

    + Test Case / Condition Design Excel Template • Import Creates linked Requirements and Tests in HP ALM automatically HP ALM Import
  10. Technical Test and Tools www.odintech.com Asset Creation Technical Test Assets

    Creation Axe Automation Platform • Project Setup • Supporting Custom Code • Added to ALM Test Resources HP ALM HP UFT
  11. www.odintech.com Asset Creation Functional Test Design / Definition Functional Testers

    (Offshore) Functional Testers (Nearshore) Axe Automation Platform • Test Design Steps and Automation Code generated automatically HP ALM
  12. www.odintech.com Test Execution • Automated Tests Scheduled and Executed HP

    ALM • Results and Acceptance Criteria Coverage Captured HP UFT
  13. www.odintech.com ClearstreamXact WebPortal Duncan Brigginshaw Technical Director - Odin •

    ClearstreamXact – Framework for access to Clearstream ICSD and CSD Services – Settlement, Cash Management, Asset Servicing, Collateral Management, Securities Lending, Fund Services • Xact Automated access • Xact Web Portal (GUI) • Clearstream Settlement and Reporting – TARGET2 and Global Securities – Instructions, Positions, Cash and Securities
  14. www.odintech.com Project Snapshot Total 75% Manual Automation Functional Acceptance Criteria

    Automated Not Automated 64.4% of Target (45% of Total) U Completed 35% Not Completed Forecast Target
  15. www.odintech.com Duncan Brigginshaw Technical Director - Odin • Application Build

    and Delivery – Daily Updates – Weekly Delivery • Testing – Subset of Tests Run Daily – Full Regression Pack of Tests run Weekly – 12hr Execution Across 12 Machines Application Build and Test Regime
  16. www.odintech.com Lessons and Conclusions Duncan Brigginshaw Technical Director - Odin

    • Lessons Learned - Refinements: – Requirement for automated test failure triage process – Defect management for automation (separate to development) – Asset naming conventions needed early in the project – New functionality found more challenging for automation than regression • Collaboration was key in automation success • Important to define clear roles and responsibilities • Leveraging relevant skills and expertise in the appropriate Mix • Collaborative methodology and selected tooling is proving successful over manual testing and previous automation