March 2014: M&S.com begins transition to agile M&S.com launches Feb 2014 Mar 2014 Good news… DevOps key to enabling success for continuous integration Agile transition commences
April 2014: Head up Performance Engineering M&S.com launches Feb 2014 Mar 2014 Apr 2014 Move to Performance Engineering Shape performance for .com Agile transition commences
End of September 2014: Performance Engineering ensures M&S.com website should be stable for Peak! M&S.com launches Feb 2014 Mar 2014 Apr 2014 May - Sep 2014 Move to Performance Engineering Prepare for Peak 2014 Agile transition commences Go for Peak 2014
End of September 2014: Performance Engineering ensures M&S.com website should be stable for Peak! M&S.com launches Feb 2014 Mar 2014 Apr 2014 May - Sep 2014 Move to Performance Engineering Prepare for Peak 2014 Agile transition commences Go for Peak 2014 but…
Transition to agile performance capability pending A full end to end view of web performance was required Need more insight into speeds our customer was experiencing?
What is the definition of B? Something bespoke? User timing & custom metrics! Steve Souders: https://speedcurve.com/blog/user-timing-and-custom-metrics/
Store Device Integration Request Process Response A B Backend System 1 Not just a .com opportunity! Backend System 1 Backend System 2 Message Process Message A B
We must test A to B through delivery DevOps tools / processes enable us to validate build on build release on release Enforce one basic DoD: never get slower!
Design Build Test Analysis Automated performance test capability Product Idea V&P Test Optimisation recommendations from PerfOps back-log (analysis & diagnostics)
Design Build Test Analysis Product Idea V&P Test Automated page speed test capability Automated performance test capability Automated performance budget test capability Optimisation recommendations from PerfOps back-log (analysis & diagnostics)
Design Build Test Analysis Product Idea V&P Test Future plans… Performance by Design including UX guidelines Automated page speed test capability Automated performance test capability Automated performance budget test capability Optimisation recommendations from PerfOps back-log (analysis & diagnostics)
Design Build Test Analysis Product Idea V&P Test Automated page speed test capability Automated performance test capability Automated performance budget test capability ? Future plans… Performance by Design including UX guidelines Optimisation recommendations from PerfOps back-log (analysis & diagnostics)
Maturing Site Speed Analytics There are a lot of studies available that highlight why speed is important to retailers in particular. Doing your own study is much more interesting!
• Correlation to single page visits and customer satisfaction • How speeds influence SEO and Marketing • Impact v benefit of personalisation and third party tags • Identifying what we cannot control Site Speed Analytics
Site Speed Analytics Product List Product List The colour of the boxes denotes the relative page load whilst the size denotes the weight of the page. M&S has decreased in size and page load, whilst competitors show no improvement A B C D D C A B
Optimisations based on metric driven decisions Business focused metrics ensure optimisation priority M&S.com is now 37% faster than it was 8 months ago Site Speed Analytics
VP Testing Back-end monitoring Optimisation Back logs Back-end diagnostics Automated VP Automated Speed Tests Automated Budget Tests More Optimisation Back log Real User Measurement The PerfOps Journey…
VP Testing Back-end monitoring Optimisation Back logs Back-end diagnostics Automated VP Automated Speed Tests Automated Budget Tests More Optimisation Back log Real User Measurement Synthetic Measurement The PerfOps Journey…
VP Testing Back-end monitoring Optimisation Back logs Back-end diagnostics Automated VP Automated Speed Tests Automated Budget Tests More Optimisation Back log Real User Measurement Synthetic Measurement Front-end diagnostics More Optimisation Back log The PerfOps Journey…
VP Testing Back-end monitoring Optimisation Back logs Back-end diagnostics Automated VP Automated Speed Tests Automated Budget Tests More Optimisation Back log Real User Measurement Synthetic Measurement Front-end diagnostics More Optimisation Back log Site Speed Dashboards The PerfOps Journey…
VP Testing Back-end monitoring Optimisation Back logs Back-end diagnostics Automated VP Automated Speed Tests Automated Budget Tests More Optimisation Back log Real User Measurement Synthetic Measurement Front-end diagnostics More Optimisation Back log Site Speed Dashboards Third party Governance The PerfOps Journey…
VP Testing Back-end monitoring Optimisation Back logs Back-end diagnostics Automated VP Automated Speed Tests Automated Budget Tests More Optimisation Back log Real User Measurement Synthetic Measurement Front-end diagnostics Third party Governance More Optimisation Back log Site Speed Dashboards Site Speed Consultancy The PerfOps Journey…
VP Testing Back-end monitoring Optimisation Back logs Back-end diagnostics Automated VP Automated Speed Tests Automated Budget Tests More Optimisation Back log Real User Measurement Synthetic Measurement Front-end diagnostics Third party Governance More Optimisation Back log Site Speed Dashboards Site Speed Consultancy Speed Forums The PerfOps Journey…
VP Testing Back-end monitoring Optimisation Back logs Back-end diagnostics Automated VP Automated Speed Tests Automated Budget Tests More Optimisation Back log Real User Measurement Synthetic Measurement Front-end diagnostics Third party Governance More Optimisation Back log Site Speed Dashboards Site Speed Consultancy Performance Transactions Speed Forums The PerfOps Journey…
ldnwebperf
herumi
imsaku
mitsuakitohei
th0x0472
bkuhlmann
datarian
opeonikute
riru
nagix
nishiharatsubasa
elcuervo
kazukihayase
thoeni
trallard
erikaheidi
rmw
ufuk
csswizardry
aleyda
chriscoyier
tanoku
roundedbygravity
sferik
chrislema