Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Evolution of Test Automation
Search
Dmitry Buzdin
March 03, 2015
Technology
0
85
Evolution of Test Automation
Dmitry Buzdin
March 03, 2015
Tweet
Share
More Decks by Dmitry Buzdin
See All by Dmitry Buzdin
Finding your garbage
buzdin
0
75
Modern Security with OAuth 2.0 and JWT and Spring
buzdin
0
180
Continous Testing at Scale
buzdin
0
64
Java 8 Language Additions
buzdin
1
240
Java EE 7 New Backend Features
buzdin
0
260
Other Decks in Technology
See All in Technology
サーバー管理しないサーバーサービスManaged DevOps Pool
kkamegawa
0
130
たった1人からはじめる【Agile Community of Practice】~ソース原理とFearless Changeを添えて~
ktc_corporate_it
1
480
Privacy Sandbox on Android / DroidKaigi 2024
7pairs
1
270
Road to Single Activity
yurihondo
2
240
『GRANBLUE FANTASY Relink』キャラクターの魅力を支えるリグ・シミュレーション制作事例
cygames
0
120
watsonx.ai Dojo 環境準備について
oniak3ibm
PRO
0
300
Swift Testingのconfirmationを コードリーディング/Dive into Swift Testing confirmation
laprasdrum
2
260
OCI で始める!! Red Hat OpenShift / Get Started OpenShift on OCI
oracle4engineer
PRO
1
180
とあるOSSを継続可能にするための取り組みについて / OSS Refactoring Process
bun913
1
210
「家族アルバム みてね」における運用管理・ オブザーバビリティの全貌 / Overview of Operation Management and Observability in FamilyAlbum
isaoshimizu
4
160
チームビルディングは"感性"で向き合おう / Team Building with Awareness
kohzas
0
260
PdMはどのように全てのスピードを上げられるか ~ 非連続進化のための具体的な取り組み ~
sansantech
PRO
4
1.3k
Featured
See All Featured
[Rails World 2023 - Day 1 Closing Keynote] - The Magic of Rails
eileencodes
28
1.6k
The Language of Interfaces
destraynor
153
23k
Speed Design
sergeychernyshev
22
430
Building a Scalable Design System with Sketch
lauravandoore
459
32k
Optimizing for Happiness
mojombo
375
69k
What’s in a name? Adding method to the madness
productmarketing
PRO
21
3k
Being A Developer After 40
akosma
84
590k
Building Adaptive Systems
keathley
36
2.1k
Producing Creativity
orderedlist
PRO
340
39k
Fontdeck: Realign not Redesign
paulrobertlloyd
80
5.1k
The Mythical Team-Month
searls
218
43k
Unsuck your backbone
ammeep
667
57k
Transcript
Evolution of Test Automation Travel through ages by Dmitry Buzdin
About Myself • Software Engineer with 10 years of experience
• Close relations with test automation • Test Automation Framework in Tieto • Test Automation Framework in Ericsson
Evolution of Testing From testers and developers point of view
Dinosaur Age ~1990 - 1999
Waterfall Approach
Typical QA department
State of Testing • Most of the testing is manual
• First custom scripts for automation • Running automated tests manually… • Release cycle 6 months
Very few open source testing tools
GUI Testing • Commercial automation tools • Record and playback
mostly • Testing on Windows 95/98
Custom Scripting Languages • “Even non-programmers understand” • Works only
inside commercial tool
Something Like This http://lolcode.org/ HAI CAN HAS STDIO? PLZ OPEN
FILE "LOLCATS.TXT"? AWSUM THX VISIBLE FILE O NOES VISIBLE "ERROR!" KTHXBYE
Summary • Most of test automations projects fail • Test
automation is not working
Developers and Testing
Iron Age 1999 - 2004
1999 2002 Agile Revolution
Agile Methodologies • Small teams • Cross-functional • Short development
cycles • Release cycle ~ 3 months
Apache JMeter 2001 JUnit.org 2000
State of Testing • Some automation achieved for core test
cases • Mostly commercial tools for testing
Developers and Testing • Developers are writing their first tests
• TDD is invented! • But covers unit testing only • Developers and QA are not sharing tests
Test-Driven Development
Developers and Testing
Middle Ages 2004 - 2008
The Webolution • Everything is a Web app now •
Ajax • Browser wars
New Tools Selenium 2004 First functional open source tools, which
everyone uses FitNesse 2005
Continuous Integration 2007 Multiple integrations per day
Continuous Integration • Continuous Integration becomes popular • Tests are
are executed every night • Release cycle - one sprint
State of Testing • Moderate test automation?
Developers and Testing • Developers learned integration testing • Talking
to QA from time to time • Using mock frameworks
Age of Enlightenment 2008 - 2014
None
Agile is the only option!
GitHub 2008 2008 Open Source Everywhere! Ruby
Mobile Revolution How do you even test this? …
Continuous Delivery
DevOps Tooling
State of Testing • Tests are executed after every commit
• Release cycle - one week or less
Developers and Testing • Everyone writes automated tests • QA
and development working together
Cyberpunk Age 2015 - now
Age of the Cloud
Open Source • Mix and match interoperable tools • New
testing tool every month • Open source Testing middleware
State of Testing • End-to-end delivery pipeline automation • No
time for manual testing • Release cycle - less than one day
Testing Architecture • Testing is behind development for about 5
years • We already experienced this change in Dev • We are working on making Test change happen
Test Automation At Scale Test Management System Test Data System
Test Execution System Test Reporting System Test Environment Manager Testing Cloud Test Scheduling System Requirement Management System Defect Tracking System
Developers and Testers
Summary • Embrace the change • Pushing the limit of
test automation • Testing is more complicated than ever