Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Evolution of Test Automation
Search
Dmitry Buzdin
March 03, 2015
Technology
0
85
Evolution of Test Automation
Dmitry Buzdin
March 03, 2015
Tweet
Share
More Decks by Dmitry Buzdin
See All by Dmitry Buzdin
Finding your garbage
buzdin
0
75
Modern Security with OAuth 2.0 and JWT and Spring
buzdin
0
190
Continous Testing at Scale
buzdin
0
67
Java 8 Language Additions
buzdin
1
240
Java EE 7 New Backend Features
buzdin
0
260
Other Decks in Technology
See All in Technology
Automated Promptingを目指すその前に / Before we can aim for Automated Prompting
rkaga
0
110
Gradle: The Build System That Loves To Hate You
aurimas
2
150
カメラを用いた店内計測におけるオプトインの仕組みの実現 / ai-optin-camera
cyberagentdevelopers
PRO
1
120
小規模に始めるデータメッシュとデータガバナンスの実践
kimujun
3
590
ガバメントクラウド先行事業中間報告を読み解く
sugiim
1
1.4k
APIテスト自動化の勘所
yokawasa
7
4.2k
【若手エンジニア応援LT会】AWS Security Hubの活用に苦労した話
kazushi_ohata
0
170
AIを駆使したゲーム開発戦略: 新設AI組織の取り組み / sge-ai-strategy
cyberagentdevelopers
PRO
1
130
いまならこう作りたい AWSコンテナ[本格]入門ハンズオン 〜2024年版 ハンズオンの構想〜
horsewin
9
2.1k
Aurora_BlueGreenDeploymentsやってみた
tsukasa_ishimaru
1
120
Apple/Google/Amazonの決済システムの違いを踏まえた定期購読課金システムの構築 / abema-billing-system
cyberagentdevelopers
PRO
1
220
pandasはPolarsに性能面で追いつき追い越せるのか
vaaaaanquish
4
4.6k
Featured
See All Featured
Understanding Cognitive Biases in Performance Measurement
bluesmoon
26
1.4k
Helping Users Find Their Own Way: Creating Modern Search Experiences
danielanewman
29
2.2k
The Language of Interfaces
destraynor
154
24k
The Myth of the Modular Monolith - Day 2 Keynote - Rails World 2024
eileencodes
14
1.9k
Large-scale JavaScript Application Architecture
addyosmani
510
110k
Rails Girls Zürich Keynote
gr2m
93
13k
Build The Right Thing And Hit Your Dates
maggiecrowley
32
2.4k
The Power of CSS Pseudo Elements
geoffreycrofte
72
5.3k
実際に使うSQLの書き方 徹底解説 / pgcon21j-tutorial
soudai
167
49k
Designing Experiences People Love
moore
138
23k
The Cult of Friendly URLs
andyhume
78
6k
Optimising Largest Contentful Paint
csswizardry
33
2.9k
Transcript
Evolution of Test Automation Travel through ages by Dmitry Buzdin
About Myself • Software Engineer with 10 years of experience
• Close relations with test automation • Test Automation Framework in Tieto • Test Automation Framework in Ericsson
Evolution of Testing From testers and developers point of view
Dinosaur Age ~1990 - 1999
Waterfall Approach
Typical QA department
State of Testing • Most of the testing is manual
• First custom scripts for automation • Running automated tests manually… • Release cycle 6 months
Very few open source testing tools
GUI Testing • Commercial automation tools • Record and playback
mostly • Testing on Windows 95/98
Custom Scripting Languages • “Even non-programmers understand” • Works only
inside commercial tool
Something Like This http://lolcode.org/ HAI CAN HAS STDIO? PLZ OPEN
FILE "LOLCATS.TXT"? AWSUM THX VISIBLE FILE O NOES VISIBLE "ERROR!" KTHXBYE
Summary • Most of test automations projects fail • Test
automation is not working
Developers and Testing
Iron Age 1999 - 2004
1999 2002 Agile Revolution
Agile Methodologies • Small teams • Cross-functional • Short development
cycles • Release cycle ~ 3 months
Apache JMeter 2001 JUnit.org 2000
State of Testing • Some automation achieved for core test
cases • Mostly commercial tools for testing
Developers and Testing • Developers are writing their first tests
• TDD is invented! • But covers unit testing only • Developers and QA are not sharing tests
Test-Driven Development
Developers and Testing
Middle Ages 2004 - 2008
The Webolution • Everything is a Web app now •
Ajax • Browser wars
New Tools Selenium 2004 First functional open source tools, which
everyone uses FitNesse 2005
Continuous Integration 2007 Multiple integrations per day
Continuous Integration • Continuous Integration becomes popular • Tests are
are executed every night • Release cycle - one sprint
State of Testing • Moderate test automation?
Developers and Testing • Developers learned integration testing • Talking
to QA from time to time • Using mock frameworks
Age of Enlightenment 2008 - 2014
None
Agile is the only option!
GitHub 2008 2008 Open Source Everywhere! Ruby
Mobile Revolution How do you even test this? …
Continuous Delivery
DevOps Tooling
State of Testing • Tests are executed after every commit
• Release cycle - one week or less
Developers and Testing • Everyone writes automated tests • QA
and development working together
Cyberpunk Age 2015 - now
Age of the Cloud
Open Source • Mix and match interoperable tools • New
testing tool every month • Open source Testing middleware
State of Testing • End-to-end delivery pipeline automation • No
time for manual testing • Release cycle - less than one day
Testing Architecture • Testing is behind development for about 5
years • We already experienced this change in Dev • We are working on making Test change happen
Test Automation At Scale Test Management System Test Data System
Test Execution System Test Reporting System Test Environment Manager Testing Cloud Test Scheduling System Requirement Management System Defect Tracking System
Developers and Testers
Summary • Embrace the change • Pushing the limit of
test automation • Testing is more complicated than ever