Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Flaky test - not on my watch
Search
Andrejs Kalnačs
October 10, 2019
Programming
0
110
Flaky test - not on my watch
Presentation about tooling which we are using to collect meta data to be aware about flaky tests
Andrejs Kalnačs
October 10, 2019
Tweet
Share
More Decks by Andrejs Kalnačs
See All by Andrejs Kalnačs
Loading time testing of web games – set-up, execution and visualization of results @ TestingStage '18
andrejska
0
220
From numbers to graphs: visualisation as a tool for better understanding of testing @ ITEM 2018 Kiev
andrejska
0
60
Grafana usage in the Quality Assurance Process @ GrafanaCon 2018
andrejska
0
240
Loading time testing and results visualisation of web games @ Heisenbug Moscow 2017
andrejska
0
110
Loading time testing and results visualisation of web games @ SQA Days 22
andrejska
0
53
Loading time testing and results visualisation of web games @ TAPOST 2017
andrejska
0
63
Other Decks in Programming
See All in Programming
Webアプリをできるだけコードを手書きしないで作ってみる
tomokusaba
2
190
2 週間で Twitter Bot を作ってみた
contour_gara
0
790
Kotlin Multiplatform at Stable and Beyond (Android Makers 2024)
zsmb
0
540
Fragment Composition of GraphQL
quramy
13
1.5k
見た目から始める生産性向上
ikumatadokoro
10
1.5k
CDKコントリビュートの最初の壁を越えよう! -簡単issueの見つけ方-
badmintoncryer
3
260
Micro Frontends for Java Microservices - Utah JUG 2024
mraible
PRO
1
110
Sheets API使ってみた
toshi0383
2
170
Netty Chicago Java User Group 2024-04-17
sullis
0
210
大規模UIKitベースアプリへのTCAの段階的導入/gradual-adoption-of-tca-in-a-large-scale-uikit-based-app
takehilo
2
210
SwiftUIで使いやすいToastの作り方 / How to build a Toast system which is easy to use in SwiftUI
lovee
3
190
WebGLで始める コンピュータグラフィックス入門
heller77
0
330
Featured
See All Featured
Unsuck your backbone
ammeep
664
57k
Raft: Consensus for Rubyists
vanstee
133
6.3k
A Tale of Four Properties
chriscoyier
153
22k
We Have a Design System, Now What?
morganepeng
43
6.8k
Helping Users Find Their Own Way: Creating Modern Search Experiences
danielanewman
21
1.9k
Keith and Marios Guide to Fast Websites
keithpitt
408
22k
Rails Girls Zürich Keynote
gr2m
91
13k
VelocityConf: Rendering Performance Case Studies
addyosmani
321
23k
Fantastic passwords and where to find them - at NoRuKo
philnash
39
2.5k
Why You Should Never Use an ORM
jnunemaker
PRO
51
8.7k
RailsConf 2023
tenderlove
9
570
Code Reviewing Like a Champion
maltzj
515
39k
Transcript
Flaky tests - not on my watch Andrejs Kalnačs Scout
RFP TAPOST 2019
2 who am i QA Automation Lead at Scout RFP
10+ years of industry experience in QA Scout RFP, Nokia, Evolution Gaming, Accenture, Nokia Networks Sharing experience in conferences for 2 years Riga Testing Automation club meet-up co-organizer TesterFromRiga
3 Scout RFP San Francisco based late stage start-up Sourcing
and procurement softwware Top reverse auctions technology provider 250+ clients
4 Flaky tests = Non deterministic ✅ ✅ ❌ ✅
5 Tests should fail expected failure false negative
6 Scale 8 diffeerent test types 247758 tests
7 Scale
8 retry() Insanity Is Doing the Same Thing Over and
Over Again and Expecting Diffeerent Results Albert Einstein
9 Retry once!
10 Not to mention
11 Be informed
12 How to retry logic test executor listener capability slack
bindings database bindings
13 Time series database Open Source* SQL-like (InfluxQL) or jq-like
(Flux) syntax
14 Supports many data sources Open Source* Packed with features
Extendable
15 Execution dashboard
16 Test dashboard
17 More dashboards
18 Our future Merge train Advanced solutions
19 Key takeaways Retry is dangerous but it is not
evil Collect meta data Always evolve
20 Thank you TesterFromRiga Andrejs Kalnačs Queestions? andrejska