Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Have you ever tested your tests?

Avatar for Rafael Machado Rafael Machado
November 09, 2019
Programming
120
2

Have you ever tested your tests?

Avatar for Rafael Machado

Rafael Machado

November 09, 2019

More Decks by Rafael Machado

See All by Rafael Machado
Evolução da arquitetura do Magalu e os desafios da modularização
Avatar for Rafael Machado rakaramos
0
81
Contratos fortes com programação funcional
Avatar for Rafael Machado rakaramos
1
30

Other Decks in Programming

See All in Programming
ソフトウェア設計に溶けるインフラ ― AWS CDK のインフラ認識論
Avatar for Kenji Kono konokenj
2
580
AI がコードを書く時代における新卒エンジニアの仕事風景 (2026) / New Graduate Engineers in the Era of AI Coding (2026)
Avatar for sushichan044 sushichan044
0
220
【やさしく解説 設計編 #1】「ドメイン駆動」と「実装駆動」ってなに？ 〜設計の考え方を、たとえ話で学ぼう〜
Avatar for HideyukiKitao panda728
PRO
1
120
分散システム、なんですぐ死んでしまうん？耐障害性を高めたいあなたのためのレジリエンスパターン入門
Avatar for Mitsuhiro Shibuya mshibuya
7
6.5k
ルールを書いて終わらせないハーネスエンジニアリング
Avatar for Yuji Yamaguchi yug1224
3
1.6k
Built Our Own Background Agent at LayerX #aidevex_findy
Avatar for LayerX layerx
PRO
3
910
【やさしく解説 設計編・中級 #1】一つの車に、運転手は一人　～ある倉庫システムの事例から～
Avatar for HideyukiKitao panda728
PRO
0
180
5分で問診！Composer セキュリティ健康診断
Avatar for コドモン開発チーム codmoninc
0
430
才能？センス？知らん、 続けたもん勝ちだ。-- 結婚・出産・癌を越えてなお、私がプロダクトを創り続ける理由
Avatar for 16bit_idol 16bitidol
2
880
任せる範囲はこう広がった / How the Scope of AI Delegation Has Expanded
Avatar for nrs nrslib
1
260
型も通る、synthも通る、それでも危ない 〜AIのCDKの権限とコストを機械で検証する〜 / It Passes Type Checks, It Passes Synth Checks, but It’s Still Risky — Automatically Verifying Permissions and Costs in AI’s CDK —
Avatar for shiro seike seike460
PRO
1
370
Claude Opus 4.6以後の受託開発エンジニアの変化(Claude Code開発ノウハウ大公開スペシャルbyクラスメソッド)
Avatar for t-iida iidatakuma
1
810

Featured

See All Featured
Sharpening the Axe: The Primacy of Toolmaking
Avatar for Bryan Cantrill bcantrill
46
2.9k
<Decoding/> the Language of Devs - We Love SEO 2024
Avatar for Nikki Halliwell nikkihalliwell
1
280
Test your architecture with Archunit
Avatar for Yoan thirion
1
2.3k
The Organizational Zoo: Understanding Human Behavior Agility Through Metaphoric Constructive Conversations (based on the works of Arthur Shelley, Ph.D)
Avatar for Dr. Kim W Petersen kimpetersen
PRO
0
390
Measuring Dark Social's Impact On Conversion and Attribution
Avatar for Stephen Akadiri stephenakadiri
2
240
Designing Dashboards & Data Visualisations in Web Apps
Avatar for Des Traynor destraynor
231
55k
30 Presentation Tips
Avatar for Ian Lurie portentint
PRO
1
350
Between Models and Reality
Avatar for mayunak mayunak
4
380
4 Signs Your Business is Dying
Avatar for Josh Pigford shpigford
187
22k
The State of eCommerce SEO: How to Win in Today's Products SERPs - #SEOweek
Avatar for Aleyda Solis aleyda
2
11k
The Hidden Cost of Media on the Web [PixelPalooza 2025]
Avatar for Tammy Everts tammyeverts
2
360
Designing Experiences People Love
Avatar for Jonathan Moore moore
143
24k

Transcript

  1. HAVE YOU EVER TESTED YOUR TESTS?

  2. Henrique Morbin iOS @ Consumer

  3. Rafael Machado iOS @ Driver

  4. AGENDA 1. SOFTWARE QUALITY & METRICS 2. CODE COVERAGE 3.

    MUTATION TESTING 4.MUTER: AUTOMATED MUTATION TESTING FOR SWIFT

  5. SOFTWARE QUALITY & METRICS

  6. CODE COVERAGE

  7. None

  8. class Tests: XCTestCase { func test_view() { let sut =

    ViewController(presenter: .dummy) XCTAssertNotNil(sut.view) } }

  9. 55% VALIDATION

  10. COVERAGE ISN’T EVERYTHING

  11. ?

  12. MUTATION TESTING

  13. HOW DOES IT WORK?

  14. None
  15. None
  16. None

  17. MUTATION SCORE = Mutants killed Total of mutants

  18. MUTATION OPERATORS

  19. None

  20. C# JAVASCRIPT JAVA PYTHON SWIFT C/C++ OBJECTIVE-C

  21. Muter Automated mutation testing for Swift

  22. DISCOVERY TESTS REPORT

  23. None

  24. $ muter init

  25. !// muter.conf.json { "executable": “/usr/bin/xcodebuild", "arguments": [ "-project", "ExampleApp.xcodeproj", "-scheme",

    "ExampleApp", "-sdk", "iphonesimulator", "-destination", "platform=iOS Simulator,name=iPhone 8", "test" ], "exclude": ["AppDelegate.swift"] }

  26. $ muter

  27. $ muter —output-xcode

  28. None

  29. $ muter —files-to-mutate "/Sources/**/*.swift"

  30. $ muter —files-to-mutate \ $(echo \"$(git diff "--name-only HEAD HEAD~1

    | tr '\n' ‘,')\")

  31. RECAP COVERAGE ISN’T EVERYTHING PAPERS HIGH COST MUTATION SCORE FEW

    OPERATORS ARE ENOUGH

  32. THANK YOU

  33. #VemProiFood