Practical Testing Tips - CocoaConf D.C., April 2015

A smorgasboard of testing tips for iOS, in both Objective-C and Swift. Links are in the slides at the end of the deck.

Transcript

1. PRACTICAL TESTING TIPS by Ellen Shapiro | Cocoaconf D.C. 2015 vokal.io | justhum.com | designatednerd.com | @designatednerd
2. Why don't developers write tests?
3. "I Don't have time to Write tests"
4. Writing Tests lets you refactor faster and with more confidence
5. Writing tests puts your time costs up front
6. Writing tests catches your mistakes as you make them
7. "I Have No idea where to start"
8. [ Demo: Super-Basic Testing ]
9. What should you test?
10. Test The Stuff That Breaks A Lot
11. "That's called software."
12. Test The Stuff That is easier for a robot than for you to test
13. Your computer is an awesome robot you can use to do your evil bidding.
14. [ Demo: Time Converter 24 ]
15. Test The Stuff That is mission-critical
16. if it breaks, will your users do this?
17. [ Demo: Core data testing ]
18. Core Data Demo Recap » When you see somthing that can cause a key piece of your app to break, test it. » When testing core data, test the NSInMemoryStoreType so you always have a clean database. » Version your databases!
19. Test The Stuff That Depends On Someone Else
20. Is it my code? or Is it their code?
21. Test it with something that looks like the real thing.
22. Mock testing
23. Verifying Did this do what it was supposed to?
24. Stubbing Fake it 'til you make it
25. Spying Faking PART of an object
26. Objective-C Mocking tools OCMock OCMockito
27. [ Demo: Making a Mockery ]
28. Objective-C Mock Demo Recap » Make a fake thing » Tell it what to do » Pass it to the thing you want to test » Make sure the tested thing reacted properly
29. Mocking in swift
30. Swift Inline Class Verification func testThingDoesStuff() { class MockThing : Thing { var methodUnderTestWasCalled = false override func methodUnderTest() { //Don't call super! methodUnderTestWasCalled = true } } let testThing = new MockThing() testThing.doSomethingThatShouldCallMethodUnderTest() XCTAssertTrue(testThing.methodUnderTestWasCalled) }
31. Swift Inline Class Stubs/Spies func testThingDoesStuff() { class StubbedThing : Thing { override func methodBeingStubbed() -> String { //Don't call super! return "A Known String!" } } let stub = new StubbedThing() let tested = new ObjectUnderTest() objectUnderTest.thing = stubbed let result = tested.doSomethingThatEventuallyCallsMethodBeingStubbed() XCTAssertTrue(result == "A Known String!") }
32. Mocking Network Responses
33. ¡¡ Flagrant plug alert !!
34. VOKMockUrlProtocol for iOS Mocktrofit for Android open-source projects of Vokal, my employers
36. HTTP/1.1 200 OK Server: nginx/1.4.6 (Ubuntu) Date: Wed, 12 Nov 2014 22:10:40 GMT Content-Type: application/json Transfer-Encoding: chunked Connection: keep-alive Vary: Accept X-Frame-Options: SAMEORIGIN Allow: GET, PUT, PATCH, DELETE, HEAD, OPTIONS { "default": true, "expiration_month": "10", "expiration_year": "2018", "last_4": "1234", "card_type": "MasterCard", "id": 2 }
37. { "default": true, "expiration_month": "10", "expiration_year": "2018", "last_4": "1234", "card_type": "MasterCard", "id": 2 }
38. #import "VOKMockURLProtocol.h" @implementation CLTAPIClient (MockData) - (void)setShouldUseMockData:(BOOL)shouldUseMockData { Class mockURLProtocol = [VOKMockUrlProtocol class]; NSMutableArray *currentProtocolClasses = [self.sessionConfiguration.protocolClasses mutableCopy]; if (shouldUseMockData) { [currentProtocolClasses insertObject:mockURLProtocol atIndex:0]; } else { [currentProtocolClasses removeObject:mockURLProtocol]; } self.sessionConfiguration.protocolClasses = currentProtocolClasses; } @end
39. Test your networking logic and your UI against known data
40. Also Test it with the real thing
41. Know what you can depend on
42. Sometimes this can cause a big fight
43. You are at the mercy of your internet connection
44. Testing against a live server can change things
45. Testing against a live server can return different data if someone else changed something
46. Know the limits of what you can test live
47. Don't lock yourself out
48. Test that you're getting expected response types, not exact data
49. Test the things that aren't already covered
50. Code Coverage tools
51. Local code coverage » gcov » lcov » XcodeCoverage* » XCoverage * - Disclosure: I am a contributor
55. Remote code coverage Designed to work with Continuous Integration servers » codecov.io » coveralls.io
56. Swift code coverage ¯\_(
    )_/¯
57. "I must cover every single line of code"
58. The most useless test I ever inherited: [Note: class prefixes have been changed to protect the guilty]
59. Don't let the perfect be the enemy of the good
60. focus on why something needs to be covered rather than whether it's covered
61. How do you write tests?
62. Test Driven Developlment
63. You have seen The TDD demo (and it has usually taken way too long)
64. The TL;DR version of the TDD demo
65. 1. Write a failing test LargerTest.m Larger.m
66. 1. Write a failing test LargerTest.m Larger.m
67. 2. Write code to make it pass LargerTest.m Larger.m
68. 2. Write code to make it pass LargerTest.m Larger.m
69. 3-∞. Refactor, but now with the guardrails of the test LargerTest.m Larger.m
70. 3-∞. Refactor, but now with the guardrails of the test LargerTest.m Larger.m
71. Repeat for every public method you write.
72. Behavior Driven Development
73. Same idea as TDD Different approach
74. Does it do what it's supposed to for the end user?
75. Given / When / Then
76. You can use libraries to enforce BDD Kiwi Specta Cedar
78. I personally prefer to use XCTest for non-UI tests
79. [ Demo: BDD in pure XCTest ]
80. BDD Demo Recap: » Use very descriptive test names. » Test the end result, not necessarily how you got there. » Use the XCTest methods you already know. » Use comments if you need the structure of given/ when/then.
81. UI Testing
82. KIF
83. Keep It Functional
84. Kif Pros » Write your UI tests in Objective C! » Uses Accessibility, so you make your app accessible in the bargain » Get to the bit you need to test » The most widely used library » Very backwards compatible
85. Kif Cons » Sloooooooooow » Some folks have had issues with lookup changing the view hierarchy » Very backwards compatible
86. [ Demo: Kif In Action ]
87. Testing your UI en muchos idiomas !"#$%&'()
88. [ Demo: Scheme Fun With Languages ]
89. UI Testing Recap » If you're swapping out your app delegate for tests, make sure you put it back for UI tests » Centralize your localized strings in a convenience class to make strings easier to test » UI and non-UI tests should be seperate targets » Add -AppleLanguages "\(en\)" arguments to the test bit of your application's scheme » Duplicate your scheme and update for every language you support
90. A Final word of warning
91. Tests do not and cannot catch everything
92. Tests catch mistakes in the rosy path and known bad states
93. Humans use your application
94. Humans are weird
95. Humans multitask
96. Humans and Robots working together to break your app make your app better
97. Official Summary Slide™ » Testing lets you refactor confidently » Testing helps you find out immediately when you broke something so it's easier to fix. » Test as much as you can, however much that is. » Find the testing ideology that works best for you. » UI Testing can give you a great opportunity to see how all the pieces of your app work together. » Have both humans and robots test your app.
98. Questions?
99. Things from me or my employer! #humblebrag » https://github.com/designatednerd/ TestingPlayground » https://github.com/designatednerd/FlickrSearcher » https://github.com/designatednerd/ DNSiOSLocalizationTestHelpers » https://github.com/vokal/VOKMockUrlProtocol » https://github.com/vokal/Mocktrofit
100. Mocking tools! » http://ocmock.org/ » https://github.com/jonreid/OCMockito UI Testing Tools! » https://github.com/kif-framework/KIF » https://github.com/Raizlabs/FRY
101. Code Coverage Tools! » https://codecov.io/ » https://coveralls.io » https://github.com/jonreid/XcodeCoverage » https://github.com/dropbox/XCoverage » http://www.xcoverageapp.com/
102. BDD Tools! » https://github.com/specta/specta » https://github.com/kiwi-bdd/Kiwi » https://github.com/pivotal/cedar Other Things I Mentioned! » http://ntoll.org/article/tdd-cargo-cult » http://qualitycoding.org/app-delegate-for-tests/
103. Photo Credits » Angry mob by Robert Course-Baker: https:// www.flickr.com/photos/29233640@N07/3645211083 » Robot by Logan Ingalls: https://www.flickr.com/ photos/plutor/847695350 » Lock ("Hodgepodged") by David Goehring https:// www.flickr.com/photos/carbonnyc/4740626368/ » All images of Kif from Futurama used without permission. Sorry, Fox.